Come join us on-site on Tue, Oct 21st, 2:30~4:00 PM CEST at Peer Gynt-salen if you’re attending CSCW in Bergen! programs.sigchi.org/cscw/2025/pr...

We will discuss how challenges, potential, and concerns for applying LLMs in research processes where *conversations* stand at the core of study design (e.g., interview, workshop, small group research)

Featuring all-⭐️ panelists✨ @mbernst.bsky.social, Shyam, Renwen, @manoelhortaribeiro.bsky.social, Yingdan, @serinachang5.bsky.social @manoelhortaribeiro.bsky.social @sherrytswu.bsky.social Aimei, @joon-s-pk.bsky.social Dmitri @ognyanova.bsky.social @ziangxiao.bsky.social Ayman @aaronshaw.bsky.social

3️⃣ How can researchers approach addressing homogeneity, biases, and ethical concerns of LLM simulation output?

2️⃣ Whether/how can researchers scale insights of LLM simulations of individuals' responses to study group and even network patterns?

1️⃣ When/how can researchers integrate the use of LLM simulation and synthetic data into existing human subjects research pipelines? How do we perform evaluation accordingly?

This panel will discuss the opportunities and perils regarding the use of LLM, simulation, and synthetic data for human subjects research. We will break the discussion down into three themes/challenges:

Would love to stop by if time permits!

Thanks for sharing our work, Freddy!!

Additionally, @dohyojin.bsky.social, Jessica He,
@feldmanmolly.bsky.social, Seyun Kim, and I are organizing a workshop at #CHIWORK on "Navigating Generative AI Disclosure, Ownership, and Accountability." Check out more info here (chiwork-aidisclosure.github.io), and we would love to see you there!!

To further develop this workstream, I will present our latest findings and seek feedback at
#AOM, @ic2s2.bsky.social, and @datasociety.bsky.social 's upcoming workshop on "What is work worth?" See extended abstract here: angelhwang.github.io/doc/ic2s2_AI...

Yao-Yuan Yang and I verified this concern by tracking the performance of 9,149 freelancers across two platforms (Upwork and Bēhance): Creators who declare the use of AI receive significantly lower pay, but non-creatives jobs earn more by labeling themselves as "AI Pros."

This ongoing work is inspired by my favorite project with @qveraliao.bsky.social, Su Lin Blodgett, @aolteanu.bsky.social, and Adam Trischler. Writers felt they could preserve their authentic voice but worried audiences would not value AI-assisted work as much as solo work. arxiv.org/abs/2411.13032