Aaron Shaw
banner
aaronshaw.bsky.social
Aaron Shaw
@aaronshaw.bsky.social

Usually professoring, parenting, running, etc. Social science and design of digital public goods in online communities. Northwestern University, Chicagoland. https://communitydata.science

Communication & Media Studies 36%
Computer science 33%

Virtual event starting soon! My lab @communitydata.science is hosting a discussion about new research on organizing software communities. Sign up & join us! wiki.communitydata.science/The_Impacts_...
The Impacts of Organizational Interventions in Open Source Software Engineering - CommunityData
wiki.communitydata.science

Hey how's it going here? been a minute.
LLMs are now widely used in social science as stand-ins for humans—assuming they can produce realistic, human-like text

But... can they? We don’t actually know.

In our new study, we develop a Computational Turing Test.

And our findings are striking:
LLMs may be far less human-like than we think.🧵
Computational Turing Test Reveals Systematic Differences Between Human and AI Language
Large language models (LLMs) are increasingly used in the social sciences to simulate human behavior, based on the assumption that they can generate realistic, human-like text. Yet this assumption rem...
arxiv.org

kudos to @zarine.net whose research and expertise really drove this. thanks also to @gowder.io for inspiring conversation in the event that precipitated the writeup.

#2 distinct categories of threats require different response strategies, which must also be localized depending on context, resources, etc.

#1 public information goods created in online communities face distinct threats over different phases of their lifecycle (e.g., a new community software project that hasn't built much yet is vulnerable in different ways than a more mature project)...

(at least) two valuable ideas here...

Defending public information goods and online communities under attack. zenodo.org/records/1560... A @communitydata.science strategy brief led by @zarine.net (with @mako.cc and me riding shotgun)
Online Community Resilience: Governing Public Information Goods Under Attack
Online communities steward a complex set of public information goods. These goods face a range of urgent threats: strategic information pollution and governance capture; legitimacy attacks by external...
zenodo.org
a new short research brief with @mako.cc and @aaronshaw.bsky.social synthesizes some of the work I presented at @communitydata.science Science of Community Dialogues back in April! zenodo.org/records/1560...
Online Community Resilience: Governing Public Information Goods Under Attack
Online communities steward a complex set of public information goods. These goods face a range of urgent threats: strategic information pollution and governance capture; legitimacy attacks by external...
zenodo.org
Important message from @ethanvporter.bsky.social @aaronshaw.bsky.social @emmaspiro.bsky.social

“NSF has accepted a dangerous myth that misinformation research (and research more generally) is really just partisan activism […] Nothing could be further from the truth”

www.science.org/doi/10.1126/...
Misinformation research continues to be urgent science
By one account, roughly 70% of Americans regard misinformation as a major threat, outpacing fears about climate change and infectious disease (1). This is true although the current and longer-term imp...
www.science.org

Some of this stuff is obvious, of course, but we think it's important to say certain obvious things out loud, in print, etc. when the attacks are overt, misinformed and/or made in bad faith.

A policy brief on what generative AI simulations of people might be good for! (based on work with the amazing team of @joon-s-pk.bsky.social @cqzou.bsky.social @mako.cc @robbwiller.bsky.social @mbernst.bsky.social Merrie Morris, Carrie Cai, and Percy Liang)
AI agents that can simulate human behaviors and attitudes can help test ideas in social science. Our latest brief introduces a generative AI agent architecture that simulates the attitudes of 1,000+ real people. Read more: hai.stanford.edu/policy/simul...
AI agents that can simulate human behaviors and attitudes can help test ideas in social science. Our latest brief introduces a generative AI agent architecture that simulates the attitudes of 1,000+ real people. Read more: hai.stanford.edu/policy/simul...

🧵🧵🧵 effective commons governance doesn't mean you get the equilibrium you want...
1. This is Piles Copse, the largest remaining fragment of high-ground temperate rainforest on Dartmoor. It’s a tiny speck of green in a dismal, human-made desert. Prepare yourselves for a story of breathtaking perversity, told in this thread. (There’s a one-page version at the bottom). 🧵

Reposted by Aaron Shaw

1. This is Piles Copse, the largest remaining fragment of high-ground temperate rainforest on Dartmoor. It’s a tiny speck of green in a dismal, human-made desert. Prepare yourselves for a story of breathtaking perversity, told in this thread. (There’s a one-page version at the bottom). 🧵

That part of the timeline where I'm watching the White Sox game and realize maybe I'm in solidarity with the pope 🧦

anyhow, just awesome. thank you @rahaeli.bsky.social

And also also, author says they'd like to write a dissertation. Hermeneutical skills ✅➕

Also, while I'm waiting, has anyone got a word count on this monster?

Find me a better Bluesky thread. Go ahead, I'll wait.
Pope Leo's first sermon and, uh, his using the phrase "be ever more fully a city set upon a hill" and cf'ing it to Rev 21:10 instead of any of the others before saying "many baptized Christians" are "living in a state of practical atheism" is. Well. Shots fired!

www.npr.org/2025/05/09/g...
Read Pope Leo XIV's first homily as pope
During his homily, delivered in Italian, Leo XIV said that Christians must serve a world that is often hostile to their beliefs.
www.npr.org

University leaders are looking for capital. They have political capital. As with their endowments, they are inclined to sit on it. The thing about political capital though, is that if you spend it wisely it grows.
New AP poll on Trump/higher education:

Maintain fed'l funding for scientific/medical research?
62% approve

Remove colleges' tax-exempt status?
30% approve

Withhold fed'l funds unless they comply w/ Trump's demands?
27% approve

Overall on Trump/colleges?
56%👎, 42%👍

apnorc.org/projects/few...

Reposted by Aaron Shaw

New interview up at the Protocol Oral History Project—Camille Acey on organizational closures: protocol.ecologies.info/interviews/a...
Camille Acey: Organizational closures
Organizations too often fail to prepare for their inevitable end; The Wind Down shares best practices for healthy closures.
protocol.ecologies.info

Reposted by Aaron Shaw

Pope Leo's first sermon and, uh, his using the phrase "be ever more fully a city set upon a hill" and cf'ing it to Rev 21:10 instead of any of the others before saying "many baptized Christians" are "living in a state of practical atheism" is. Well. Shots fired!

www.npr.org/2025/05/09/g...
Read Pope Leo XIV's first homily as pope
During his homily, delivered in Italian, Leo XIV said that Christians must serve a world that is often hostile to their beliefs.
www.npr.org

Reposted by Aaron Shaw

New AP poll on Trump/higher education:

Maintain fed'l funding for scientific/medical research?
62% approve

Remove colleges' tax-exempt status?
30% approve

Withhold fed'l funds unless they comply w/ Trump's demands?
27% approve

Overall on Trump/colleges?
56%👎, 42%👍

apnorc.org/projects/few...

(what have we been waiting for? idk, but grateful that were here)

Northwestern faculty Senate has passed a version of the Rutgers mutual defense compact tonight, making it (I think) a dozen faculty governance bodies around the country to do so. Go cats!

AI-generated from a model prompted with someone's truth social feed?
🚨🚨 Deranged letter from Education Secretary Linda McMahon to Harvard’s president, cutting off federal funding for any new grants.

Worth reading in full. It is NUTS.
🚨🚨 Deranged letter from Education Secretary Linda McMahon to Harvard’s president, cutting off federal funding for any new grants.

Worth reading in full. It is NUTS.

👀👀👀
Incredible reporting from USC student journalists about how a ginned-up financial crisis is being used to crush faculty and staff power.
ANALYSIS: USC deliberately escalated ‘structural deficit’
A doubling debt and egregious management growth place blame on the university.
www.uscannenbergmedia.com