Alexander Wuttke
kunkakom.bsky.social
Alexander Wuttke
@kunkakom.bsky.social

Digitalization & Pol Behavior LMU_Muenchen | Democracy and Populist Attitudes | Open Science | 🚵‍♂️🐶

Political science 63%
Communication & Media Studies 7%

The sale pitch for this AI Scientist "Kosmos" as presented in this Podcast just seems like a big HARKing exercise. Yes, just look at the data long enough and you'll find "something".

Has anybody made any experiences with AI scientists models? Recommendations?
pca.st/episode/58aa...
Where Is All the A.I.-Driven Scientific Progress?
pca.st
Survey experiments have become a popular methodology among social scientists. Has it been effective?

In POQ, Rauf et al. study the efficacy of 100 survey experiments. Their results show that a majority of hypotheses were not supported.

Read now: doi.org/10.1093/poq/...

Congratulations!

Reposted by Alexander Wuttke

I’m vocally skeptical of silicon samples, yet vocally impressed by SurveyBot3000.

The difference: this does not rely on magic beans or assumed omniscience, it is trained and validated against a large corpus of highly relevant data and makes specific predictions with known accuracy and precision.
Finally, @bjoernhommel.bsky.social's and my paper introducing the SurveyBot3000 is officially out in AMPPS. It's a fine-tuned language model that guesstimates correlations between survey items from text alone. Not perfectly, but useful for search, for example.
journals.sagepub.com/doi/10.1177/...

Reposted by Alexander Wuttke

We took pains to avoid overfitting. In addition to the standard training/test/holdout divide, we also ran a registered report follow up and locked down the predictions before we collected data. Accuracy was indeed a tad attenuated r=.71 -> .59.
Finally, @bjoernhommel.bsky.social's and my paper introducing the SurveyBot3000 is officially out in AMPPS. It's a fine-tuned language model that guesstimates correlations between survey items from text alone. Not perfectly, but useful for search, for example.
journals.sagepub.com/doi/10.1177/...

Same.
And users start to recognize when others change their profile pictures...

Is it just me or has bluesky started to feel like good old academic twitter recently?

Australia bans social media for the youth.
Any plans that
@jonathanhaidt.bsky.social and his critics get together for an adversarial collaboration to pre-register success/failure criteria on a specific diff-in-diff design to exploit this natural experiment?
pca.st/episode/0155...
Australia Kicks Kids Off Social Media + Is the A.I. Water Issue Fake? + Hard Fork Wrapped
pca.st

Reposted by Alexander Wuttke

i guess the expertise of the authors is limited to experience of being criticised
Critique argues post-publication peer review "often focuses on minor details" and "risks damaging trust in both the research itself and the peer review process" found to contain:

- Hallucinated references
- Undisclosed COIs (EiC is author)
- 8/9 authors have retractions or related scandals
An expert criticism on post-publication peer review platforms: the case of pubpeer - DARU Journal of Pharmaceutical Sciences
While traditional peer review offers advantages in academic publishing, it is often hampered by significant weaknesses, leading to frustration among many authors. Scientific discoveries after publicat...
link.springer.com
Critique argues post-publication peer review "often focuses on minor details" and "risks damaging trust in both the research itself and the peer review process" found to contain:

- Hallucinated references
- Undisclosed COIs (EiC is author)
- 8/9 authors have retractions or related scandals
An expert criticism on post-publication peer review platforms: the case of pubpeer - DARU Journal of Pharmaceutical Sciences
While traditional peer review offers advantages in academic publishing, it is often hampered by significant weaknesses, leading to frustration among many authors. Scientific discoveries after publicat...
link.springer.com
I was also bored and pulled up the replication package.

The results are quite sensitive in aggregate to needing the controls. Here's the replication of Figure 3, including the case w/o controls:
Thanks to @johnholbein1.bsky.social I learned about this paper on rent control in Berlin.

Because I was marking, I immediately downloaded the replication materials.

bsky.app/profile/john...
Um, ok...

This paper forthcoming at the JOP provides evidence that rent control in Germany actually made tenants MASSIVELY *less* NIMBY.

This result was in the opposite direction of the authors' pre-registered expectations.

And the effect sizes are, truly, massive.
🚀 We’re hiring a Postdoc!

Our group is looking for a Postdoc to join the team working on computational comm research. If you’re excited about automated content analysis, large text & social-media data, open science, this might be for you.

💡 Sounds like you or someone you know? Please share/boost!
We're thrilled to open registration for our 1st 2026 Replication Games. The event will be at the University of Zurich on January 19th.

Psych, public health, pol sci and econ studies will be reproduced! Register here: www.surveymonkey.ca/r/Replicatio...

Reposted by Alessandro Nai

Grateful for the opportunity to contribute—by name—to what must be the most massive collaborative encyclopedia project of all time, next to Wikipedia. All credit goes to @annisch.bsky.social who did the heavy lifting for the overview article on Populist Attitudes.

osf.io/preprints/so...
Christmas came early this year! Very happy to see our paper out in Science Advances. Led by @lfoswaldo.bsky.social, we ran a unique collective field-experiment on Reddit, to better understand who is participating in online debates and why.

Paper: www.science.org/doi/10.1126/...

And more below 👇

Reposted by Alexander Wuttke

📢 New paper out!
What do people want from AI systems? How should outputs be adjusted? And how do views differ between countries?
@adrauc.bsky.social and I explore this for @socialmedia-soc.bsky.social in Public Opinion on the Politics of AI Alignment.

journals.sagepub.com/doi/10.1177/...

Oh, I see.
you're right. Journals retracting the article is, of course, not the only and perhaps not even the most common way.
Good point

I like this idea.

Let's include retraction in university rankings
(And perhaps successful reproductions)
Achal Agrawal is on Nature’s list of 10 people who shaped science in 2025. His work helped change India’s university rankings system to include a penalty for large number of retractions.

www.nature.com/articles/d41...
This science sleuth revealed a retraction crisis at Indian universities
Achal Agrawal is part of Nature’s 10, a list of people who shaped science in 2025.
www.nature.com
Achal Agrawal is on Nature’s list of 10 people who shaped science in 2025. His work helped change India’s university rankings system to include a penalty for large number of retractions.

www.nature.com/articles/d41...
This science sleuth revealed a retraction crisis at Indian universities
Achal Agrawal is part of Nature’s 10, a list of people who shaped science in 2025.
www.nature.com

wow. So nice to hear. Congratulations and good luck!
With my project IMMERSE I investigate whether immersive narrative interventions (storytelling, live theatre, video games and virtual reality) can strengthen support for liberal democracy by engaging people more deeply than conventional communication. See: www.uva.nl/en/content/n... 2/2
Nine UvA researchers receive ERC Consolidator Grants
The European Research Council (ERC) has awarded Consolidator Grants to nine UvA researchers. The laureates are: Thijs Bol, Jaron Harambam, Eirini Karyotaki, Patty Leijten, Dora Matzke, Matthijs Roodui...
www.uva.nl

Perhaps it should include a slide on the proliferation of causal designs in polisci in the recent 2 decades as documented by @carotorreblanca.bsky.social
et Al
osf.io/preprints/so...
OSF
osf.io

I'm grateful for critical views and hints

I played around with NotebookLM and asked it to build a short explainer based on "Causal Empiricism", a @nickchk.com chapter and different prompts. That’s what the video above is based on.

I’d still love to have one resource that introduces the logic of (a) controlled and (b) natural experiments and (c) directly contrasts these designs with the “just run a regression” approach. Do you know readings / videos / other material that do all of this well?

Today I noticed that my BA students struggled with it. My fault: I used it to introduce our causal design block instead of placing it at the end. The text assumes that readers already know the main designs.

A while ago I asked here which text to assign on this. Many of you (thanks!) pointed me to the @cdsamii.bsky.social piece and it has become one of my absolute favorite readings in 2025.
www.journals.uchicago.edu/doi/abs/10.1...
Causal Empiricism in Quantitative Research | The Journal of Politics: Vol 78, No 3
Quantitative analysis of causal effects in political science has trended toward the adoption of “causal empiricist” approaches. Such approaches place heavy emphasis on causal identification through ex...
www.journals.uchicago.edu
How to explain the “credibility revolution” in a few minutes?

"I" "made" a short video that tries to show why clever (natural) experiments and research design beat pure statistical adjustment for causal claims.

I am genuinely curious what methods people think:
youtu.be/Fv14ktwA31Q?...
The Causal Revolution: Why Research Design trumps (regression) models for causal claims
YouTube video by Alexander Wuttke
youtu.be