Anne Scheel
@annemscheel.bsky.social
Assistant prof at Utrecht University, trying to make science as reproducible as non-scientists think it is. Blogs at @the100ci.
Reposted by Anne Scheel
It's harder to understand reality than we intuitively think
February 13, 2026 at 4:51 PM
It's harder to understand reality than we intuitively think
Reposted by Anne Scheel
New paper, on a worrying trend in meta-science: the practice of anonymising datasets on, e.g., published articles. We argue that this is at odds with norms established in research synthesis, explore arguments for anonymisation, provide counterpoints, and demonstrate implications and epistemic costs.
Against Anonymising Meta-Scientific Data: https://osf.io/6eyjf
February 13, 2026 at 4:50 PM
New paper, on a worrying trend in meta-science: the practice of anonymising datasets on, e.g., published articles. We argue that this is at odds with norms established in research synthesis, explore arguments for anonymisation, provide counterpoints, and demonstrate implications and epistemic costs.
Reposted by Anne Scheel
New blog post about the age-period-cohort identification problem!
In which, for the first time ever, I ask "What's the mechanism?" and also suggest that sometimes you may actually *not* be interested in causal inference.
www.the100.ci/2026/02/13/o...
In which, for the first time ever, I ask "What's the mechanism?" and also suggest that sometimes you may actually *not* be interested in causal inference.
www.the100.ci/2026/02/13/o...
One approach to the age-period-cohort problem: Just don’t.
Just to cause yourself more problems, you seek for something. But there is no need for you to seek anything. You have plenty, and you have just enough problems.
Shunryū Suzuki in a 1971 talk
A ...
www.the100.ci
February 13, 2026 at 2:33 PM
New blog post about the age-period-cohort identification problem!
In which, for the first time ever, I ask "What's the mechanism?" and also suggest that sometimes you may actually *not* be interested in causal inference.
www.the100.ci/2026/02/13/o...
In which, for the first time ever, I ask "What's the mechanism?" and also suggest that sometimes you may actually *not* be interested in causal inference.
www.the100.ci/2026/02/13/o...
Reposted by Anne Scheel
Great post @ruxandrabio.bsky.social on FDA’s refusal to review Moderna’s flu vaccine, changing its position on what trial design was acceptable.
Regulatory uncertainty doesn’t just mean missing out on this vaccine, but also reduces future R&D investment:
clinicaltrialsabundance.blog/p/the-modern...
Regulatory uncertainty doesn’t just mean missing out on this vaccine, but also reduces future R&D investment:
clinicaltrialsabundance.blog/p/the-modern...
February 11, 2026 at 4:17 PM
Great post @ruxandrabio.bsky.social on FDA’s refusal to review Moderna’s flu vaccine, changing its position on what trial design was acceptable.
Regulatory uncertainty doesn’t just mean missing out on this vaccine, but also reduces future R&D investment:
clinicaltrialsabundance.blog/p/the-modern...
Regulatory uncertainty doesn’t just mean missing out on this vaccine, but also reduces future R&D investment:
clinicaltrialsabundance.blog/p/the-modern...
Reposted by Anne Scheel
Some people confuse correlation and causation, some people confuse causation and “deterministic direct 1:1 causation” 🥲
February 11, 2026 at 5:03 AM
Some people confuse correlation and causation, some people confuse causation and “deterministic direct 1:1 causation” 🥲
Reposted by Anne Scheel
I learned, in the same semester, how methodological rigor is the bedrock of all progress in psychological science, and that a moderated mediation model based on questionnaires from 86 undergrad students is rock-solid proof for a theory in social psychology.
February 6, 2026 at 9:35 PM
I learned, in the same semester, how methodological rigor is the bedrock of all progress in psychological science, and that a moderated mediation model based on questionnaires from 86 undergrad students is rock-solid proof for a theory in social psychology.
Is this a thing in other fields too?
The (IMO large) bad portion of the psych literature typically violates basic principles that we teach undergrads in intro methods & stats. Feeling increasingly embarrassed when I think of how awful published papers look compared to what I’m asking of my students
The (IMO large) bad portion of the psych literature typically violates basic principles that we teach undergrads in intro methods & stats. Feeling increasingly embarrassed when I think of how awful published papers look compared to what I’m asking of my students
February 6, 2026 at 1:22 PM
Is this a thing in other fields too?
The (IMO large) bad portion of the psych literature typically violates basic principles that we teach undergrads in intro methods & stats. Feeling increasingly embarrassed when I think of how awful published papers look compared to what I’m asking of my students
The (IMO large) bad portion of the psych literature typically violates basic principles that we teach undergrads in intro methods & stats. Feeling increasingly embarrassed when I think of how awful published papers look compared to what I’m asking of my students
Reposted by Anne Scheel
Bad news: additional capacity goes to patients who look remarkably similar to those already receiving care. Hence, outcomes are nonreactive. Thus, expanding the workforce doesn't inevitably reach those with the greatest need. 7/n
February 5, 2026 at 8:35 AM
Bad news: additional capacity goes to patients who look remarkably similar to those already receiving care. Hence, outcomes are nonreactive. Thus, expanding the workforce doesn't inevitably reach those with the greatest need. 7/n
Reposted by Anne Scheel
New meta finds no correlation between testosterone and risk preference, buuuuut testosterone was mainly measured using 2D:4D (nonsense) or saliva (still bad) and we know from Frey et al. 2017 that the risk measures don't tap into a coherent preference.
www.sciencedirect.com/science/arti...
www.sciencedirect.com/science/arti...
February 3, 2026 at 12:03 PM
New meta finds no correlation between testosterone and risk preference, buuuuut testosterone was mainly measured using 2D:4D (nonsense) or saliva (still bad) and we know from Frey et al. 2017 that the risk measures don't tap into a coherent preference.
www.sciencedirect.com/science/arti...
www.sciencedirect.com/science/arti...
Reposted by Anne Scheel
Do you sometimes think "oh boy, I would really like to hear Julia ramble some more about the topics about which she doesn't stop talking to begin with?"
The wait is finally over! @guruspod.bsky.social and had a chat about open science, causal inference, and apparently birth order effects.
The wait is finally over! @guruspod.bsky.social and had a chat about open science, causal inference, and apparently birth order effects.
Open Science, Psychology, and the Art of Not Quite Claiming Causality with Julia Rohrer - Decoding the Gurus
In a rare departure from our usual diet of online weirdos, this episode features an academic who is very much not a guru. We’re joined by Julia Rohrer...
decoding-the-gurus.captivate.fm
January 30, 2026 at 11:06 AM
Do you sometimes think "oh boy, I would really like to hear Julia ramble some more about the topics about which she doesn't stop talking to begin with?"
The wait is finally over! @guruspod.bsky.social and had a chat about open science, causal inference, and apparently birth order effects.
The wait is finally over! @guruspod.bsky.social and had a chat about open science, causal inference, and apparently birth order effects.
Reposted by Anne Scheel
Really cool work!
New paper out:
Some people are systematically better at judging others’ intelligence.
Who are the best judges? People WHO are intelligent themselves, have good emotion-perception ability, and who are high in well-being.
www.sciencedirect.com/science/arti...
Some people are systematically better at judging others’ intelligence.
Who are the best judges? People WHO are intelligent themselves, have good emotion-perception ability, and who are high in well-being.
www.sciencedirect.com/science/arti...
The good judge of intelligence
Accurately judging others' intelligence is important, yet little is known about individual differences in this ability. In this study we investigated …
www.sciencedirect.com
January 31, 2026 at 8:37 AM
Really cool work!
Reposted by Anne Scheel
Great talk from @lhdjung.bsky.social at the SwissRN Research-On-Research day on his, our, and other folks' work to develop trustworthiness assessment tools.
Finally his {scrutiny} R package has a logo!
Finally his {scrutiny} R package has a logo!
January 29, 2026 at 4:09 PM
Great talk from @lhdjung.bsky.social at the SwissRN Research-On-Research day on his, our, and other folks' work to develop trustworthiness assessment tools.
Finally his {scrutiny} R package has a logo!
Finally his {scrutiny} R package has a logo!
Reposted by Anne Scheel
January 29, 2026 at 1:02 PM
Reposted by Anne Scheel
Just learned about this study looking at methodological trends in psych and econ over time: online.ucpress.edu/collabra/art....
Matches my perception well: Nobody in psych bothers to (explicitly) try causal inference unless they conducted an experiment, not a lot of theoretical work either.
Matches my perception well: Nobody in psych bothers to (explicitly) try causal inference unless they conducted an experiment, not a lot of theoretical work either.
January 29, 2026 at 9:41 AM
Just learned about this study looking at methodological trends in psych and econ over time: online.ucpress.edu/collabra/art....
Matches my perception well: Nobody in psych bothers to (explicitly) try causal inference unless they conducted an experiment, not a lot of theoretical work either.
Matches my perception well: Nobody in psych bothers to (explicitly) try causal inference unless they conducted an experiment, not a lot of theoretical work either.
Reposted by Anne Scheel
New blog post introducing Causion - a web app for causal inference teaching and learning: pedermisager.org/blog/causion....
Introducing Causion: A web app for playing with DAGs | Peder M. Isager
Personal website of Dr. Peder M. Isager
pedermisager.org
January 28, 2026 at 9:23 AM
New blog post introducing Causion - a web app for causal inference teaching and learning: pedermisager.org/blog/causion....
Reposted by Anne Scheel
In sum: all global prevalence rates about gaming addiction/disorder seem to be a partial combination of both gaming *and* gambling prevalence. The same applies to other studies, which use gaming measures in relevant languages. Chinese seems to be a major exception.
January 28, 2026 at 9:56 AM
In sum: all global prevalence rates about gaming addiction/disorder seem to be a partial combination of both gaming *and* gambling prevalence. The same applies to other studies, which use gaming measures in relevant languages. Chinese seems to be a major exception.
Reposted by Anne Scheel
behold, we found great variation in how people think! Many activities that we thought would be “gaming” weren't & vice versa, eg half of the participants interpreted ‘gambling’ to be ‘gaming’. Ergo: surveying ‘gaming’ without defining it creates data mess
January 28, 2026 at 9:56 AM
behold, we found great variation in how people think! Many activities that we thought would be “gaming” weren't & vice versa, eg half of the participants interpreted ‘gambling’ to be ‘gaming’. Ergo: surveying ‘gaming’ without defining it creates data mess
Reposted by Anne Scheel
..we then reviewed the next 358 studies to see if we could find more information in papers & public materials. Basically the only case where gambling was excluded was inherent language: ~30% of the studies used Chinese, where confusion shouldn’t exist. Field-wide measurement error is hence ~70%
January 28, 2026 at 9:56 AM
..we then reviewed the next 358 studies to see if we could find more information in papers & public materials. Basically the only case where gambling was excluded was inherent language: ~30% of the studies used Chinese, where confusion shouldn’t exist. Field-wide measurement error is hence ~70%
Reposted by Anne Scheel
📣 Our introduction to structural causal models in science studies is now published:
doi.org/10.1162/QSS....
@tklebel.bsky.social and I tried to make our introduction as accessible as possible. We illustrate the theory by three case studies based on a simulated model of Open Science. 🧵(1/6)
doi.org/10.1162/QSS....
@tklebel.bsky.social and I tried to make our introduction as accessible as possible. We illustrate the theory by three case studies based on a simulated model of Open Science. 🧵(1/6)
January 27, 2026 at 10:24 AM
📣 Our introduction to structural causal models in science studies is now published:
doi.org/10.1162/QSS....
@tklebel.bsky.social and I tried to make our introduction as accessible as possible. We illustrate the theory by three case studies based on a simulated model of Open Science. 🧵(1/6)
doi.org/10.1162/QSS....
@tklebel.bsky.social and I tried to make our introduction as accessible as possible. We illustrate the theory by three case studies based on a simulated model of Open Science. 🧵(1/6)
Reposted by Anne Scheel
We looked at 100 IGT studies and found abysmal reporting standards, and 244 different scoring techniques. Applied to a new dataset, the average correlation between these 244 techniques was 0. 5/15 IGT meta-analyses we looked at did not account for this hetereogenity.
January 26, 2026 at 8:28 AM
We looked at 100 IGT studies and found abysmal reporting standards, and 244 different scoring techniques. Applied to a new dataset, the average correlation between these 244 techniques was 0. 5/15 IGT meta-analyses we looked at did not account for this hetereogenity.
Reposted by Anne Scheel
Foody et al 2013 has over 130 citations (top 1%) as support for an element of Acceptance and Commitment Therapy's model, but it contains no evidence for that claim.
This is a case study in flawed original studies being cited favorably and uncritically until it becomes a common scientific belief.🧵
This is a case study in flawed original studies being cited favorably and uncritically until it becomes a common scientific belief.🧵
No evidence of differences between hierarchical versus distinction relations in self-based ACT exercises: A critical reanalysis of Foody et al. (2013) and Foody et al. (2015): https://osf.io/ab7de
January 26, 2026 at 12:47 PM
Foody et al 2013 has over 130 citations (top 1%) as support for an element of Acceptance and Commitment Therapy's model, but it contains no evidence for that claim.
This is a case study in flawed original studies being cited favorably and uncritically until it becomes a common scientific belief.🧵
This is a case study in flawed original studies being cited favorably and uncritically until it becomes a common scientific belief.🧵
Reposted by Anne Scheel
The raw data is now lost to the sands of time, but a multiverse analysis can still be conducted on the differences between the conditions at post by extracting data from the figures.
Results show no differences in means under any set of analytic choices.
Results show no differences in means under any set of analytic choices.
January 26, 2026 at 12:47 PM
The raw data is now lost to the sands of time, but a multiverse analysis can still be conducted on the differences between the conditions at post by extracting data from the figures.
Results show no differences in means under any set of analytic choices.
Results show no differences in means under any set of analytic choices.
Reposted by Anne Scheel
To understand the impact of this flexibility in scoring, we ran a multiverse analysis on an open IGT dataset using 205 of the identified scores. The correlations ranged from -0.942 to 0.998 with a median r = 0.022.
January 25, 2026 at 11:16 AM
To understand the impact of this flexibility in scoring, we ran a multiverse analysis on an open IGT dataset using 205 of the identified scores. The correlations ranged from -0.942 to 0.998 with a median r = 0.022.
Reposted by Anne Scheel
But the most striking finding was in the scoring: We found 244 distinct scores used to analyze IGT outcomes. 177 of those scores appeared only once in our sample, showing a massive fragmentation in how IGT data is analyzed.
January 25, 2026 at 11:16 AM
But the most striking finding was in the scoring: We found 244 distinct scores used to analyze IGT outcomes. 177 of those scores appeared only once in our sample, showing a massive fragmentation in how IGT data is analyzed.
Reposted by Anne Scheel
FYI to anyone whose "task queued" status never changed - there was a small bug preventing them from being processed, and this is now fixed. Your reports should be ready soon!
January 24, 2026 at 11:16 AM
FYI to anyone whose "task queued" status never changed - there was a small bug preventing them from being processed, and this is now fixed. Your reports should be ready soon!