moin syed
@syeducation.bsky.social
Professor of Psychology, University of Minnesota. Sporadically writing stuff at http://getsyeducated.substack.com
Reposted by moin syed
I thought about this point a bit more and I think Moin is onto something 😅 take randomized experiments, which are a huge hassle — yet social psych has determined that “this is what science looks like”, and so they be randomizing (for better or worse), no matter what.
November 14, 2025 at 5:19 AM
I thought about this point a bit more and I think Moin is onto something 😅 take randomized experiments, which are a huge hassle — yet social psych has determined that “this is what science looks like”, and so they be randomizing (for better or worse), no matter what.
Reposted by moin syed
Psychology wants to stay WEIRD, not go WILD: https://osf.io/bxk6c
November 12, 2025 at 10:37 PM
Psychology wants to stay WEIRD, not go WILD: https://osf.io/bxk6c
A quick (1000 words) read to enjoy with your morning coffee or afternoon tea:
"Psychology wants to stay WEIRD, not go WILD"
Why hasn't psychology diversified it samples, methods, theories, etc.? Because it doesn't want to. osf.io/preprints/ps...
"Psychology wants to stay WEIRD, not go WILD"
Why hasn't psychology diversified it samples, methods, theories, etc.? Because it doesn't want to. osf.io/preprints/ps...
November 13, 2025 at 2:59 PM
A quick (1000 words) read to enjoy with your morning coffee or afternoon tea:
"Psychology wants to stay WEIRD, not go WILD"
Why hasn't psychology diversified it samples, methods, theories, etc.? Because it doesn't want to. osf.io/preprints/ps...
"Psychology wants to stay WEIRD, not go WILD"
Why hasn't psychology diversified it samples, methods, theories, etc.? Because it doesn't want to. osf.io/preprints/ps...
Reposted by moin syed
Shout out to @psychmag.bsky.social for being speedy, open access, and helping to share things I care about quickly and freely:
www.bps.org.uk/psychologist...
www.bps.org.uk/psychologist...
November 13, 2025 at 2:01 PM
Shout out to @psychmag.bsky.social for being speedy, open access, and helping to share things I care about quickly and freely:
www.bps.org.uk/psychologist...
www.bps.org.uk/psychologist...
Reposted by moin syed
What's the take home message?
If you're submitting AI slop you're a loser. You're just making these great free services harder to run, and making it more difficult to separate signal (science) from noise (your crappy AI shit.)
If you're submitting AI slop you're a loser. You're just making these great free services harder to run, and making it more difficult to separate signal (science) from noise (your crappy AI shit.)
November 3, 2025 at 2:52 PM
What's the take home message?
If you're submitting AI slop you're a loser. You're just making these great free services harder to run, and making it more difficult to separate signal (science) from noise (your crappy AI shit.)
If you're submitting AI slop you're a loser. You're just making these great free services harder to run, and making it more difficult to separate signal (science) from noise (your crappy AI shit.)
Reposted by moin syed
There still seems to be a lot of confusion about significance testing in psych. No, p-values *don’t* become useless at large N. This flawed point also used to be framed as "too much power". But power isn't the problem – it's 1) unbalanced error rates and 2) the (lack of a) SESOI. 1/ >
But here's, the thing, p values and significance become useless at such large sample sizes. When you're dividing the coefficient by the SE and the sample size is in the tens of thousands, EVERYTHING IS SIGNIFICANT. All you're testing is whether the coefficient is different than zero.
October 31, 2025 at 8:13 AM
There still seems to be a lot of confusion about significance testing in psych. No, p-values *don’t* become useless at large N. This flawed point also used to be framed as "too much power". But power isn't the problem – it's 1) unbalanced error rates and 2) the (lack of a) SESOI. 1/ >
Reposted by moin syed
MetaROR, a platform for reviews of research on research, is a success! We have published 24 sets of reviews and have 16 submissions in process. MetaROR now has 9 partners - these are journals that agree to use our reviews when authors submit to them. metaror.org #metascience #openaccess
Home - MetaROR
MetaResearch Open Review
MetaResearch Open Review MetaResearch Open Review
A new platform designed to transform how we review and share metaresearch
A new platform designed to transform
metaror.org
October 26, 2025 at 10:33 PM
MetaROR, a platform for reviews of research on research, is a success! We have published 24 sets of reviews and have 16 submissions in process. MetaROR now has 9 partners - these are journals that agree to use our reviews when authors submit to them. metaror.org #metascience #openaccess
Reposted by moin syed
We built the openESM database:
▶️60 openly available experience sampling datasets (16K+ participants, 740K+ obs.) in one place
▶️Harmonized (meta-)data, fully open-source software
▶️Filter & search all data, simply download via R/Python
Find out more:
🌐 openesmdata.org
📝 doi.org/10.31234/osf...
▶️60 openly available experience sampling datasets (16K+ participants, 740K+ obs.) in one place
▶️Harmonized (meta-)data, fully open-source software
▶️Filter & search all data, simply download via R/Python
Find out more:
🌐 openesmdata.org
📝 doi.org/10.31234/osf...
October 22, 2025 at 7:34 PM
We built the openESM database:
▶️60 openly available experience sampling datasets (16K+ participants, 740K+ obs.) in one place
▶️Harmonized (meta-)data, fully open-source software
▶️Filter & search all data, simply download via R/Python
Find out more:
🌐 openesmdata.org
📝 doi.org/10.31234/osf...
▶️60 openly available experience sampling datasets (16K+ participants, 740K+ obs.) in one place
▶️Harmonized (meta-)data, fully open-source software
▶️Filter & search all data, simply download via R/Python
Find out more:
🌐 openesmdata.org
📝 doi.org/10.31234/osf...
Reposted by moin syed
Can AI simulations of human research participants advance cognitive science? In @cp-trendscognsci.bsky.social, @lmesseri.bsky.social & I analyze this vision. We show how “AI Surrogates” entrench practices that limit the generalizability of cognitive science while aspiring to do the opposite. 1/
AI Surrogates and illusions of generalizability in cognitive science
Recent advances in artificial intelligence (AI) have generated enthusiasm for using AI simulations of human research participants to generate new know…
www.sciencedirect.com
October 21, 2025 at 8:24 PM
Can AI simulations of human research participants advance cognitive science? In @cp-trendscognsci.bsky.social, @lmesseri.bsky.social & I analyze this vision. We show how “AI Surrogates” entrench practices that limit the generalizability of cognitive science while aspiring to do the opposite. 1/
Reposted by moin syed
Results of the replication are in!
Chocolate is more desirable than poop:
Cohen's d_rm = 6.20, 95%CI [5.63, 6.78]
N = 486, two single item 1-7 Likert scales of desirability.
w/
@jamiecummins.bsky.social
Chocolate is more desirable than poop:
Cohen's d_rm = 6.20, 95%CI [5.63, 6.78]
N = 486, two single item 1-7 Likert scales of desirability.
w/
@jamiecummins.bsky.social
Make an effect size prediction!
@jamiecummins.bsky.social and I are replicating Balcetis & Dunning's (2010) "chocolate is more desirable than poop" (Cohen's d = 4.52)
Let us known in the replies what effect size you think we'll find. Details of the study in the thread below.
@jamiecummins.bsky.social and I are replicating Balcetis & Dunning's (2010) "chocolate is more desirable than poop" (Cohen's d = 4.52)
Let us known in the replies what effect size you think we'll find. Details of the study in the thread below.
October 14, 2025 at 6:16 PM
Results of the replication are in!
Chocolate is more desirable than poop:
Cohen's d_rm = 6.20, 95%CI [5.63, 6.78]
N = 486, two single item 1-7 Likert scales of desirability.
w/
@jamiecummins.bsky.social
Chocolate is more desirable than poop:
Cohen's d_rm = 6.20, 95%CI [5.63, 6.78]
N = 486, two single item 1-7 Likert scales of desirability.
w/
@jamiecummins.bsky.social
Nice post from Matti on preprints and the nonsense of journals. This paragraph is outstanding.
October 14, 2025 at 5:40 PM
Nice post from Matti on preprints and the nonsense of journals. This paragraph is outstanding.
Reposted by moin syed
Against Publishing: universonline.nl/nieuws/2025/...
Preprints are read, shared, and cited, yet still dismissed as incomplete until blessed by a publisher. I argue that the true measure of scholarship lies in open exchange, not in the industry’s gatekeeping of what counts as published.
Preprints are read, shared, and cited, yet still dismissed as incomplete until blessed by a publisher. I argue that the true measure of scholarship lies in open exchange, not in the industry’s gatekeeping of what counts as published.
October 14, 2025 at 9:16 AM
Against Publishing: universonline.nl/nieuws/2025/...
Preprints are read, shared, and cited, yet still dismissed as incomplete until blessed by a publisher. I argue that the true measure of scholarship lies in open exchange, not in the industry’s gatekeeping of what counts as published.
Preprints are read, shared, and cited, yet still dismissed as incomplete until blessed by a publisher. I argue that the true measure of scholarship lies in open exchange, not in the industry’s gatekeeping of what counts as published.
Reposted by moin syed
Apropos of recent open science conversations - this paper is an awesome primer for grad students and faculty who want to learn more: online.ucpress.edu/collabra/art...
Easing Into Open Science: A Guide for Graduate Students and Their Advisors
This article provides a roadmap to assist graduate students and their advisors to engage in open science practices. We suggest eight open science practices that novice graduate students could begin ad...
online.ucpress.edu
October 3, 2025 at 11:00 AM
Apropos of recent open science conversations - this paper is an awesome primer for grad students and faculty who want to learn more: online.ucpress.edu/collabra/art...
Reposted by moin syed
"The simplest recommendation that flows from my arguments in this article is that we need to enhance the degree of specificity and precision when making theoretical claims."
By @syeducation.bsky.social
By @syeducation.bsky.social
Elegant theories and the problems of social psychology
This perspective article provides a commentary on the current state of theories used in social psychology, with a particular emphasis on the importance of distinguishing between theoretical models ...
doi.org
September 21, 2025 at 11:12 PM
"The simplest recommendation that flows from my arguments in this article is that we need to enhance the degree of specificity and precision when making theoretical claims."
By @syeducation.bsky.social
By @syeducation.bsky.social
Reposted by moin syed
Just learned about this diamond journal, which has apparently been running since 2015! Looks like a very nice place for any meta-sciency work & probably deserves some visibility.
septentrio.uit.no/index.php/no...
septentrio.uit.no/index.php/no...
Nordic Perspectives on Open Science
Nordic-Baltic journal of Open Access to publications, data, peer review and open science.
septentrio.uit.no
September 20, 2025 at 12:31 PM
Just learned about this diamond journal, which has apparently been running since 2015! Looks like a very nice place for any meta-sciency work & probably deserves some visibility.
septentrio.uit.no/index.php/no...
septentrio.uit.no/index.php/no...
Reposted by moin syed
Can large language models stand in for human participants?
Many social scientists seem to think so, and are already using "silicon samples" in research.
One problem: depending on the analytic decisions made, you can basically get these samples to show any effect you want.
THREAD 🧵
Many social scientists seem to think so, and are already using "silicon samples" in research.
One problem: depending on the analytic decisions made, you can basically get these samples to show any effect you want.
THREAD 🧵
The threat of analytic flexibility in using large language models to simulate human data: A call to attention
Social scientists are now using large language models to create "silicon samples" - synthetic datasets intended to stand in for human respondents, aimed at revolutionising human subjects research. How...
arxiv.org
September 18, 2025 at 7:56 AM
Can large language models stand in for human participants?
Many social scientists seem to think so, and are already using "silicon samples" in research.
One problem: depending on the analytic decisions made, you can basically get these samples to show any effect you want.
THREAD 🧵
Many social scientists seem to think so, and are already using "silicon samples" in research.
One problem: depending on the analytic decisions made, you can basically get these samples to show any effect you want.
THREAD 🧵
Reposted by moin syed
In a new paper, my colleagues and I set out to demonstrate how method biases can create spurious findings in relationship science, by using a seemingly meaningless scale (e.g., "My relationship has very good Saturn") to predict relationship outcomes. journals.sagepub.com/doi/10.1177/...
Pseudo Effects: How Method Biases Can Produce Spurious Findings About Close Relationships - Samantha Joel, John K. Sakaluk, James J. Kim, Devinder Khera, Helena Yuchen Qin, Sarah C. E. Stanton, 2025
Research on interpersonal relationships frequently relies on accurate self-reporting across various relationship facets (e.g., conflict, trust, appreciation). Y...
journals.sagepub.com
September 10, 2025 at 6:18 PM
In a new paper, my colleagues and I set out to demonstrate how method biases can create spurious findings in relationship science, by using a seemingly meaningless scale (e.g., "My relationship has very good Saturn") to predict relationship outcomes. journals.sagepub.com/doi/10.1177/...
This is a good post, tracking closely with my own (often unpopular) views on the subject. Worth a read for anyone with interest or experience in interdisciplinary work.
September 8, 2025 at 2:30 PM
This is a good post, tracking closely with my own (often unpopular) views on the subject. Worth a read for anyone with interest or experience in interdisciplinary work.
Reread this one for the history of psych class I am teaching and was reminded of how good it is. Short, thoughtful, and provocative. A highly worthwhile read. doi.org/10.1037/gpr0...
September 5, 2025 at 1:59 PM
Reread this one for the history of psych class I am teaching and was reminded of how good it is. Short, thoughtful, and provocative. A highly worthwhile read. doi.org/10.1037/gpr0...
Reposted by moin syed
If this is turning into a battle, then the researchers’ possible counter is to normalize updating preprints and CVs with “accepted at journal x” as sufficient for getting publication credit and not pay the fees.
Making Your Research Free May Cost You
* With federal funding exceptionally unreliable, scientists say they are stressed about spending thousands of grant dollars on unexpected and questionable open-access charges.
By @stephaniemlee.bsky.social for @chronicle.com
www.chronicle.com/article/maki...
* With federal funding exceptionally unreliable, scientists say they are stressed about spending thousands of grant dollars on unexpected and questionable open-access charges.
By @stephaniemlee.bsky.social for @chronicle.com
www.chronicle.com/article/maki...
Making Your Research Free May Cost You
Under a new requirement that NIH-funded research be freely, immediately available, some journals are forcing researchers to pay to publish.
www.chronicle.com
August 29, 2025 at 9:38 PM
If this is turning into a battle, then the researchers’ possible counter is to normalize updating preprints and CVs with “accepted at journal x” as sufficient for getting publication credit and not pay the fees.
Reposted by moin syed
✨✨ I will be reviewing applications for the University of Minnesota psychology PhD program this fall!
Information for potential applicants can be found on my lab website: ringwaldlab.psych.umn.edu/join-lab
Please spread the word!
Information for potential applicants can be found on my lab website: ringwaldlab.psych.umn.edu/join-lab
Please spread the word!
Join the Lab | Ringwald Lab
ringwaldlab.psych.umn.edu
August 29, 2025 at 4:39 PM
✨✨ I will be reviewing applications for the University of Minnesota psychology PhD program this fall!
Information for potential applicants can be found on my lab website: ringwaldlab.psych.umn.edu/join-lab
Please spread the word!
Information for potential applicants can be found on my lab website: ringwaldlab.psych.umn.edu/join-lab
Please spread the word!
Reposted by moin syed
a recent study led by @anniewham.bsky.social takes a specific look at post-publication critique in psychology too, in case that's of interest doi.org/10.31234/osf...
August 27, 2025 at 4:22 AM
a recent study led by @anniewham.bsky.social takes a specific look at post-publication critique in psychology too, in case that's of interest doi.org/10.31234/osf...
Reposted by moin syed
Excellent essay outlining the reasons why scientific critique is currently broken -- would love to learn more about the historical part ie how/why things have changed over years (ht @syeducation.bsky.social )
www.oncologynewscentral.com/oncology/wha...
www.oncologynewscentral.com/oncology/wha...
What the Death of Letters to the Editor Means for Oncology
The role of letters to the editor in oncology is fading. Once a potent tool to “rattle cages,” the letters are now slowed by conflicts of interest and delays, says Amol Akhade, MD, MBBS. What does thi...
www.oncologynewscentral.com
August 26, 2025 at 6:46 PM
Excellent essay outlining the reasons why scientific critique is currently broken -- would love to learn more about the historical part ie how/why things have changed over years (ht @syeducation.bsky.social )
www.oncologynewscentral.com/oncology/wha...
www.oncologynewscentral.com/oncology/wha...
Reposted by moin syed
Due to a recent influx of problematic submissions, PsyArXiv has switched to pre-moderating its content. If your submitted preprint had not yet been approved, it will be temporarily inaccessible to the public (you can still view your preprint when logged into your OSF account). #PsychSciSky
August 19, 2025 at 4:58 PM
Due to a recent influx of problematic submissions, PsyArXiv has switched to pre-moderating its content. If your submitted preprint had not yet been approved, it will be temporarily inaccessible to the public (you can still view your preprint when logged into your OSF account). #PsychSciSky
Reposted by moin syed
Yes. I have been puzzling over how there is such a large gap in some accounts of the reform movement and my experience living and observing it.
A hypothesis is that many researchers who have gotten interested in studying it, did so after the movement had some success and so trace it from that lens.
A hypothesis is that many researchers who have gotten interested in studying it, did so after the movement had some success and so trace it from that lens.
August 16, 2025 at 11:35 AM
Yes. I have been puzzling over how there is such a large gap in some accounts of the reform movement and my experience living and observing it.
A hypothesis is that many researchers who have gotten interested in studying it, did so after the movement had some success and so trace it from that lens.
A hypothesis is that many researchers who have gotten interested in studying it, did so after the movement had some success and so trace it from that lens.