Samantha Joel
@datingdecisions.bsky.social
Social psychologist, relationships enthusiast, Associate Prof at Western University 🇨🇦.
Pinned
Pseudo Effects: How Method Biases Can Produce Spurious Findings About Close Relationships - Samantha Joel, John K. Sakaluk, James J. Kim, Devinder Khera, Helena Yuchen Qin, Sarah C. E. Stanton, 2025
Research on interpersonal relationships frequently relies on accurate self-reporting across various relationship facets (e.g., conflict, trust, appreciation). Y...
journals.sagepub.com
In a new paper, my colleagues and I set out to demonstrate how method biases can create spurious findings in relationship science, by using a seemingly meaningless scale (e.g., "My relationship has very good Saturn") to predict relationship outcomes. journals.sagepub.com/doi/10.1177/...
First thought when I read this was, "$900 a year is a lot of money".
But you're telling me that's PER MONTH??
But you're telling me that's PER MONTH??
I put off doing the inevitable…I called my insurance provider.
My current premium is $480. It will be almost $900 next year.
Thanks, Trump voters.
My current premium is $480. It will be almost $900 next year.
Thanks, Trump voters.
October 29, 2025 at 10:45 PM
First thought when I read this was, "$900 a year is a lot of money".
But you're telling me that's PER MONTH??
But you're telling me that's PER MONTH??
Reposted by Samantha Joel
Is social interaction a tradeoff of autonomy for belonging compared to being alone? New paper by phenom @elainehoan.bsky.social says yes if you're interacting with strangers, no if you're interacting with friends/family. With a romantic partner you gain in both. journals.sagepub.com/doi/10.1177/...
Sage Journals: Discover world-class research
Subscription and open access journals from Sage, the world's leading independent academic publisher.
journals.sagepub.com
October 16, 2025 at 4:32 PM
Is social interaction a tradeoff of autonomy for belonging compared to being alone? New paper by phenom @elainehoan.bsky.social says yes if you're interacting with strangers, no if you're interacting with friends/family. With a romantic partner you gain in both. journals.sagepub.com/doi/10.1177/...
Nice coverage of our Pseudo project in Nature Reviews. @johnsakaluk.bsky.social @davekhera.bsky.social @helenaqin.bsky.social @sarahcestanton.bsky.social
www.nature.com/articles/s44...
www.nature.com/articles/s44...
Common method bias can lead to spurious correlations in relationship studies
Nature Reviews Psychology - Common method bias can lead to spurious correlations in relationship studies
www.nature.com
October 20, 2025 at 11:57 AM
Nice coverage of our Pseudo project in Nature Reviews. @johnsakaluk.bsky.social @davekhera.bsky.social @helenaqin.bsky.social @sarahcestanton.bsky.social
www.nature.com/articles/s44...
www.nature.com/articles/s44...
Reposted by Samantha Joel
So for-profit AI companies have trained on the world's largest collaborative volunteer project and a precious free resource, to make money for their for-profit enterprises. They have crushed traffic to the volunteer project, starving it of donors and volunteers
www.404media.co/wikipedia-sa...
www.404media.co/wikipedia-sa...
Wikipedia Says AI Is Causing a Dangerous Decline in Human Visitors
“With fewer visits to Wikipedia, fewer volunteers may grow and enrich the content, and fewer individual donors may support this work.”
www.404media.co
October 17, 2025 at 2:28 PM
So for-profit AI companies have trained on the world's largest collaborative volunteer project and a precious free resource, to make money for their for-profit enterprises. They have crushed traffic to the volunteer project, starving it of donors and volunteers
www.404media.co/wikipedia-sa...
www.404media.co/wikipedia-sa...
Reposted by Samantha Joel
"I have a decent fluency in LLMs, and they have utility, but the absurd degree of over-hype, the way they're being forced on everyone, and the insistence on ignoring the many valid critiques about them make it very difficult to focus on legitimate uses where they might add value."
October 17, 2025 at 4:32 AM
"I have a decent fluency in LLMs, and they have utility, but the absurd degree of over-hype, the way they're being forced on everyone, and the insistence on ignoring the many valid critiques about them make it very difficult to focus on legitimate uses where they might add value."
Major shoutout to @andrew.heiss.phd for recreating FiveThirtyEight's p-hacking app. My teaching prep panic at discovering the broken link lasted only a few minutes of googling thanks to this beautiful replacement:
stats.andrewheiss.com/hack-your-way
stats.andrewheiss.com/hack-your-way
Hack Your Way To Scientific Glory (recreation) – Hack Your Way To Scientific Glory
Recreation of FiveThirtyEight’s “Hack Your Way To Scientific Glory” with Observable JS
stats.andrewheiss.com
October 17, 2025 at 12:41 PM
Major shoutout to @andrew.heiss.phd for recreating FiveThirtyEight's p-hacking app. My teaching prep panic at discovering the broken link lasted only a few minutes of googling thanks to this beautiful replacement:
stats.andrewheiss.com/hack-your-way
stats.andrewheiss.com/hack-your-way
Reposted by Samantha Joel
If a grad or undergrad researcher in my lab said to me, "We are doing the studies to make the proof", I would have them retake research methods course and/or a philosophy of science course.
RFK Jr on Tylenol and autism: "It is not proof. We're doing the studies to make the proof."
October 10, 2025 at 2:05 PM
If a grad or undergrad researcher in my lab said to me, "We are doing the studies to make the proof", I would have them retake research methods course and/or a philosophy of science course.
Reposted by Samantha Joel
UNC is hiring in Quantitative Psychology! Assistant Professor (tenure-track). Please share widely! Find details here: unc.peopleadmin.com/postings/307...
a logo for the carolina tar heels with a ram head
ALT: a logo for the carolina tar heels with a ram head
media.tenor.com
October 3, 2025 at 7:34 PM
UNC is hiring in Quantitative Psychology! Assistant Professor (tenure-track). Please share widely! Find details here: unc.peopleadmin.com/postings/307...
Reposted by Samantha Joel
New ad for an open rank position in Psychology at Cornell. That Human Bonding course seems very popular! May be a good fit for a relationship scientist out there. Below is a snippet of the job ad.
October 1, 2025 at 6:37 PM
New ad for an open rank position in Psychology at Cornell. That Human Bonding course seems very popular! May be a good fit for a relationship scientist out there. Below is a snippet of the job ad.
Reposted by Samantha Joel
Had missed this absolutely brilliant paper. They take a widely used social media addiction scale & replace 'social media' with 'friends'. The resulting scale has great psychometric properties & 69% of people have friend addictions.
link.springer.com/article/10.3...
link.springer.com/article/10.3...
Development of an Offline-Friend Addiction Questionnaire (O-FAQ): Are most people really social addicts? - Behavior Research Methods
A growing number of self-report measures aim to define interactions with social media in a pathological behavior framework, often using terminology focused on identifying those who are ‘addicted’ to engaging with others online. Specifically, measures of ‘social media addiction’ focus on motivations for online social information seeking, which could relate to motivations for offline social information seeking. However, it could be the case that these same measures could reveal a pattern of friend addiction in general. This study develops the Offline-Friend Addiction Questionnaire (O-FAQ) by re-wording items from highly cited pathological social media use scales to reflect “spending time with friends”. Our methodology for validation follows the current literature precedent in the development of social media ‘addiction’ scales. The O-FAQ had a three-factor solution in an exploratory sample of N = 807 and these factors were stable in a 4-week retest (r = .72 to .86) and was validated against personality traits, and risk-taking behavior, in conceptually plausible directions. Using the same polythetic classification techniques as pathological social media use studies, we were able to classify 69% of our sample as addicted to spending time with their friends. The discussion of our satirical research is a critical reflection on the role of measurement and human sociality in social media research. We question the extent to which connecting with others can be considered an ‘addiction’ and discuss issues concerning the validation of new ‘addiction’ measures without relevant medical constructs. Readers should approach our measure with a level of skepticism that should be afforded to current social media addiction measures.
link.springer.com
October 1, 2025 at 11:33 AM
Had missed this absolutely brilliant paper. They take a widely used social media addiction scale & replace 'social media' with 'friends'. The resulting scale has great psychometric properties & 69% of people have friend addictions.
link.springer.com/article/10.3...
link.springer.com/article/10.3...
Reposted by Samantha Joel
We should fear common method variance; especially in self-report scales.
A nonsense likert scale ‘predicts’ later relationship satisfaction.
We are getting results using methods when we are measuring nothing.
From @datingdecisions.bsky.social
journals.sagepub.com/doi/pdf/10.1...
#psych #stats
A nonsense likert scale ‘predicts’ later relationship satisfaction.
We are getting results using methods when we are measuring nothing.
From @datingdecisions.bsky.social
journals.sagepub.com/doi/pdf/10.1...
#psych #stats
September 29, 2025 at 2:53 PM
We should fear common method variance; especially in self-report scales.
A nonsense likert scale ‘predicts’ later relationship satisfaction.
We are getting results using methods when we are measuring nothing.
From @datingdecisions.bsky.social
journals.sagepub.com/doi/pdf/10.1...
#psych #stats
A nonsense likert scale ‘predicts’ later relationship satisfaction.
We are getting results using methods when we are measuring nothing.
From @datingdecisions.bsky.social
journals.sagepub.com/doi/pdf/10.1...
#psych #stats
Reposted by Samantha Joel
How does the brain decide? 🧠
Our new @nature.com paper shows that neural activity switches from an 'evidence gathering' to a 'commitment' state at a precise moment we call nTc.
After nTc, new evidence is ignored, revealing a neural marker for the instant when the mind is made up.
rdcu.be/eGUrv
Our new @nature.com paper shows that neural activity switches from an 'evidence gathering' to a 'commitment' state at a precise moment we call nTc.
After nTc, new evidence is ignored, revealing a neural marker for the instant when the mind is made up.
rdcu.be/eGUrv
Transitions in dynamical regime and neural mode during perceptual decisions - Nature
Simultaneous recordings were made of hundreds of neurons in the rat frontal cortex and striatum, showing that decision commitment involves a rapid, coordinated transition in dynamical regime and neura...
www.nature.com
September 17, 2025 at 8:12 PM
How does the brain decide? 🧠
Our new @nature.com paper shows that neural activity switches from an 'evidence gathering' to a 'commitment' state at a precise moment we call nTc.
After nTc, new evidence is ignored, revealing a neural marker for the instant when the mind is made up.
rdcu.be/eGUrv
Our new @nature.com paper shows that neural activity switches from an 'evidence gathering' to a 'commitment' state at a precise moment we call nTc.
After nTc, new evidence is ignored, revealing a neural marker for the instant when the mind is made up.
rdcu.be/eGUrv
Reposted by Samantha Joel
Is the idea that getting into a romantic relationship increases well-being a myth? A new MacLab paper says no. And I had so much to say about this work, I started a Substack: The Unromantic. Links for the paper and the Substack in replies.
September 15, 2025 at 3:33 PM
Is the idea that getting into a romantic relationship increases well-being a myth? A new MacLab paper says no. And I had so much to say about this work, I started a Substack: The Unromantic. Links for the paper and the Substack in replies.
Reposted by Samantha Joel
The Substack: unromanticprof.substack.com
The Unromantic | Geoff MacDonald | Substack
An attempt at a sober look at research on singlehood and relationships. Click to read The Unromantic, by Geoff MacDonald, a Substack publication. Launched 2 days ago.
unromanticprof.substack.com
September 15, 2025 at 3:34 PM
The Substack: unromanticprof.substack.com
I think I might just hurl my laptop into the sea
Can large language models stand in for human participants?
Many social scientists seem to think so, and are already using "silicon samples" in research.
One problem: depending on the analytic decisions made, you can basically get these samples to show any effect you want.
THREAD 🧵
Many social scientists seem to think so, and are already using "silicon samples" in research.
One problem: depending on the analytic decisions made, you can basically get these samples to show any effect you want.
THREAD 🧵
The threat of analytic flexibility in using large language models to simulate human data: A call to attention
Social scientists are now using large language models to create "silicon samples" - synthetic datasets intended to stand in for human respondents, aimed at revolutionising human subjects research. How...
arxiv.org
September 18, 2025 at 3:03 PM
I think I might just hurl my laptop into the sea
Reposted by Samantha Joel
A tale as old as time. Different methods of measuring the supposedly same construct simply...do not. I'll add that I think "subjective" and "objective" measures both tell us something meaningful, just about different things.
www.sciencedirect.com/science/arti...
www.sciencedirect.com/science/arti...
The association between subjective and objective cognitive functioning from a transdiagnostic perspective: An umbrella review and meta-analysis
The relationship between subjective (self-reported) and objective (performance-based) cognitive functioning has significant clinical implications acro…
www.sciencedirect.com
September 13, 2025 at 1:23 AM
A tale as old as time. Different methods of measuring the supposedly same construct simply...do not. I'll add that I think "subjective" and "objective" measures both tell us something meaningful, just about different things.
www.sciencedirect.com/science/arti...
www.sciencedirect.com/science/arti...
Reposted by Samantha Joel
Most folks will find their courage by finding their people.
September 12, 2025 at 4:26 AM
Most folks will find their courage by finding their people.
Reposted by Samantha Joel
I've watched a lot of people find their courage. They usually believed in something, but they also believed in each other. As co-strugglers, they depended on each other. They comforted and encouraged each other. They helped each other. That investment made them stronger, bolder, and more capable.
September 12, 2025 at 4:26 AM
I've watched a lot of people find their courage. They usually believed in something, but they also believed in each other. As co-strugglers, they depended on each other. They comforted and encouraged each other. They helped each other. That investment made them stronger, bolder, and more capable.
Reposted by Samantha Joel
In my experience, courage is usually the product of love and/or solidarity. When we are deeply invested in each other, we are more likely to take risks that we wouldn't take out of mere principle, or for the sake of people we feel disconnected from. Our alienation mass produces cowardice.
September 12, 2025 at 4:23 AM
In my experience, courage is usually the product of love and/or solidarity. When we are deeply invested in each other, we are more likely to take risks that we wouldn't take out of mere principle, or for the sake of people we feel disconnected from. Our alienation mass produces cowardice.
For potential grad students: if you're interested in this kind of work on assessing and improving close relationships measures, our group just got a grant to do five more years of it. Join our team!
In a new paper, my colleagues and I set out to demonstrate how method biases can create spurious findings in relationship science, by using a seemingly meaningless scale (e.g., "My relationship has very good Saturn") to predict relationship outcomes. journals.sagepub.com/doi/10.1177/...
Pseudo Effects: How Method Biases Can Produce Spurious Findings About Close Relationships - Samantha Joel, John K. Sakaluk, James J. Kim, Devinder Khera, Helena Yuchen Qin, Sarah C. E. Stanton, 2025
Research on interpersonal relationships frequently relies on accurate self-reporting across various relationship facets (e.g., conflict, trust, appreciation). Y...
journals.sagepub.com
September 11, 2025 at 3:12 PM
For potential grad students: if you're interested in this kind of work on assessing and improving close relationships measures, our group just got a grant to do five more years of it. Join our team!
Reposted by Samantha Joel
Helena's qualitative work for this was so amazing. Participants summed up sentiment override and their use of global evaluations for us really nicely.
September 11, 2025 at 1:36 AM
Helena's qualitative work for this was so amazing. Participants summed up sentiment override and their use of global evaluations for us really nicely.
Reposted by Samantha Joel
I’ve watched Sam give two talks about this topic (once as a first year grad student which was extremely formative for my research trajectory). Very excited to see this in print!
In a new paper, my colleagues and I set out to demonstrate how method biases can create spurious findings in relationship science, by using a seemingly meaningless scale (e.g., "My relationship has very good Saturn") to predict relationship outcomes. journals.sagepub.com/doi/10.1177/...
Pseudo Effects: How Method Biases Can Produce Spurious Findings About Close Relationships - Samantha Joel, John K. Sakaluk, James J. Kim, Devinder Khera, Helena Yuchen Qin, Sarah C. E. Stanton, 2025
Research on interpersonal relationships frequently relies on accurate self-reporting across various relationship facets (e.g., conflict, trust, appreciation). Y...
journals.sagepub.com
September 11, 2025 at 1:28 AM
I’ve watched Sam give two talks about this topic (once as a first year grad student which was extremely formative for my research trajectory). Very excited to see this in print!
Reposted by Samantha Joel
Did Pseudo measure anything? Well, yes. "Qualitative probing suggested that participants tended to imbue the Pseudo items with relational meaning.”
The provocative questions is where else is this happening? What other psych measures only capture general vibes, not the specific constructs we assume?
The provocative questions is where else is this happening? What other psych measures only capture general vibes, not the specific constructs we assume?
September 10, 2025 at 10:56 PM
Did Pseudo measure anything? Well, yes. "Qualitative probing suggested that participants tended to imbue the Pseudo items with relational meaning.”
The provocative questions is where else is this happening? What other psych measures only capture general vibes, not the specific constructs we assume?
The provocative questions is where else is this happening? What other psych measures only capture general vibes, not the specific constructs we assume?
Reposted by Samantha Joel
The meaningless scale measuring 'pseudo' correlated well with established relationship quality variables.
In other contexts, authors interpret similar correlation matrices as evidence of a Nuanced Construct, without considering it could be spurious.
In other contexts, authors interpret similar correlation matrices as evidence of a Nuanced Construct, without considering it could be spurious.
September 10, 2025 at 10:56 PM
The meaningless scale measuring 'pseudo' correlated well with established relationship quality variables.
In other contexts, authors interpret similar correlation matrices as evidence of a Nuanced Construct, without considering it could be spurious.
In other contexts, authors interpret similar correlation matrices as evidence of a Nuanced Construct, without considering it could be spurious.
Reposted by Samantha Joel
Despite having gibberish items, 'Pseudo' was measured reliably (alpha = .95), had good single factor structure (CFI = .98, RMSEA = .07, SRMR = .02), was prospectively predictive of relationship satisfaction. Hard to argue it's not a 'good' scale.
September 10, 2025 at 10:56 PM
Despite having gibberish items, 'Pseudo' was measured reliably (alpha = .95), had good single factor structure (CFI = .98, RMSEA = .07, SRMR = .02), was prospectively predictive of relationship satisfaction. Hard to argue it's not a 'good' scale.