Bob C-J and Geoff Cumming
@thenewstats.bsky.social
Open science, estimation statistics, and random thoughts from Bob Calin-Jageman and Geoff Cumming. https://thenewstatistics.com/itns/
Pinned
Look what you can find in the latest version of JASP:
**esci**
That's right, all your favorite estimation-focused analyses, strong hypothesis testing, and meta-analysis are available in the esci module for JASP 0.95.
#stats #metascience
Many thanks to the good people at @jaspstats.bsky.social
**esci**
That's right, all your favorite estimation-focused analyses, strong hypothesis testing, and meta-analysis are available in the esci module for JASP 0.95.
#stats #metascience
Many thanks to the good people at @jaspstats.bsky.social
New analysis of statistical (mal)practice in top journals shows widespread problems in how correlations are reported and interpreted.
What is the word I keep reaching for that would mean: not surprised and yet still deeply shocked?
arxiv.org/abs/2511.14092
@nature.com,
@natneuro.nature.com
What is the word I keep reaching for that would mean: not surprised and yet still deeply shocked?
arxiv.org/abs/2511.14092
@nature.com,
@natneuro.nature.com
The Prevalence of Misreporting and Misinterpreting Correlation Coefficients in Biomedical Literature
Correlation coefficient is widely used in biomedical and biological literature, yet its frequent misuse and misinterpretation undermine the credibility and reproducibility of the scientific findings. ...
arxiv.org
November 20, 2025 at 7:27 PM
New analysis of statistical (mal)practice in top journals shows widespread problems in how correlations are reported and interpreted.
What is the word I keep reaching for that would mean: not surprised and yet still deeply shocked?
arxiv.org/abs/2511.14092
@nature.com,
@natneuro.nature.com
What is the word I keep reaching for that would mean: not surprised and yet still deeply shocked?
arxiv.org/abs/2511.14092
@nature.com,
@natneuro.nature.com
Another CREP study out in print: online.ucpress.edu/collabra/art...
Congrats to all the students and dedicated faculty mentors involved, like @aggieerin.bsky.social ky.social and @jorowags.bsky.social
Get your students involved in CREP: www.crep-psych.org!
#stats #psychology
Congrats to all the students and dedicated faculty mentors involved, like @aggieerin.bsky.social ky.social and @jorowags.bsky.social
Get your students involved in CREP: www.crep-psych.org!
#stats #psychology
Collaborative Registered Replication of Griskevicius et al. (2010): Can Pro-environmental Behavior Be Promoted by Priming Status Motivation?
The present study presents the results of a collaborative registered replication of Griskevicius et al. (2010, Experiment 1). As part of the Collaborative Replication and Education Project, 24 student...
online.ucpress.edu
September 18, 2025 at 3:23 PM
Another CREP study out in print: online.ucpress.edu/collabra/art...
Congrats to all the students and dedicated faculty mentors involved, like @aggieerin.bsky.social ky.social and @jorowags.bsky.social
Get your students involved in CREP: www.crep-psych.org!
#stats #psychology
Congrats to all the students and dedicated faculty mentors involved, like @aggieerin.bsky.social ky.social and @jorowags.bsky.social
Get your students involved in CREP: www.crep-psych.org!
#stats #psychology
September 4, 2025 at 12:00 AM
What We’ll Never Know
thenewstatistics.com/itns/2025/09...
Use these to lobby your politicians, not only if you are in the U.S. Suggest further makers of videos: tdw@virginia.edu
thenewstatistics.com/itns/2025/09...
Use these to lobby your politicians, not only if you are in the U.S. Suggest further makers of videos: tdw@virginia.edu
What We’ll Never Know | Introduction to the New Statistics
Message just in from James Pennebaker, President of the APS, about a sadly highly important project by Tim Wilson. Tim is collecting a bunch of short punchy videos on the theme of 'what we'll never kn...
thenewstatistics.com
September 3, 2025 at 11:56 PM
What We’ll Never Know
thenewstatistics.com/itns/2025/09...
Use these to lobby your politicians, not only if you are in the U.S. Suggest further makers of videos: tdw@virginia.edu
thenewstatistics.com/itns/2025/09...
Use these to lobby your politicians, not only if you are in the U.S. Suggest further makers of videos: tdw@virginia.edu
New version of vcmeta (1.5) for R now out: github.com/dgbonett/vcm....
Some new functions and a few name changes.
vcmeta provides all the tools you need for variable-coefficient meta-analysis (no assumption of effect-size homogeneity; probably the best default option?).
#stats
Some new functions and a few name changes.
vcmeta provides all the tools you need for variable-coefficient meta-analysis (no assumption of effect-size homogeneity; probably the best default option?).
#stats
GitHub - dgbonett/vcmeta
Contribute to dgbonett/vcmeta development by creating an account on GitHub.
github.com
August 26, 2025 at 12:28 PM
New version of vcmeta (1.5) for R now out: github.com/dgbonett/vcm....
Some new functions and a few name changes.
vcmeta provides all the tools you need for variable-coefficient meta-analysis (no assumption of effect-size homogeneity; probably the best default option?).
#stats
Some new functions and a few name changes.
vcmeta provides all the tools you need for variable-coefficient meta-analysis (no assumption of effect-size homogeneity; probably the best default option?).
#stats
Cool paper about JASP's raincloud plots with nice examples of how they can be used, especially for complex designs.
I do wish JASP would supplement add to this visualizations of group differences and their uncertainty.
#stats
doi-org.proxy.cc.uic.edu/10.3758/s134...
I do wish JASP would supplement add to this visualizations of group differences and their uncertainty.
#stats
doi-org.proxy.cc.uic.edu/10.3758/s134...
Shibboleth Authentication Request
doi-org.proxy.cc.uic.edu
August 20, 2025 at 2:11 PM
Cool paper about JASP's raincloud plots with nice examples of how they can be used, especially for complex designs.
I do wish JASP would supplement add to this visualizations of group differences and their uncertainty.
#stats
doi-org.proxy.cc.uic.edu/10.3758/s134...
I do wish JASP would supplement add to this visualizations of group differences and their uncertainty.
#stats
doi-org.proxy.cc.uic.edu/10.3758/s134...
Reposted by Bob C-J and Geoff Cumming
"“I ain’t ever bought no prostitutes. I ain’t never raped nobody. I ain’t never paid anybody off. None of that stuff,” said G, a resident from one of the photographed tents.
“He’s much more of a criminal than I am”"
streetsensemedia.org/article/home...
“He’s much more of a criminal than I am”"
streetsensemedia.org/article/home...
Donald Trump threatens to clear encampments in D.C.
With D.C.’s MPD now under federal control and the National Guard coming to D.C., the fate of people in encampments remains up in the air.
streetsensemedia.org
August 12, 2025 at 2:37 PM
"“I ain’t ever bought no prostitutes. I ain’t never raped nobody. I ain’t never paid anybody off. None of that stuff,” said G, a resident from one of the photographed tents.
“He’s much more of a criminal than I am”"
streetsensemedia.org/article/home...
“He’s much more of a criminal than I am”"
streetsensemedia.org/article/home...
Reposted by Bob C-J and Geoff Cumming
Just out: JASP 0.95! With sandboxing, a new plot builder, ESCI, and more.
jasp-stats.org/2025/08/02/i...
jasp-stats.org/2025/08/02/i...
Introducing JASP 0.95: Sandboxing, Plotbuilder, ESCI, Parametric Survival Analysis, and Much More - JASP - Free and User-Friendly Statistical Software
We are proud to announce that JASP 0.95 has been released and is now available on our download page. JASP 0.95 presents a big step forwards, as you can see from the full release notes. Some of the hig...
https://jasp-stats.org/2025/08/02/introducing-jasp-0-95-sandboxing-plotbuilder-esci-parametric-survival-analysis-and-much-more/"
August 2, 2025 at 10:05 AM
Just out: JASP 0.95! With sandboxing, a new plot builder, ESCI, and more.
jasp-stats.org/2025/08/02/i...
jasp-stats.org/2025/08/02/i...
Great new review of forgetting mechanisms in C. elegans -- lots of cool research I had missed (or maybe forgotten about?)
#neuroskyence
www.sciencedirect.com/science/arti...?
#neuroskyence
www.sciencedirect.com/science/arti...?
Investigations of forgetting in Caenorhabditis elegans
The traditional view considered forgetting as a passive process where memory traces gradually fade due to the natural weakening of neural connections.…
www.sciencedirect.com
July 31, 2025 at 12:50 PM
Great new review of forgetting mechanisms in C. elegans -- lots of cool research I had missed (or maybe forgotten about?)
#neuroskyence
www.sciencedirect.com/science/arti...?
#neuroskyence
www.sciencedirect.com/science/arti...?
Here's a nice paper in JCB on why testing for exactly no effect is not a great idea when studying biological systems, and how putting effect sizes at the front of our thinking can help.
Paper is by Josh Morgan at WashU St. Louis.
#stats #neuroskyence
rupress.org/jcb/article/...
Paper is by Josh Morgan at WashU St. Louis.
#stats #neuroskyence
rupress.org/jcb/article/...
Alternative to the statistical mass confusion of testing for “no effect” | Journal of Cell Biology | Rockefeller University Press
Morgan discusses how progress in cell biology is hindered by significance testing and the need for a shift to effect size estimation.
rupress.org
July 31, 2025 at 12:46 PM
Here's a nice paper in JCB on why testing for exactly no effect is not a great idea when studying biological systems, and how putting effect sizes at the front of our thinking can help.
Paper is by Josh Morgan at WashU St. Louis.
#stats #neuroskyence
rupress.org/jcb/article/...
Paper is by Josh Morgan at WashU St. Louis.
#stats #neuroskyence
rupress.org/jcb/article/...
Feel like an excuse to get that travel money for some sun and surf in November? Consider these two back-to-back meetings Down Under. 16-18 and 19-21 November 2025.
researchintegrityconf.com
aimos-inc.github.io/aimos.confer...
researchintegrityconf.com
aimos-inc.github.io/aimos.confer...
July 30, 2025 at 10:51 PM
Feel like an excuse to get that travel money for some sun and surf in November? Consider these two back-to-back meetings Down Under. 16-18 and 19-21 November 2025.
researchintegrityconf.com
aimos-inc.github.io/aimos.confer...
researchintegrityconf.com
aimos-inc.github.io/aimos.confer...
Look what you can find in the latest version of JASP:
**esci**
That's right, all your favorite estimation-focused analyses, strong hypothesis testing, and meta-analysis are available in the esci module for JASP 0.95.
#stats #metascience
Many thanks to the good people at @jaspstats.bsky.social
**esci**
That's right, all your favorite estimation-focused analyses, strong hypothesis testing, and meta-analysis are available in the esci module for JASP 0.95.
#stats #metascience
Many thanks to the good people at @jaspstats.bsky.social
July 29, 2025 at 2:27 AM
Look what you can find in the latest version of JASP:
**esci**
That's right, all your favorite estimation-focused analyses, strong hypothesis testing, and meta-analysis are available in the esci module for JASP 0.95.
#stats #metascience
Many thanks to the good people at @jaspstats.bsky.social
**esci**
That's right, all your favorite estimation-focused analyses, strong hypothesis testing, and meta-analysis are available in the esci module for JASP 0.95.
#stats #metascience
Many thanks to the good people at @jaspstats.bsky.social
Reposted by Bob C-J and Geoff Cumming
New Replication Project in sport and exercise science shares it results: Out of 25 replication studies performed, 56% yielded significant results, but only 7 (28%) revealed a similar effect size. Several problems related to the quality of are discussed.
link.springer.com/article/10.1...
link.springer.com/article/10.1...
Estimating the Replicability of Sports and Exercise Science Research - Sports Medicine
Background The replicability of sports and exercise research has not been assessed previously despite concerns about scientific practices within the field. Aim This study aims to provide an initial es...
link.springer.com
June 16, 2025 at 7:01 PM
New Replication Project in sport and exercise science shares it results: Out of 25 replication studies performed, 56% yielded significant results, but only 7 (28%) revealed a similar effect size. Several problems related to the quality of are discussed.
link.springer.com/article/10.1...
link.springer.com/article/10.1...
What stats software should you teach with?
Here's a super-comprehensive review of GUI-based options from Thomas Langkamp.
The winners (on very reasonable criteria)? JASP and jamovi.
Strongly agree!
osf.io/preprints/ps...
#stats #psychology
@jaspstats.bsky.social
Here's a super-comprehensive review of GUI-based options from Thomas Langkamp.
The winners (on very reasonable criteria)? JASP and jamovi.
Strongly agree!
osf.io/preprints/ps...
#stats #psychology
@jaspstats.bsky.social
OSF
osf.io
June 16, 2025 at 2:38 PM
What stats software should you teach with?
Here's a super-comprehensive review of GUI-based options from Thomas Langkamp.
The winners (on very reasonable criteria)? JASP and jamovi.
Strongly agree!
osf.io/preprints/ps...
#stats #psychology
@jaspstats.bsky.social
Here's a super-comprehensive review of GUI-based options from Thomas Langkamp.
The winners (on very reasonable criteria)? JASP and jamovi.
Strongly agree!
osf.io/preprints/ps...
#stats #psychology
@jaspstats.bsky.social
Reposted by Bob C-J and Geoff Cumming
I love this paper too!
The author, Rick Born, is part of the @comm4rigor.bsky.social which is developing educational units on topics like confirmation bias!
For anyone interested in learning more, check out the beta form of the unit at c4r.io (and give us feedback so we can keep improving it)!
The author, Rick Born, is part of the @comm4rigor.bsky.social which is developing educational units on topics like confirmation bias!
For anyone interested in learning more, check out the beta form of the unit at c4r.io (and give us feedback so we can keep improving it)!
In the genre of thinking about bias, I like this recent paper in neuro alot. What I prefer about this is the framing of worrying about bias generally (inflating or diminishing), not just emphasizing a certain direction (diminishing).
www.eneuro.org/content/11/1...
www.eneuro.org/content/11/1...
Stop Fooling Yourself! (Diagnosing and Treating Confirmation Bias)
Confirmation bias (CB) is a cognitive bias that allows us to fool ourselves by selectively filtering data and distorting analyses to support favored beliefs or hypotheses. In this article, I will brie...
www.eneuro.org
June 13, 2025 at 1:37 PM
I love this paper too!
The author, Rick Born, is part of the @comm4rigor.bsky.social which is developing educational units on topics like confirmation bias!
For anyone interested in learning more, check out the beta form of the unit at c4r.io (and give us feedback so we can keep improving it)!
The author, Rick Born, is part of the @comm4rigor.bsky.social which is developing educational units on topics like confirmation bias!
For anyone interested in learning more, check out the beta form of the unit at c4r.io (and give us feedback so we can keep improving it)!
Here's a fascinating paper on the interpretation of novel object recognition tests: scores can reflect changes in novelty-preference, not just memory performance!
A nice reminder of the "neglected factors" in doing fruitful science.
#neuroskyence #stats
www.sciencedirect.com/science/arti...
A nice reminder of the "neglected factors" in doing fruitful science.
#neuroskyence #stats
www.sciencedirect.com/science/arti...
The curious interpretation of novel object recognition tests
Novel object recognition tasks are commonly used to assess memory in rodents. These tests rely on an innate preference for exploring objects that are …
www.sciencedirect.com
June 12, 2025 at 2:43 PM
Here's a fascinating paper on the interpretation of novel object recognition tests: scores can reflect changes in novelty-preference, not just memory performance!
A nice reminder of the "neglected factors" in doing fruitful science.
#neuroskyence #stats
www.sciencedirect.com/science/arti...
A nice reminder of the "neglected factors" in doing fruitful science.
#neuroskyence #stats
www.sciencedirect.com/science/arti...
A depressing evaluation of RCT quality for working memory interventions:
"In our sample, only an average of 11.9 out of 45 CONSORT items were fully reported per article.. 36 RCTs were deemed high risk for bias, 10 had some concerns, and 1 was rated as low risk."
tinyurl.com/5647mu99
#stats
"In our sample, only an average of 11.9 out of 45 CONSORT items were fully reported per article.. 36 RCTs were deemed high risk for bias, 10 had some concerns, and 1 was rated as low risk."
tinyurl.com/5647mu99
#stats
Can Research Findings be Used in Clinical Neuropsychology? Analysis of Randomized Controlled Trials of Working Memory Intervention for Children
AbstractObjective. Working memory difficulties are prevalent in children with cognitive disorders, affecting their academic performance and quality of life
academic.oup.com
June 10, 2025 at 1:47 PM
A depressing evaluation of RCT quality for working memory interventions:
"In our sample, only an average of 11.9 out of 45 CONSORT items were fully reported per article.. 36 RCTs were deemed high risk for bias, 10 had some concerns, and 1 was rated as low risk."
tinyurl.com/5647mu99
#stats
"In our sample, only an average of 11.9 out of 45 CONSORT items were fully reported per article.. 36 RCTs were deemed high risk for bias, 10 had some concerns, and 1 was rated as low risk."
tinyurl.com/5647mu99
#stats
Reposted by Bob C-J and Geoff Cumming
We developed CrossFilt, a read-level, cross-species filtering approach that avoids these errors without sacrificing usable data. It outperforms all existing strategies and exposes just how much signal in comparative genomics has been misread.
doi.org/10.1101/2025...
doi.org/10.1101/2025...
CrossFilt: A Cross-species Filtering Tool that Eliminates Alignment Bias in Comparative Genomics Studies
Comparative functional genomic studies are often affected by biased read mapping across species due to inter-species differences in genome structure, sequence composition, and annotation quality. We d...
doi.org
June 7, 2025 at 12:07 AM
We developed CrossFilt, a read-level, cross-species filtering approach that avoids these errors without sacrificing usable data. It outperforms all existing strategies and exposes just how much signal in comparative genomics has been misread.
doi.org/10.1101/2025...
doi.org/10.1101/2025...
The replication crisis is one of the bad faith justifications for wrecking US science.
Fighting antisemitism is one of the bad faith justifications for wrecking US academia.
I have no regrets for my efforts towards both these worthy causes.
#metascience
Fighting antisemitism is one of the bad faith justifications for wrecking US academia.
I have no regrets for my efforts towards both these worthy causes.
#metascience
May 27, 2025 at 3:16 AM
The replication crisis is one of the bad faith justifications for wrecking US science.
Fighting antisemitism is one of the bad faith justifications for wrecking US academia.
I have no regrets for my efforts towards both these worthy causes.
#metascience
Fighting antisemitism is one of the bad faith justifications for wrecking US academia.
I have no regrets for my efforts towards both these worthy causes.
#metascience
Are these points useful? How can a researcher tell the right environment to use? The right appearance? Can they know with much certainty?
If all these factors matter, should every conclusion be: in this type of room, with this researcher demeanor, clothing, and attractiveness?
If all these factors matter, should every conclusion be: in this type of room, with this researcher demeanor, clothing, and attractiveness?
Very useful set of guidelines for conducting social psychology lab experiments by @eddiehj.bsky.social, @davidamodio.bsky.social, and colleagues.
Preprint: doi.org/10.31234/osf...
Few quotes follow…
Preprint: doi.org/10.31234/osf...
Few quotes follow…
May 15, 2025 at 11:34 AM
Are these points useful? How can a researcher tell the right environment to use? The right appearance? Can they know with much certainty?
If all these factors matter, should every conclusion be: in this type of room, with this researcher demeanor, clothing, and attractiveness?
If all these factors matter, should every conclusion be: in this type of room, with this researcher demeanor, clothing, and attractiveness?
It’s the end of the world as we know it, part 1000:
AIs do about as well as medical students on neuroscience exams for med students (multiple choice).
It was lovely teaching while it lasted :-(
journals.physiology.org/doi/full/10....
AIs do about as well as medical students on neuroscience exams for med students (multiple choice).
It was lovely teaching while it lasted :-(
journals.physiology.org/doi/full/10....
Claude, ChatGPT, Copilot, and Gemini performance versus students in different topics of neuroscience | Advances in Physiology Education | American Physiological Society
Despite extensive studies on large language models and their capability to respond to questions from various licensed exams, there has been limited focus on employing chatbots for specific subjects wi...
journals.physiology.org
May 15, 2025 at 11:25 AM
It’s the end of the world as we know it, part 1000:
AIs do about as well as medical students on neuroscience exams for med students (multiple choice).
It was lovely teaching while it lasted :-(
journals.physiology.org/doi/full/10....
AIs do about as well as medical students on neuroscience exams for med students (multiple choice).
It was lovely teaching while it lasted :-(
journals.physiology.org/doi/full/10....
Reposted by Bob C-J and Geoff Cumming
If you design a study to test a prediction, you need to be able to falsify it. In frequentist statistics this is achieved through an equivalence test. You can't have an informative test if you can't prove yourself wrong. You need to learn about equivalence testing.
lakens.github.io/statistical_...
lakens.github.io/statistical_...
Improving Your Statistical Inferences - 9 Equivalence Testing and Interval Hypotheses
This open educational resource contains information to improve statistical inferences, design better experiments, and report scientific research more transparently.
lakens.github.io
May 14, 2025 at 3:20 AM
If you design a study to test a prediction, you need to be able to falsify it. In frequentist statistics this is achieved through an equivalence test. You can't have an informative test if you can't prove yourself wrong. You need to learn about equivalence testing.
lakens.github.io/statistical_...
lakens.github.io/statistical_...
Cool new findings in Aplysia from the lab of Riccardo Mozzachiodi, showing that sensitization is a complex system of responses: it can produce both increased reflexes and decreased feeding, but these are differently sensitive to stimulation pattern and time of training.
doi.org/10.1016/j.ph...
doi.org/10.1016/j.ph...
Redirecting
doi.org
May 8, 2025 at 4:06 PM
Cool new findings in Aplysia from the lab of Riccardo Mozzachiodi, showing that sensitization is a complex system of responses: it can produce both increased reflexes and decreased feeding, but these are differently sensitive to stimulation pattern and time of training.
doi.org/10.1016/j.ph...
doi.org/10.1016/j.ph...
This is really important: these grants have been stolen, not cancelled. It f-ing theft.
Side note, I think it is important to consistently refer to these grant cancellations as illegal. They straightforwardly are, and are currently being challenged in courts by @aaup.bsky.social and @aclu.org. Many should likely be restored if the law works.
bsky.app/profile/aaup...
bsky.app/profile/aaup...
May 7, 2025 at 1:03 AM
This is really important: these grants have been stolen, not cancelled. It f-ing theft.
Here's an interesting editorial on factors that can influence replication failures: psycnet.apa.org/fulltext/202...
@eddiehj.bsky.social
There are lots of nice points here, but also some big issues lurking under the surface, I think.
#stats #metascience
@eddiehj.bsky.social
There are lots of nice points here, but also some big issues lurking under the surface, I think.
#stats #metascience
APA PsycNet
psycnet.apa.org
May 6, 2025 at 3:45 PM
Here's an interesting editorial on factors that can influence replication failures: psycnet.apa.org/fulltext/202...
@eddiehj.bsky.social
There are lots of nice points here, but also some big issues lurking under the surface, I think.
#stats #metascience
@eddiehj.bsky.social
There are lots of nice points here, but also some big issues lurking under the surface, I think.
#stats #metascience