Felix Thoemmes
@felixthoemmes.bsky.social
Reposted by Felix Thoemmes
File systems, object stores, and databases - oh my! russpoldrack.substack.com/p/storing-re... The latest in my Better Code, Better Science series
Storing research data
Better Code, Better Science: Chapter 7, Part 2
russpoldrack.substack.com
December 23, 2025 at 3:02 PM
File systems, object stores, and databases - oh my! russpoldrack.substack.com/p/storing-re... The latest in my Better Code, Better Science series
Reposted by Felix Thoemmes
This was a fantastic policy—we need more like this in other cities.
Many people defended the status quo, but then liked the policy a lot once it was implemented.
There was far too many policies like this—held up because people can’t imagine an alternative.
Many people defended the status quo, but then liked the policy a lot once it was implemented.
There was far too many policies like this—held up because people can’t imagine an alternative.
Year 1 data on congestion pricing in Manhattan…
* Vehicle traffic: -11%
* Foot traffic: +3.4%
* Storefront vacancy: -0.9%
* Pollution: -22%
* Revenue for mass transit: $548M
So YES this has been a huge success.
* Vehicle traffic: -11%
* Foot traffic: +3.4%
* Storefront vacancy: -0.9%
* Pollution: -22%
* Revenue for mass transit: $548M
So YES this has been a huge success.
December 23, 2025 at 4:24 PM
This was a fantastic policy—we need more like this in other cities.
Many people defended the status quo, but then liked the policy a lot once it was implemented.
There was far too many policies like this—held up because people can’t imagine an alternative.
Many people defended the status quo, but then liked the policy a lot once it was implemented.
There was far too many policies like this—held up because people can’t imagine an alternative.
Reposted by Felix Thoemmes
> We archived around 86M music files, representing around 99.6% of listens. It’s a little under 300TB. This is the largest music metadata database that is publicly available.
Many interesting 📊 charts on this page that can only be made by having this scale of data.
annas-archive.li/blog/backing...
Many interesting 📊 charts on this page that can only be made by having this scale of data.
annas-archive.li/blog/backing...
December 21, 2025 at 11:05 AM
> We archived around 86M music files, representing around 99.6% of listens. It’s a little under 300TB. This is the largest music metadata database that is publicly available.
Many interesting 📊 charts on this page that can only be made by having this scale of data.
annas-archive.li/blog/backing...
Many interesting 📊 charts on this page that can only be made by having this scale of data.
annas-archive.li/blog/backing...
Reposted by Felix Thoemmes
A propos of some stuff, a brief thread on randomized experiments. 👇
We like randomization as it provides us with a powerful way to solve a big problem: identification.
Identification should not - cannot - precede other parts of the research process: theory, conceptualization, operationalization.
We like randomization as it provides us with a powerful way to solve a big problem: identification.
Identification should not - cannot - precede other parts of the research process: theory, conceptualization, operationalization.
December 21, 2025 at 1:50 PM
A propos of some stuff, a brief thread on randomized experiments. 👇
We like randomization as it provides us with a powerful way to solve a big problem: identification.
Identification should not - cannot - precede other parts of the research process: theory, conceptualization, operationalization.
We like randomization as it provides us with a powerful way to solve a big problem: identification.
Identification should not - cannot - precede other parts of the research process: theory, conceptualization, operationalization.
Reposted by Felix Thoemmes
I also want to share some resources that were created for the community based on AMPPS papers. First, there is a new article out in the APS Observer that puts together 9 practical guides for research methods including papers and tutorials www.psychologicalscience.org/publications...
Nine Practical Guides to Support Your Research in 2026
The Observer has compiled a list of 2025 guides, tutorials, and manuals designed to support psychological scientists as they expand their toolboxes of research practices and methods.
www.psychologicalscience.org
December 18, 2025 at 3:42 PM
I also want to share some resources that were created for the community based on AMPPS papers. First, there is a new article out in the APS Observer that puts together 9 practical guides for research methods including papers and tutorials www.psychologicalscience.org/publications...
Reposted by Felix Thoemmes
Some days ago a student struggling with her master’s thesis e-mailed me, asking me about partial least squares structural equation modeling. I told her I can only tell her not to do that, and then she sent more details.>
December 20, 2025 at 6:28 PM
Some days ago a student struggling with her master’s thesis e-mailed me, asking me about partial least squares structural equation modeling. I told her I can only tell her not to do that, and then she sent more details.>
Reposted by Felix Thoemmes
AMPPS recently accepted a new paper "Registered Replication Report: Johns, Schmader, & Martens (2005)" on stereotype threat (osf.io/preprints/ps...); full paper is forthcoming on our website). AMPPS is now soliciting Commentary articles on this paper. @psychscience.bsky.social /cont
OSF
osf.io
December 20, 2025 at 5:38 PM
AMPPS recently accepted a new paper "Registered Replication Report: Johns, Schmader, & Martens (2005)" on stereotype threat (osf.io/preprints/ps...); full paper is forthcoming on our website). AMPPS is now soliciting Commentary articles on this paper. @psychscience.bsky.social /cont
Reposted by Felix Thoemmes
Here's the link to our ever-expanding Collections! journals.sagepub.com/collection-i...
Advances in Methods and Practices in Psychological Science: Special collections
Subscription and open access journals from Sage, the world's leading independent academic publisher.
journals.sagepub.com
December 20, 2025 at 5:41 PM
Here's the link to our ever-expanding Collections! journals.sagepub.com/collection-i...
Reposted by Felix Thoemmes
Wake up babe, Applied Causal Graphs workshop just got announced.
I attended the previous versions of this event which were absolutely *fantastic.* It's the place to be for all causal graph connoisseurs!
I attended the previous versions of this event which were absolutely *fantastic.* It's the place to be for all causal graph connoisseurs!
December 19, 2025 at 7:59 AM
Wake up babe, Applied Causal Graphs workshop just got announced.
I attended the previous versions of this event which were absolutely *fantastic.* It's the place to be for all causal graph connoisseurs!
I attended the previous versions of this event which were absolutely *fantastic.* It's the place to be for all causal graph connoisseurs!
Reposted by Felix Thoemmes
All I want for Christmas is... published nonsignificant findings and more Registered Reports?
www.psychologicalscience.org/publications...
www.psychologicalscience.org/publications...
Are Psychological Scientists Overvaluing Significance?
Some scientists are hesitant to submit nonsignificant results to journals, citing reputation as a major factor.
www.psychologicalscience.org
December 19, 2025 at 7:09 PM
All I want for Christmas is... published nonsignificant findings and more Registered Reports?
www.psychologicalscience.org/publications...
www.psychologicalscience.org/publications...
Reposted by Felix Thoemmes
The package formerly known as papercheck has changed its name to metacheck! We're checking more than just papers, with functions to assess OSF projects, github repos, and AsPredicted pre-registrations, with more being developed all the time.
scienceverse.github.io/metacheck/
scienceverse.github.io/metacheck/
Check Research Outputs for Best Practices
A modular, extendable system for automatically checking research outputs for best practices using text search, R code, and/or (optional) LLM queries.
scienceverse.github.io
November 3, 2025 at 4:20 PM
The package formerly known as papercheck has changed its name to metacheck! We're checking more than just papers, with functions to assess OSF projects, github repos, and AsPredicted pre-registrations, with more being developed all the time.
scienceverse.github.io/metacheck/
scienceverse.github.io/metacheck/
Reposted by Felix Thoemmes
Finally, @bjoernhommel.bsky.social's and my paper introducing the SurveyBot3000 is officially out in AMPPS. It's a fine-tuned language model that guesstimates correlations between survey items from text alone. Not perfectly, but useful for search, for example.
journals.sagepub.com/doi/10.1177/...
journals.sagepub.com/doi/10.1177/...
December 18, 2025 at 8:21 PM
Finally, @bjoernhommel.bsky.social's and my paper introducing the SurveyBot3000 is officially out in AMPPS. It's a fine-tuned language model that guesstimates correlations between survey items from text alone. Not perfectly, but useful for search, for example.
journals.sagepub.com/doi/10.1177/...
journals.sagepub.com/doi/10.1177/...
Reposted by Felix Thoemmes
🚨 New paper alert 🚨 Using LLMs as data annotators, you can produce any scientific result you want. We call this **LLM Hacking**.
Paper: arxiv.org/pdf/2509.08825
Paper: arxiv.org/pdf/2509.08825
September 12, 2025 at 10:33 AM
🚨 New paper alert 🚨 Using LLMs as data annotators, you can produce any scientific result you want. We call this **LLM Hacking**.
Paper: arxiv.org/pdf/2509.08825
Paper: arxiv.org/pdf/2509.08825
Reposted by Felix Thoemmes
What should psychology journals do about this? What’s a reasonable policy/standard to apply to research using online data collection methods?
We need better ways to tell computers and humans apart
Article: The potential existential threat of large language models to online survey research
www.pnas.org/doi/10.1073/...
Article: The potential existential threat of large language models to online survey research
www.pnas.org/doi/10.1073/...
December 18, 2025 at 11:58 PM
What should psychology journals do about this? What’s a reasonable policy/standard to apply to research using online data collection methods?
Reposted by Felix Thoemmes
Just gave my last talk of the year!
2025 was quite packed, I gave talks about:
- the age-period-cohort problem
- making rigorous causal inference more mainstream
- mediation analysis
- marginaleffects
- causal graphs (x10)
If you're curious, check out my slides here: juliarohrer.com/resources/
2025 was quite packed, I gave talks about:
- the age-period-cohort problem
- making rigorous causal inference more mainstream
- mediation analysis
- marginaleffects
- causal graphs (x10)
If you're curious, check out my slides here: juliarohrer.com/resources/
Resources
Here you can find a collection of things that may be helpful, including slide decks, a curated list of introductory papers and blog posts, as well as some infographics I have generated to explain v…
juliarohrer.com
December 18, 2025 at 12:38 PM
Just gave my last talk of the year!
2025 was quite packed, I gave talks about:
- the age-period-cohort problem
- making rigorous causal inference more mainstream
- mediation analysis
- marginaleffects
- causal graphs (x10)
If you're curious, check out my slides here: juliarohrer.com/resources/
2025 was quite packed, I gave talks about:
- the age-period-cohort problem
- making rigorous causal inference more mainstream
- mediation analysis
- marginaleffects
- causal graphs (x10)
If you're curious, check out my slides here: juliarohrer.com/resources/
Reposted by Felix Thoemmes
Ultimately, it may have taken several papers and much back-and-forth to come to a similar conclusion. And, most likely, we might never have come to a genuine agreement if we had not engaged in this adversarial collaboration together. I think it's a great approach to science!
December 17, 2025 at 5:17 PM
Ultimately, it may have taken several papers and much back-and-forth to come to a similar conclusion. And, most likely, we might never have come to a genuine agreement if we had not engaged in this adversarial collaboration together. I think it's a great approach to science!
Reposted by Felix Thoemmes
🚨 Now out in Psych Science 🚨
We report an adversarial collaboration (with @donandrewmoore.bsky.social) testing whether overconfidence is genuinely a trait
The paper was led by Jabin Binnendyk & Sophia Li (who is fantastic and on the job market!) Free copy here: journals.sagepub.com/eprint/7JIYS...
We report an adversarial collaboration (with @donandrewmoore.bsky.social) testing whether overconfidence is genuinely a trait
The paper was led by Jabin Binnendyk & Sophia Li (who is fantastic and on the job market!) Free copy here: journals.sagepub.com/eprint/7JIYS...
December 17, 2025 at 5:17 PM
🚨 Now out in Psych Science 🚨
We report an adversarial collaboration (with @donandrewmoore.bsky.social) testing whether overconfidence is genuinely a trait
The paper was led by Jabin Binnendyk & Sophia Li (who is fantastic and on the job market!) Free copy here: journals.sagepub.com/eprint/7JIYS...
We report an adversarial collaboration (with @donandrewmoore.bsky.social) testing whether overconfidence is genuinely a trait
The paper was led by Jabin Binnendyk & Sophia Li (who is fantastic and on the job market!) Free copy here: journals.sagepub.com/eprint/7JIYS...
Reposted by Felix Thoemmes
Dana-Farber Cancer Institute has settled a lawsuit filed under the False Claims Act, admitting researchers used images and data that were “misrepresented and/or duplicated." As part of the agreement, @sholtodavid.bsky.social will receive $2.63 million, or 17.5 percent of the $15 million settlement.
Dana-Farber settles suit alleging image manipulation for $15 million
Dana-Farber Cancer Institute has settled a lawsuit filed under the False Claims Act, admitting researchers used images and data that were “misrepresented and/or duplicated” in support of grant appl…
retractionwatch.com
December 17, 2025 at 1:22 AM
Dana-Farber Cancer Institute has settled a lawsuit filed under the False Claims Act, admitting researchers used images and data that were “misrepresented and/or duplicated." As part of the agreement, @sholtodavid.bsky.social will receive $2.63 million, or 17.5 percent of the $15 million settlement.
Reposted by Felix Thoemmes
You remember that Nature Aging paper about how multilingualism protects against accelerated aging? Well…
December 17, 2025 at 7:15 AM
You remember that Nature Aging paper about how multilingualism protects against accelerated aging? Well…
Reposted by Felix Thoemmes
Thanks @janhove.bsky.social for taking the time to check the paper — something that paid editors at Nature, as well as unpaid reviewers — apparently did not.
Also shows once more that providing statistical code should be mandatory for every single paper.
janhove.github.io/posts/2025-1...
Also shows once more that providing statistical code should be mandatory for every single paper.
janhove.github.io/posts/2025-1...
Jan Vanhove :: Blog - Does multilingualism really protect against accelerated ageing? Some critical comments
janhove.github.io
December 17, 2025 at 10:28 AM
Thanks @janhove.bsky.social for taking the time to check the paper — something that paid editors at Nature, as well as unpaid reviewers — apparently did not.
Also shows once more that providing statistical code should be mandatory for every single paper.
janhove.github.io/posts/2025-1...
Also shows once more that providing statistical code should be mandatory for every single paper.
janhove.github.io/posts/2025-1...
Reposted by Felix Thoemmes
The Department of Psychology @uzh-ch.bsky.social has an open position for a tenured Lecturer (Research) «Psychological Data Management and -Stewardship»
jobs.uzh.ch/job-vacancie...
#psychjobs
jobs.uzh.ch/job-vacancie...
#psychjobs
UZH: Lecturer Research «Psychological Data Management and -Stewardship»
The Department of Psychology at the University of Zurich invites applications for a tenured Lecturer Research position for «Psychological Data Management and -Stewardship». We are seeking an enthusias...
jobs.uzh.ch
December 15, 2025 at 11:39 AM
The Department of Psychology @uzh-ch.bsky.social has an open position for a tenured Lecturer (Research) «Psychological Data Management and -Stewardship»
jobs.uzh.ch/job-vacancie...
#psychjobs
jobs.uzh.ch/job-vacancie...
#psychjobs
Reposted by Felix Thoemmes
Hanging out with William James at the @psychscience.bsky.social office. Lots of discussion of new ways forward for APS. Let me know in comments what would keep or make you a member in the future.
December 14, 2025 at 6:32 PM
Hanging out with William James at the @psychscience.bsky.social office. Lots of discussion of new ways forward for APS. Let me know in comments what would keep or make you a member in the future.
Reposted by Felix Thoemmes
“Dutch people cycle an average of 2.6km each per day. If this pattern was replicated worldwide, annual carbon emissions would drop by 686 million tonnes.
This mammoth figure exceeds the entire carbon footprint of most countries, including the UK, Canada, Saudi Arabia and Australia.” @euronews.com
This mammoth figure exceeds the entire carbon footprint of most countries, including the UK, Canada, Saudi Arabia and Australia.” @euronews.com
Cycling like the Dutch would slash the world’s carbon footprint
If everybody cycled like the Dutch, we could offset the UK or Australia’s entire carbon footprint.
www.euronews.com
December 13, 2025 at 10:01 PM
“Dutch people cycle an average of 2.6km each per day. If this pattern was replicated worldwide, annual carbon emissions would drop by 686 million tonnes.
This mammoth figure exceeds the entire carbon footprint of most countries, including the UK, Canada, Saudi Arabia and Australia.” @euronews.com
This mammoth figure exceeds the entire carbon footprint of most countries, including the UK, Canada, Saudi Arabia and Australia.” @euronews.com
Reposted by Felix Thoemmes
Call for papers: Emotion special issue on Affect Dynamics Across Multiple Timescales (moments→days→years) and links to mental and physical health. Letters of intent due Jan 15, 2026. Details/submission:
www.apa.org/pubs/journal...
Please share with colleagues/trainees. @affectscience.bsky.social
www.apa.org/pubs/journal...
Please share with colleagues/trainees. @affectscience.bsky.social
www.apa.org
December 13, 2025 at 3:24 PM
Call for papers: Emotion special issue on Affect Dynamics Across Multiple Timescales (moments→days→years) and links to mental and physical health. Letters of intent due Jan 15, 2026. Details/submission:
www.apa.org/pubs/journal...
Please share with colleagues/trainees. @affectscience.bsky.social
www.apa.org/pubs/journal...
Please share with colleagues/trainees. @affectscience.bsky.social
Reposted by Felix Thoemmes
Keeping this at hand in case I need to point to it and tap
December 12, 2025 at 4:39 PM
Keeping this at hand in case I need to point to it and tap