James Steele
@jamessteeleii.bsky.social
I'm just a guy who's an academic for fun
Pinned
James Steele
@jamessteeleii.bsky.social
· Sep 30
Excited to have now started new role as Head of Research with Macrofactor (macrofactorapp.com). Looking forward to getting stuck into some really cool projects and getting that out to all the users!
Reposted by James Steele
Two-group pre/post data are deceptively simple, and you could analyze them in many different ways, depending on your goals. Here are three blog posts on the topic:
solomonkurz.netlify.app/blog/2022-06...
solomonkurz.netlify.app/blog/2020-12...
solomonkurz.netlify.app/blog/2023-06...
solomonkurz.netlify.app/blog/2022-06...
solomonkurz.netlify.app/blog/2020-12...
solomonkurz.netlify.app/blog/2023-06...
November 10, 2025 at 7:19 PM
Two-group pre/post data are deceptively simple, and you could analyze them in many different ways, depending on your goals. Here are three blog posts on the topic:
solomonkurz.netlify.app/blog/2022-06...
solomonkurz.netlify.app/blog/2020-12...
solomonkurz.netlify.app/blog/2023-06...
solomonkurz.netlify.app/blog/2022-06...
solomonkurz.netlify.app/blog/2020-12...
solomonkurz.netlify.app/blog/2023-06...
Goddamit, my stiches itch... wait a minute! St-itch-es 🤔
November 10, 2025 at 8:44 AM
Goddamit, my stiches itch... wait a minute! St-itch-es 🤔
Anyone have a copy of the following (pic because citation too long for character limit, also see alt text).
November 10, 2025 at 8:38 AM
Anyone have a copy of the following (pic because citation too long for character limit, also see alt text).
I've made the decision to step down from all editorial positions at journals. Mostly due to shifting personal and professional situation, priorities, and wanting to avoid the psychological burden of obligation such formal roles tend to bring me...
November 9, 2025 at 2:06 PM
I've made the decision to step down from all editorial positions at journals. Mostly due to shifting personal and professional situation, priorities, and wanting to avoid the psychological burden of obligation such formal roles tend to bring me...
Reposted by James Steele
New 'Preliminary Report' submission format at Science and Medicine in Football. An idea that should be interesting for other journals! Explicitly make space for honestly reported smaller sample-size studies www.tandfonline.com/doi/full/10....
November 6, 2025 at 2:40 PM
New 'Preliminary Report' submission format at Science and Medicine in Football. An idea that should be interesting for other journals! Explicitly make space for honestly reported smaller sample-size studies www.tandfonline.com/doi/full/10....
Ah man, just got reminded about that methods paper on Item Response Theory for measurement of sporting abilities that I had on my to do list to write a few years back and never got round to.
We did some initial work with Elite Skills Arena and presented the results at the BASES conference in 2022.
We did some initial work with Elite Skills Arena and presented the results at the BASES conference in 2022.
(PDF) Measurement of sporting abilities using item response theory: an introduction and example using passing ability in soccer
PDF | Measurement of performance in sport has historically followed operationist tendencies and applications of Classical Test Theory (i.e., true score... | Find, read and cite all the research you ne...
doi.org
November 5, 2025 at 11:12 AM
Ah man, just got reminded about that methods paper on Item Response Theory for measurement of sporting abilities that I had on my to do list to write a few years back and never got round to.
We did some initial work with Elite Skills Arena and presented the results at the BASES conference in 2022.
We did some initial work with Elite Skills Arena and presented the results at the BASES conference in 2022.
Honestly, the film was soo good... watched twice in the cinema and if it was still on here in the UK I would go watch again in a heartbeat #chainsawman #rezearc
劇場版『チェンソーマン レゼ篇』オープニングムービー 主題歌：米津玄師「IRIS OUT」“Chainsaw Man – The Movie: Reze Arc” – Opening Movie
YouTube video by Kenshi Yonezu 米津玄師
www.youtube.com
November 4, 2025 at 2:03 PM
Honestly, the film was soo good... watched twice in the cinema and if it was still on here in the UK I would go watch again in a heartbeat #chainsawman #rezearc
Reposted by James Steele
The package formerly known as papercheck has changed its name to metacheck! We're checking more than just papers, with functions to assess OSF projects, github repos, and AsPredicted pre-registrations, with more being developed all the time.
scienceverse.github.io/metacheck/
scienceverse.github.io/metacheck/
Check Research Outputs for Best Practices
A modular, extendable system for automatically checking research outputs for best practices using text search, R code, and/or (optional) LLM queries.
scienceverse.github.io
November 3, 2025 at 4:20 PM
The package formerly known as papercheck has changed its name to metacheck! We're checking more than just papers, with functions to assess OSF projects, github repos, and AsPredicted pre-registrations, with more being developed all the time.
scienceverse.github.io/metacheck/
scienceverse.github.io/metacheck/
My old role at Kieser Australia has now been advertised.
employmenthero.com/jobs/positio...
employmenthero.com/jobs/positio...
Head Of Research
Head Office (NCS) • South Melbourne, Victoria 3205, Australia • Full-time. Apply now and secure your next job today!
employmenthero.com
November 2, 2025 at 3:37 PM
My old role at Kieser Australia has now been advertised.
employmenthero.com/jobs/positio...
employmenthero.com/jobs/positio...
Reposted by James Steele
How to ensure your research data is error-free & understandable by other users & your future self?🗂️ This tutorial by LMU OSC is on documenting & validating data in R to make it more reusable.
Self-Paced Tutorial of the Day: Data Documentation & Validation using R📑 lmu-osc.github.io/data-documen...
Self-Paced Tutorial of the Day: Data Documentation & Validation using R📑 lmu-osc.github.io/data-documen...
lmu-osc.github.io
October 31, 2025 at 11:00 AM
How to ensure your research data is error-free & understandable by other users & your future self?🗂️ This tutorial by LMU OSC is on documenting & validating data in R to make it more reusable.
Self-Paced Tutorial of the Day: Data Documentation & Validation using R📑 lmu-osc.github.io/data-documen...
Self-Paced Tutorial of the Day: Data Documentation & Validation using R📑 lmu-osc.github.io/data-documen...
Reposted by James Steele
There still seems to be a lot of confusion about significance testing in psych. No, p-values *don’t* become useless at large N. This flawed point also used to be framed as "too much power". But power isn't the problem – it's 1) unbalanced error rates and 2) the (lack of a) SESOI. 1/ >
But here's, the thing, p values and significance become useless at such large sample sizes. When you're dividing the coefficient by the SE and the sample size is in the tens of thousands, EVERYTHING IS SIGNIFICANT. All you're testing is whether the coefficient is different than zero.
October 31, 2025 at 8:13 AM
There still seems to be a lot of confusion about significance testing in psych. No, p-values *don’t* become useless at large N. This flawed point also used to be framed as "too much power". But power isn't the problem – it's 1) unbalanced error rates and 2) the (lack of a) SESOI. 1/ >
Reposted by James Steele
New Commentary published in the German Journal for Sport and Exercise Research, emphasizing not only the need to specify a SESOI when testing a claim, but recommending also to start a discussion about best practices to determine a SESOI
link.springer.com/article/10.1...
From best practices to severe testing: A methodological response to Büsch and Loffing (2024) - German Journal of Exercise and Sport Research
This commentary builds on the Büsch and Loffing (2024) exploration of methodological best practices for validly evaluating intervention studies. Extending their perspective, it is argued that research...
link.springer.com
October 30, 2025 at 9:43 PM
New Commentary published in the German Journal for Sport and Exercise Research, emphasizing not only the need to specify a SESOI when testing a claim, but recommending also to start a discussion about best practices to determine a SESOI
link.springer.com/article/10.1...
Reposted by James Steele
Which reminds me of this old classic on the Noise Miners.
“'Noise mining is a funny thing,' he said. 'When you first see a bit of noise, it doesn’t look so impressive. But as you work it out of the rock, it gets more and more refined.' This process, he explained, is called 'shucking.'"
“'Noise mining is a funny thing,' he said. 'When you first see a bit of noise, it doesn’t look so impressive. But as you work it out of the rock, it gets more and more refined.' This process, he explained, is called 'shucking.'"
October 30, 2025 at 9:24 AM
Which reminds me of this old classic on the Noise Miners.
“'Noise mining is a funny thing,' he said. 'When you first see a bit of noise, it doesn’t look so impressive. But as you work it out of the rock, it gets more and more refined.' This process, he explained, is called 'shucking.'"
“'Noise mining is a funny thing,' he said. 'When you first see a bit of noise, it doesn’t look so impressive. But as you work it out of the rock, it gets more and more refined.' This process, he explained, is called 'shucking.'"
Note to folks getting into meta-analysis... when extracting data from studies extract it EXACTLY as reported by the authors. Don't do any calculations outside of analysis scripts. This means have a column for units, mean/median/SD/SE/IQR/lower range/upper range or whatever else you might need...
October 29, 2025 at 4:13 PM
Note to folks getting into meta-analysis... when extracting data from studies extract it EXACTLY as reported by the authors. Don't do any calculations outside of analysis scripts. This means have a column for units, mean/median/SD/SE/IQR/lower range/upper range or whatever else you might need...
Reposted by James Steele
New release of PowerLMM.js! Browser-based power analysis for longitudinal models with dropout.
Now includes:
- Power analysis summary report
- Reproducible & shareable configs (URL/JSON)
- Calculations validated against R
- Hypothesis region visualization
powerlmmjs.rpsychologist.com
Now includes:
- Power analysis summary report
- Reproducible & shareable configs (URL/JSON)
- Calculations validated against R
- Hypothesis region visualization
powerlmmjs.rpsychologist.com
October 28, 2025 at 2:02 PM
New release of PowerLMM.js! Browser-based power analysis for longitudinal models with dropout.
Now includes:
- Power analysis summary report
- Reproducible & shareable configs (URL/JSON)
- Calculations validated against R
- Hypothesis region visualization
powerlmmjs.rpsychologist.com
Now includes:
- Power analysis summary report
- Reproducible & shareable configs (URL/JSON)
- Calculations validated against R
- Hypothesis region visualization
powerlmmjs.rpsychologist.com
Reposted by James Steele
The reality is a lot of parts of a research project are determined in the *design,* not in the analysis.
That's why serious projects have lit reviews and unserious projects have "our stakeholders liked these words"
That's why serious projects have lit reviews and unserious projects have "our stakeholders liked these words"
October 26, 2025 at 8:52 PM
The reality is a lot of parts of a research project are determined in the *design,* not in the analysis.
That's why serious projects have lit reviews and unserious projects have "our stakeholders liked these words"
That's why serious projects have lit reviews and unserious projects have "our stakeholders liked these words"
Reposted by James Steele
This scene living rent free in my head 😳
October 27, 2025 at 6:33 AM
This scene living rent free in my head 😳
This scene living rent free in my head 😳
October 27, 2025 at 6:33 AM
This scene living rent free in my head 😳
Reposted by James Steele
People seem to be discussing multiverse analysis again! I haven’t read the latest piece but will use that as an opportunity to share a blog post of mine with a title of which I’m still proud (although I probably shouldn’t)
www.the100.ci/2021/03/07/m...
www.the100.ci/2021/03/07/m...
Mülltiverse Analysis
Psychologists like their analyses like I like my coffee: robusta. Results shouldn’t change too much, no matter which exclusion criteria are applied, which covariates are included, which transformation...
www.the100.ci
October 26, 2025 at 5:06 AM
People seem to be discussing multiverse analysis again! I haven’t read the latest piece but will use that as an opportunity to share a blog post of mine with a title of which I’m still proud (although I probably shouldn’t)
www.the100.ci/2021/03/07/m...
www.the100.ci/2021/03/07/m...
Pretty sure that reviewer 2's comments alongside mine for a paper I recently reviewed are LLM generated, or at least produced in some manner through an LLM.
October 26, 2025 at 1:23 PM
Pretty sure that reviewer 2's comments alongside mine for a paper I recently reviewed are LLM generated, or at least produced in some manner through an LLM.
Chainsaw Man Reze Arc was honestly incredible. Watched last night and not surprised by 100% Rotten Tomatoes as well as sitting at no. 2 ranking on My Anime List behind Frieren. Movie was 🔥🔥🔥
October 26, 2025 at 11:55 AM
Chainsaw Man Reze Arc was honestly incredible. Watched last night and not surprised by 100% Rotten Tomatoes as well as sitting at no. 2 ranking on My Anime List behind Frieren. Movie was 🔥🔥🔥
We're struggling to get reviews for our recent stage 1 at @pci-regreports.bsky.social
www.medrxiv.org/content/10.1...
If you've expertise in the methods proposed and/or subject area and would be happy to review then please get in contact and I can let the recommender handling the submission know.
www.medrxiv.org/content/10.1...
If you've expertise in the methods proposed and/or subject area and would be happy to review then please get in contact and I can let the recommender handling the submission know.
Preserving musculoskeletal health through resistance training in individuals undergoing Glucagon-like Peptide-1 Receptor Agonist Therapy: a controlled interrupted time-series analysis (Stage 1 Registe...
Glucagon-like peptide-1 receptor agonists (GLP-1-RAs) are increasingly prescribed for weight loss and cardiometabolic health but have been evidenced to lead to loss of lean soft tissue mass. Resistanc...
www.medrxiv.org
October 24, 2025 at 3:26 PM
We're struggling to get reviews for our recent stage 1 at @pci-regreports.bsky.social
www.medrxiv.org/content/10.1...
If you've expertise in the methods proposed and/or subject area and would be happy to review then please get in contact and I can let the recommender handling the submission know.
www.medrxiv.org/content/10.1...
If you've expertise in the methods proposed and/or subject area and would be happy to review then please get in contact and I can let the recommender handling the submission know.
Reposted by James Steele
I am hiring PhD candidates to study the psychology of attention & technology use at @tilburg-university.bsky.social.
We're looking for motivated & curious scholars with expertise in cognitive psychology and statistics, and offer a friendly work environment with great terms & benefits.
tiu.nu/22989
We're looking for motivated & curious scholars with expertise in cognitive psychology and statistics, and offer a friendly work environment with great terms & benefits.
tiu.nu/22989
October 23, 2025 at 3:04 PM
I am hiring PhD candidates to study the psychology of attention & technology use at @tilburg-university.bsky.social.
We're looking for motivated & curious scholars with expertise in cognitive psychology and statistics, and offer a friendly work environment with great terms & benefits.
tiu.nu/22989
We're looking for motivated & curious scholars with expertise in cognitive psychology and statistics, and offer a friendly work environment with great terms & benefits.
tiu.nu/22989
Reposted by James Steele
The recording of @dingdingpeng.the100.ci's fantastic #CIIG presentation "Making Rigorous Causal Inference More Mainstream" is now available on YouTube!
www.youtube.com/watch?v=YL0c...
www.youtube.com/watch?v=YL0c...
CIIG Seminar: Julia Rohrer | Making Rigorous Causal Inference More Mainstream | 20 Oct 2025
YouTube video by the Causal Inference Interest Group (CIIG)
www.youtube.com
October 21, 2025 at 3:36 PM
The recording of @dingdingpeng.the100.ci's fantastic #CIIG presentation "Making Rigorous Causal Inference More Mainstream" is now available on YouTube!
www.youtube.com/watch?v=YL0c...
www.youtube.com/watch?v=YL0c...
October 22, 2025 at 10:32 AM