Anne-Laure Boulesteix
@boulesteixlaure.bsky.social
Statistician and metascientist. Professor of biometrics at LMU Munich Medical and Mathematical Faculties, committed to open science, member of the Munich Center of Machine Learning. Opinions are mine.
Reposted by Anne-Laure Boulesteix
Comment by the STRATOS initiative: (including @boulesteixlaure.bsky.social @mhstat.bsky.social) onlinelibrary.wiley.com/doi/10.1002/... (6/8)
Commentary: Regression Models—Efforts Are Required to Improve Statistical Practice and Teaching
Click on the article title to read more.
onlinelibrary.wiley.com
June 26, 2025 at 12:28 PM
Comment by the STRATOS initiative: (including @boulesteixlaure.bsky.social @mhstat.bsky.social) onlinelibrary.wiley.com/doi/10.1002/... (6/8)
Reposted by Anne-Laure Boulesteix
Workshop on “Evidence & Uncertainty in Science: Methodological, Philosophical and Meta-Scientific Issues”
10th & 11th June, Uni of Tübingen, in-person only
uni-tuebingen.de/de/281247#c2...
With @cruwelli.bsky.social, @boulesteixlaure.bsky.social, @babeheim.bsky.social, & @hendriks.bsky.social
10th & 11th June, Uni of Tübingen, in-person only
uni-tuebingen.de/de/281247#c2...
With @cruwelli.bsky.social, @boulesteixlaure.bsky.social, @babeheim.bsky.social, & @hendriks.bsky.social
May 23, 2025 at 2:25 PM
Workshop on “Evidence & Uncertainty in Science: Methodological, Philosophical and Meta-Scientific Issues”
10th & 11th June, Uni of Tübingen, in-person only
uni-tuebingen.de/de/281247#c2...
With @cruwelli.bsky.social, @boulesteixlaure.bsky.social, @babeheim.bsky.social, & @hendriks.bsky.social
10th & 11th June, Uni of Tübingen, in-person only
uni-tuebingen.de/de/281247#c2...
With @cruwelli.bsky.social, @boulesteixlaure.bsky.social, @babeheim.bsky.social, & @hendriks.bsky.social
Reposted by Anne-Laure Boulesteix
NEW (METASCIENTIFIC) PREPRINT on the exploratory/confirmatory distinction:
Title: On "confirmatory" methodological research in statistics and related fields
by @iamjulianlange.bsky.social J. Wilcke, @sabinehoffmann11.bsky.social M. Herrmann and myself
arxiv.org/abs/2503.08124
Title: On "confirmatory" methodological research in statistics and related fields
by @iamjulianlange.bsky.social J. Wilcke, @sabinehoffmann11.bsky.social M. Herrmann and myself
arxiv.org/abs/2503.08124
On "confirmatory" methodological research in statistics and related fields
Empirical substantive research, such as in the life or social sciences, is commonly categorized into the two modes exploratory and confirmatory, both of which are essential to scientific progress. The...
arxiv.org
March 12, 2025 at 8:26 AM
NEW (METASCIENTIFIC) PREPRINT on the exploratory/confirmatory distinction:
Title: On "confirmatory" methodological research in statistics and related fields
by @iamjulianlange.bsky.social J. Wilcke, @sabinehoffmann11.bsky.social M. Herrmann and myself
arxiv.org/abs/2503.08124
Title: On "confirmatory" methodological research in statistics and related fields
by @iamjulianlange.bsky.social J. Wilcke, @sabinehoffmann11.bsky.social M. Herrmann and myself
arxiv.org/abs/2503.08124
NEW METASCIENTIFIC PREPRINT: "The impact of the storytelling fallacy on real data examples in methodological research" by M. Mandl et al:
arxiv.org/html/2503.03...
or why it is misleading to argue in favor of a method just because one can tell a nice story on the results obtained for n=1 dataset.
arxiv.org/html/2503.03...
or why it is misleading to argue in favor of a method just because one can tell a nice story on the results obtained for n=1 dataset.
The impact of the storytelling fallacy on real data examples in methodological research
arxiv.org
March 7, 2025 at 8:14 AM
NEW METASCIENTIFIC PREPRINT: "The impact of the storytelling fallacy on real data examples in methodological research" by M. Mandl et al:
arxiv.org/html/2503.03...
or why it is misleading to argue in favor of a method just because one can tell a nice story on the results obtained for n=1 dataset.
arxiv.org/html/2503.03...
or why it is misleading to argue in favor of a method just because one can tell a nice story on the results obtained for n=1 dataset.
NEW PAPER: Confidence intervals for (e.g., cross-validation) prediction error
by H. Schulz-Kümpel, S. Fischer et al.
"Constructing confidence Intervals for “the” Generalization
Error – a Comprehensive Benchmark Study"
openreview.net/pdf?id=x7kCj...
by H. Schulz-Kümpel, S. Fischer et al.
"Constructing confidence Intervals for “the” Generalization
Error – a Comprehensive Benchmark Study"
openreview.net/pdf?id=x7kCj...
openreview.net
March 5, 2025 at 7:58 AM
NEW PAPER: Confidence intervals for (e.g., cross-validation) prediction error
by H. Schulz-Kümpel, S. Fischer et al.
"Constructing confidence Intervals for “the” Generalization
Error – a Comprehensive Benchmark Study"
openreview.net/pdf?id=x7kCj...
by H. Schulz-Kümpel, S. Fischer et al.
"Constructing confidence Intervals for “the” Generalization
Error – a Comprehensive Benchmark Study"
openreview.net/pdf?id=x7kCj...
Reposted by Anne-Laure Boulesteix
This Registered Report masterpiece just dropped at BMC Biology, brilliantly led by a great team with the help of 300+ analysts & reviewers
Same question, same data: go figure!
tl;dr: Substantial heterogeneity among results comes from differences among analytical choices
🔗 doi.org/10.1186/s129...
Same question, same data: go figure!
tl;dr: Substantial heterogeneity among results comes from differences among analytical choices
🔗 doi.org/10.1186/s129...
February 7, 2025 at 4:00 AM
This Registered Report masterpiece just dropped at BMC Biology, brilliantly led by a great team with the help of 300+ analysts & reviewers
Same question, same data: go figure!
tl;dr: Substantial heterogeneity among results comes from differences among analytical choices
🔗 doi.org/10.1186/s129...
Same question, same data: go figure!
tl;dr: Substantial heterogeneity among results comes from differences among analytical choices
🔗 doi.org/10.1186/s129...
Reposted by Anne-Laure Boulesteix
IMO it’s a mistake to give stats to 1st year med students. It’s not why they chose medicine & they resent it. Better to wait until they have developed some curiosity for it. I argued unsuccessfully for this during my time at UCL.
November 25, 2024 at 7:49 AM
IMO it’s a mistake to give stats to 1st year med students. It’s not why they chose medicine & they resent it. Better to wait until they have developed some curiosity for it. I argued unsuccessfully for this during my time at UCL.
Reposted by Anne-Laure Boulesteix
Does #randomization ensures balance of risk factors between groups? Consider this:
In Denmark 860 individuals were randomly allocated to either intervention or control. Individuals were unaware of their allocation. No intervention took place. Mortality was higher in the intervention group (p=0.003)
In Denmark 860 individuals were randomly allocated to either intervention or control. Individuals were unaware of their allocation. No intervention took place. Mortality was higher in the intervention group (p=0.003)
November 26, 2024 at 1:38 PM
Does #randomization ensures balance of risk factors between groups? Consider this:
In Denmark 860 individuals were randomly allocated to either intervention or control. Individuals were unaware of their allocation. No intervention took place. Mortality was higher in the intervention group (p=0.003)
In Denmark 860 individuals were randomly allocated to either intervention or control. Individuals were unaware of their allocation. No intervention took place. Mortality was higher in the intervention group (p=0.003)
Reposted by Anne-Laure Boulesteix
So happy to see you all here! As the @lmu-osc.bsky.social coordinator, I just started a new project: coaching individual research groups so members can switch together to #OpenResearch - a tailored pedagogical intervention to maximise chances of sustainable adoption in the group, and a lot of fun! 🧵
November 19, 2024 at 5:21 PM
So happy to see you all here! As the @lmu-osc.bsky.social coordinator, I just started a new project: coaching individual research groups so members can switch together to #OpenResearch - a tailored pedagogical intervention to maximise chances of sustainable adoption in the group, and a lot of fun! 🧵
Reposted by Anne-Laure Boulesteix
Something that's been bugging me for a while in bioinformatics data analysis is this overreliance on packages, workflows and what's been called "cargo cult science".
Can we have more conceptual thinking, more theory?
Asking for what we really want to achieve and what we need to do gets us there.
Can we have more conceptual thinking, more theory?
Asking for what we really want to achieve and what we need to do gets us there.
November 19, 2024 at 10:58 AM
Something that's been bugging me for a while in bioinformatics data analysis is this overreliance on packages, workflows and what's been called "cargo cult science".
Can we have more conceptual thinking, more theory?
Asking for what we really want to achieve and what we need to do gets us there.
Can we have more conceptual thinking, more theory?
Asking for what we really want to achieve and what we need to do gets us there.
Happy to have been involved in this exciting project on the registration, design and reporting of statistical simulation studies, with @bsiepe.bsky.social @timpmorris.bsky.social et al., appeared in Psychological Methods:
Journal version at doi.org/10.1037/met0..., final openly available version at doi.org/10.31234/osf....
I have learned a lot from this collaboration, which started with a cold email at the beginning of my PhD - very much worth it
I have learned a lot from this collaboration, which started with a cold email at the beginning of my PhD - very much worth it
APA PsycNet
doi.org
November 18, 2024 at 10:48 AM
Happy to have been involved in this exciting project on the registration, design and reporting of statistical simulation studies, with @bsiepe.bsky.social @timpmorris.bsky.social et al., appeared in Psychological Methods:
Reposted by Anne-Laure Boulesteix
AI researchers: hold my beer —
Old model performed slightly not worse when data were generated by the new generative AI method I just made up
Old model performed slightly not worse when data were generated by the new generative AI method I just made up
November 18, 2024 at 9:19 AM
AI researchers: hold my beer —
Old model performed slightly not worse when data were generated by the new generative AI method I just made up
Old model performed slightly not worse when data were generated by the new generative AI method I just made up
Reposted by Anne-Laure Boulesteix
I made one for stats papers
November 18, 2024 at 4:02 AM
I made one for stats papers
Reposted by Anne-Laure Boulesteix
Simulation studies are essential for methods research. How well are they conducted & reported? How can we improve their quality? Out now in Psychological Methods, see 🧵 below.
With @fbartos.bsky.social, @timpmorris.bsky.social, @boulesteixlaure.bsky.social, @danielheck.bsky.social & Samuel Pawel
With @fbartos.bsky.social, @timpmorris.bsky.social, @boulesteixlaure.bsky.social, @danielheck.bsky.social & Samuel Pawel
We reviewed 100 psych. simulation studies & find room for improvement in planning/reporting. As a remedy, we (František Bartoš, @timpmorris.bsky.social Anne-Laure Boulesteix, @danielheck.bsky.social & Samuel Pawel) present ADEMP-PreReg, a simulation study preregistration & reporting template 🧵/1
November 18, 2024 at 9:25 AM
Simulation studies are essential for methods research. How well are they conducted & reported? How can we improve their quality? Out now in Psychological Methods, see 🧵 below.
With @fbartos.bsky.social, @timpmorris.bsky.social, @boulesteixlaure.bsky.social, @danielheck.bsky.social & Samuel Pawel
With @fbartos.bsky.social, @timpmorris.bsky.social, @boulesteixlaure.bsky.social, @danielheck.bsky.social & Samuel Pawel
Reposted by Anne-Laure Boulesteix
MEMTAB 2025 pre-conference courses news!
2 options:
- An Introduction to Clinical Prediction Models and Sample Size Calculations for Model Development & Evaluation
- Systematic Reviews of Prognosis Studies
Just £50 when registering for conference!
Details 👇
uobevents.eventsair.com/memtab-2025/...
2 options:
- An Introduction to Clinical Prediction Models and Sample Size Calculations for Model Development & Evaluation
- Systematic Reviews of Prognosis Studies
Just £50 when registering for conference!
Details 👇
uobevents.eventsair.com/memtab-2025/...
Pre-conference Courses - MEMTAB 2025
uobevents.eventsair.com
November 14, 2024 at 7:11 PM
MEMTAB 2025 pre-conference courses news!
2 options:
- An Introduction to Clinical Prediction Models and Sample Size Calculations for Model Development & Evaluation
- Systematic Reviews of Prognosis Studies
Just £50 when registering for conference!
Details 👇
uobevents.eventsair.com/memtab-2025/...
2 options:
- An Introduction to Clinical Prediction Models and Sample Size Calculations for Model Development & Evaluation
- Systematic Reviews of Prognosis Studies
Just £50 when registering for conference!
Details 👇
uobevents.eventsair.com/memtab-2025/...
Reposted by Anne-Laure Boulesteix
We must stand against the arbitrary categorization of continuous variables!
... and that's why I'm proud to announce my support of abolishing time zones in favor of the time gradient
... and that's why I'm proud to announce my support of abolishing time zones in favor of the time gradient
November 14, 2024 at 1:15 PM
We must stand against the arbitrary categorization of continuous variables!
... and that's why I'm proud to announce my support of abolishing time zones in favor of the time gradient
... and that's why I'm proud to announce my support of abolishing time zones in favor of the time gradient
Reposted by Anne-Laure Boulesteix
Which reminds me of this Andrew Vickers quote
www.nature.com/articles/ncp...
www.nature.com/articles/ncp...
November 11, 2024 at 9:53 AM
Which reminds me of this Andrew Vickers quote
www.nature.com/articles/ncp...
www.nature.com/articles/ncp...
Reposted by Anne-Laure Boulesteix
Independent GroupLeader / PI position in
AI in Genome Biology, Multimodal Omics
at European Molecular Biology Lab (EMBL), Heidelberg!
www.embl.org/jobs/positio...
Looking in particular for researchers with quantitative/ methodological background who want to dive into leading edge biology research.
AI in Genome Biology, Multimodal Omics
at European Molecular Biology Lab (EMBL), Heidelberg!
www.embl.org/jobs/positio...
Looking in particular for researchers with quantitative/ methodological background who want to dive into leading edge biology research.
November 1, 2024 at 11:50 AM
Independent GroupLeader / PI position in
AI in Genome Biology, Multimodal Omics
at European Molecular Biology Lab (EMBL), Heidelberg!
www.embl.org/jobs/positio...
Looking in particular for researchers with quantitative/ methodological background who want to dive into leading edge biology research.
AI in Genome Biology, Multimodal Omics
at European Molecular Biology Lab (EMBL), Heidelberg!
www.embl.org/jobs/positio...
Looking in particular for researchers with quantitative/ methodological background who want to dive into leading edge biology research.
Reposted by Anne-Laure Boulesteix
For all the new followers here: welcome!
Here some recent highlights:
(1/4) My eclectic and subjective list of scientific writing tips
Here some recent highlights:
(1/4) My eclectic and subjective list of scientific writing tips
Scientific writing tips – Huber Group @ EMBL
An eclectic and subjective list
www.huber.embl.de
October 21, 2024 at 8:18 AM
For all the new followers here: welcome!
Here some recent highlights:
(1/4) My eclectic and subjective list of scientific writing tips
Here some recent highlights:
(1/4) My eclectic and subjective list of scientific writing tips
Reposted by Anne-Laure Boulesteix
Reposted by Anne-Laure Boulesteix
Created a new group replacing and updating a list I enjoyed following on the bird site. Mostly people posting on medical stats and DS/AI
ICYI: go.bsky.app/ArqEz36
ICYI: go.bsky.app/ArqEz36
Medical stats/ds/ai
Join the conversation
go.bsky.app
October 21, 2024 at 10:40 AM
Created a new group replacing and updating a list I enjoyed following on the bird site. Mostly people posting on medical stats and DS/AI
ICYI: go.bsky.app/ArqEz36
ICYI: go.bsky.app/ArqEz36
Reposted by Anne-Laure Boulesteix
And there, look out! A meteor! In the form of the BMJ that code sharing will become mandatory. We told you this was coming. Scrutiny of your research data practices. And now it's here.
www.bmj.com/content/384/...
www.bmj.com/content/384/...
Mandatory data and code sharing for research published by The BMJ
New policy requires authors to share analytic codes from all studies and data from all trials
The case for sharing data from clinical research is strong.12 Clinical study data include all informatio...
www.bmj.com
October 24, 2024 at 10:30 AM
And there, look out! A meteor! In the form of the BMJ that code sharing will become mandatory. We told you this was coming. Scrutiny of your research data practices. And now it's here.
www.bmj.com/content/384/...
www.bmj.com/content/384/...
Reposted by Anne-Laure Boulesteix
Heinze G, Boulesteix A-L, Kammer M, Morris TP, White IR. ‘Phases of methodological research in biostatistics—Building the evidence base for new methods.’
Proposes a ‘methods-development pipeline’…
10/
doi.org/10.1002/bimj...
Proposes a ‘methods-development pipeline’…
10/
doi.org/10.1002/bimj...
Phases of methodological research in biostatistics—Building the evidence base for new methods
Although new biostatistical methods are published at a very high rate, many of these developments are not trustworthy enough to be adopted by the scientific community. We propose a framework to think...
doi.org
October 22, 2024 at 10:46 AM
Heinze G, Boulesteix A-L, Kammer M, Morris TP, White IR. ‘Phases of methodological research in biostatistics—Building the evidence base for new methods.’
Proposes a ‘methods-development pipeline’…
10/
doi.org/10.1002/bimj...
Proposes a ‘methods-development pipeline’…
10/
doi.org/10.1002/bimj...
Reposted by Anne-Laure Boulesteix
Friedrich S, Friede T. ‘On the role of benchmarking data sets and simulations in method comparison studies.’
Nice discussion of simulation studies vs. benchmarking datasets for prediction/classification methodology work.
9/
doi.org/10.1002/bimj...
Nice discussion of simulation studies vs. benchmarking datasets for prediction/classification methodology work.
9/
doi.org/10.1002/bimj...
On the role of benchmarking data sets and simulations in method comparison studies
Method comparisons are essential to provide recommendations and guidance for applied researchers, who often have to choose from a plethora of available approaches. While many comparisons exist in the...
doi.org
October 22, 2024 at 10:45 AM
Friedrich S, Friede T. ‘On the role of benchmarking data sets and simulations in method comparison studies.’
Nice discussion of simulation studies vs. benchmarking datasets for prediction/classification methodology work.
9/
doi.org/10.1002/bimj...
Nice discussion of simulation studies vs. benchmarking datasets for prediction/classification methodology work.
9/
doi.org/10.1002/bimj...