Ingo Rohlfing | Lightnews

Serhii Nazarovets @serhiinazarovets.bsky.social · 22h

A new article by Chloe Patton in #ResearchEvaluation shows how debates about #OpenScience often slip into absurdity – like demanding #replication from the #Humanities. You can’t replicate history, culture, or interpretation the way you replicate a physics experiment: doi.org/10.1093/rese...

Patton, C. (2024). Replicability and the humanities: the problem with universal measures of research quality. Research Evaluation, 34. https://doi.org/10.1093/reseval/rvaf052

Sophie E. Hill @sophieehill.bsky.social · 1d

lads i found ANOTHER Table of Impossible Summary Statistics in a "green economics" paper 🚩

Can you see the problem?

Ingo Rohlfing @ingorohlfing.bsky.social · 4d

I read this post yesterday again because I was reading on many websites about CIs as covering the population value with 95% (or so) probability. I started to doubt my understanding of CIs and needed reassurance.

andrewpgrieve.bsky.social @andrewpgrieve.bsky.social · 5d

"If we are unable to educate clinicians then merely persuading them to use CI's rather than p-values is to replace
the unthinking use of one technique with that of another."

A.P.Grieve (1992) Royal Statistical Society News and Notes, 18(7), 3-4.

Ingo Rohlfing @ingorohlfing.bsky.social · 5d

Same here. (Incidentally, we cover confidence intervals tomorrow in Stats 101.) However, when one says "Only use confidence intervals" (not you, but others), you are mandating a certain research interest, which is what one may or may not have in a given study.

Michael Friendly @datavisfriendly.bsky.social · 5d

#dataviz Very cool interactive - 7 sets Venn Diagram
128 color combinations from mixing 7 colors

moebio.com/research/sev...

7 sets Venn Diagram

moebio.com

Richard D. Morey @richarddmorey.bsky.social · 5d

Luckily, you don't need to choose b/c you can use them both! The framing of "p value bad"/"CI good" means that some people never really get that they're based on the same information & the same basic stat. philosophy (some of these points are made here: richarddmorey.medium.com/power-and-pr...)

Power and precision

Why the push for replacing “power” with “precision” is misguided

richarddmorey.medium.com

European Consortium for Political Research @ecpr.bsky.social · 5d

💫 Beginner-friendly #qualitative courses this Feb ⤵️

🔹Applications of Focus Groups @karenlumsden.bsky.social
🔹Case Study Research: Method & Practice @ingorohlfing.bsky.social
🔹Intro to Qualitative Comparative Analysis

📆 16–27 Feb 2026, Online

🐦 Early Bird until 5 Jan buff.ly/qoXc0pJ
#ecprms

Ingo Rohlfing @ingorohlfing.bsky.social · 5d

At least it's different, but valid point. p-values can be useful in some contexts and for some questions, confidence intervals for others. I never got why CIs should be superior to p-values per se. I would have to read ab New Statistics again, but I can't imagine a convincing reason.

Philipp Heimberger @heimbergecon.bsky.social · 5d

"academic publishing is dominated by profit-oriented, multinational companies for whom scientific knowledge is a commodity to be sold back to the academic community who created it... The dominant four collectively generated... $12 billion in profits between 2019 and 2024."

Elisabeth Bik - Perpetrator 5, a fraudulent microbiologist @elisabethbik.bsky.social · 6d

Next: Geoff Cumming @thenewstats.bsky.social with 'Statistical significance and p values: The researcher’s heroin'
* p values are highly unrealiable - don't trust them, don't use them!
www.thenewstatistics.com
tiny.cc/osfsigroulette
#IRICSydney

Speaker at the pedestal wearing a t-short with the link to TheNewStatistics website.

Ingo Rohlfing @ingorohlfing.bsky.social · 6d

Nature's 5 best science book picks are behind a paywall. www.nature.com/articles/d41... You can see the first three books completely, the fourth book has the review capped, the fifth is completely hidden. I am sure one can do a nice quasi-experimental study with this.

Ingo Rohlfing @ingorohlfing.bsky.social · 7d

Just one level below sacrificing half a thumb mpra.ub.uni-muenchen.de/36335/1/Righ...

Egon Willigh☮gen 🟥 @egonw.mastodon.social.ap.brid.gy · 7d

"Author changes name, publishes 10 papers in journals that banned him" https://retractionwatch.com/2025/11/10/author-changes-name-publishes-10-papers-in-journals-that-banned-him/

Of course...

Author changes name, publishes 10 papers in journals that banned him

How to render a publishing ban moot? Change your surname and just keep submitting. That’s what happened in the case of Hashem Babaei, aka Hashem Gharababaei. In 2010, the Institution of Mechanical Engineers (IMechE), a professional society based in the U.K., banned the mechanical engineering researcher from the University of Guilan from submitting his work … Continue reading Author changes name, publishes 10 papers in journals that banned him

retractionwatch.com

Egon Willigh☮gen 🟥 @egonw.mastodon.social.ap.brid.gy · 7d

"Author changes name, publishes 10 papers in journals that banned him" https://retractionwatch.com/2025/11/10/author-changes-name-publishes-10-papers-in-journals-that-banned-him/

Of course...

Author changes name, publishes 10 papers in journals that banned him

How to render a publishing ban moot? Change your surname and just keep submitting. That’s what happened in the case of Hashem Babaei, aka Hashem Gharababaei. In 2010, the Institution of Mechanical Engineers (IMechE), a professional society based in the U.K., banned the mechanical engineering researcher from the University of Guilan from submitting his work … Continue reading Author changes name, publishes 10 papers in journals that banned him

retractionwatch.com

Ingo Rohlfing @ingorohlfing.bsky.social · 9d

I am sure they spent a lot of time thinking about what should and shouldn't be included in the interface. As they write, it reflects their experience with teaching quantitative methods, so I am sure it meets their needs.

Ingo Rohlfing @ingorohlfing.bsky.social · 9d

actual data, probably messy, to answer real-world questions.
The tabs seem a bit overloaded to me with input elements, data, formulas and plots, but this is just my personal impression.
Here is the direct link to the website: 2k1.iq.harvard.edu 2/

Ingo Rohlfing @ingorohlfing.bsky.social · 9d

Statistical Intuition without Coding (or Teachers) [and w/o LLMs]
www.cambridge.org/core/journal...
I think this is a very useful approach when one does not want to teach coding in parallel. Simulating data and quantities of interest are insightful features, though at the expense of not using 1/

MetaArXivBot @metaarxivbot.bsky.social · 10d

Risk of bias in robustness reports: https://osf.io/wj26e

Ingo Rohlfing @ingorohlfing.bsky.social · 11d

Okay, quote tweets do not work when replies are restricted too (makes sense).
I was referring to a post where someone wrote he "heard numbers" that a larger share of papers is never read and an even larger share never cited. There was no source. One should just not dish out such number w/o sources.

Ingo Rohlfing @ingorohlfing.bsky.social · 12d

As replies are restricted, a quote-post it has to be: What are the sources for these numbers? For political science, we have ongoing work in progress showing it is less than 50% of papers (for about 100 journals). Still high, but not that high.

Ingo Rohlfing @ingorohlfing.bsky.social · 11d

I am not sure either whether this is for real, a scam or something else. The listed organizers are actual people, at least, and they refer to this agents4science.stanford.edu as their role model, which looks legit, but who can tell these days?

Ingo Rohlfing @ingorohlfing.bsky.social · 11d

this, but this is necessarily still in its infancy. If one combines three new uses of AI in one format, how do you which one works better or worse and under what conditions? If an LLM tells you an LLM-written paper on LLM-based qualitative research is great, would you buy this w/o human scrutiny? 3/

Ingo Rohlfing @ingorohlfing.bsky.social · 11d

The use of LLMs for qualitative research is new in itself and worth exploring. Determining the value of AI for this purpose requires human evaluation, IMO. Delegating paper writing to an LLM and the review of papers is also a new element of science, worth exploring too, I guess. There is work on 2/

Ingo Rohlfing @ingorohlfing.bsky.social · 11d

Open Conference of AI Agents for Qualitative Research 2026 www.aiagents4qual.org "The 1st open conference where AI serves as both primary authors and reviewers of research papers" that use AI for qualitative research.
Maybe I am missing something here: this seems to overdo it with exploring AI 1/

Ingo Rohlfing @ingorohlfing.bsky.social · 12d

As replies are restricted, a quote-post it has to be: What are the sources for these numbers? For political science, we have ongoing work in progress showing it is less than 50% of papers (for about 100 journals). Still high, but not that high.

Ingo Rohlfing @ingorohlfing.bsky.social · 12d

The best time to slow down with publishing was yesterday. Unfortunately, publishing is likely to get accelerated by LLMs.

Jay Van Bavel, PhD @jayvanbavel.bsky.social · 12d

The race to churn out papers is a systemic problem.

Early career scholars are desperate to get more papers to compete in the academic job market. This can make it hard for faculty mentors hard to reduce their output unless they shrink their lab (which removes opportunities from next generation).

Jay Van Bavel, PhD @jayvanbavel.bsky.social · 12d

The race to churn out papers is a systemic problem.

Early career scholars are desperate to get more papers to compete in the academic job market. This can make it hard for faculty mentors hard to reduce their output unless they shrink their lab (which removes opportunities from next generation).

Gabriella Lapesa @gabriellalapesa.bsky.social · 12d

Join our CSS department @gesis.org! Postdoc/senior researcher position, tenure track! All info at: www.gesis.org/institut/kar...

Details

GESIS Leibniz Institut für Sozialwissenschaften

www.gesis.org

Casper Albers 🟥 @handle.invalid · 12d

Doing non-causal inference (and being explicit about it), yet using a causal word as second word in the title.

If you pay Nature € 10.690, they will publish this in Nature Ageing.

I can tell you what I think of that for free.

www.nature.com/articles/s43...

screenshot from the paper, stating that no causal claims (like they did in the title) should be made.

Ingo Rohlfing @ingorohlfing.bsky.social · 13d

The added value is marginal compared to several blog posts on the topic because the product does not seem in any way superior to alternatives. Let's pass the benefit of a doubt here because the article states there is no conflict of interest. 2/

Add to Home Screen

Light up
your news

Add to Home Screen

Light upyour news

Sign in to Lightnews

Sign up to start reading

Connect Bluesky

Connect with Bluesky

Light up
your news