My belated annual roundup of things we learned about peer review in 2024. Including structured peer review, reviewers' uncertainty, & "uselessly elongated review bias." Now online at @plos.org

absolutelymaybe.plos.org/2025/04/28/5...

Featuring @mariomalicki.bsky.social @aidybarnett.bsky.social

📅On 27th November 2024, TIER2 and Taylor & Francis Group hosted a workshop at the 19th Munin Conference on Scholarly Publishing in Tromsø, Norway, addressing research reproducibility. A report on the workshop is now available on TIER2's website.💡
🔗Learn more here: tier2-project.eu/news/tier2-a...

Sadly spent most of this very sunny day writing a narrative CV for a grant application. Jeez, that's a lot of extra work that I'm not sure anyone is likely to read too deeply.

What do others think of them?

A new TIER2 preprint, authored by Serge Horbach, Nicki Lisa Cole, Simone Kopeinik, Barbara Leitner, Tony Ross-Hellauer and Joeri Tijdink, explores the barriers and enablers for reproducibility in research.
🔗Learn more: tier2-project.eu/news/new-tie...

"Conflation of synthetic #GenAI and real data could corrupt the research record; degrade the #quality and #reproducibility of scientific data and analytical methods; and, ironically, sabotage the training of AI models." www.pnas.org/doi/10.1073/... #synthetic_data #research_integrity

Was reminded of this ultimate Venn today.

New paper by Thomas Klebel "Investigating patterns of knowledge production in research on three UN sustainable development goals", just published in Online Information Review! doi.org/10.1108/OIR-...

While I see (again) many new persons here, here is the meta-research and open science starting pack 2.

New Preprint! "Reproducibility and replicability of qualitative research: An integrative review of concepts, barriers and enablers" - osf.io/preprints/me...

A nice ouput from our TIER2 project, led by Nicki Lisa Cole :)

1/ 🚨 NEW PAPER! “Open Science at the Generative AI Turn”
In a new study just published in Quantitative Science Studies, we explore how GenAI both enables and challenges Open Science, and why GenAI will benefit from adopting Open Science values. 🧵
doi.org/10.1162/qss_...
#OpenScience #AI #GenAI

New Paper! “Understanding the social and political dimensions of research(er) assessment: evaluative flexibility and hidden criteria in promotion processes at research institutes”, just published in Research Evaluation by me, @naubertbonn.bsky.social & Serge Horbach. Thread below!

Beware of the #streetlight effect in measuring #openscience #impact @tonyrh.bsky.social #munin2024 conference

Brilliant overview of #openscience by @tonyrh.bsky.social #munin2024 conference: particularly liked the “unintended consequences “ side, (me, not Tony) thinking about the 12290$ APC asked by #SpringerNature for one single article to be #openaccess - not equitable at all.

The LSE Impact Blog covering our recent scoping review on evidence regarding the uptake, attitudes and efficacy of Open Peer Review.

Conclusion: many persistent and crucial questions remain poorly explored. We suggest ways to move forward and invite collaboration!

blogs.lse.ac.uk/impactofsoci...

JOB NEWS: I am advertising two postdoctoral research positions of 3 years, to work with me at the TUM Think Tank and my Chair of Philosophy and History of Science to develop the Ethical Data Initiative – info and application requirements here: portal.mytum.de/jobs/wissens... #sts #philsci 🧪 #hps

New preprint on the societal impact of Open Science!

As part of the PathOS project, we have scoped the academic, societal and economic impacts of Open Science. The first of three upcoming preprints (each covering one theme) is now available!

doi.org/10.31235/osf.io/tqrwg

pathos-project.eu

New article, just out in Research Evaluation!
Serge Horbach and I review recent evidence on uptake, attitudes, efficacy of Open Peer Review
doi.org/10.1093/rese...
The tl;dr is all in Table 4 ;)

#openscience #peerreview