MetaROR
@metaror.bsky.social
MetaROR is a community initiative led jointly by RoRI and AIMOS. It provides a platform that leverages the publish–review-curate model to improve the dissemination and evaluation of metaresearch.
Reposted by MetaROR
Revised preprint: "Establishing trust in automated reasoning"
osf.io/preprints/me...
Based on two very helpful reviews from @metaror.bsky.social:
metaror.org/kotahi/artic...
More references, better discussion of unfamiliar concepts (e.g. conviviality), and more.
🧪 #metasci #compsci
osf.io/preprints/me...
Based on two very helpful reviews from @metaror.bsky.social:
metaror.org/kotahi/artic...
More references, better discussion of unfamiliar concepts (e.g. conviviality), and more.
🧪 #metasci #compsci
OSF
osf.io
November 6, 2025 at 9:26 AM
Revised preprint: "Establishing trust in automated reasoning"
osf.io/preprints/me...
Based on two very helpful reviews from @metaror.bsky.social:
metaror.org/kotahi/artic...
More references, better discussion of unfamiliar concepts (e.g. conviviality), and more.
🧪 #metasci #compsci
osf.io/preprints/me...
Based on two very helpful reviews from @metaror.bsky.social:
metaror.org/kotahi/artic...
More references, better discussion of unfamiliar concepts (e.g. conviviality), and more.
🧪 #metasci #compsci
How are national systems for assessing publicly funded research evolving? That's the question our latest article poses.
Reviewers consider the work "valuable and timely", noting its relevance to reform initiatives like @coarassessment.bsky.social
👇 Read the assessment, reviews & full article here
Reviewers consider the work "valuable and timely", noting its relevance to reform initiatives like @coarassessment.bsky.social
👇 Read the assessment, reviews & full article here
A new typology of national research assessment systems: continuity and change in 13 countries
metaror.org
November 4, 2025 at 3:39 PM
How are national systems for assessing publicly funded research evolving? That's the question our latest article poses.
Reviewers consider the work "valuable and timely", noting its relevance to reform initiatives like @coarassessment.bsky.social
👇 Read the assessment, reviews & full article here
Reviewers consider the work "valuable and timely", noting its relevance to reform initiatives like @coarassessment.bsky.social
👇 Read the assessment, reviews & full article here
Between open reviews and cases of abusing anonymity, the authors of our latest article argue for "pseudo-anonymous" (i.e., traceable) reviews.
The reviewers support the general idea while also offering amendments and alternative solutions.
👇 Read the assessment, reviews & full article now
The reviewers support the general idea while also offering amendments and alternative solutions.
👇 Read the assessment, reviews & full article now
Open Reviews is a good first step. Pseudo-Anonymous Reviews can take it further.
metaror.org
October 24, 2025 at 10:22 AM
Between open reviews and cases of abusing anonymity, the authors of our latest article argue for "pseudo-anonymous" (i.e., traceable) reviews.
The reviewers support the general idea while also offering amendments and alternative solutions.
👇 Read the assessment, reviews & full article now
The reviewers support the general idea while also offering amendments and alternative solutions.
👇 Read the assessment, reviews & full article now
Reposted by MetaROR
Just finished my @metaror.bsky.social journey – two rounds of #OpenPeerReview, valuable feedback, a stronger paper, and finally a journal submission. Open review takes time, but it’s worth every week for the transparency and trust it brings. doi.org/10.70744/Met... #OpenScience #Publishing
APC waivers and Ukraine’s publishing output in Gold OA journals: Evidence from five commercial publishers
doi.org
October 14, 2025 at 8:31 AM
Just finished my @metaror.bsky.social journey – two rounds of #OpenPeerReview, valuable feedback, a stronger paper, and finally a journal submission. Open review takes time, but it’s worth every week for the transparency and trust it brings. doi.org/10.70744/Met... #OpenScience #Publishing
Reposted by MetaROR
I just published my first paper on MetaROR (MetaResearch Open Review). The #PublishReviewCurate model brings reviewing and editorial decision making into the open.
To me, it can become a real game changer in #ScholarlyCommunication. I got great reviews and look forward to revise my manuscript!
To me, it can become a real game changer in #ScholarlyCommunication. I got great reviews and look forward to revise my manuscript!
🆕 Our latest study asks how authors incorporate the PRISMA guideline into workflows when conducting reviews.
Both reviewers highlighted the study's importance yet also requested more information and details from the author.
👇 Read the full editorial assessment, reviews and paper on MetaROR
Both reviewers highlighted the study's importance yet also requested more information and details from the author.
👇 Read the full editorial assessment, reviews and paper on MetaROR
From Form to Formation. Biomedical Reporting Standards in Practice
metaror.org
October 14, 2025 at 7:37 AM
I just published my first paper on MetaROR (MetaResearch Open Review). The #PublishReviewCurate model brings reviewing and editorial decision making into the open.
To me, it can become a real game changer in #ScholarlyCommunication. I got great reviews and look forward to revise my manuscript!
To me, it can become a real game changer in #ScholarlyCommunication. I got great reviews and look forward to revise my manuscript!
🆕 Our latest study asks how authors incorporate the PRISMA guideline into workflows when conducting reviews.
Both reviewers highlighted the study's importance yet also requested more information and details from the author.
👇 Read the full editorial assessment, reviews and paper on MetaROR
Both reviewers highlighted the study's importance yet also requested more information and details from the author.
👇 Read the full editorial assessment, reviews and paper on MetaROR
From Form to Formation. Biomedical Reporting Standards in Practice
metaror.org
October 9, 2025 at 2:05 PM
🆕 Our latest study asks how authors incorporate the PRISMA guideline into workflows when conducting reviews.
Both reviewers highlighted the study's importance yet also requested more information and details from the author.
👇 Read the full editorial assessment, reviews and paper on MetaROR
Both reviewers highlighted the study's importance yet also requested more information and details from the author.
👇 Read the full editorial assessment, reviews and paper on MetaROR
Reposted by MetaROR
Very glad to see the ANU Journal of Law and Technology has agreed to be @metaror.bsky.social's first partner journal from the field of law: cms.metaror.org/partner-jour...
MetaROR partners accept MetaROR reviews as part of their editorial process, making the publishing ecosystem more efficient.
MetaROR partners accept MetaROR reviews as part of their editorial process, making the publishing ecosystem more efficient.
October 8, 2025 at 12:17 AM
Very glad to see the ANU Journal of Law and Technology has agreed to be @metaror.bsky.social's first partner journal from the field of law: cms.metaror.org/partner-jour...
MetaROR partners accept MetaROR reviews as part of their editorial process, making the publishing ecosystem more efficient.
MetaROR partners accept MetaROR reviews as part of their editorial process, making the publishing ecosystem more efficient.
A qualified statistician's review can improve study designs. But who has access to one? Our new article surveys this among Australian human research ethics committees.
Reviewers liked the article yet were disappointed by the response rate. They suggested minor changes.
👇Read it now on MetaROR
Reviewers liked the article yet were disappointed by the response rate. They suggested minor changes.
👇Read it now on MetaROR
The varying perceptions of a statistician’s value, from “critical” to “not needed for 99.9% of applications”: A national study of human research ethics committees
metaror.org
September 12, 2025 at 12:04 PM
A qualified statistician's review can improve study designs. But who has access to one? Our new article surveys this among Australian human research ethics committees.
Reviewers liked the article yet were disappointed by the response rate. They suggested minor changes.
👇Read it now on MetaROR
Reviewers liked the article yet were disappointed by the response rate. They suggested minor changes.
👇Read it now on MetaROR
📠 Why should we trust automated reasoning systems? That's the question posed in our latest article by @khinsen.scholar.social.ap.brid.gy.
The two reviewers generally praise the ideas but ask for more detail and share some concerns.
👇 Read the editorial assessment, reviews and full paper at MetaROR
The two reviewers generally praise the ideas but ask for more detail and share some concerns.
👇 Read the editorial assessment, reviews and full paper at MetaROR
Establishing trust in automated reasoning
metaror.org
September 10, 2025 at 2:16 PM
📠 Why should we trust automated reasoning systems? That's the question posed in our latest article by @khinsen.scholar.social.ap.brid.gy.
The two reviewers generally praise the ideas but ask for more detail and share some concerns.
👇 Read the editorial assessment, reviews and full paper at MetaROR
The two reviewers generally praise the ideas but ask for more detail and share some concerns.
👇 Read the editorial assessment, reviews and full paper at MetaROR
Reposted by MetaROR
Thank you Hans for sharing your positive experience with @metaror.bsky.social, using your reviews and assessment to publish at our partner journal, Quantitative Science Studies: www.openscience.nl/en/cases/the...
The MetaROR Publish-Review-Curate Model: our experience as authors | Open Science NL
www.openscience.nl
September 10, 2025 at 3:08 AM
Thank you Hans for sharing your positive experience with @metaror.bsky.social, using your reviews and assessment to publish at our partner journal, Quantitative Science Studies: www.openscience.nl/en/cases/the...
Reposted by MetaROR
🔓 It's great to see authors sharing their experiences with publishing on MetaROR (MetaResearch Open Review) — our open review platform for metascience using the publish–review–curate model: www.openscience.nl/en/cases/the...
September 9, 2025 at 11:42 AM
🔓 It's great to see authors sharing their experiences with publishing on MetaROR (MetaResearch Open Review) — our open review platform for metascience using the publish–review–curate model: www.openscience.nl/en/cases/the...
⌛ How is preprinting adopted over time across disciplines and regions? Our latest article attempts to answer this.
The reviewers praised the comprehensive analysis & clear presentation, while requesting more background information & addressing data availability issues.
👇 Read it now on MetaROR
The reviewers praised the comprehensive analysis & clear presentation, while requesting more background information & addressing data availability issues.
👇 Read it now on MetaROR
Adoption of Preprinting Across Scientific Disciplines and Geographical Regions (1991-2023)
metaror.org
September 3, 2025 at 1:43 PM
⌛ How is preprinting adopted over time across disciplines and regions? Our latest article attempts to answer this.
The reviewers praised the comprehensive analysis & clear presentation, while requesting more background information & addressing data availability issues.
👇 Read it now on MetaROR
The reviewers praised the comprehensive analysis & clear presentation, while requesting more background information & addressing data availability issues.
👇 Read it now on MetaROR
MetaROR will be present at the @stienid2025.bsky.social conference this week!
We are excited for all the presentations, discussions and inspiration to come and we would be more than happy to greet you at our stand 👋
www.stienid2025.org
We are excited for all the presentations, discussions and inspiration to come and we would be more than happy to greet you at our stand 👋
www.stienid2025.org
Home | STI-ENID2025
Official website of the 29th Annual STI ENID Conference 2025
www.stienid2025.org
September 2, 2025 at 1:41 PM
MetaROR will be present at the @stienid2025.bsky.social conference this week!
We are excited for all the presentations, discussions and inspiration to come and we would be more than happy to greet you at our stand 👋
www.stienid2025.org
We are excited for all the presentations, discussions and inspiration to come and we would be more than happy to greet you at our stand 👋
www.stienid2025.org
This great new initiative highlights lots of interesting research and initiatives, including (on p.40) a primer on what MetaROR is doing, by @andre-brasil.bsky.social
👏 Congratulations to everyone involved for producing such a great magazine!
👏 Congratulations to everyone involved for producing such a great magazine!
🌟 REACH is live!
A new digital magazine on research integrity & open science.
📖 In this issue:
✨ Launch of the Science Integrity Alliance
✨ Coverage of the U.S. Conference on Research Integrity
✨ COPE’s evolution in publication ethics
...and more!
🔗 Read here: www.sci-integrity.com/reach-inaugu...
A new digital magazine on research integrity & open science.
📖 In this issue:
✨ Launch of the Science Integrity Alliance
✨ Coverage of the U.S. Conference on Research Integrity
✨ COPE’s evolution in publication ethics
...and more!
🔗 Read here: www.sci-integrity.com/reach-inaugu...
September 1, 2025 at 5:17 PM
This great new initiative highlights lots of interesting research and initiatives, including (on p.40) a primer on what MetaROR is doing, by @andre-brasil.bsky.social
👏 Congratulations to everyone involved for producing such a great magazine!
👏 Congratulations to everyone involved for producing such a great magazine!
Reposted by MetaROR
Great question!
Indeed @metaror.bsky.social and @peercommunityin.bsky.social have a lot in common, and in fact the MetaROR model was partly inspired by the great work done by Peer Community In (PCI).
However, there are also various differences between MetaROR and PCI. Let me highlight two of them.
Indeed @metaror.bsky.social and @peercommunityin.bsky.social have a lot in common, and in fact the MetaROR model was partly inspired by the great work done by Peer Community In (PCI).
However, there are also various differences between MetaROR and PCI. Let me highlight two of them.
August 15, 2025 at 10:09 AM
Great question!
Indeed @metaror.bsky.social and @peercommunityin.bsky.social have a lot in common, and in fact the MetaROR model was partly inspired by the great work done by Peer Community In (PCI).
However, there are also various differences between MetaROR and PCI. Let me highlight two of them.
Indeed @metaror.bsky.social and @peercommunityin.bsky.social have a lot in common, and in fact the MetaROR model was partly inspired by the great work done by Peer Community In (PCI).
However, there are also various differences between MetaROR and PCI. Let me highlight two of them.
👇 MetaROR is very proud and excited to announce this new partnership with @plosbiology.org 🙏
As part of this, "PLOS Biology will formally consider meta-research articles that are peer-reviewed on the MetaROR platform", in order to "improve transparency" and "[prevent] futile cycles of peer review".
As part of this, "PLOS Biology will formally consider meta-research articles that are peer-reviewed on the MetaROR platform", in order to "improve transparency" and "[prevent] futile cycles of peer review".
We are proud to announce a new agreement with @rorinstitute.bsky.social and @aimosinc.bsky.social to become a partner journal with MetaResearch Open Review (MetaRoR) @metaror.bsky.social
#metaresearch #openscience 🧪
Learn more: plos.io/45wPZB9
#metaresearch #openscience 🧪
Learn more: plos.io/45wPZB9
PLOS Biology announces agreement to become a MetaROR partner journal - The Official PLOS Blog
Note: PLOS issued the following press release on Thursday, August 14th. SAN FRANCISCO, CA — Today, PLOS Biology announced a new agreement…
plos.io
August 14, 2025 at 1:58 PM
👇 MetaROR is very proud and excited to announce this new partnership with @plosbiology.org 🙏
As part of this, "PLOS Biology will formally consider meta-research articles that are peer-reviewed on the MetaROR platform", in order to "improve transparency" and "[prevent] futile cycles of peer review".
As part of this, "PLOS Biology will formally consider meta-research articles that are peer-reviewed on the MetaROR platform", in order to "improve transparency" and "[prevent] futile cycles of peer review".
🔒Our latest study regards "the effect of APC waivers on the participation of Ukrainian researchers in fully Gold OA journals".
The reviewers call it "well-developed", "timely" & "important" while questioning the focus on only 5 publishers.
👇Read the assessment, reviews & author response on MetaROR
The reviewers call it "well-developed", "timely" & "important" while questioning the focus on only 5 publishers.
👇Read the assessment, reviews & author response on MetaROR
The effect of APC discounts on Ukraine's participation in gold open access journals
metaror.org
August 8, 2025 at 9:48 AM
🔒Our latest study regards "the effect of APC waivers on the participation of Ukrainian researchers in fully Gold OA journals".
The reviewers call it "well-developed", "timely" & "important" while questioning the focus on only 5 publishers.
👇Read the assessment, reviews & author response on MetaROR
The reviewers call it "well-developed", "timely" & "important" while questioning the focus on only 5 publishers.
👇Read the assessment, reviews & author response on MetaROR
Reposted by MetaROR
Exciting news! @metaror.bsky.social has joined Lifecycle Journal's growing list of evaluation service partners, & will review & assess metaresearch submissions.
Under LJ's innovative model of scholarly communication, research is published first, then openly reviewed.
🔎: lifecyclejournal.org/about/
Under LJ's innovative model of scholarly communication, research is published first, then openly reviewed.
🔎: lifecyclejournal.org/about/
LinkedIn
This link will take you to a page that’s not on LinkedIn
lnkd.in
August 7, 2025 at 8:18 PM
Exciting news! @metaror.bsky.social has joined Lifecycle Journal's growing list of evaluation service partners, & will review & assess metaresearch submissions.
Under LJ's innovative model of scholarly communication, research is published first, then openly reviewed.
🔎: lifecyclejournal.org/about/
Under LJ's innovative model of scholarly communication, research is published first, then openly reviewed.
🔎: lifecyclejournal.org/about/
📢 MetaROR is excited to announce our partnership with Lifecycle Journal.
We have joined LCJ's growing group of evaluation services and will review and assess metaresearch submissions.
👇 LCJ joins our ever-increasing list of partner journals. Please find the full list in the link below
[1/2]
We have joined LCJ's growing group of evaluation services and will review and assess metaresearch submissions.
👇 LCJ joins our ever-increasing list of partner journals. Please find the full list in the link below
[1/2]
Partnership with journals - MetaROR
About Our Partner Journals About Our Partner Journals Leveraging reviews for streamlined journal submissions Leveraging reviews for streamlined journal submissions
After peer review and editori...
metaror.org
August 7, 2025 at 1:48 PM
📢 MetaROR is excited to announce our partnership with Lifecycle Journal.
We have joined LCJ's growing group of evaluation services and will review and assess metaresearch submissions.
👇 LCJ joins our ever-increasing list of partner journals. Please find the full list in the link below
[1/2]
We have joined LCJ's growing group of evaluation services and will review and assess metaresearch submissions.
👇 LCJ joins our ever-increasing list of partner journals. Please find the full list in the link below
[1/2]
Great news from Rogue Scholar!
As briefly referenced in the piece, MetaROR is open to receive scholarly blog posts for peer review (as long as they fit our guidelines: cms.metaror.org/guidelines-a...)
See also this peer-reviewed blog post (& thoughtful author response): metaror.org/kotahi/artic...
As briefly referenced in the piece, MetaROR is open to receive scholarly blog posts for peer review (as long as they fit our guidelines: cms.metaror.org/guidelines-a...)
See also this peer-reviewed blog post (& thoughtful author response): metaror.org/kotahi/artic...
August 7, 2025 at 10:09 AM
Great news from Rogue Scholar!
As briefly referenced in the piece, MetaROR is open to receive scholarly blog posts for peer review (as long as they fit our guidelines: cms.metaror.org/guidelines-a...)
See also this peer-reviewed blog post (& thoughtful author response): metaror.org/kotahi/artic...
As briefly referenced in the piece, MetaROR is open to receive scholarly blog posts for peer review (as long as they fit our guidelines: cms.metaror.org/guidelines-a...)
See also this peer-reviewed blog post (& thoughtful author response): metaror.org/kotahi/artic...
📝 Our latest article is on "a large-scale empirical analysis of spelling errors in scientific titles and abstracts".
The reviews "emphasize the paper's novelty & scope" while suggesting "more refinement of its theoretical framing & methodological rigor"
👇 Read the full evaluation now on MetaROR
The reviews "emphasize the paper's novelty & scope" while suggesting "more refinement of its theoretical framing & methodological rigor"
👇 Read the full evaluation now on MetaROR
Spelling errors in health and medical abstracts: An observational analysis from 2008 to 2024
metaror.org
July 31, 2025 at 4:11 PM
📝 Our latest article is on "a large-scale empirical analysis of spelling errors in scientific titles and abstracts".
The reviews "emphasize the paper's novelty & scope" while suggesting "more refinement of its theoretical framing & methodological rigor"
👇 Read the full evaluation now on MetaROR
The reviews "emphasize the paper's novelty & scope" while suggesting "more refinement of its theoretical framing & methodological rigor"
👇 Read the full evaluation now on MetaROR
🆕 From now on, MetaROR can also include author responses on its submission pages. You will find them underneath the assessment & reviews.
Have you already been reviewed on MetaROR & want to provide a response? Please contact your editor.
👇 Two of our submissions now include such a response
[1/3]
Have you already been reviewed on MetaROR & want to provide a response? Please contact your editor.
👇 Two of our submissions now include such a response
[1/3]
July 30, 2025 at 1:20 PM
🆕 From now on, MetaROR can also include author responses on its submission pages. You will find them underneath the assessment & reviews.
Have you already been reviewed on MetaROR & want to provide a response? Please contact your editor.
👇 Two of our submissions now include such a response
[1/3]
Have you already been reviewed on MetaROR & want to provide a response? Please contact your editor.
👇 Two of our submissions now include such a response
[1/3]
When MetaROR launched at the end of last year, we published four articles. One of these has now returned to our platform for another round of peer review.
👇 Read the editorial assessment, reviews & full manuscript text at MetaROR (incl. links to the first version and first round of reviews)
[1/3]
👇 Read the editorial assessment, reviews & full manuscript text at MetaROR (incl. links to the first version and first round of reviews)
[1/3]
Peer Review at the Crossroads
metaror.org
July 23, 2025 at 8:08 AM
When MetaROR launched at the end of last year, we published four articles. One of these has now returned to our platform for another round of peer review.
👇 Read the editorial assessment, reviews & full manuscript text at MetaROR (incl. links to the first version and first round of reviews)
[1/3]
👇 Read the editorial assessment, reviews & full manuscript text at MetaROR (incl. links to the first version and first round of reviews)
[1/3]
Reposted by MetaROR
Discussion at #Metascience2025 about transforming research communication, including a talk by @andre-brasil.bsky.social about the @metaror.bsky.social platform.
@rorinstitute.bsky.social @aimosinc.bsky.social @cwts.nl
@rorinstitute.bsky.social @aimosinc.bsky.social @cwts.nl
For those who missed it at #Metascience2025, @katiecorker.bsky.social kindly recorded our session on "Transforming research communication: innovations in publishing, peer review, & curation" and you can check it out here: youtu.be/6d-LJYbNBmE
Transforming research communication: Innovations in publishing, peer review, and curation
YouTube video by ASAPbio
youtu.be
July 18, 2025 at 8:15 PM
Discussion at #Metascience2025 about transforming research communication, including a talk by @andre-brasil.bsky.social about the @metaror.bsky.social platform.
@rorinstitute.bsky.social @aimosinc.bsky.social @cwts.nl
@rorinstitute.bsky.social @aimosinc.bsky.social @cwts.nl
Today's MetaROR paper discusses "the use of document data networks to control the topic clustering of a science map" with "rigorous methodology" & "careful presentation".
Reviewers consider it "a valuable contribution to the literature", and provide the authors detailed feedback.
👇 Read on MetaROR
Reviewers consider it "a valuable contribution to the literature", and provide the authors detailed feedback.
👇 Read on MetaROR
Use of diverse data sources to control which topics emerge in a science map
metaror.org
July 16, 2025 at 3:36 PM
Today's MetaROR paper discusses "the use of document data networks to control the topic clustering of a science map" with "rigorous methodology" & "careful presentation".
Reviewers consider it "a valuable contribution to the literature", and provide the authors detailed feedback.
👇 Read on MetaROR
Reviewers consider it "a valuable contribution to the literature", and provide the authors detailed feedback.
👇 Read on MetaROR