Research on Research Institute (RoRI)
@rorinstitute.bsky.social
RoRI’s mission is to accelerate transformational research on research systems, cultures & decision-making.
We’ve added 4 new countries to RoRI’s Atlas of Assessment: Latvia 🇱🇻, Portugal 🇵🇹, the Czech Republic 🇨🇿 and Namibia 🇳🇦.
The Atlas is designed to help compare national approaches, understand emerging trends, and support responsible assessment reform: researchonresearch.org/atlas/
The Atlas is designed to help compare national approaches, understand emerging trends, and support responsible assessment reform: researchonresearch.org/atlas/
November 7, 2025 at 1:29 PM
We’ve added 4 new countries to RoRI’s Atlas of Assessment: Latvia 🇱🇻, Portugal 🇵🇹, the Czech Republic 🇨🇿 and Namibia 🇳🇦.
The Atlas is designed to help compare national approaches, understand emerging trends, and support responsible assessment reform: researchonresearch.org/atlas/
The Atlas is designed to help compare national approaches, understand emerging trends, and support responsible assessment reform: researchonresearch.org/atlas/
RoRI’s AFIRE Sprints are back! 🌏 Join our Asia/Pacific-friendly sprint on AI in research funding, starting on 12 November. Funders and AI enthusiasts welcome.
Find out more: docs.google.com/presentation...
Find out more: docs.google.com/presentation...
November 4, 2025 at 3:32 PM
RoRI’s AFIRE Sprints are back! 🌏 Join our Asia/Pacific-friendly sprint on AI in research funding, starting on 12 November. Funders and AI enthusiasts welcome.
Find out more: docs.google.com/presentation...
Find out more: docs.google.com/presentation...
Representing RoRI at #AIS25, Denis Newman-Griffis shares insights from our Handbook on Responsible AI for Research Funders at the first European AI in Science Summit.
You can access the handbook here: rori.figshare.com/articles/boo...
You can access the handbook here: rori.figshare.com/articles/boo...
November 4, 2025 at 12:03 PM
Representing RoRI at #AIS25, Denis Newman-Griffis shares insights from our Handbook on Responsible AI for Research Funders at the first European AI in Science Summit.
You can access the handbook here: rori.figshare.com/articles/boo...
You can access the handbook here: rori.figshare.com/articles/boo...
RoRI's Helen Buckley Woods reflects on the growing push to regulate research security in response to geopolitical tensions, sharing insights from the European Flagship Conference on Research Security: researchonresearch.org/research-sec...
November 3, 2025 at 4:03 PM
RoRI's Helen Buckley Woods reflects on the growing push to regulate research security in response to geopolitical tensions, sharing insights from the European Flagship Conference on Research Security: researchonresearch.org/research-sec...
Reposted by Research on Research Institute (RoRI)
#SSHRC, CIHR and Michael Smith Health Research BC have awarded more than 2.7 million in funding through the Research-on-Research Joint Initiative. 14 teams will be researching meta-research - the study of how research itself is funded, practiced, and shared. sshrc-crsh.canada.ca/en/news/2025...
October 30, 2025 at 2:51 PM
#SSHRC, CIHR and Michael Smith Health Research BC have awarded more than 2.7 million in funding through the Research-on-Research Joint Initiative. 14 teams will be researching meta-research - the study of how research itself is funded, practiced, and shared. sshrc-crsh.canada.ca/en/news/2025...
"Could there be a risk of research becoming a self-fulfilling prophecy if we make decisions based on algorithms?" asks RoRI's @jameswilsdon.bsky.social in Chemistry World, discussing Funding the Frontier, a new AI tool mapping how funding shapes science: www.chemistryworld.com/news/ai-tool...
October 29, 2025 at 12:36 PM
"Could there be a risk of research becoming a self-fulfilling prophecy if we make decisions based on algorithms?" asks RoRI's @jameswilsdon.bsky.social in Chemistry World, discussing Funding the Frontier, a new AI tool mapping how funding shapes science: www.chemistryworld.com/news/ai-tool...
🌍 The Atlas of Assessment maps national research evaluation systems worldwide: researchonresearch.org/atlas/
Curated by RoRI with input from policymakers & funders in 13 countries, it helps researchers and leaders explore trends, compare systems, and see how different nations assess research.
Curated by RoRI with input from policymakers & funders in 13 countries, it helps researchers and leaders explore trends, compare systems, and see how different nations assess research.
October 28, 2025 at 2:49 PM
🌍 The Atlas of Assessment maps national research evaluation systems worldwide: researchonresearch.org/atlas/
Curated by RoRI with input from policymakers & funders in 13 countries, it helps researchers and leaders explore trends, compare systems, and see how different nations assess research.
Curated by RoRI with input from policymakers & funders in 13 countries, it helps researchers and leaders explore trends, compare systems, and see how different nations assess research.
European grant applications are at record highs, success rates below 10%: www.nature.com/articles/d41...
Time to rethink how we fund, assess and support research - not just increase competition.
Time to rethink how we fund, assess and support research - not just increase competition.
October 20, 2025 at 12:23 PM
European grant applications are at record highs, success rates below 10%: www.nature.com/articles/d41...
Time to rethink how we fund, assess and support research - not just increase competition.
Time to rethink how we fund, assess and support research - not just increase competition.
Help shape how policy experimentation is supported across Europe. The European Commission is gathering insights from people working in policy and research & innovation.
Survey closes in 1 week: eu.mar.medallia.com?e=461456&d=l...
Survey closes in 1 week: eu.mar.medallia.com?e=461456&d=l...
October 17, 2025 at 10:43 AM
Help shape how policy experimentation is supported across Europe. The European Commission is gathering insights from people working in policy and research & innovation.
Survey closes in 1 week: eu.mar.medallia.com?e=461456&d=l...
Survey closes in 1 week: eu.mar.medallia.com?e=461456&d=l...
RoRI's MATTHEW project has a new reviewed preprint in @elife.bsky.social, studying the Matthew effect and early-career setbacks in research funding across 14 programmes and 6 funders ⬇️
📢 New reviewed preprint, published by @elife.bsky.social at doi.org/10.7554/eLif.... We study two effects in science funding across 14 different funding programmes from 6 research funders across Europe and North America: (1) The Matthew effect; and (2) and the early-career setback effect.
🧵1/8
🧵1/8
October 16, 2025 at 11:59 AM
RoRI's MATTHEW project has a new reviewed preprint in @elife.bsky.social, studying the Matthew effect and early-career setbacks in research funding across 14 programmes and 6 funders ⬇️
32% of peer reviewers now use AI tools.
RoRI’s Wolfgang Kaltenbrunner and Denis Newman-Griffis discuss the rise of AI in peer review and why it may be a “sticking plaster” for deeper systemic problems: www.researchprofessionalnews.com/rr-news-worl...
RoRI’s Wolfgang Kaltenbrunner and Denis Newman-Griffis discuss the rise of AI in peer review and why it may be a “sticking plaster” for deeper systemic problems: www.researchprofessionalnews.com/rr-news-worl...
October 16, 2025 at 11:33 AM
32% of peer reviewers now use AI tools.
RoRI’s Wolfgang Kaltenbrunner and Denis Newman-Griffis discuss the rise of AI in peer review and why it may be a “sticking plaster” for deeper systemic problems: www.researchprofessionalnews.com/rr-news-worl...
RoRI’s Wolfgang Kaltenbrunner and Denis Newman-Griffis discuss the rise of AI in peer review and why it may be a “sticking plaster” for deeper systemic problems: www.researchprofessionalnews.com/rr-news-worl...
🌟 RoRI is growing! We’re delighted to welcome nine new colleagues across UCL and CWTS (Leiden University), strengthening our work in metascience, AI, research assessment, and science policy.
Read more about our new team members and their work here: researchonresearch.org/rori-welcome...
Read more about our new team members and their work here: researchonresearch.org/rori-welcome...
October 15, 2025 at 11:24 AM
🌟 RoRI is growing! We’re delighted to welcome nine new colleagues across UCL and CWTS (Leiden University), strengthening our work in metascience, AI, research assessment, and science policy.
Read more about our new team members and their work here: researchonresearch.org/rori-welcome...
Read more about our new team members and their work here: researchonresearch.org/rori-welcome...
“When there’s so much misinformation around and distrust about science, it’s more important than ever that we are transparent about how exactly science goes on” - RoRI's @scurry.bsky.social calls on the research sector to end the “publication bias” against negative results: tinyurl.com/ux5xtm4d
October 13, 2025 at 11:33 AM
“When there’s so much misinformation around and distrust about science, it’s more important than ever that we are transparent about how exactly science goes on” - RoRI's @scurry.bsky.social calls on the research sector to end the “publication bias” against negative results: tinyurl.com/ux5xtm4d
Australia’s universities are rethinking how they assess learning and research in the age of AI.
The Australian reports that AI “cheats” are almost impossible to detect - and RoRI partner Australian Research Council is reviewing its AI policy for grant assessment.
Read more(£): tinyurl.com/3tzfvvpk
The Australian reports that AI “cheats” are almost impossible to detect - and RoRI partner Australian Research Council is reviewing its AI policy for grant assessment.
Read more(£): tinyurl.com/3tzfvvpk
October 8, 2025 at 11:33 AM
Australia’s universities are rethinking how they assess learning and research in the age of AI.
The Australian reports that AI “cheats” are almost impossible to detect - and RoRI partner Australian Research Council is reviewing its AI policy for grant assessment.
Read more(£): tinyurl.com/3tzfvvpk
The Australian reports that AI “cheats” are almost impossible to detect - and RoRI partner Australian Research Council is reviewing its AI policy for grant assessment.
Read more(£): tinyurl.com/3tzfvvpk
“Using metrics to assess researchers can be ‘very dodgy terrain,’” says @jameswilsdon.bsky.social.
Great overview of how research assessment is changing worldwide in @nature.com , featuring recent work by RoRI with the Global Research Council: www.nature.com/articles/d41...
Great overview of how research assessment is changing worldwide in @nature.com , featuring recent work by RoRI with the Global Research Council: www.nature.com/articles/d41...
October 7, 2025 at 1:03 PM
“Using metrics to assess researchers can be ‘very dodgy terrain,’” says @jameswilsdon.bsky.social.
Great overview of how research assessment is changing worldwide in @nature.com , featuring recent work by RoRI with the Global Research Council: www.nature.com/articles/d41...
Great overview of how research assessment is changing worldwide in @nature.com , featuring recent work by RoRI with the Global Research Council: www.nature.com/articles/d41...
At our UCL seminar, ESRC Exec Chair @stianwestlake.bsky.social said UKRI’s analytic capacity is “pretty limited” and “geared towards compliance need.” Better use of data will be key for stronger investment decisions and to act as the UK’s “strategic brain” for R&D: tinyurl.com/5n742x5w
October 6, 2025 at 11:52 AM
At our UCL seminar, ESRC Exec Chair @stianwestlake.bsky.social said UKRI’s analytic capacity is “pretty limited” and “geared towards compliance need.” Better use of data will be key for stronger investment decisions and to act as the UK’s “strategic brain” for R&D: tinyurl.com/5n742x5w
Reposted by Research on Research Institute (RoRI)
Very much looking forward to this event!
@metaror.bsky.social @asapbio.bsky.social @rorinstitute.bsky.social @aimosinc.bsky.social @cwts.nl
@metaror.bsky.social @asapbio.bsky.social @rorinstitute.bsky.social @aimosinc.bsky.social @cwts.nl
Publish, Review, Curate: Turning scholarly publishing on its head
Register now for our in-person event in Cambridge on December 3rd co-organised by the Open Research team at Cambridge and @coar-repositories.bsky.social. Full programme to follow!
Register now for our in-person event in Cambridge on December 3rd co-organised by the Open Research team at Cambridge and @coar-repositories.bsky.social. Full programme to follow!
Publish, Review, Curate: Turning scholarly publishing on its head
Tired of long delays, expensive fees, and a lack of transparency about editorial decisions when publishing your articles? Join us at Cambridge University on December 3rd for an in-depth discussion …
coar-repositories.org
October 3, 2025 at 6:19 PM
Very much looking forward to this event!
@metaror.bsky.social @asapbio.bsky.social @rorinstitute.bsky.social @aimosinc.bsky.social @cwts.nl
@metaror.bsky.social @asapbio.bsky.social @rorinstitute.bsky.social @aimosinc.bsky.social @cwts.nl
Reposted by Research on Research Institute (RoRI)
Research assessment: a round-up
Excellent survey of the assessment landscape by @hollyelse.bsky.social in @nature.com, including our recent work @rorinstitute.bsky.social with the Global Research Council.
www.nature.com/articles/d41...
@alexrushforth.bsky.social @prussianhippie.bsky.social
Excellent survey of the assessment landscape by @hollyelse.bsky.social in @nature.com, including our recent work @rorinstitute.bsky.social with the Global Research Council.
www.nature.com/articles/d41...
@alexrushforth.bsky.social @prussianhippie.bsky.social
Research assessment: a round-up for early-career researchers
Confused by research evaluation and its potential impact on career progression? Here are some pointers as to how things work in different parts of the world.
www.nature.com
October 4, 2025 at 8:23 AM
Research assessment: a round-up
Excellent survey of the assessment landscape by @hollyelse.bsky.social in @nature.com, including our recent work @rorinstitute.bsky.social with the Global Research Council.
www.nature.com/articles/d41...
@alexrushforth.bsky.social @prussianhippie.bsky.social
Excellent survey of the assessment landscape by @hollyelse.bsky.social in @nature.com, including our recent work @rorinstitute.bsky.social with the Global Research Council.
www.nature.com/articles/d41...
@alexrushforth.bsky.social @prussianhippie.bsky.social
New in @nature.com: Funding the Frontier, an AI tool to map & predict research impacts.
The piece cites RoRI's @jameswilsdon.bsky.social, who warns such algorithms risk reinforcing past successes over future potential: www.nature.com/articles/d41...
The piece cites RoRI's @jameswilsdon.bsky.social, who warns such algorithms risk reinforcing past successes over future potential: www.nature.com/articles/d41...
October 2, 2025 at 10:29 AM
New in @nature.com: Funding the Frontier, an AI tool to map & predict research impacts.
The piece cites RoRI's @jameswilsdon.bsky.social, who warns such algorithms risk reinforcing past successes over future potential: www.nature.com/articles/d41...
The piece cites RoRI's @jameswilsdon.bsky.social, who warns such algorithms risk reinforcing past successes over future potential: www.nature.com/articles/d41...
Yesterday, we hosted Stian Westlake (@ukri.org ESRC) for a seminar at UCL on how analytics & experimentation can strengthen research funding and UKRI’s role as a “strategic brain” for UK R&D. With great responses from Molly Morgan Jones (British Academy) & Sarah Chaytor (UCL).
October 1, 2025 at 11:05 AM
Yesterday, we hosted Stian Westlake (@ukri.org ESRC) for a seminar at UCL on how analytics & experimentation can strengthen research funding and UKRI’s role as a “strategic brain” for UK R&D. With great responses from Molly Morgan Jones (British Academy) & Sarah Chaytor (UCL).
DOIs may seem like a technical detail, but they’re central to how research outputs are recognised.
In a new blog post, RoRI's @ludowaltman.bsky.social & @andre-brasil.bsky.social discuss why we need good practices for DOI registration for publish-review-curate platforms: tinyurl.com/y632m7kz
In a new blog post, RoRI's @ludowaltman.bsky.social & @andre-brasil.bsky.social discuss why we need good practices for DOI registration for publish-review-curate platforms: tinyurl.com/y632m7kz
September 29, 2025 at 12:46 PM
DOIs may seem like a technical detail, but they’re central to how research outputs are recognised.
In a new blog post, RoRI's @ludowaltman.bsky.social & @andre-brasil.bsky.social discuss why we need good practices for DOI registration for publish-review-curate platforms: tinyurl.com/y632m7kz
In a new blog post, RoRI's @ludowaltman.bsky.social & @andre-brasil.bsky.social discuss why we need good practices for DOI registration for publish-review-curate platforms: tinyurl.com/y632m7kz
Reposted by Research on Research Institute (RoRI)
We need good practices for DOI registration for publish-review-curate platforms like @metaror.bsky.social and others.
@andre-brasil.bsky.social and I wrote a blog post about this: doi.org/10.64000/76j...
Together with @crossref.bsky.social we hope to receive input from the community on this issue!
@andre-brasil.bsky.social and I wrote a blog post about this: doi.org/10.64000/76j...
Together with @crossref.bsky.social we hope to receive input from the community on this issue!
Innovation in scientific publishing and its implications for Crossref DOI registration practices - Request for input - Crossref
Lots of exciting innovations are being made in scientific publishing, often raising fundamental questions about established publishing practices. In this guest post, Ludo Waltman and André Brasil disc...
doi.org
September 26, 2025 at 6:47 AM
We need good practices for DOI registration for publish-review-curate platforms like @metaror.bsky.social and others.
@andre-brasil.bsky.social and I wrote a blog post about this: doi.org/10.64000/76j...
Together with @crossref.bsky.social we hope to receive input from the community on this issue!
@andre-brasil.bsky.social and I wrote a blog post about this: doi.org/10.64000/76j...
Together with @crossref.bsky.social we hope to receive input from the community on this issue!
🧠 Does STI policy need a strategic brain?
Join us next Tuesday at UCL for a talk by @stianwestlake.bsky.social (Executive Chair, @ukri.org ESRC) on the future of UK R&D, with responses from @britishacademy.bsky.social's Molly Morgan Jones & UCL’s Sarah Chaytor: tinyurl.com/vekzka23
Join us next Tuesday at UCL for a talk by @stianwestlake.bsky.social (Executive Chair, @ukri.org ESRC) on the future of UK R&D, with responses from @britishacademy.bsky.social's Molly Morgan Jones & UCL’s Sarah Chaytor: tinyurl.com/vekzka23
September 23, 2025 at 8:15 AM
🧠 Does STI policy need a strategic brain?
Join us next Tuesday at UCL for a talk by @stianwestlake.bsky.social (Executive Chair, @ukri.org ESRC) on the future of UK R&D, with responses from @britishacademy.bsky.social's Molly Morgan Jones & UCL’s Sarah Chaytor: tinyurl.com/vekzka23
Join us next Tuesday at UCL for a talk by @stianwestlake.bsky.social (Executive Chair, @ukri.org ESRC) on the future of UK R&D, with responses from @britishacademy.bsky.social's Molly Morgan Jones & UCL’s Sarah Chaytor: tinyurl.com/vekzka23
🐝 A move from the wisdom of the gatekeeper to the wisdom of the (expert) crowd
RoRI researchers wrote for @lseimpactblog.bsky.social about our study with @volkswagenstiftung.de, testing distributed peer review as an alternative to traditional funding panels:
RoRI researchers wrote for @lseimpactblog.bsky.social about our study with @volkswagenstiftung.de, testing distributed peer review as an alternative to traditional funding panels:
Distributed Peer Review – How the wisdom of the crowd can allocate grant funding - Impact of Social Sciences
New research shows engaging the applicants in funding review processes can resolve and reframe many issues facing peer review.
blogs.lse.ac.uk
September 19, 2025 at 8:15 AM
🐝 A move from the wisdom of the gatekeeper to the wisdom of the (expert) crowd
RoRI researchers wrote for @lseimpactblog.bsky.social about our study with @volkswagenstiftung.de, testing distributed peer review as an alternative to traditional funding panels:
RoRI researchers wrote for @lseimpactblog.bsky.social about our study with @volkswagenstiftung.de, testing distributed peer review as an alternative to traditional funding panels:
Reposted by Research on Research Institute (RoRI)
💥New: Distributed Peer Review – How the wisdom of the crowd can allocate grant funding
✍️ Melanie Benson Marshall, Anna Butters, @stephenpinfield.bsky.social @tomstafford.mastodon.online.ap.brid.gy
#PeerReview #PRW25 #ResearchPolicy
✍️ Melanie Benson Marshall, Anna Butters, @stephenpinfield.bsky.social @tomstafford.mastodon.online.ap.brid.gy
#PeerReview #PRW25 #ResearchPolicy
Distributed Peer Review – How the wisdom of the crowd can allocate grant funding - Impact of Social Sciences
New research shows engaging the applicants in funding review processes can resolve and reframe many issues facing peer review.
blogs.lse.ac.uk
September 18, 2025 at 10:07 AM
💥New: Distributed Peer Review – How the wisdom of the crowd can allocate grant funding
✍️ Melanie Benson Marshall, Anna Butters, @stephenpinfield.bsky.social @tomstafford.mastodon.online.ap.brid.gy
#PeerReview #PRW25 #ResearchPolicy
✍️ Melanie Benson Marshall, Anna Butters, @stephenpinfield.bsky.social @tomstafford.mastodon.online.ap.brid.gy
#PeerReview #PRW25 #ResearchPolicy