Here's a case study from Cardiff University (UoA 28, History) from REF2021 that suggests why--beyond commitment to the intrinsic value of these subjects--we should care about their individual and collective presence in UK universities.
You can read the case study in full here. 3/8
You can read the case study in full here. 3/8
Results and submissions : REF 2021
results2021.ref.ac.uk
November 10, 2025 at 10:10 AM
Here's a case study from Cardiff University (UoA 28, History) from REF2021 that suggests why--beyond commitment to the intrinsic value of these subjects--we should care about their individual and collective presence in UK universities.
You can read the case study in full here. 3/8
You can read the case study in full here. 3/8
For anyone interested in #psychology, #research assessment and evaluation, how the expert panel rated research submitted to #REF2021 - and especially the fate of #qualitative research - our article in Cogent Psychology is #OpenAccess (link in next post).
1/2
1/2
October 27, 2025 at 12:20 PM
For anyone interested in #psychology, #research assessment and evaluation, how the expert panel rated research submitted to #REF2021 - and especially the fate of #qualitative research - our article in Cogent Psychology is #OpenAccess (link in next post).
1/2
1/2
Figure 2 from ‘Equality and employment aspects of the UK Research Excellence Framework’ in Research Evaluation, Volume 34, 2025 academic.oup.com/rev/article/... (published last week)
October 20, 2025 at 8:51 PM
Figure 2 from ‘Equality and employment aspects of the UK Research Excellence Framework’ in Research Evaluation, Volume 34, 2025 academic.oup.com/rev/article/... (published last week)
New linguistic analysis suggests less applied subjects and impact case studies focussed on technology or culture were more likely to use hyperbolic and promotional language, or ‘hype’ thank other case studies in REF2021 academic.oup.com/applij/advan...
Hype and the manufacture of impact in REF submissions
Abstract. This paper examines the use of hyperbolic and promotional language, or ‘hype’, in the impact case studies submitted to the 2021 Research Excellen
academic.oup.com
October 17, 2025 at 7:31 PM
New linguistic analysis suggests less applied subjects and impact case studies focussed on technology or culture were more likely to use hyperbolic and promotional language, or ‘hype’ thank other case studies in REF2021 academic.oup.com/applij/advan...
Published open access this week in OUP’s Research Evaluation (by me)
Equality and employment aspects of the UK Research Excellence Framework url: academic.oup.com/rev/article/...
#REF2021 #REF2029
Equality and employment aspects of the UK Research Excellence Framework url: academic.oup.com/rev/article/...
#REF2021 #REF2029
Equality and employment aspects of the UK Research Excellence Framework
Abstract. This article analyses issues of equality and selection arising from the preparation for, and submissions to, the Research Excellence Framework 20
academic.oup.com
October 16, 2025 at 11:55 AM
Published open access this week in OUP’s Research Evaluation (by me)
Equality and employment aspects of the UK Research Excellence Framework url: academic.oup.com/rev/article/...
#REF2021 #REF2029
Equality and employment aspects of the UK Research Excellence Framework url: academic.oup.com/rev/article/...
#REF2021 #REF2029
The authors aren't working with individual REF2021 output scores, for example: they use 'departmental average REF2021 quality scores as a proxy for article quality' of 96,800 articles (no books or other output types). They're being compared to citation data, which rather a lot of UoAs don't use. 2/3
October 15, 2025 at 3:47 PM
The authors aren't working with individual REF2021 output scores, for example: they use 'departmental average REF2021 quality scores as a proxy for article quality' of 96,800 articles (no books or other output types). They're being compared to citation data, which rather a lot of UoAs don't use. 2/3
We tried some thinking aloud with kpop, then traditional outputs. And now...non-traditional outputs from REF2021.
October 7, 2025 at 2:22 PM
We tried some thinking aloud with kpop, then traditional outputs. And now...non-traditional outputs from REF2021.
There are complicated plans afoot for portability for longer form and longer duration outputs. But the broader point is that ultimately mobility of talent is good for scholarship and for scholars. Double portability worked fine in REF2021.
September 23, 2025 at 7:45 AM
There are complicated plans afoot for portability for longer form and longer duration outputs. But the broader point is that ultimately mobility of talent is good for scholarship and for scholars. Double portability worked fine in REF2021.
Academic Lead for REF2021. Many thanks to everyone and wishing you all the best for the future!
September 20, 2025 at 10:09 AM
Academic Lead for REF2021. Many thanks to everyone and wishing you all the best for the future!
Yes, it's very light on details and 'experts' (a term that is weirdly back in vogue). A reversion back closer to 2021 does seem likely. Whether they will actually take the sorry record of REF2021 re EDI into account or not remains however an important question. I admit to uncharacteristic pessimism.
Analysis of inclusion for submission, representation in outputs attribution and scoring - REF 2021
2021.ref.ac.uk
September 12, 2025 at 3:28 PM
Yes, it's very light on details and 'experts' (a term that is weirdly back in vogue). A reversion back closer to 2021 does seem likely. Whether they will actually take the sorry record of REF2021 re EDI into account or not remains however an important question. I admit to uncharacteristic pessimism.
Most of our research environments are now worse than during the REF2021 cycle. The pandemic, the erosion of research and teaching funding, in some nations the wild swings in student numbers, the BL hack and more have degraded our research conditions.
Don't degrade them more by bad-REFfing. 4/7
Don't degrade them more by bad-REFfing. 4/7
September 5, 2025 at 12:44 PM
Most of our research environments are now worse than during the REF2021 cycle. The pandemic, the erosion of research and teaching funding, in some nations the wild swings in student numbers, the BL hack and more have degraded our research conditions.
Don't degrade them more by bad-REFfing. 4/7
Don't degrade them more by bad-REFfing. 4/7
Three VCs (KCL, UEA, Leicester) applaud the REF pause (including the continued commitment to QR) and suggest a steer back to a REF closer to REF2021.
‘Keep focus on excellence and impact,’ say v-cs after REF pause
Using REF to tackle research culture risks making it too ‘bureaucratic and burdensome’, university leaders warn as Vallance rethinks changes to weightings
www.timeshighereducation.com
September 5, 2025 at 6:12 AM
Three VCs (KCL, UEA, Leicester) applaud the REF pause (including the continued commitment to QR) and suggest a steer back to a REF closer to REF2021.
ChatGPT had better correlation with REF2021 scores than citations.
I guess that makes sense, they're both about reading the language rather than a quantitative proxy metric. Some fields used citations to help, maybe ChatGPT would be better.
Both were awful in classics though 😂
#STIENID2021
I guess that makes sense, they're both about reading the language rather than a quantitative proxy metric. Some fields used citations to help, maybe ChatGPT would be better.
Both were awful in classics though 😂
#STIENID2021
September 4, 2025 at 8:47 AM
ChatGPT had better correlation with REF2021 scores than citations.
I guess that makes sense, they're both about reading the language rather than a quantitative proxy metric. Some fields used citations to help, maybe ChatGPT would be better.
Both were awful in classics though 😂
#STIENID2021
I guess that makes sense, they're both about reading the language rather than a quantitative proxy metric. Some fields used citations to help, maybe ChatGPT would be better.
Both were awful in classics though 😂
#STIENID2021
All 4 of the 4 top-ranked History UoAs in REF2021 have experienced or been threatened with redundancies since the results were announced.
September 2, 2025 at 7:38 AM
All 4 of the 4 top-ranked History UoAs in REF2021 have experienced or been threatened with redundancies since the results were announced.
Meet our next #RISummit Duo: David Phipps & Dori Simeonov
They will explore Strengthening Institutional Impact Support, with fresh perspectives on changes after #REF2021 in the UK and the evolving role of #AI in knowledge mobilization.
Register now at researchimpactsummit.com
They will explore Strengthening Institutional Impact Support, with fresh perspectives on changes after #REF2021 in the UK and the evolving role of #AI in knowledge mobilization.
Register now at researchimpactsummit.com
August 19, 2025 at 12:01 AM
Meet our next #RISummit Duo: David Phipps & Dori Simeonov
They will explore Strengthening Institutional Impact Support, with fresh perspectives on changes after #REF2021 in the UK and the evolving role of #AI in knowledge mobilization.
Register now at researchimpactsummit.com
They will explore Strengthening Institutional Impact Support, with fresh perspectives on changes after #REF2021 in the UK and the evolving role of #AI in knowledge mobilization.
Register now at researchimpactsummit.com
In the word salad that is anti-'woke', PCE, anti-EDI critique there is never a reference to the REF2021 EDI report. It would be salutary to know either 1) Why this should be ignored (if that is the argument), or 2) How, concretely, it will be addressed. The silence is resounding.
Analysis of inclusion for submission, representation in outputs attribution and scoring - REF 2021
2021.ref.ac.uk
August 7, 2025 at 8:14 AM
In the word salad that is anti-'woke', PCE, anti-EDI critique there is never a reference to the REF2021 EDI report. It would be salutary to know either 1) Why this should be ignored (if that is the argument), or 2) How, concretely, it will be addressed. The silence is resounding.
A REF2029 spokesperson: “We are assessing the findings from the People, Culture and Environment pilot, including on unnecessary burden, and we will bring forward final recommendations from the funding bodies shortly.”
Synopsis: some people contacted urge a return to REF2021 rules. Others disagree.
Synopsis: some people contacted urge a return to REF2021 rules. Others disagree.
Calls to run REF 2029 on old rules intensify
“Uncertainty” prompts simplification push, but critics warn against dropping research culture metrics.
www.researchprofessionalnews.com/rr-news-uk-r...
“Uncertainty” prompts simplification push, but critics warn against dropping research culture metrics.
www.researchprofessionalnews.com/rr-news-uk-r...
Calls to run REF 2029 on old rules intensify - Research Professional News
“Uncertainty” prompts simplification push, but critics warn against dropping research culture metrics
www.researchprofessionalnews.com
July 30, 2025 at 11:06 AM
A REF2029 spokesperson: “We are assessing the findings from the People, Culture and Environment pilot, including on unnecessary burden, and we will bring forward final recommendations from the funding bodies shortly.”
Synopsis: some people contacted urge a return to REF2021 rules. Others disagree.
Synopsis: some people contacted urge a return to REF2021 rules. Others disagree.
Meanwhile, on the REF2029 CKU front, 'diversity of outputs' has become all the rage, apparently diverting scrutiny of the known 'diversity of researchers' problem toward the 'representativeness' of submitted outputs notwithstanding the dismal human EDI stats in REF2021. 3/3
July 18, 2025 at 6:06 AM
Meanwhile, on the REF2029 CKU front, 'diversity of outputs' has become all the rage, apparently diverting scrutiny of the known 'diversity of researchers' problem toward the 'representativeness' of submitted outputs notwithstanding the dismal human EDI stats in REF2021. 3/3
If you know REF2021, you know the 'representativeness' of staff was dismal, with the report finding 'negative impacts...for Black, female and disabled staff' in particular (link below). Several questions in the Town Hall asked if EDI characteristics will be analysed in 2029. Not known. Hmmmm. 4/10
2021.ref.ac.uk
July 15, 2025 at 2:07 PM
If you know REF2021, you know the 'representativeness' of staff was dismal, with the report finding 'negative impacts...for Black, female and disabled staff' in particular (link below). Several questions in the Town Hall asked if EDI characteristics will be analysed in 2029. Not known. Hmmmm. 4/10
Less cheery news includes: fixation on 'diversity of Outputs' seems to have replaced REF2021's EDI concerns re 'diversity of researchers'; decoupling has (largely) killed off Output portability & also added greatly to ambiguity & bureaucracy; CKU 'representativeness' simply makes no sense. 3/10
July 15, 2025 at 2:07 PM
Less cheery news includes: fixation on 'diversity of Outputs' seems to have replaced REF2021's EDI concerns re 'diversity of researchers'; decoupling has (largely) killed off Output portability & also added greatly to ambiguity & bureaucracy; CKU 'representativeness' simply makes no sense. 3/10
Having chaired REF2021 IDAP I find it an interesting approach. Not all parts of the system really recognise what IDR is and isn’t or how difficult it can be to do (and judge). Very variable landscape!
July 10, 2025 at 10:19 AM
Having chaired REF2021 IDAP I find it an interesting approach. Not all parts of the system really recognise what IDR is and isn’t or how difficult it can be to do (and judge). Very variable landscape!
Discussions about submission of 'non-traditional' outputs are important, although NB some of the examples cited in the guidance are utterly standard in many UoA submissions.
When however will we address the auditorium-sized elephant in the room that is these REF2021 data? 1/3
When however will we address the auditorium-sized elephant in the room that is these REF2021 data? 1/3
July 10, 2025 at 9:59 AM
Discussions about submission of 'non-traditional' outputs are important, although NB some of the examples cited in the guidance are utterly standard in many UoA submissions.
When however will we address the auditorium-sized elephant in the room that is these REF2021 data? 1/3
When however will we address the auditorium-sized elephant in the room that is these REF2021 data? 1/3
Just at the level of basic factual accuracy, let alone as 'analysis', this claim is sadly lacking. The 'new element that was not there before' is not yet fully defined & confirmed nor 'new', as anyone even remotely familiar with REF2021/2029 would know. (And I say that as a sceptic of PCE). 2/3
Equality and Diversity - REF 2021
2021.ref.ac.uk
July 3, 2025 at 2:49 PM
Just at the level of basic factual accuracy, let alone as 'analysis', this claim is sadly lacking. The 'new element that was not there before' is not yet fully defined & confirmed nor 'new', as anyone even remotely familiar with REF2021/2029 would know. (And I say that as a sceptic of PCE). 2/3
The university is inviting feedback. Email historyfb@leicester.ac.uk by 5pm, 4th July.
Yes, History at Leicester was ranked #2 in the UK in REF2021. Yes, it is the home of Centre for Regional & Local History (inc. my PhD). Yes, it has fostered extraordinary work for over a century. le.ac.uk/history
Yes, History at Leicester was ranked #2 in the UK in REF2021. Yes, it is the home of Centre for Regional & Local History (inc. my PhD). Yes, it has fostered extraordinary work for over a century. le.ac.uk/history
History at Leicester | University of Leicester
Studying for a History degree at the University of Leicester will enable you to learn from leading academics in the field, ensuring you undertake a course that is both challenging and rewarding, and w...
le.ac.uk
June 30, 2025 at 10:23 AM
The university is inviting feedback. Email historyfb@leicester.ac.uk by 5pm, 4th July.
Yes, History at Leicester was ranked #2 in the UK in REF2021. Yes, it is the home of Centre for Regional & Local History (inc. my PhD). Yes, it has fostered extraordinary work for over a century. le.ac.uk/history
Yes, History at Leicester was ranked #2 in the UK in REF2021. Yes, it is the home of Centre for Regional & Local History (inc. my PhD). Yes, it has fostered extraordinary work for over a century. le.ac.uk/history
Yeah, quite. They're somewhere in the REF2021 reports which have stats for average grant income in each UoA.
June 18, 2025 at 4:29 PM
Yeah, quite. They're somewhere in the REF2021 reports which have stats for average grant income in each UoA.