Lisa DeBruine
@debruine.bsky.social
#rstats #PsyTeachR #PsySciAcc #OpenResearch #CodingClub #ManyFaces (overwhelmed by social media) 🏳️🌈 she/they
The package formerly known as papercheck has changed its name to metacheck! We're checking more than just papers, with functions to assess OSF projects, github repos, and AsPredicted pre-registrations, with more being developed all the time.
scienceverse.github.io/metacheck/
scienceverse.github.io/metacheck/
Check Research Outputs for Best Practices
A modular, extendable system for automatically checking research outputs for best practices using text search, R code, and/or (optional) LLM queries.
scienceverse.github.io
November 3, 2025 at 4:20 PM
The package formerly known as papercheck has changed its name to metacheck! We're checking more than just papers, with functions to assess OSF projects, github repos, and AsPredicted pre-registrations, with more being developed all the time.
scienceverse.github.io/metacheck/
scienceverse.github.io/metacheck/
Reposted by Lisa DeBruine
This November, like every November, I am teaching basic research proposal writing to the new phd cohort at my institute. Here is the 2 page template we start with and adapt. Link to LaTeX github.com/rmcelreath/P...
![\title[PhD Plan for CANDIDATE]{Department of \mbox{Full Luxury Galactic Metascience}\\PhD Plan for CANDIDATE}
% list committee members
\author[]{Committee:\\
Prof.~MEMBER1\\
Dr.~MEMBER2\\
Dr.~MEMBER3}
\date{\today}
\begin{document}
\maketitle% this prints the handout title, author, and date
\begin{marginfigure}[-5.2cm]
\includegraphics[width=3.5cm]{Minerva.pdf}
\end{marginfigure}
\section{Phenomenon}
The subject matter to be addressed. What is the question? Citation for background are useful, but don't do a full lit review (yet).\cite{HenrichMcElreath:2003} Additional references can be included at the end bibliography by using \verb|\nocite|. \nocite{NBGA2005}
\section{Theoretical Perspective}
The framework for explaining the phenomenon. What are the implications of theory? If more than one theory is relevant, how do the implications differ? What are the current holes in the theory or theories?
\section{Approach}
Modeling and empirical research approach to address the theory/ies nominated above. Important thing is to \emph{justify} the approach in terms of theory.
\section{Specifics of Approach}
Outline any special skills, equipment, or techniques that will be required. This includes, in the case of field research, a paragraph on the background of the field location. Data analysis approach needs a sketch. Can use citation\cite{Merowetal2014} for further detail.
\section{Expected Products}
A list of the (usually 3) articles expected for completion of the PhD. Think of each as a fantasy abstract.
\begin{enumerate}
\item \emph{The Evolution of Human Uniqueness.} There is wide agreement that humans are unique. But it is rarely asked: Have they always been unique? In this paper, we derive a general uniqueness theorem that states that any unique species must have been less unique at some point in the past. This theorem has implications for the achievement of world peace.](https://cdn.bsky.app/img/feed_thumbnail/plain/did:plc:ta2whs6wjtpljvpqgs5leu36/bafkreihnoflhyf2lajrvcsovawt3xr47qlm76jfhzet5lqumkabtzufvoe@jpeg)
November 3, 2025 at 7:45 AM
This November, like every November, I am teaching basic research proposal writing to the new phd cohort at my institute. Here is the 2 page template we start with and adapt. Link to LaTeX github.com/rmcelreath/P...
Reposted by Lisa DeBruine
ladies and gentlemen...we got him
October 30, 2025 at 7:10 PM
ladies and gentlemen...we got him
I was re-listening to the episode of @ifbookspod.bsky.social on The Anxious Generation, and the bit around 1:15 where they’re incredulous about “solutions” to age verification online has aged hilariously, given the recent UK online safety act changes.
podcasts.apple.com/gb/podcast/i...
podcasts.apple.com/gb/podcast/i...
The Anxious Generation
Podcast Episode · If Books Could Kill · 08/08/2024 · 2h
podcasts.apple.com
October 31, 2025 at 9:56 AM
I was re-listening to the episode of @ifbookspod.bsky.social on The Anxious Generation, and the bit around 1:15 where they’re incredulous about “solutions” to age verification online has aged hilariously, given the recent UK online safety act changes.
podcasts.apple.com/gb/podcast/i...
podcasts.apple.com/gb/podcast/i...
The Festival of Data Science and AI is next week #DataAIFest
I'll be speaking in a panel on Using AI Ethically in Research on Monday
www.gla.ac.uk/research/az/...
And leading a workshop on Papercheck on Tuesday
www.gla.ac.uk/research/az/...
I'll be speaking in a panel on Using AI Ethically in Research on Monday
www.gla.ac.uk/research/az/...
And leading a workshop on Papercheck on Tuesday
www.gla.ac.uk/research/az/...
October 21, 2025 at 4:09 PM
The Festival of Data Science and AI is next week #DataAIFest
I'll be speaking in a panel on Using AI Ethically in Research on Monday
www.gla.ac.uk/research/az/...
And leading a workshop on Papercheck on Tuesday
www.gla.ac.uk/research/az/...
I'll be speaking in a panel on Using AI Ethically in Research on Monday
www.gla.ac.uk/research/az/...
And leading a workshop on Papercheck on Tuesday
www.gla.ac.uk/research/az/...
I'm finally writing a proper paper about faux, and have so many naming & default choices I regret (it was my first solo R package). Which is a better strategy:
1. Add new functions that work the way I wish the old ones did, but keep the old ones
2. Create a faux2 package and retire faux eventually
1. Add new functions that work the way I wish the old ones did, but keep the old ones
2. Create a faux2 package and retire faux eventually
October 20, 2025 at 11:15 AM
I'm finally writing a proper paper about faux, and have so many naming & default choices I regret (it was my first solo R package). Which is a better strategy:
1. Add new functions that work the way I wish the old ones did, but keep the old ones
2. Create a faux2 package and retire faux eventually
1. Add new functions that work the way I wish the old ones did, but keep the old ones
2. Create a faux2 package and retire faux eventually
Please help us, #MetaScience community!
It's time to decide on a forever name for papercheck (scienceverse.github.io/papercheck/). We don't want it to be confused with papercheck.ai, and we plan to check other research artifacts like repo contents, data, code, and prereg. Any suggestions?
It's time to decide on a forever name for papercheck (scienceverse.github.io/papercheck/). We don't want it to be confused with papercheck.ai, and we plan to check other research artifacts like repo contents, data, code, and prereg. Any suggestions?
Check Scientific Papers for Best Practices
A modular, extendable system for automatically checking scientific papers for best practices using text search, R code, and/or (optional) LLM queries.
scienceverse.github.io
October 14, 2025 at 1:06 PM
Please help us, #MetaScience community!
It's time to decide on a forever name for papercheck (scienceverse.github.io/papercheck/). We don't want it to be confused with papercheck.ai, and we plan to check other research artifacts like repo contents, data, code, and prereg. Any suggestions?
It's time to decide on a forever name for papercheck (scienceverse.github.io/papercheck/). We don't want it to be confused with papercheck.ai, and we plan to check other research artifacts like repo contents, data, code, and prereg. Any suggestions?
I love the OSF, but I'm going to have to stop using it for student projects if it continues to take 30 seconds every time I load a new page.
October 13, 2025 at 1:39 PM
I love the OSF, but I'm going to have to stop using it for student projects if it continues to take 30 seconds every time I load a new page.
Reposted by Lisa DeBruine
Adding my voice to the chorus battling to retain an increased focus on people, culture, and environment in the next REF... wonkhe.com/blogs/the-ba...
The battle for people, culture and environment
Lizzie Gadd makes the case for embracing People, Culture and Environment and sets out why reverting to REF 2021 would be a mistake
wonkhe.com
October 7, 2025 at 6:25 AM
Adding my voice to the chorus battling to retain an increased focus on people, culture, and environment in the next REF... wonkhe.com/blogs/the-ba...
I'm having an #rdev problem using data in an r package inside a function when calling the function without loading the package. I made a reprex to demonstrate the problem (code in the next post) but I think it has something to do with lazyloading data.
mydata is a data table
myfunc() returns mydata
mydata is a data table
myfunc() returns mydata
October 7, 2025 at 11:02 AM
I'm having an #rdev problem using data in an r package inside a function when calling the function without loading the package. I made a reprex to demonstrate the problem (code in the next post) but I think it has something to do with lazyloading data.
mydata is a data table
myfunc() returns mydata
mydata is a data table
myfunc() returns mydata
I need #rstats meme help. I've just updated my MSc book and all of the chapters start with a (probably outdated) meme except chapter 10 (next steps). Any ideas?
psyteachr.github.io/reprores-v5
psyteachr.github.io/reprores-v5
Data Skills for Reproducible Research
This book provides an overview of skills needed for reproducible and open research using the statistical programming language R and tidyverse packages. It covers reproducible workflows, data visualisa...
psyteachr.github.io
September 22, 2025 at 10:05 AM
I need #rstats meme help. I've just updated my MSc book and all of the chapters start with a (probably outdated) meme except chapter 10 (next steps). Any ideas?
psyteachr.github.io/reprores-v5
psyteachr.github.io/reprores-v5
Excited for today’s seminar by @juliehulme-psyc.bsky.social about the experiences of disabled and neurodivergent students.
September 19, 2025 at 2:09 PM
Excited for today’s seminar by @juliehulme-psyc.bsky.social about the experiences of disabled and neurodivergent students.
Reposted by Lisa DeBruine
Time is running out to register for our pre-symposium workshop and Meta Research Symposium event at Paul Meehl Graduate School
Check the information and registration links below:
paulmeehlschool.github.io/workshops/
Check the information and registration links below:
paulmeehlschool.github.io/workshops/
September 10, 2025 at 1:53 PM
Time is running out to register for our pre-symposium workshop and Meta Research Symposium event at Paul Meehl Graduate School
Check the information and registration links below:
paulmeehlschool.github.io/workshops/
Check the information and registration links below:
paulmeehlschool.github.io/workshops/
This fall I will have a blind student in my coding class for the first time. Do any other instructors or visually impaired coders have advice beyond making sure my book has useful alt-text for the images? #rstats #accessibility
Class book: psyteachr.github.io/reprores-v5/
Class book: psyteachr.github.io/reprores-v5/
September 16, 2025 at 9:54 AM
This fall I will have a blind student in my coding class for the first time. Do any other instructors or visually impaired coders have advice beyond making sure my book has useful alt-text for the images? #rstats #accessibility
Class book: psyteachr.github.io/reprores-v5/
Class book: psyteachr.github.io/reprores-v5/
Reposted by Lisa DeBruine
Our contribution to an upcoming book on teaching open science was "how to teach reproducible research". There are plenty of lesson plans or individual courses out there but less on how you can build skills across a whole degree.
osf.io/preprints/ps...
osf.io/preprints/ps...
OSF
osf.io
September 8, 2025 at 11:04 AM
Our contribution to an upcoming book on teaching open science was "how to teach reproducible research". There are plenty of lesson plans or individual courses out there but less on how you can build skills across a whole degree.
osf.io/preprints/ps...
osf.io/preprints/ps...
I have discovered the most delicious oatmeal topping ever. Stir in a spoon of biscoff spread and top with flaky sea salt (measure with your heart, it really depends how you're feeling abut sweet vs salty on a given day).
August 22, 2025 at 8:45 AM
I have discovered the most delicious oatmeal topping ever. Stir in a spoon of biscoff spread and top with flaky sea salt (measure with your heart, it really depends how you're feeling abut sweet vs salty on a given day).
Reposted by Lisa DeBruine
Happy to share the first article of my PhD journey at @uofglasgow.bsky.social and @socialai.bsky.social
@debruine.bsky.social, Prof Stumpf and I reviewed ~150 articles from 10 disciplines about trust in AI and synthesised how it forms in affective human-AI relationships: doi.org/10.1016/j.ch...
@debruine.bsky.social, Prof Stumpf and I reviewed ~150 articles from 10 disciplines about trust in AI and synthesised how it forms in affective human-AI relationships: doi.org/10.1016/j.ch...
August 15, 2025 at 1:53 PM
Happy to share the first article of my PhD journey at @uofglasgow.bsky.social and @socialai.bsky.social
@debruine.bsky.social, Prof Stumpf and I reviewed ~150 articles from 10 disciplines about trust in AI and synthesised how it forms in affective human-AI relationships: doi.org/10.1016/j.ch...
@debruine.bsky.social, Prof Stumpf and I reviewed ~150 articles from 10 disciplines about trust in AI and synthesised how it forms in affective human-AI relationships: doi.org/10.1016/j.ch...
What was I supposed to do this morning?
Make comments on a draft of the Papercheck paper.
What did I actually do?
Write an R function to add DOIs from OpenAlex to a .bib file (the bibtex citations you get from google scholar bizarrely don't have DOIs)
Make comments on a draft of the Papercheck paper.
What did I actually do?
Write an R function to add DOIs from OpenAlex to a .bib file (the bibtex citations you get from google scholar bizarrely don't have DOIs)
August 19, 2025 at 1:23 PM
What was I supposed to do this morning?
Make comments on a draft of the Papercheck paper.
What did I actually do?
Write an R function to add DOIs from OpenAlex to a .bib file (the bibtex citations you get from google scholar bizarrely don't have DOIs)
Make comments on a draft of the Papercheck paper.
What did I actually do?
Write an R function to add DOIs from OpenAlex to a .bib file (the bibtex citations you get from google scholar bizarrely don't have DOIs)
I've started 6 chapters in the past 3 days. It's very draft content, but I'd love feedback on whether this is the sort of thing people might use and what you'd want out of it.
What metadata about each version would you want to be able to decide if a version is good for a lesson you're planning?
What metadata about each version would you want to be able to decide if a version is good for a lesson you're planning?
August 8, 2025 at 4:14 PM
I've started 6 chapters in the past 3 days. It's very draft content, but I'd love feedback on whether this is the sort of thing people might use and what you'd want out of it.
What metadata about each version would you want to be able to decide if a version is good for a lesson you're planning?
What metadata about each version would you want to be able to decide if a version is good for a lesson you're planning?
I'm putting together some datasets relevant to the UN Sustainable Development Goals (for teaching purposes) and wondered if anyone has suggestions for interesting datasets on these themes. You can see what I'm aiming at in the first chapter.
psyteachr.github.io/sdg-data/
psyteachr.github.io/sdg-data/
August 6, 2025 at 4:06 PM
I'm putting together some datasets relevant to the UN Sustainable Development Goals (for teaching purposes) and wondered if anyone has suggestions for interesting datasets on these themes. You can see what I'm aiming at in the first chapter.
psyteachr.github.io/sdg-data/
psyteachr.github.io/sdg-data/
Am I being dumb, or is the only way to retrieve info about an entity like osf.io/4i578 using the OSF API to iteratively check if it is a node, file, preprint, registration, user, etc. until I find one that doesn't return a 404?
If this is the actual case, please someone at @cos.io help 🙏
If this is the actual case, please someone at @cos.io help 🙏
August 6, 2025 at 10:49 AM
Am I being dumb, or is the only way to retrieve info about an entity like osf.io/4i578 using the OSF API to iteratively check if it is a node, file, preprint, registration, user, etc. until I find one that doesn't return a 404?
If this is the actual case, please someone at @cos.io help 🙏
If this is the actual case, please someone at @cos.io help 🙏
Does anyone from @cos.io know how to access info on the API about nodes you don't own with an active view-only link?
My test link is:
osf.io/ybm3c/?view_...
But following the API docs at developer.osf.io#operation/no...
I can't access info using api.osf.io/v2/nodes/ybm... unless logged in
My test link is:
osf.io/ybm3c/?view_...
But following the API docs at developer.osf.io#operation/no...
I can't access info using api.osf.io/v2/nodes/ybm... unless logged in
August 6, 2025 at 10:33 AM
Does anyone from @cos.io know how to access info on the API about nodes you don't own with an active view-only link?
My test link is:
osf.io/ybm3c/?view_...
But following the API docs at developer.osf.io#operation/no...
I can't access info using api.osf.io/v2/nodes/ybm... unless logged in
My test link is:
osf.io/ybm3c/?view_...
But following the API docs at developer.osf.io#operation/no...
I can't access info using api.osf.io/v2/nodes/ybm... unless logged in
Reposted by Lisa DeBruine
The first version of the open science blog archive is complete, with 3530 posts from 52 blogs. Browse them in the online Shiny app: shiny.ieis.tue.nl/open_science... All blog posts are ordered chronologically. Have fun exploring part of the open science history in psychology!
July 26, 2025 at 6:10 AM
The first version of the open science blog archive is complete, with 3530 posts from 52 blogs. Browse them in the online Shiny app: shiny.ieis.tue.nl/open_science... All blog posts are ordered chronologically. Have fun exploring part of the open science history in psychology!
Reposted by Lisa DeBruine
If you just got an email from APA encouraging you to come to this session, YOU SHOULD! Because the "Open Science and Methodology panel member" is ME! Come say hi! Learn about registered reports, and other awesome open science things at APA!
July 25, 2025 at 5:14 PM
If you just got an email from APA encouraging you to come to this session, YOU SHOULD! Because the "Open Science and Methodology panel member" is ME! Come say hi! Learn about registered reports, and other awesome open science things at APA!
Reposted by Lisa DeBruine
This is going to be a very real challenge for all open content providers to handle. I'd love to hear from others in the preprint space about how we're addressing these challenges.
The OSF was designed to make open scholarship possible and easy to adopt. As the role of AI in research continues to evolve, COS is assessing how our infrastructure can deter AI misuse and help researchers share their work in transparent, responsible ways.
🔗 Read more:
www.cos.io/blog/eval...
🔗 Read more:
www.cos.io/blog/eval...
A Shared Challenge: Evaluating AI’s Impact on Open Research Infrastructure
OSF was designed to make open scholarship possible and easy to adopt, while upholding the values of transparency, credibility, and accountability. As we navigate the evolving role of AI in research, COS remains focused on strengthening open research infrastructure and helping communities embed open practices that foster rigor and trust.
www.cos.io
July 25, 2025 at 3:15 PM
This is going to be a very real challenge for all open content providers to handle. I'd love to hear from others in the preprint space about how we're addressing these challenges.