Lisa DeBruine
LightNews LightNews
banner
debruine.bsky.social
Lisa DeBruine
@debruine.bsky.social
6.9K followers 350 following 320 posts
#rstats #PsyTeachR #PsySciAcc #OpenResearch #CodingClub #ManyFaces (overwhelmed by social media) 🏳️‍🌈 she/they
Posts Replies Media Videos
debruine.bsky.social
I've started 6 chapters in the past 3 days. It's very draft content, but I'd love feedback on whether this is the sort of thing people might use and what you'd want out of it.

What metadata about each version would you want to be able to decide if a version is good for a lesson you're planning?
A plot showing water access by development level from 2000 to 2022. High-income countries have nearly 100% safe access, while access steadily worsens for lower income levels, but steadily improves over time.
August 8, 2025 at 4:14 PM
debruine.bsky.social
Happy Glasgow Pride!
❤️🧡💛💚💙💜🩷🩵🤍🤎🖤

(The #NoPrideInGenocide event at Kinning Park is fab)
A face in a black mask with rainbow gem eyeshadow, standing in front of a giant trans flag
July 19, 2025 at 2:08 PM
debruine.bsky.social
Ed Gerstner from @springernature.com presents data from their survey on researcher perspectives on evaluation practices

stories.springernature.com/state-of-res...
METRICS DOMINATE EXISTING ASSESSMENT PRACTICES, BUT MOST RESEARCHERS DESIRE BALANCE • The majority of respondents told us they are evaluated either entirely or mostly based on metrics — primarily publication metrics. • All researchers want assessment to be more representative of their contributions other than research outputs. • Compared to existing practices, there is also a clear desire to reduce reliance on metrics. Plot showing that people think current assessment is skewed towards quantitative measures, but want more balance At present, what is the mix of quantitative and qualitative methods for how your work is evaluated? (n=4,910) In an ideal research assessment process, what would you suggest should be the weighting? (n=4,869)
July 2, 2025 at 11:27 AM
debruine.bsky.social
@alexrushforth.bsky.social speaking about the Dutch national initiative to reform research assessment
#MetaScience2025
Formative Appraisal Where things have gone well - Major establishment bodies bought in - Withstood public opposition - Grown the coalition - (Positive) unanticipated effects and 'small wins' Challenges - Expecting too much, too soon (e.g. over half of sector claimed no meaningful benefits yet. Source: Culture Barometer 2024) - Lack of awareness (53% of PhD researchers not aware of program) - Persuading 'rank and file' gatekeepers and wider academic community - Engaging with research fields and publishing reform movement
July 2, 2025 at 11:10 AM
debruine.bsky.social
@lizziegadd.bsky.social from @coarassessment.bsky.social speaks on how you assess the success of a reform movement #MetaScience2025
DRIVERS OF ASSESSMENT REFORM - Open research - Research Integrity - Equity, Diversion & Inclusion - Research Culture - Research careers
July 2, 2025 at 10:58 AM
debruine.bsky.social
Bregt Saenen presents data from a European Survey of Strategic Approaches to, and Research Assessment of, Open Science
#MetaScience2025

www.scienceeurope.org/our-resource...
Which elements of open science are part of the documented strategic approach followed by your organisation? Open access to research articles Findable, Accessible, Interoperable, Re-usable (FAIR) | research data (including for example data management plans) Open access to research data (including for example metadata) Open access to research books Open research infrastructure Stakeholder engagement with industry partners, policy makers, and/or the public (including for example science communication) Open source research software, code, and tools (including for example software management plans) Citizen science Open evaluation (including for example open peer review. open and transparent indicators/metrics) Open research methods (such as pre-registration of study designs, open protocols and workflows) Service and leadership (such as engagement in open science policy development, teaching, and/or supervision) Open hardware Open education Outcome from a 2024 survey among Science Europe Member Organisations (Europe's foremost public research funding and research performing organisations) on their strategic approaches to, and research assessment of, Open Science. See scieur.org/ra-os-survey for more information.
July 2, 2025 at 10:54 AM
debruine.bsky.social
Emmanuel Boakye, founder of the African Reproducibility Network is building bridges between communities in Africa
#MetaScience2025
The African open science landscape, a slide with logos of organisations like Africa Open Science Hardware and AfricArXiv
July 2, 2025 at 8:38 AM
debruine.bsky.social
Both optimistic and pessimistic conclusions from @tomhardwicke.bsky.social #MetaScience2025

Open practices are increasing, but not very fast.

doi.org/10.1177/2515...
Plots showing significant but still quite small increases from 2015 to 2022 in prevalence of preregistration, open materials, data, analysis scripts, open access, conflict of interest statements, and funding statements
July 1, 2025 at 11:46 AM
debruine.bsky.social
Modifications Required to Pass Reproducibility Verification
Results Change Every Run (Unstable) 13.4% Manual Steps Not Documented 15.7% Starts from Intermediate (Undocumented) Data 15.7% Coding Mistakes 19.8% Paper Exhibits are Outdated 35.5%
July 1, 2025 at 11:34 AM
debruine.bsky.social
Strongly recommending reproducibility packages leads to increased quality of open research over time, with more packages running at first try and more steps documented
A plot that shows changes from first submission to subsequent submissions Improving Science in the World Bank Authors Learn by Doing Packages Ran at First Try: 42.5 to 55.4% Packages with Manual Steps Not Documented: 20.9 to 8.8% Package Starts From Intermediate (undocumented) data: 18.6 to 5.9%
July 1, 2025 at 11:29 AM
debruine.bsky.social
Conclusions from a systematic replication of 30 highly cited AI studies (Odd Erik Gundersen)
#MetaScience2025

arxiv.org/abs/2412.17859
Reproducing Al studies - results Data only 33% success 67% failure Code and data 86% success 14% failure Code is important - not its documentation Data documentation is important
July 1, 2025 at 10:53 AM
debruine.bsky.social
It was all just vibes! But what shocked me even more was promoting the lab leak theory 🤯

(The podcast “If Books Could Kill” has a recent very good discussion of the evidence around this theory and the political forces pushing it)
A panel with John Ioannides speaking in fromt of a slide that reads: "Is science currently overall more beneficial or harmful to humans?" In 2005 "Undoubtedly yes!" In 2025 "I hope so, but I am not so sure" See conflicts of interest (?), SARS-CoV-2 from a lab (?), lockdowns (?), loss of trust, challenge to Mertonian values (disinterestedness, communality, universalism, organized skepticism)
July 1, 2025 at 9:05 AM
debruine.bsky.social
Another in my head/handstands around the world series, photographed by academic colleagues! @ambra-prg.bsky.social were passing by this famous statue (yes, I know what they call him) and I decided this was the perfect background for my Rotterdam edition.
A person standing on their head with no hands in front of the famous Rotterdam statue of Santa holding a bell and a Christmas tree (get your mind out of the gutter…)
June 25, 2025 at 8:09 AM
debruine.bsky.social
Of course, Gav! (I know you can read a methods section…)
In both sessions, blood samples (20 mL) were first collected in which we assessed levels of FSH, LH, total and free testosterone, SHBG, estradiol, and progesterone. Participants thereafter filled out online surveys on sexual function, general well-being and depressive symptoms. These results are reported in Zethraeus et al. (2016) and Zethraeus et al. (2017). After these surveys, participants were given the online survey on facial preferences. In the follow-up session, participants also participated in an economic experiment after the survey on facial preferences. The results from that experiment are reported in Ranehill et al. (2018). In this experiment, we also measured 2D:4D and tested if 2D:4D was associated with economic preferences; those results are reported in Parslow et al. (2019).
June 23, 2025 at 8:25 AM
debruine.bsky.social
I was speaking at a statistics conference in Leuven a few weeks ago and ran into @eikofried.bsky.social who was at an unrelated conference. It was lovely to catch up, and also to get help taking this photo (for a project of my acro teacher)
A person doing a handstand in front of a church door. The photo is taken from below so the church looms in perspective.
June 21, 2025 at 6:47 PM
debruine.bsky.social
From doi.org/10.1098/rsos... by Minocher, @rmcelreath.bsky.social, @babeheim.bsky.social...

"The availability of social learning data decays exponentially with time since publication. The expected probability of finding material for any publication halves every 5.7 years on average (CI: 4.2–7.1)."
Plot showing years since publication on the x-axis (0-25) and probability of data recovery on the y-axis (0-1). The curve starts around 0.8 prob at 0 years and rapidly declines to 0 by 20 years.
June 18, 2025 at 10:29 AM
debruine.bsky.social
A demo letter you can use and modify (check alt text for copy-pastable text).
Dear [MP of my local authority], I am writing to express my serious concern about the UK Supreme Court’s recent judgment in For Women Scotland Ltd v The Scottish Ministers [2025] UKSC 16. In allowing the appeal, the Court concluded that the term “woman" refers exclusively to biological females, excluding trans women with a Gender Recognition Certificate. This interpretation not only undermines the rights and dignity of transgender people, but also sets a dangerous precedent for how legal protections for all minority groups may be interpreted in future. The judgment effectively denies legal recognition of acquired gender in a context where such recognition is fundamental to the safety, inclusion, and equality of trans people. By reducing the legal meaning of “woman” to biology alone, the Court has reinforced a rigid and exclusionary framework that threatens to marginalise trans individuals across public life including employment, healthcare, and political participation. This decision risks emboldening discrimination under the guise of clarity. We are already seeing an immediate rise in the discriminationory group activity which is well publicised on national media. More broadly, this decision signals a retreat from inclusive statutory interpretation and may pave the way for similar restrictions to be placed on other protected characteristics, such as religion, sexual orientation, and disability. If fundamental rights can be narrowed in this way, then the principles of dignity, autonomy, and fairness which underpin the equality law are at risk. I urge you to raise this matter in Parliament and call for legislative clarification to ensure that equality law remains inclusive, humane, and fit for modern society. Regards, Name Full address
April 17, 2025 at 11:15 PM
debruine.bsky.social
Oh no! The signature has nearly entirely sun-faded off one of my favourite thank-you gifts, a signed @xkcd.com comic that @emilynordmann.bsky.social gave me for coding a study for her during her PhD around 2009
A photo of a hard copy of an xkcd comic (https://xkcd.com/303): a line drawing of two people sword fighting on rolling chairs. Speech bubbles out of a door say: “HEY! GET BACK TO WORK!” “COMPILING!” “OH. CARRY ON.” The text above the comic says: THE #1 PROGRAMMER EXCUSE FOR LEGITIMATELY SLACKING OFF: "MY CODE'S COMPILING."
April 10, 2025 at 12:30 PM
debruine.bsky.social
#Day4 of the #30DayChartChallenge (I'm catching up out of order because I don't have a good idea for circles yet)

I use a papercheck module to visualise the distribution of imprecise p-values in PsychSci papers, like "p < .05" or "p > .25" (surprisingly common).

debruine.github.io/30DCC-2025/0...
The distribution of imprecise p-values in results sections. Values with < are shown in red, and > are shown in blue. Notably there are many instances of `p < .01`, `p < .05`, and `p > .25`, with smaller peaks at `p > .05`, `p < .02` and `p < .005`.
April 6, 2025 at 8:14 PM
debruine.bsky.social
#Day2 of #30DayChartChallenge (I'm running a little behind)

I show how to get citation data from OpenAlex for a set of PsychSci papers, and create a simple plot to explore the relationship between citation counts and field-weighted citation impact.

debruine.github.io/30DCC-2025/0...
A chart showing the relationship between citation count (plotted on the x-axis) and field-weighted citation impact (FWCI; plotted on the y-axis). The relation is strongly positive and linear, with some variation. The papers are represented by points with the colour by year of publication (2014-2024), showing that the papers above the regression line tend to be more recent, and those below the line tend to be older.
April 6, 2025 at 12:58 PM
debruine.bsky.social
#Day1 of #30DayChartChallenge - I'm collecting my code and charts in a #quarto book again this year, and using data from a set of 250 open access papers from Psychological Science

debruine.github.io/30DCC-2025/0...
A chart showing the fraction of published papers received each year by Psychological Science, from 2012 to 2023, that have open data, open materials, or preregistration badges. The number is mostly increasing each year, with a sharp decrease in 2022.
April 2, 2025 at 12:04 AM
debruine.bsky.social
I fully sympathise (from my current position)
A person sitting on a chair with one leg tucked underneath and the other foot on a table
March 20, 2025 at 1:55 PM
debruine.bsky.social
My @socialai.bsky.social PhD student is looking for folks who would like to participate in a study about trusting GenAI as a source of emotional support. Registration link: forms.office.com/e/tQ39sRWiHb
Participants needed For a qualitative study on seeking emotional support from Generative AI Chatbots Eligibility criteria ⁃ Adult (18+) ⁃ Currently using GenAI chatbots for emotional support ⁃ Comfortable discussing emotional experiences Commitment and benefits ⁃ 3h of participation over 2 weeks ⁃ £30-39 voucher compensation Social AI: social-cdt.org University of Glasgow
March 13, 2025 at 10:03 AM
debruine.bsky.social
Post a photo you took with no context to bring some zen to the timeline.
Water splashing over the v-shaped rusty edge of a canal lock into the canal far below, photo taken from above.
March 10, 2025 at 8:53 AM
debruine.bsky.social
Very topical example!
Time to go back home Research question: There is a strike, is the train coming? Probability grid
February 21, 2025 at 11:06 AM