Jack Fitzgerald
@jackfitzgerald.bsky.social
Economics PhD candidate at Vrije Universiteit Amsterdam and the Tinbergen Institute. Working on applied econometrics, replication, and economics of science. https://jack-fitzgerald.github.io. Likes/reposts aren’t endorsements, views are my own.
Had a great time presenting my job market paper at the Lindau Nobel Meeting in Economic Sciences! 🔗 : osf.io/d7sqr_v1/
#LINOecon #EconSky
#LINOecon #EconSky
September 2, 2025 at 7:05 PM
Had a great time presenting my job market paper at the Lindau Nobel Meeting in Economic Sciences! 🔗 : osf.io/d7sqr_v1/
#LINOecon #EconSky
#LINOecon #EconSky
Registration closes July 4! Come join us in-person or online in Amsterdam!
Only a few days left to register to the Amsterdam Replication Games on July 19. Virtual participation is possible and coauthorship to a meta paper is granted.
Register: www.surveymonkey.ca/r/Replicatio...
Register: www.surveymonkey.ca/r/Replicatio...
July 1, 2025 at 1:36 PM
Registration closes July 4! Come join us in-person or online in Amsterdam!
Dutch academics, please share - replication games are coming to Vrije Universiteit Amsterdam on July 19! If you live in the Netherlands, or want a good reason to visit, come take a day to network, hone your skills, and potentially coauthor a paper. Registration: www.surveymonkey.ca/r/Replicatio...
May 15, 2025 at 10:03 AM
Dutch academics, please share - replication games are coming to Vrije Universiteit Amsterdam on July 19! If you live in the Netherlands, or want a good reason to visit, come take a day to network, hone your skills, and potentially coauthor a paper. Registration: www.surveymonkey.ca/r/Replicatio...
Reposted by Jack Fitzgerald
#GDRI_rep Update 7: Retraction! Our comment of "Parent–teacher meetings and student outcomes: Evidence from a developing country" has led to the paper being retracted. Our comment is accepted as is.
Short 🧵
Short 🧵
March 27, 2025 at 9:48 PM
#GDRI_rep Update 7: Retraction! Our comment of "Parent–teacher meetings and student outcomes: Evidence from a developing country" has led to the paper being retracted. Our comment is accepted as is.
Short 🧵
Short 🧵
This will likely be a good initiative, conditional on it not substituting for the journal publishing full comments. Publication is an important incentive for reproducibility/robustness analyses and substantive empirical critiques almost always take more than one page.
We are pleased to announce an experiment intended to stimulate academic discussion and exchange, centered on papers published in Econometrica 1/5
March 27, 2025 at 4:44 PM
This will likely be a good initiative, conditional on it not substituting for the journal publishing full comments. Publication is an important incentive for reproducibility/robustness analyses and substantive empirical critiques almost always take more than one page.
Reposted by Jack Fitzgerald
#GDRI_rep Update 5: We have a new report. We reproduced the paper entitled "Partisan Effects of Information Campaigns in Competitive Authoritarian Elections: Evidence from Bangladesh" by Ahmed, Hodler and Islam published at the Economic Journal. See below for links to report and authors' responses.
March 14, 2025 at 1:25 PM
#GDRI_rep Update 5: We have a new report. We reproduced the paper entitled "Partisan Effects of Information Campaigns in Competitive Authoritarian Elections: Evidence from Bangladesh" by Ahmed, Hodler and Islam published at the Economic Journal. See below for links to report and authors' responses.
What academic journal should I start? Wrong answers only
March 13, 2025 at 4:45 PM
What academic journal should I start? Wrong answers only
Reposted by Jack Fitzgerald
#GDRI_rep Update 4: We have a new report. We reproduced the paper entitled "Parent–teacher meetings and student outcomes" by Islam @ European Economic Review. See below for links to report and author's response.
March 11, 2025 at 5:12 PM
#GDRI_rep Update 4: We have a new report. We reproduced the paper entitled "Parent–teacher meetings and student outcomes" by Islam @ European Economic Review. See below for links to report and author's response.
Thank you @carlislerainey.bsky.social for boosting my job market paper! I’’m a fan of your prior work on this topic.
If you want to learn more, check out the paper and my BIBAP seminar on it tomorrow, 3/12 7 AM CET/5 PM Sydney time.
www.unsw.edu.au/business/beh...
If you want to learn more, check out the paper and my BIBAP seminar on it tomorrow, 3/12 7 AM CET/5 PM Sydney time.
www.unsw.edu.au/business/beh...
March 10, 2025 at 4:33 PM
Thank you @carlislerainey.bsky.social for boosting my job market paper! I’’m a fan of your prior work on this topic.
If you want to learn more, check out the paper and my BIBAP seminar on it tomorrow, 3/12 7 AM CET/5 PM Sydney time.
www.unsw.edu.au/business/beh...
If you want to learn more, check out the paper and my BIBAP seminar on it tomorrow, 3/12 7 AM CET/5 PM Sydney time.
www.unsw.edu.au/business/beh...
Reposted by Jack Fitzgerald
#5 Here's another recent critique of close elections RDDs.
It's unclear whether there is actually good evidence against potentially fatal precise manipulation around the cutoff in these designs.
It's unclear whether there is actually good evidence against potentially fatal precise manipulation around the cutoff in these designs.
March 7, 2025 at 2:59 PM
#5 Here's another recent critique of close elections RDDs.
It's unclear whether there is actually good evidence against potentially fatal precise manipulation around the cutoff in these designs.
It's unclear whether there is actually good evidence against potentially fatal precise manipulation around the cutoff in these designs.
I'll be waking up early (7 AM CET) on Tuesday, March 12 to present my job market paper at 5 PM Sydney time! If you're awake too, stop by to hear me talk about equivalence testing, replication-based methods research, and the robustness of null results in economics!
March 7, 2025 at 10:53 AM
I'll be waking up early (7 AM CET) on Tuesday, March 12 to present my job market paper at 5 PM Sydney time! If you're awake too, stop by to hear me talk about equivalence testing, replication-based methods research, and the robustness of null results in economics!
Relatedly, I also develop new equivalence testing methods for testing running variable (RV) manipulation in RDD. In 36 RDD publications, I find >44% of RV density discontinuities at treatment cutoffs can't be significantly bounded beneath 50% upward jumps. 🧵: bsky.app/profile/jack...
Lots of talk on X today about rethinking the results produced by close elections RDDs.
So, I thought I'd drop a few recent articles about issues that arise in this space so that folks can have them all in one place. 1/N
So, I thought I'd drop a few recent articles about issues that arise in this space so that folks can have them all in one place. 1/N
March 7, 2025 at 10:46 AM
Relatedly, I also develop new equivalence testing methods for testing running variable (RV) manipulation in RDD. In 36 RDD publications, I find >44% of RV density discontinuities at treatment cutoffs can't be significantly bounded beneath 50% upward jumps. 🧵: bsky.app/profile/jack...
Reposted by Jack Fitzgerald
#GDRI_rep Update 2: I4R sent a report to the original authors for the PLOS One article "“Food insecurity and mental health of women during COVID-19: Evidence from a developing country". All authors have now emailed PLOS One to withdraw their names. osf.io/7tzek/
March 3, 2025 at 6:40 PM
#GDRI_rep Update 2: I4R sent a report to the original authors for the PLOS One article "“Food insecurity and mental health of women during COVID-19: Evidence from a developing country". All authors have now emailed PLOS One to withdraw their names. osf.io/7tzek/
Reposted by Jack Fitzgerald
#GDRI_rep Update 1: I4R are now reproducing all published papers that use data from GDRI, or are closely related in other ways. Here is a first update on our work. 🧵
March 3, 2025 at 1:48 AM
#GDRI_rep Update 1: I4R are now reproducing all published papers that use data from GDRI, or are closely related in other ways. Here is a first update on our work. 🧵
Reposted by Jack Fitzgerald
Our proposal for post-publication review: “our system would add only 1 percent to the total reviewing effort, while providing important perspectives on papers representing more than one-quarter of the citations received by these influential journals.”
statmodeling.stat.columbia.edu/2025/02/26/pp/
statmodeling.stat.columbia.edu/2025/02/26/pp/
February 26, 2025 at 2:17 PM
Our proposal for post-publication review: “our system would add only 1 percent to the total reviewing effort, while providing important perspectives on papers representing more than one-quarter of the citations received by these influential journals.”
statmodeling.stat.columbia.edu/2025/02/26/pp/
statmodeling.stat.columbia.edu/2025/02/26/pp/
Reposted by Jack Fitzgerald
The Need for Equivalence Testing in Economics
NEP/RePEc link
to paper
d.repec.org
February 24, 2025 at 9:45 AM
The Need for Equivalence Testing in Economics
As a coauthor on the AEJ:AE report, it’s a lot. Oh my god, It’s a lot. In that paper, outcomes are inconsistently handled both in the code and in the field, the paper’s data is connected to a bunch of other experiments, and we find irregularities in the raw survey files.
After being alerted about possible misconduct, the I4R are reproducing published papers that use data from a specific NGO (GDRI). This thread releases the first 2 reports and provides more information about the work and responses/statements from authors journals and journals. 🧵
February 24, 2025 at 6:42 AM
As a coauthor on the AEJ:AE report, it’s a lot. Oh my god, It’s a lot. In that paper, outcomes are inconsistently handled both in the code and in the field, the paper’s data is connected to a bunch of other experiments, and we find irregularities in the raw survey files.
I had a wonderful time presenting my job market paper at RWI Essen! Thank you @jrgptrs.bsky.social and Julian Rose for hosting and organizing!
Last week we had @jackfitzgerald.bsky.social with us presenting his work on equivalence testing. Economists typically interpret null results as the absence of an effect. This is wrong. Proper testing is particularly important for robustness checks in IV & RDD settings www.econstor.eu/handle/10419...
January 25, 2025 at 2:32 PM
I had a wonderful time presenting my job market paper at RWI Essen! Thank you @jrgptrs.bsky.social and Julian Rose for hosting and organizing!
New working paper! @i4replication.bsky.social does a good job detailing the experiment’s results, so for anyone who considers LLMs/AI as a (soon-to-be) solution to reproducibility in social science, let me walk you through the 🔥hell🔥 of trying to reproduce a paper on an "AI-led" team. 1/7
New research alert! Our study investigates the effectiveness of human-only, AI-assisted, and AI-led teams in assessing the reproducibility of quantitative social science research. We've got some surprising findings!
January 22, 2025 at 3:45 PM
New working paper! @i4replication.bsky.social does a good job detailing the experiment’s results, so for anyone who considers LLMs/AI as a (soon-to-be) solution to reproducibility in social science, let me walk you through the 🔥hell🔥 of trying to reproduce a paper on an "AI-led" team. 1/7
New paper for holiday reading! @isager.bsky.social and I provide an introduction to three-sided testing, a framework for testing estimates' practical significance. We offer a tutorial, Shiny app, + commands/code in #Rstats, #Jamovi, + #Stata. 1/9
osf.io/preprints/psyarxiv/8y925
#EconSky #PsychSky
osf.io/preprints/psyarxiv/8y925
#EconSky #PsychSky
December 20, 2024 at 3:50 PM
New paper for holiday reading! @isager.bsky.social and I provide an introduction to three-sided testing, a framework for testing estimates' practical significance. We offer a tutorial, Shiny app, + commands/code in #Rstats, #Jamovi, + #Stata. 1/9
osf.io/preprints/psyarxiv/8y925
#EconSky #PsychSky
osf.io/preprints/psyarxiv/8y925
#EconSky #PsychSky
Reposted by Jack Fitzgerald
New preprint: “Three-Sided Testing to Establish Practical Significance: A Tutorial” (osf.io/preprints/ps...) with @FitzgeraldJack_, proposing an upgraded version of the TOST equivalence test 🧵
OSF
osf.io
December 20, 2024 at 9:21 AM
New preprint: “Three-Sided Testing to Establish Practical Significance: A Tutorial” (osf.io/preprints/ps...) with @FitzgeraldJack_, proposing an upgraded version of the TOST equivalence test 🧵
A huge thanks to @sweiwang.bsky.social for highlighting my job market paper, The Need for Equivalence Testing in Economics!
#eeac Day 8 @jackfitzgerald.bsky.social argues in his JMP for the need to use equivalence testing for making null claims. He does a large-scale replication of estimates from more than 80 papers and provides goodies in State and R. jack-fitzgerald.github.io/files/The_Ne... #econsky #econjmp
December 11, 2024 at 8:13 AM
A huge thanks to @sweiwang.bsky.social for highlighting my job market paper, The Need for Equivalence Testing in Economics!
In more recent news, I thoroughly enjoyed presenting The Need for Equivalence Testing in Economics at the Netherlands Reproducibility Network Symposium and Platform for Young Meta-Scientists Symposium, with great discussion from Tsz Keung Wong!
December 9, 2024 at 8:58 PM
In more recent news, I thoroughly enjoyed presenting The Need for Equivalence Testing in Economics at the Netherlands Reproducibility Network Symposium and Platform for Young Meta-Scientists Symposium, with great discussion from Tsz Keung Wong!
Two weeks ago, I had a wonderful time presenting The Need for Equivalence Testing in Economics at the Leibniz Open Science Day! (pic: @prashantgarg.bsky.social)
December 9, 2024 at 8:55 PM
Two weeks ago, I had a wonderful time presenting The Need for Equivalence Testing in Economics at the Leibniz Open Science Day! (pic: @prashantgarg.bsky.social)
Moving from Florida to the Netherlands is a trip because for three months of the year, you can look to the sky and think ‘wow, what a beautiful sunset’ before realizing it’s 2:30 in the afternoon
November 24, 2024 at 1:40 PM
Moving from Florida to the Netherlands is a trip because for three months of the year, you can look to the sky and think ‘wow, what a beautiful sunset’ before realizing it’s 2:30 in the afternoon