#statstab #330 Encourage Playing with Data and Discourage Questionable Reporting Practices
Thoughts: What are and aren't "Questionable Research Practices"? Where is the "grey area"? Interesting opinion piece.
#QRPs #exploratory #EDA #posthoc #phacking
link.springer.com/article/10.1...
Thoughts: What are and aren't "Questionable Research Practices"? Where is the "grey area"? Interesting opinion piece.
#QRPs #exploratory #EDA #posthoc #phacking
link.springer.com/article/10.1...
Encourage Playing with Data and Discourage Questionable Reporting Practices - Psychometrika
Psychometrika -
link.springer.com
April 25, 2025 at 6:22 PM
#statstab #330 Encourage Playing with Data and Discourage Questionable Reporting Practices
Thoughts: What are and aren't "Questionable Research Practices"? Where is the "grey area"? Interesting opinion piece.
#QRPs #exploratory #EDA #posthoc #phacking
link.springer.com/article/10.1...
Thoughts: What are and aren't "Questionable Research Practices"? Where is the "grey area"? Interesting opinion piece.
#QRPs #exploratory #EDA #posthoc #phacking
link.springer.com/article/10.1...
The thesis actually seems to find some evidence there is more phacking in non-prereg studies (so weird the original poster did not highlight that, right?! You wonder why!). I think an analysis of what is locked in and what not and how often deviate where is interesting.
August 30, 2023 at 5:04 AM
The thesis actually seems to find some evidence there is more phacking in non-prereg studies (so weird the original poster did not highlight that, right?! You wonder why!). I think an analysis of what is locked in and what not and how often deviate where is interesting.
☂️To bring clarity, we introduced "QRP umbrella terms" that group conceptually related QRPs. For example, #Phacking 🪓consists of 13 specific QRPs, and #CherryPicking 🍒covers 7. This disaggregation helps pinpoint specific behaviors.
July 11, 2025 at 8:52 AM
☂️To bring clarity, we introduced "QRP umbrella terms" that group conceptually related QRPs. For example, #Phacking 🪓consists of 13 specific QRPs, and #CherryPicking 🍒covers 7. This disaggregation helps pinpoint specific behaviors.
Thanks @chrisdc77, used a few of your Registered Reports -related slides at Macquarie today http://www.slideshare.net/AlexHolcombe/open-access-phacking-registered-reports-registered-replication-reports They went down well :)
open access, p-hacking, registered reports, registered re...
open access, p-hacking, registered reports, registered re...
www.slideshare.net
December 5, 2024 at 8:47 AM
Thanks @chrisdc77, used a few of your Registered Reports -related slides at Macquarie today http://www.slideshare.net/AlexHolcombe/open-access-phacking-registered-reports-registered-replication-reports They went down well :)
"Most researchers don’t set out to cheat, but they could unknowingly make choices that push them towards a significant result. Here are five ways P hacking can slip into your research."
buff.ly/ArtMGCu
#PHacking #PValue #ScientificRigor
buff.ly/ArtMGCu
#PHacking #PValue #ScientificRigor
P hacking — Five ways it could happen to you
Some data practices can lead to statistically dubious findings. Here’s how to avoid them.
buff.ly
May 28, 2025 at 1:03 PM
"Most researchers don’t set out to cheat, but they could unknowingly make choices that push them towards a significant result. Here are five ways P hacking can slip into your research."
buff.ly/ArtMGCu
#PHacking #PValue #ScientificRigor
buff.ly/ArtMGCu
#PHacking #PValue #ScientificRigor
From a respected colleague. Still a long way to go! #openscience #pHacking I suppose there's no data on how many still ignorant of this?
December 5, 2024 at 12:36 AM
From a respected colleague. Still a long way to go! #openscience #pHacking I suppose there's no data on how many still ignorant of this?
Check out the preprint for the full results (also combinations of p-hacking strategies) and the accompanying Shiny app, where you can check out your favorite p-hacking combinations ;)
emaassen.shinyapps.io/phacking/
emaassen.shinyapps.io/phacking/
<div style="font-size:20px; margin-bottom:5px;">Estimating Effect Size and Heterogeneity in Meta-Analysis in the Presence of Publication Bias and p-hacking</div>
emaassen.shinyapps.io
June 19, 2025 at 8:46 AM
Check out the preprint for the full results (also combinations of p-hacking strategies) and the accompanying Shiny app, where you can check out your favorite p-hacking combinations ;)
emaassen.shinyapps.io/phacking/
emaassen.shinyapps.io/phacking/
YOR PHACKING COOKED
November 21, 2024 at 5:31 PM
YOR PHACKING COOKED
The crisis of science from ChatGPT's perspective. #openscience #replication #metascience #academicpublishing #publishorperish #phacking #HARKing
November 26, 2024 at 10:44 AM
The crisis of science from ChatGPT's perspective. #openscience #replication #metascience #academicpublishing #publishorperish #phacking #HARKing
Explore five ways p-hacking can occur in research and strategies to uphold scientific integrity.
🔗 buff.ly/GVqUJZK
#DataAnalysis #PHacking #Research
🔗 buff.ly/GVqUJZK
#DataAnalysis #PHacking #Research
P hacking — Five ways it could happen to you
Some data practices can lead to statistically dubious findings. Here’s how to avoid them.
buff.ly
July 28, 2025 at 9:03 PM
Explore five ways p-hacking can occur in research and strategies to uphold scientific integrity.
🔗 buff.ly/GVqUJZK
#DataAnalysis #PHacking #Research
🔗 buff.ly/GVqUJZK
#DataAnalysis #PHacking #Research
After seeing FiveThirtyEights implementation of this idea (thank you @andrew.heiss.phd for sharing), I've been working on a medicine themed p-hacking simulator called Placebo playground: medicines.charlwood.xyz#phacking
#pharmsky #healtheconomics #medsky #pharmacy
1/3 🧵
#pharmsky #healtheconomics #medsky #pharmacy
1/3 🧵
April 3, 2025 at 7:36 PM
After seeing FiveThirtyEights implementation of this idea (thank you @andrew.heiss.phd for sharing), I've been working on a medicine themed p-hacking simulator called Placebo playground: medicines.charlwood.xyz#phacking
#pharmsky #healtheconomics #medsky #pharmacy
1/3 🧵
#pharmsky #healtheconomics #medsky #pharmacy
1/3 🧵
I mean, they have a hypothesis (something/ someone is fraud), how do they test that hypothesis, it should obviously be transparent and laid out beforehand to avoid bias/ phacking.
What analyses are they using, how many images do they look at, what analyses are run on those images, etc.
What analyses are they using, how many images do they look at, what analyses are run on those images, etc.
January 10, 2025 at 9:16 PM
I mean, they have a hypothesis (something/ someone is fraud), how do they test that hypothesis, it should obviously be transparent and laid out beforehand to avoid bias/ phacking.
What analyses are they using, how many images do they look at, what analyses are run on those images, etc.
What analyses are they using, how many images do they look at, what analyses are run on those images, etc.
in which i list a bunch of scientific reforms & call them all populist gimmicks. for an hour.
writing & producing this episode was a real slog, in my 30°C, noisy studio (attic). it's likely also going to be a slog for my ~100 listeners.
#blockbuster #epic #openscience #reform #phacking #QRP
writing & producing this episode was a real slog, in my 30°C, noisy studio (attic). it's likely also going to be a slog for my ~100 listeners.
#blockbuster #epic #openscience #reform #phacking #QRP
Part II of my epic criticism of - some parts of - the #openscience / scientific #reform movement. Episode #40
"The populists" (& the podcasters; but not the meek)
Full text transcript, links & references (b-log):
theerrorbar.com?e=40
Podcast audio (a-log):
podcasters.spotify.com/pod/show/the...
"The populists" (& the podcasters; but not the meek)
Full text transcript, links & references (b-log):
theerrorbar.com?e=40
Podcast audio (a-log):
podcasters.spotify.com/pod/show/the...
Open Science and its Enemies. Part II: The populists by the error bar
in this episode i continue discussing some problems in the open science movement. i focus on populist podcasters and the promotion of simplistic heuristics that some scientists argue will improve scie...
podcasters.spotify.com
August 2, 2024 at 7:08 AM
in which i list a bunch of scientific reforms & call them all populist gimmicks. for an hour.
writing & producing this episode was a real slog, in my 30°C, noisy studio (attic). it's likely also going to be a slog for my ~100 listeners.
#blockbuster #epic #openscience #reform #phacking #QRP
writing & producing this episode was a real slog, in my 30°C, noisy studio (attic). it's likely also going to be a slog for my ~100 listeners.
#blockbuster #epic #openscience #reform #phacking #QRP
Thanks @maxcoltheart @DrBrocktagon @annecastles @vincepsy for openaccess prereg, p-hack meeting today! My slides: http://www.slideshare.net/AlexHolcombe/open-access-phacking-registered-reports-registered-replication-reports
open access, p-hacking, registered reports, registered re...
open access, p-hacking, registered reports, registered re...
www.slideshare.net
December 5, 2024 at 8:42 AM
Thanks @maxcoltheart @DrBrocktagon @annecastles @vincepsy for openaccess prereg, p-hack meeting today! My slides: http://www.slideshare.net/AlexHolcombe/open-access-phacking-registered-reports-registered-replication-reports
I am so phacking mad rn I got spoiled for Neon Genesis Evangelion by a PHACKING ARTMS EDIT ARE YOU FUCKING KIDDING ME IM
July 12, 2025 at 8:18 AM
I am so phacking mad rn I got spoiled for Neon Genesis Evangelion by a PHACKING ARTMS EDIT ARE YOU FUCKING KIDDING ME IM
🎉 Week 2 of the #MemeChallenge complete!
📚 Topic(s): Sampling Theory & Research Ethics
🧠 32 creative submissions
🧑⚖️ Judged by an international jury of 8
🏆 5 winners — that’s a competitive 16% win-ratio
Once again, I’m impressed – show that learning & laughing can go hand in hand.
📚 Topic(s): Sampling Theory & Research Ethics
🧠 32 creative submissions
🧑⚖️ Judged by an international jury of 8
🏆 5 winners — that’s a competitive 16% win-ratio
Once again, I’m impressed – show that learning & laughing can go hand in hand.
April 3, 2025 at 3:25 PM
🎉 Week 2 of the #MemeChallenge complete!
📚 Topic(s): Sampling Theory & Research Ethics
🧠 32 creative submissions
🧑⚖️ Judged by an international jury of 8
🏆 5 winners — that’s a competitive 16% win-ratio
Once again, I’m impressed – show that learning & laughing can go hand in hand.
📚 Topic(s): Sampling Theory & Research Ethics
🧠 32 creative submissions
🧑⚖️ Judged by an international jury of 8
🏆 5 winners — that’s a competitive 16% win-ratio
Once again, I’m impressed – show that learning & laughing can go hand in hand.
we should call it "phacking"
August 7, 2024 at 1:47 PM
we should call it "phacking"
P-hacking: subtle practices that can distort research findings. Nature discusses five ways this can occur and how to prevent it. A must-read for data analysts and researchers.
🔗 buff.ly/GVqUJZK
#PHacking #DataScience #ResearchEthics #Reproducibility
🔗 buff.ly/GVqUJZK
#PHacking #DataScience #ResearchEthics #Reproducibility
P hacking — Five ways it could happen to you
Some data practices can lead to statistically dubious findings. Here’s how to avoid them.
buff.ly
June 30, 2025 at 1:19 PM
P-hacking: subtle practices that can distort research findings. Nature discusses five ways this can occur and how to prevent it. A must-read for data analysts and researchers.
🔗 buff.ly/GVqUJZK
#PHacking #DataScience #ResearchEthics #Reproducibility
🔗 buff.ly/GVqUJZK
#PHacking #DataScience #ResearchEthics #Reproducibility
In my comment, I agree with virtually everything said but point to a blind spot in the discussion: sex research is dominated by single study papers that hinder both the detection of anomalies and scientific progress. #solidscience #sexology #pHACKING https://psyarxiv.com/cpjr7
OSF
psyarxiv.com
November 23, 2024 at 12:40 AM
In my comment, I agree with virtually everything said but point to a blind spot in the discussion: sex research is dominated by single study papers that hinder both the detection of anomalies and scientific progress. #solidscience #sexology #pHACKING https://psyarxiv.com/cpjr7
These people when the movie has an Alien Starfish who speaks in color: 😀
Them when it has one (1) gay character:
Them when it has one (1) gay character:
November 1, 2024 at 3:33 PM
These people when the movie has an Alien Starfish who speaks in color: 😀
Them when it has one (1) gay character:
Them when it has one (1) gay character:
#statstab #135 {p-checker} The one-for-all p-value analyzer
Thoughts: Why not try your hand at some tools for detecting publication bias (mileage may vary). Useful teaching demo tools.
#shinyapp #r #rstats #phacking #pvalues #NHST #education #edu
shinyapps.org/apps/p-check...
Thoughts: Why not try your hand at some tools for detecting publication bias (mileage may vary). Useful teaching demo tools.
#shinyapp #r #rstats #phacking #pvalues #NHST #education #edu
shinyapps.org/apps/p-check...
Experience Statistics
shinyapps.org
July 12, 2024 at 3:35 PM
#statstab #135 {p-checker} The one-for-all p-value analyzer
Thoughts: Why not try your hand at some tools for detecting publication bias (mileage may vary). Useful teaching demo tools.
#shinyapp #r #rstats #phacking #pvalues #NHST #education #edu
shinyapps.org/apps/p-check...
Thoughts: Why not try your hand at some tools for detecting publication bias (mileage may vary). Useful teaching demo tools.
#shinyapp #r #rstats #phacking #pvalues #NHST #education #edu
shinyapps.org/apps/p-check...