Thanks so much! 😁

Not sure Daniel has anywhere near enough time (and not totally sure I have anywhere near enough experience doing meta science). That said, thinking about null results is kind of an obsession of mine, so I’ll keep it in mind for the future! 🙏

Really enjoyed this, as always!👏

FWIW, one argument I find persuasive is that, yes, high SES kids have advantages on the SAT that are unrelated to the underlying trait.

BUT—banning it would give more weight to things that high SES kids are *even more* advantaged on (rec letters, HS quality, etc) 🤔

Indeed! Would love to see a side-by-side comparison of (1) z/t-statistic distributions for hypothesized effects (we'd see the classic drop right around 1.96ish), vs. (2) z/t-statistic distributions for any placebo tests--just how different would these distributions look? 😬

The more I think about it, p-stacking might be esp common for robustness checks & placebo tests, wherein the goal is to show a non-significant effect.

For example, rule out an alternative explanation via showing it's non-significant, which serves as more evidence for one's significant effect. 🤔

😂 that one crossed my mind as well.

Ultimately I thought better to go with something that evokes “going up” (and maybe something less violent lol)

Really enjoyed this!

I esp loved the discussion of reverse p-hacking as a means of purposely generating null results. I could picture this happening more as null results become more acceptable--it'd be yet another way of creating a "clear story." Might I suggest calling it: "p-stacking"? 😉

I didn’t even notice—I just feel that last sentence deep in my soul every time I have to grade a new batch of assignments 😭

Amen to this, Andrew!

So nice of you to say that, Andrew. And thank you for sharing about your children—they’re lucky to have a dad as kind as you, and it makes the paper all the more touching.

And your graphs look terrific! 🤩 (I quickly spotted those bolded headings on the y-axis 😊) So glad the guides are useful! 🙏

Thanks so much for this, Andrew. Before the Ph.D. I was a social worker for 6 years, working with developmentally disabled adults. This research hits close to home 😔

LOVE this book ❤️🙏

@sgadarian.bsky.social and @polpsychangel.bsky.social, in case it’s useful for you! 👍

Much appreciated, Sam! 🙏

Link to article on Medium:
medium.com/the-stata-ga...

CC'ing some fellow @statacorp.bsky.social users (that I know of): @lilymasonphd.bsky.social @juliewronski.bsky.social @cbwlezien.bsky.social @profsamperry.bsky.social @nathankalmoe.bsky.social @mirya.bsky.social @asjadnaqvi.bsky.social

You are most welcome! I’m a huge fan of writing practical guides for researchers and students, so it was wonderful to read yours.

(That said, apologies for the unintentional spike in requests! 😬)

@meganakpeters.bsky.social I really loved this article. I definitely will share with students.

FYI I posted it on "the other site" and it kind of blew up (as it should!). 😁

Really appreciate it, Rikio! My primary goal for that paper was for it to be as practical and useful for researchers as possible, so this is really nice to hear! 😊🙏

Just heard about this from a friend. Wow. It’s like the Refused, Hives, Minus (circa “Jesus Christ Bobby” album), and At the Drive-In all combined together in the best possible way. Loving it.