Political Scientist. Professor at NYU’s Center for Global Affairs. Experiments, data analysis, guitar, drums, fan of comedy. Make guides for @statacorp.bsky.social users. Two boys and exhausted all the time. More at www.johnvkane.com .. more
Political Scientist. Professor at NYU’s Center for Global Affairs. Experiments, data analysis, guitar, drums, fan of comedy. Make guides for @statacorp.bsky.social users. Two boys and exhausted all the time. More at www.johnvkane.com
Do you do survey experiments? This article is for you! 7 things that increase the risk of null/non-significant results & how to detect/prevent them. It's one of my fav things I've ever written so I hope you enjoy ☺️ polisky
cup.org/3OQhKNv
Not sure Daniel has anywhere near enough time (and not totally sure I have anywhere near enough experience doing meta science). That said, thinking about null results is kind of an obsession of mine, so I’ll keep it in mind for the future! 🙏
FWIW, one argument I find persuasive is that, yes, high SES kids have advantages on the SAT that are unrelated to the underlying trait.
BUT—banning it would give more weight to things that high SES kids are *even more* advantaged on (rec letters, HS quality, etc) 🤔
For example, rule out an alternative explanation via showing it's non-significant, which serves as more evidence for one's significant effect. 🤔
Ultimately I thought better to go with something that evokes “going up” (and maybe something less violent lol)
I esp loved the discussion of reverse p-hacking as a means of purposely generating null results. I could picture this happening more as null results become more acceptable--it'd be yet another way of creating a "clear story." Might I suggest calling it: "p-stacking"? 😉
Reposted by John Kane, William Myers, Maksym Polyakov
Reposted by Brendan Nyhan, Linda J. Skitka, John Kane , and 15 more Brendan Nyhan, Linda J. Skitka, John Kane, Jürgen Maier, Jon Green, Efrén O. Pérez, Jacob Montgomery, Melanie C. Green, Julia Lynch, Nazita Lajevardi, Kristen Olson, David C. Kimball, Maria Abreu, Michael Jones‐Correa, Jeff Carter, Nathan P. Kalmoe, Virginia Sapiro, David Darmofal
The 3-wave ANES panel is now available. It merges data from 3 election studies (2016-2020-2024), the first time the ANES has collected interviews of the same respondents across 3 presidential elections.
In fact, it stars in one of my favorite horror movies as a kid: House on Haunted Hill (1959 version). Not necessarily the best performance in the film, but also not bad given that it lacks a central nervous system.
And your graphs look terrific! 🤩 (I quickly spotted those bolded headings on the y-axis 😊) So glad the guides are useful! 🙏
Reposted by Mirya R. Holman, Nathan P. Kalmoe, David Darmofal
medium.com/the-stata-ga...
CC'ing some fellow @statacorp.bsky.social users (that I know of): @lilymasonphd.bsky.social @juliewronski.bsky.social @cbwlezien.bsky.social @profsamperry.bsky.social @nathankalmoe.bsky.social @mirya.bsky.social @asjadnaqvi.bsky.social
Reposted by Samuel L. Perry, Efrén O. Pérez
software. Link in thread. 👇
Made it mostly for my students but hope you find it useful, too! 😁
(That said, apologies for the unintentional spike in requests! 😬)
FYI I posted it on "the other site" and it kind of blew up (as it should!). 😁
Lots of good advice here 👍
Reposted by Winston T. Lin
IMO, there are only 3 good reasons to do it. One of them needs to be true--otherwise, don't.
medium.com/the-quantast...
Reposted by David Darmofal
@miacosta.bsky.social, in the new @apsa.bsky.social Experiments Newsletter!
In it, we offer some thoughts on how to think about how "realistic" experimental results are. Might be useful for students 😁
connect.apsanet.org/s42/newslett...
medium.com/the-stata-ga...
I've been wanting to write this one for a long time and just posted it on Medium (no paywall 👍). For the profs out there, it might serve as a useful class reading (?). Hope you enjoy!
medium.com/@jvk221/3-st...
Lots more to do on this, so thank you for the feedback! 😁