#metasci
LightNews LightNews
devezer.bsky.social
#metasci #statsky
November 10, 2025 at 5:33 PM
markrubin.bsky.social
"Basic scientists consistently enhance scientific output quality, yet research and newly joining researchers have shifted toward applied orientations."

Preprint: arxiv.org/abs/2509.01530

#PhilSci #MetaSci #AcademicSky 🧪
Despite broad acclaim for basic research, science is undergoing an applied shift that marginalizes basic scientists. This gap reflects an incomplete understanding of their distinctive roles, which prevents translating philosophical appreciation into effective support. We introduce a scalable metric--the application score--to position research along the basic-applied spectrum and apply it to 62 million publications (1970-2023) to reveal the distinctive contributions of basic scientists. We find a structural asymmetry: involvement of basic scientists substantially increases citation impact, even more so in applied contexts, while applied scientists show no such effect in basic domains. This asymmetric effect arises from their intellectual leadership in conceptualization, writing, and experimental design, amplified in large, multidisciplinary, and intermediate career teams. Yet basic scientists remain concentrated in historically prestigious institutions, while new entrants shift toward applied work, indicating critical undersupply. These findings provide large-scale evidence for the indispensable role of basic scientists, guiding policy and institutional strategy to sustain the foundations of discovery and innovation.
November 8, 2025 at 11:37 AM
khinsen.net
Revised preprint: "Establishing trust in automated reasoning"

osf.io/preprints/me...

Based on two very helpful reviews from @metaror.bsky.social:

metaror.org/kotahi/artic...

More references, better discussion of unfamiliar concepts (e.g. conviviality), and more.

🧪 #metasci #compsci
OSF
osf.io
November 6, 2025 at 9:26 AM
devezer.bsky.social
Here's a link to the paper. Let me know what you think.

#metasci #philsci #statsky #sts

11/11
pmc.ncbi.nlm.nih.gov
November 5, 2025 at 7:07 PM
redteamofsci.bsky.social
Counting hypotheses changed GWAS. Why not physics? The role of... insults.
#metasci
www.redteamofscience.com/p/physics-de...
Physics defends itself
There's not as much math as you'd expect
www.redteamofscience.com
November 3, 2025 at 2:02 PM
reproducibilitea.org
📅 Upcoming events - ReproducibiliTea online
Check out our calendar for more details:
reproducibilitea.org/calendar

#OpenResearch #OpenScience #metasci #academicsky
ReproducibiliTea Calendar
ReproducibiliTea - Journal Clubs for Open Science
reproducibilitea.org
November 3, 2025 at 9:35 AM
markrubin.bsky.social
"Preregistarians may have an answer to that, of course. It goes something like: 'yeah, but that isn’t the right kind of preregistered study. You have to do it right'.”

#MetaSci #OpenSci
November 2, 2025 at 7:35 AM
markrubin.bsky.social
“[Psychologists] were typically interested in going beyond direct replication and exploring the phenomenon further in conceptual replications. Thus, they seemed to entertain the kind of wider view of replication that Feest and others have emphasized.”

#MetaSci #STS #OpenSci #AcademicSky
markrubin.bsky.social Mark Rubin @markrubin.bsky.social · May 25
“Why replication is overrated” by @ufeest.bsky.social

doi.org/10.1086/705451
Current debates about the replication crisis in psychology take it for granted that direct replication is valuable, largely focusing on its role in uncovering questionable statistical practices. This article takes a broader look at the notion of replication in psychological experiments. It is argued that all experimentation/replication involves individuation judgments and that research in experimental psychology frequently turns on probing the adequacy of such judgments. In this vein, I highlight the ubiquity of conceptual and material questions in research, arguing that replication has its place but is not as central to psychological research as it is sometimes taken to be.
November 1, 2025 at 2:01 PM
wamsleylab.bsky.social
OK... but if you brag about your Google Scholar sH-index you have to pronounce it "Shindex".

#academicsky #metasci
Google Scholar-based tool gives extra credit to first and last authors
Researchers welcome the initiative, but say it doesn’t go far enough to capture the nuance of researcher productivity and impact.
www.nature.com
October 28, 2025 at 12:43 PM
devezer.bsky.social
#metasci #philsci #sts
October 27, 2025 at 6:34 PM
fraor.bsky.social
The paradox of any system is that it is created to contain chaos, but over time it itself becomes its source when it forgets why it was created.

#philsci #histsci #philsky #MetaSci #Methodology #Psychology #Philosophy
October 27, 2025 at 3:00 AM
fraor.bsky.social
Creation asks for everything you have and then, when it leaves your hands, it leaves silence instead of exhaustion.

#philsci #histsci #philsky #MetaSci #Methodology #Psychology
#Philosophy #stockphoto #photoart #streetphoto #journey #photography
#photooftheday
October 25, 2025 at 9:13 AM
markrubin.bsky.social
"We are not trying to foist replication on anyone. Rather, we are making the case that replication could help (a) qualitative researchers accomplish their existing goals and (b) consumers of qualitative research make decisions about the transferability of findings"
#MetaSci #AcademicSky #Methodology
October 23, 2025 at 8:37 PM
wamsleylab.bsky.social
So, apparently, "left-wing bias" is responsible for a failure of sociologists to adopt #openscience practices and robust causal inference methods. 🤔 And apparently, this implies that enforcing political "viewpoint diversity" among the faculty is a "scientific necessity."

🫤

#academicsky #metasci
Opinion | Left-Wing Bias Is Corrupting Sociology
Other social scientists have reformed. Sociologists haven’t.
www.chronicle.com
October 23, 2025 at 1:19 AM
markrubin.bsky.social
“Multiverse analyses require thorough, theory-based model selection. Otherwise, they become a ‘dangerous tool’ that drowns valid models in misspecified ones, needlessly eroding trust in science.”

A plea for thoughtful models by @kauspurg.bsky.social

#MetaSci
October 21, 2025 at 4:18 PM
reproducibilitea.org
📣 “Peer Review and its Diversification” Webinars 📣

👉 Register for the Zoom link: forms.gle/1R4Y3d33W8bQ...

#PeerReview #metasci #academicsky
October 14, 2025 at 7:46 AM
reproducibilitea.org
📅 Upcoming events - ReproducibiliTea online
Check out our calendar for more details:
reproducibilitea.org/calendar

#OpenResearch #OpenScience #metasci #academicsky
ReproducibiliTea Calendar
ReproducibiliTea - Journal Clubs for Open Science
reproducibilitea.org
October 13, 2025 at 11:34 AM
markrubin.bsky.social
"In its place, we find a messier but more instructive tale, in which science sometimes corrects itself, sometimes evades correction, and always does so amid tangled alliances and competing narrators."

#STS #PhilSci #MetaSci
October 12, 2025 at 7:17 AM
reproducibilitea.org
Join our webinars “Peer Review and its Diversification”!

📅 15-16 October 2025 on Zoom
👉 Registration: forms.gle/1R4Y3d33W8bQ...
📄 Full programme: docs.google.com/document/d/1...

#PeerReview #metasci #academicsky
October 6, 2025 at 8:57 AM
fraor.bsky.social
The suppression of dissent is not a conspiracy, but a systemic function. It is a homeostatic mechanism built into the very fabric of reality. It is designed to dampen impulses that could lead to the unpredictable degeneration of the entire system.

#philsci #histsci #philsky #MetaSci #Psychology
October 3, 2025 at 3:11 PM
markrubin.bsky.social
Reminds me of this recent paper by Carlos Santana

doi.org/10.1017/can....

#MetaSci #OpenSci
Again, the point here is not to vilify openness. Healthy science requires both a great degree of transparency and significant accountability to nonexpert audiences. But Nguyen (2022) was right that, when expertise matters, transparency alone does not lead to the ideal social epistemic outcomes. Healthy epistemic communities involve a good mix of transparency and trust, and despite what you might infer from some of the rhetoric surrounding OS, more transparency does not always lead to more trust (de Fine Licht and Naurin 2015). Transparency is a way to monitor those we do not fully trust, and so we sometimes take it as evidence that actors are untrustworthy (de Fine Licht 2011). Even with the increase in replication work and other OS practices, science will always require a great deal of just trusting that scientists are generally honest actors. That openness can reduce as well as increase trust is thus an important reason not to treat openness as an unmitigated epistemic good.
September 27, 2025 at 10:32 PM
nath-ormond.bsky.social
Most provocatively, I was recently reading this book & thought the methodological issues (comparing the inference schema phrenology) is fairly on the mark. HOWEVER, I think the inferential and methodological mistakes can be put much more carefully in PhilSci/MetaSci @lakens.bsky.social
September 26, 2025 at 9:45 AM
markrubin.bsky.social
"Disadvantaged members of society might perceive experts as members of the elite that they feel alienated from and are thus less inclined to leave deliberative power in their hands."

#MetaSci #AcademicSky #SciComm #SocialPsyc 🧪
September 25, 2025 at 5:20 AM
fraor.bsky.social
Most people don’t want to see or understand.
Not because they’re stupid, but because the fear of breaking their picture of a “unique self” is stronger than the desire to go beyond it.

#philsci #histsci #philsky #SystemTheory
#MetaSci #Methodology #Psychology
#Philosophy #BehavioralTheory #Decision
thx.bsky.social Grant Peace @thx.bsky.social · Sep 24
By definition, that means we are not "artificial intelligence".

Our intelligence is classified as "natural intelligence"...
September 25, 2025 at 12:47 AM
markrubin.bsky.social
Multiverse Analyses

Nice consideration of five nonmutually exclusive motives for conducting multiverse analyses:

🔹️ Assessing robustness

🔹️ Examining boundary conditions

🔹️ Generating hypotheses

🔹️ Increasing transparency

🔹️ Improving a study’s methodology

#MetaSci #Methodology
When processing and analyzing empirical data, researchers regularly face choices that may appear arbitrary (e.g., how to define and handle outliers). If one chooses to exclusively focus on a particular option and conduct a single analysis, its outcome might be of limited utility. That is, one remains agnostic regarding the generalizability of the results, because plausible alternative paths remain unexplored. A multiverse analysis offers a solution to this issue by exploring the various choices pertaining to data processing and/or model building, and examining their impact on the conclusion of a study. However, even though multiverse analyses are arguably less susceptible to biases compared to the typical single-pathway approach, it is still possible to selectively add or omit pathways. To address this issue, we outline a novel, more principled approach to conducting multiverse analyses through crowdsourcing. The approach is detailed in a step-by-step tutorial to facilitate its implementation. We also provide a worked out illustration featuring the Semantic Priming Across Many Languages project, thereby demonstrating its feasibility and its ability to increase objectivity and transparency.
September 23, 2025 at 7:14 AM