Jay Patel
@infotainment.bsky.social
🎷 vibe adulting
#HCI #PeerReview #SciPub
#toolsforthought #ResearchSynthesis
#OpenScience #MetaSci #FoSci
🔎 Research: ethnography of peer review
🧑🏫 Teaching: Stats, DataViz
🐢 UMD: College of Info
🌐 PhD Candidate: Info Studies / HCI + Data
🏝️ OASISlab
#HCI #PeerReview #SciPub
#toolsforthought #ResearchSynthesis
#OpenScience #MetaSci #FoSci
🔎 Research: ethnography of peer review
🧑🏫 Teaching: Stats, DataViz
🐢 UMD: College of Info
🌐 PhD Candidate: Info Studies / HCI + Data
🏝️ OASISlab
Pinned
Jay Patel
@infotainment.bsky.social
· Jun 11
🌐 It strikes me that crowdsourced evaluation/benchmarking of LLMs for scientific work would be valuable and possible in the style of ManyLabs projects.
If I coordinate crowds of volunteers to assess how well LLMs can evaluate papers, would you be interested?
#openscience #metascience #AI #LLM
If I coordinate crowds of volunteers to assess how well LLMs can evaluate papers, would you be interested?
#openscience #metascience #AI #LLM
Hands down, the best PubPeer comment I've read in a while.
November 10, 2025 at 11:12 PM
Hands down, the best PubPeer comment I've read in a while.
I've never seen a qualitative research paper with excellent figures (relevant, eye-catching, etc.).
They only rely on text and photos/screenshots to communicate.
#dataviz + #qualitative research seem opposed, no?
#scicomm #AcademicWriting
They only rely on text and photos/screenshots to communicate.
#dataviz + #qualitative research seem opposed, no?
#scicomm #AcademicWriting
November 10, 2025 at 11:07 PM
I've never seen a qualitative research paper with excellent figures (relevant, eye-catching, etc.).
They only rely on text and photos/screenshots to communicate.
#dataviz + #qualitative research seem opposed, no?
#scicomm #AcademicWriting
They only rely on text and photos/screenshots to communicate.
#dataviz + #qualitative research seem opposed, no?
#scicomm #AcademicWriting
If synesthesia can help perceptual discrimination, I wonder if there are any synesthetic sleuths doing #ImageFraud checks.
#SciComment
matthewjamestaylor.com/synesthesia-...
#SciComment
matthewjamestaylor.com/synesthesia-...
Synesthesia Helps Me Find Four Leaf Clovers
I explain how my synesthesia condition helps me to find four-leaf clovers
matthewjamestaylor.com
November 10, 2025 at 10:42 PM
If synesthesia can help perceptual discrimination, I wonder if there are any synesthetic sleuths doing #ImageFraud checks.
#SciComment
matthewjamestaylor.com/synesthesia-...
#SciComment
matthewjamestaylor.com/synesthesia-...
Reposted by Jay Patel
Have increased capacity for this December INSPECT-SR online training workshop following a successful 1st event today. Book here: www.trybooking.com/uk/FKHV
Introduction to INSPECT-SR Training Workshop December
An introductory 2-hour online workshop will introduce participants to the INSPECT-SR tool for assessing trustworthiness of randomised controlled...
www.trybooking.com
November 6, 2025 at 5:55 PM
Have increased capacity for this December INSPECT-SR online training workshop following a successful 1st event today. Book here: www.trybooking.com/uk/FKHV
While reading a data science conference paper today, I noticed an interesting transparency statement.
Is this common to data mining conferences?
I like this sort of statement; it reminds me a bit of the 21-word solution. #metascience
Is this common to data mining conferences?
I like this sort of statement; it reminds me a bit of the 21-word solution. #metascience
November 7, 2025 at 2:47 AM
While reading a data science conference paper today, I noticed an interesting transparency statement.
Is this common to data mining conferences?
I like this sort of statement; it reminds me a bit of the 21-word solution. #metascience
Is this common to data mining conferences?
I like this sort of statement; it reminds me a bit of the 21-word solution. #metascience
#SciComment Nice example of protecting ECRs from critiques that they had no power to avoid...
I want to comment on a piece of research that came to my attention yesterday that I think is a reflection of endemic problems in our field. The study was published in a top-tier journal and was covered by the national press. It had a very large sample (N>30,000) and several yearly time points.
November 1, 2025 at 1:31 AM
#SciComment Nice example of protecting ECRs from critiques that they had no power to avoid...
Reposted by Jay Patel
New release of PowerLMM.js! Browser-based power analysis for longitudinal models with dropout.
Now includes:
- Power analysis summary report
- Reproducible & shareable configs (URL/JSON)
- Calculations validated against R
- Hypothesis region visualization
powerlmmjs.rpsychologist.com
Now includes:
- Power analysis summary report
- Reproducible & shareable configs (URL/JSON)
- Calculations validated against R
- Hypothesis region visualization
powerlmmjs.rpsychologist.com
October 28, 2025 at 2:02 PM
New release of PowerLMM.js! Browser-based power analysis for longitudinal models with dropout.
Now includes:
- Power analysis summary report
- Reproducible & shareable configs (URL/JSON)
- Calculations validated against R
- Hypothesis region visualization
powerlmmjs.rpsychologist.com
Now includes:
- Power analysis summary report
- Reproducible & shareable configs (URL/JSON)
- Calculations validated against R
- Hypothesis region visualization
powerlmmjs.rpsychologist.com
Reposted by Jay Patel
3rd International Conference “Integrity, Open Science and Artificial Intelligence in Academia and Beyond: Meeting at the Crossroads”
December 17-18
Online & Free
Call for abstracts and registration: armgpublishing.com/3rd-internat...
December 17-18
Online & Free
Call for abstracts and registration: armgpublishing.com/3rd-internat...
3rd International Conference “Integrity, Open Science and Artificial Intelligence in Academia and Beyond: Meeting at the Crossroads” | ArmgPublishing3rd International Conference “Integrity, Open Scien...
armgpublishing.com
October 27, 2025 at 11:46 AM
3rd International Conference “Integrity, Open Science and Artificial Intelligence in Academia and Beyond: Meeting at the Crossroads”
December 17-18
Online & Free
Call for abstracts and registration: armgpublishing.com/3rd-internat...
December 17-18
Online & Free
Call for abstracts and registration: armgpublishing.com/3rd-internat...
Reposted by Jay Patel
Considering Scrivener. Do any of you use any non-Word/Google writing programs?
October 27, 2025 at 12:23 AM
Considering Scrivener. Do any of you use any non-Word/Google writing programs?
Bit of a wild shot, but I'm playing with #RetractionWatch data and #Altmetrics data for a side project and am seeking light, informal guidance here and there from people with experience.
Happy to work through details in DMs (open for you).
Happy to work through details in DMs (open for you).
October 23, 2025 at 11:01 PM
Bit of a wild shot, but I'm playing with #RetractionWatch data and #Altmetrics data for a side project and am seeking light, informal guidance here and there from people with experience.
Happy to work through details in DMs (open for you).
Happy to work through details in DMs (open for you).
Reposted by Jay Patel
What if we did a single run and declared victory
October 23, 2025 at 2:28 AM
What if we did a single run and declared victory
Prediction: AWS Down Memorial Day will be the first new holiday created for GenZ.
Remember the fallen...servers.
Remember the fallen...servers.
October 20, 2025 at 8:06 PM
Prediction: AWS Down Memorial Day will be the first new holiday created for GenZ.
Remember the fallen...servers.
Remember the fallen...servers.
Dear Reviewer 2: Go F’ Yourself.
Another gem in the #peerreview literature, a joke paper, finds that it's Reviewer #3 who's the real problem.
The paper even has a credulous PubPeer comment!
Paper: doi:10.1111/ssqu.12824s
PubPeer: pubpeer.com/publications/80F9ACFE1DC2E6510A4CC3D2D841C1
Another gem in the #peerreview literature, a joke paper, finds that it's Reviewer #3 who's the real problem.
The paper even has a credulous PubPeer comment!
Paper: doi:10.1111/ssqu.12824s
PubPeer: pubpeer.com/publications/80F9ACFE1DC2E6510A4CC3D2D841C1
October 17, 2025 at 11:58 PM
Dear Reviewer 2: Go F’ Yourself.
Another gem in the #peerreview literature, a joke paper, finds that it's Reviewer #3 who's the real problem.
The paper even has a credulous PubPeer comment!
Paper: doi:10.1111/ssqu.12824s
PubPeer: pubpeer.com/publications/80F9ACFE1DC2E6510A4CC3D2D841C1
Another gem in the #peerreview literature, a joke paper, finds that it's Reviewer #3 who's the real problem.
The paper even has a credulous PubPeer comment!
Paper: doi:10.1111/ssqu.12824s
PubPeer: pubpeer.com/publications/80F9ACFE1DC2E6510A4CC3D2D841C1
Reposted by Jay Patel
To absolutely nobody’s surprise, the more than 2,200 episodes of the Joe Rogan Experience do not link to research items even once.
The team decided to run our algorithm across all available episodes of the Joe Rogan Podcast.
At 2261 eps, 3-4 hours long, this was a big task.
The algorithm detected not a single citation in nearly 7,000 hours of content.
The Altmetric team shed a collective tear.
It had worked flawlessly.
9/17
At 2261 eps, 3-4 hours long, this was a big task.
The algorithm detected not a single citation in nearly 7,000 hours of content.
The Altmetric team shed a collective tear.
It had worked flawlessly.
9/17
October 15, 2025 at 12:06 PM
To absolutely nobody’s surprise, the more than 2,200 episodes of the Joe Rogan Experience do not link to research items even once.
Reposted by Jay Patel
I have just left a lengthy Pubpeer comment on the autism/Tylenol study being cited by the Trump administration. There appear to be a number of fairly straightforward errors in the paper.
pubpeer.com/publications...
pubpeer.com/publications...
PubPeer - Evaluation of the evidence on acetaminophen use and neurodev...
There are comments on PubPeer for publication: Evaluation of the evidence on acetaminophen use and neurodevelopmental disorders using the Navigation Guide methodology (2025)
pubpeer.com
October 1, 2025 at 5:03 AM
I have just left a lengthy Pubpeer comment on the autism/Tylenol study being cited by the Trump administration. There appear to be a number of fairly straightforward errors in the paper.
pubpeer.com/publications...
pubpeer.com/publications...
Reposted by Jay Patel
Despite the gutting of the National Center for Educational Statistics, the dept of Ed *did* manage to release 2024 college major counts in the usual format, so I can run it through the same code I do every year. First off, the change since peak of the largest fields -- another year of drops.
September 28, 2025 at 2:20 AM
Despite the gutting of the National Center for Educational Statistics, the dept of Ed *did* manage to release 2024 college major counts in the usual format, so I can run it through the same code I do every year. First off, the change since peak of the largest fields -- another year of drops.
Reposted by Jay Patel
Matthew 15:29-31: And great crowds came to him, bringing with them the lame, the blind, the crippled, the mute, and many others, and they put them at his feet, and he healed them after verifying their citizenship status.
October 2, 2025 at 9:00 PM
Matthew 15:29-31: And great crowds came to him, bringing with them the lame, the blind, the crippled, the mute, and many others, and they put them at his feet, and he healed them after verifying their citizenship status.
One reason I like to post reviews of research papers on @paperstarsorg.bsky.social instead of @pubpeer.com: they actually pass moderation.
The same neutral, substantive comment gets very different results.
The same neutral, substantive comment gets very different results.
October 1, 2025 at 2:37 AM
One reason I like to post reviews of research papers on @paperstarsorg.bsky.social instead of @pubpeer.com: they actually pass moderation.
The same neutral, substantive comment gets very different results.
The same neutral, substantive comment gets very different results.
Reposted by Jay Patel
What’s the best platform for post publication peer review? @pubpeer.com ?
September 25, 2025 at 9:07 PM
What’s the best platform for post publication peer review? @pubpeer.com ?
Reposted by Jay Patel
If you need a GPT-proof assignment... go for a concept map.
Below I am showing the terms that need to be included, the concept map that we made in class, and two different concept maps that ChatGPT suggested.
HOPODSIS TESTING! 🤡
#AcademicSky
Below I am showing the terms that need to be included, the concept map that we made in class, and two different concept maps that ChatGPT suggested.
HOPODSIS TESTING! 🤡
#AcademicSky
October 22, 2024 at 7:29 PM
If you need a GPT-proof assignment... go for a concept map.
Below I am showing the terms that need to be included, the concept map that we made in class, and two different concept maps that ChatGPT suggested.
HOPODSIS TESTING! 🤡
#AcademicSky
Below I am showing the terms that need to be included, the concept map that we made in class, and two different concept maps that ChatGPT suggested.
HOPODSIS TESTING! 🤡
#AcademicSky
Reposted by Jay Patel
I'm looking for examples of post-publication peer review on social media that resulted in considerable harms to the study authors (mistaken accusations or cyberbullying).
Are there examples I've missed over the past few years?
#SciComment #MetaScience #PeerReview
Are there examples I've missed over the past few years?
#SciComment #MetaScience #PeerReview
December 27, 2024 at 10:02 PM
I'm looking for examples of post-publication peer review on social media that resulted in considerable harms to the study authors (mistaken accusations or cyberbullying).
Are there examples I've missed over the past few years?
#SciComment #MetaScience #PeerReview
Are there examples I've missed over the past few years?
#SciComment #MetaScience #PeerReview
I'm looking for an accessible summary of the publish vs. perish and research waste problem for a new graduate student who thinks a longer CV with more pubs is somehow better and indicative of ability.
Any recs? #metascience
Blog posts and explainers > articles
Any recs? #metascience
Blog posts and explainers > articles
September 23, 2025 at 7:12 PM
I'm looking for an accessible summary of the publish vs. perish and research waste problem for a new graduate student who thinks a longer CV with more pubs is somehow better and indicative of ability.
Any recs? #metascience
Blog posts and explainers > articles
Any recs? #metascience
Blog posts and explainers > articles
Reposted by Jay Patel
Looks like vaccines.gov is broken and unusable; it throws a zip code error for all zip codes.
Now millions of Americans have only a patchwork of private-sector tools to search for vaccines.
Now millions of Americans have only a patchwork of private-sector tools to search for vaccines.
September 14, 2025 at 11:50 PM
Looks like vaccines.gov is broken and unusable; it throws a zip code error for all zip codes.
Now millions of Americans have only a patchwork of private-sector tools to search for vaccines.
Now millions of Americans have only a patchwork of private-sector tools to search for vaccines.
Reposted by Jay Patel
🚨 New paper alert 🚨 Using LLMs as data annotators, you can produce any scientific result you want. We call this **LLM Hacking**.
Paper: arxiv.org/pdf/2509.08825
Paper: arxiv.org/pdf/2509.08825
September 12, 2025 at 10:33 AM
🚨 New paper alert 🚨 Using LLMs as data annotators, you can produce any scientific result you want. We call this **LLM Hacking**.
Paper: arxiv.org/pdf/2509.08825
Paper: arxiv.org/pdf/2509.08825