Timothy Keyes
@timothykeyes.bsky.social
Data Scientist @ Stanford Health Care and perpetual MD/PhD student. 🏳️🌈
AI/ML for health, #rstats and #pydata
AI/ML for health, #rstats and #pydata
Reposted by Timothy Keyes
Just wrapped up a talk at #positconf2025 about LLM evaluation with R! Such a joy to hang out with #rstats folks in person and hear about what others are working on.
Resources and slides: github.com/simonpcouch/...
Resources and slides: github.com/simonpcouch/...
September 17, 2025 at 7:08 PM
Just wrapped up a talk at #positconf2025 about LLM evaluation with R! Such a joy to hang out with #rstats folks in person and hear about what others are working on.
Resources and slides: github.com/simonpcouch/...
Resources and slides: github.com/simonpcouch/...
my most recent hot take: after a year working inside my hospital’s IT system, i’m increasingly convinced that clinical informatics should have been a residency (like pathology or radiology), not a fellowship.
May 13, 2025 at 4:10 AM
my most recent hot take: after a year working inside my hospital’s IT system, i’m increasingly convinced that clinical informatics should have been a residency (like pathology or radiology), not a fellowship.
as i prepare to go back to med school, i am haunted daily by the number of my med school classmates (who are now residents, fellows, or attendings) who have reached out to me to learn about my side-career in health tech because they want to explore alternatives to a full-time clinical career
March 23, 2025 at 11:50 PM
as i prepare to go back to med school, i am haunted daily by the number of my med school classmates (who are now residents, fellows, or attendings) who have reached out to me to learn about my side-career in health tech because they want to explore alternatives to a full-time clinical career
today i got an email in which a statistician cited a paper from over 200 years ago and all i could think is how that’s the kind of power computer scientists wish they had
March 20, 2025 at 3:35 AM
today i got an email in which a statistician cited a paper from over 200 years ago and all i could think is how that’s the kind of power computer scientists wish they had
I feel like every paper I read about LLMs in health care takes for granted that the encouraging, but not necessarily transformative, results we’ve seen so far are going to scale upward as LLMs improve. But are we really safe to assume that LLMs will keep getting better? I’m not so sure.
March 12, 2025 at 5:51 AM
I feel like every paper I read about LLMs in health care takes for granted that the encouraging, but not necessarily transformative, results we’ve seen so far are going to scale upward as LLMs improve. But are we really safe to assume that LLMs will keep getting better? I’m not so sure.
forced my physician collaborators to listen to me talk about partial derivatives today
March 12, 2025 at 2:46 AM
forced my physician collaborators to listen to me talk about partial derivatives today
Reposted by Timothy Keyes
It’s finally out! We brought a multidisciplinary team of physicians, computer scientists, and engineers to red team LLMs for healthcare uses. And we have shared the dataset! www.nature.com/articles/s41...
Red teaming ChatGPT in medicine to yield real-world insights on model behavior - npj Digital Medicine
npj Digital Medicine - Red teaming ChatGPT in medicine to yield real-world insights on model behavior
www.nature.com
March 7, 2025 at 6:46 PM
It’s finally out! We brought a multidisciplinary team of physicians, computer scientists, and engineers to red team LLMs for healthcare uses. And we have shared the dataset! www.nature.com/articles/s41...
i’m working on a few really cool applications of LLMs in health right now (in the real world, in a deployment environment) and my most valuable asset by far in this work isn’t being the most technical person on the team (i’m not); it’s knowing just enough about medicine to ask the right questions
March 1, 2025 at 2:37 AM
i’m working on a few really cool applications of LLMs in health right now (in the real world, in a deployment environment) and my most valuable asset by far in this work isn’t being the most technical person on the team (i’m not); it’s knowing just enough about medicine to ask the right questions
Reposted by Timothy Keyes
Dr. @emilyalsentzer.bsky.social, a Stanford faculty member and expert in clinical #AI, discusses the evolution of natural language processing, the challenges of AI in clinical settings, and what the future holds for open-source medical AI. Full episode: nejm.ai/4gOGeSo
#MedSky #MLSky
#MedSky #MLSky
February 19, 2025 at 2:22 PM
Dr. @emilyalsentzer.bsky.social, a Stanford faculty member and expert in clinical #AI, discusses the evolution of natural language processing, the challenges of AI in clinical settings, and what the future holds for open-source medical AI. Full episode: nejm.ai/4gOGeSo
#MedSky #MLSky
#MedSky #MLSky
Reposted by Timothy Keyes
"What I find hard to reconcile is, on the one hand, we want to not fall behind on AI writ large. And on the other hand, the very people we need to ensure that agility are being let go.”—Nigam Shah @stanfordhai.bsky.social
February 17, 2025 at 1:13 AM
"What I find hard to reconcile is, on the one hand, we want to not fall behind on AI writ large. And on the other hand, the very people we need to ensure that agility are being let go.”—Nigam Shah @stanfordhai.bsky.social
i have to respect how non-technical folks use spreadsheets - they give you these beautiful murals with all kinds of colors and spacing and intricate patterns. i must say it really breaks my heart to immediately flatten it all with read_csv
February 18, 2025 at 1:34 AM
i have to respect how non-technical folks use spreadsheets - they give you these beautiful murals with all kinds of colors and spacing and intricate patterns. i must say it really breaks my heart to immediately flatten it all with read_csv
i’ve been trying to understand why reporting some estimate of confidence intervals around performance metrics (or null hypothesis significance testing) is not more common in the machine learning/AI literature. i think this is changing, but there’s still a lot of weird (or missing) statistics ime
February 2, 2025 at 11:18 PM
i’ve been trying to understand why reporting some estimate of confidence intervals around performance metrics (or null hypothesis significance testing) is not more common in the machine learning/AI literature. i think this is changing, but there’s still a lot of weird (or missing) statistics ime
i think the vast ambiguity in the term “data scientist” causes a lot of headaches. am i an engineer? am i a computer scientist? am i a statistician? who knows!!!
January 31, 2025 at 8:35 PM
i think the vast ambiguity in the term “data scientist” causes a lot of headaches. am i an engineer? am i a computer scientist? am i a statistician? who knows!!!
started my day writing a few (simple) statistical proofs for a data science project (to justify simplifying a calculation from something complicated to something simpler and equivalent) and wow it really is nice to dust off the old PhD and put it to use every once in a while
January 31, 2025 at 8:30 PM
started my day writing a few (simple) statistical proofs for a data science project (to justify simplifying a calculation from something complicated to something simpler and equivalent) and wow it really is nice to dust off the old PhD and put it to use every once in a while
i rounded on stanford’s palliative medicine service today, and it was such a powerful reminder that end-of-life care clinicians are some of the most kind and empathetic people in health care. truly in awe of their ability to bear witness to (and guide people through) such difficult moments
December 23, 2024 at 11:59 PM
i rounded on stanford’s palliative medicine service today, and it was such a powerful reminder that end-of-life care clinicians are some of the most kind and empathetic people in health care. truly in awe of their ability to bear witness to (and guide people through) such difficult moments
if i could distill my time in the world of health ai down to a single thesis statement, i think it would be that imo everyone in health care (patients, health care workers, researchers, caregivers of all kinds) should have a very, very healthy dose of skepticism about every ai product they encounter
December 6, 2024 at 1:27 AM
if i could distill my time in the world of health ai down to a single thesis statement, i think it would be that imo everyone in health care (patients, health care workers, researchers, caregivers of all kinds) should have a very, very healthy dose of skepticism about every ai product they encounter
Reposted by Timothy Keyes
Reposted by Timothy Keyes
Now more than ever the world should learn about the life and impact of @stanfordmedicine.bsky.social neuroscientist Ben Barres, the movie is underway! @atqmovie.bsky.social
November 23, 2024 at 2:13 AM
Now more than ever the world should learn about the life and impact of @stanfordmedicine.bsky.social neuroscientist Ben Barres, the movie is underway! @atqmovie.bsky.social
Reposted by Timothy Keyes
This isn't really an #rstats vs #python thing but rather a tidyverse vs pandas thing, and for data wrangling the tidyverse API is just so darn good it's hard to compete with, which is why there are ports of it to other languages, e.g. Tidier in #julia, siuba in python
A good example about why Pandas is not an elegant tool for data analysis and wrangling. #SundayProvocation #python #rstats www.sumsar.net/blog/pandas-...
Why pandas feels clunky when coming from R
Five years ago I started a new role and I suddenly found myself, a
staunch R fan, having to code in Python on a daily basis. Working with
data, most of my Python work involved using
pandas, the …
www.sumsar.net
November 18, 2024 at 2:59 AM
one of the guiding principles of my life as a scientist (inherited from a mentor who has since passed away) has been to resist the incentives that foster egoism, possessiveness, and competition over collaboration in science - and to instead lead with generosity, openness, and lifting others up.
November 20, 2024 at 3:02 AM
one of the guiding principles of my life as a scientist (inherited from a mentor who has since passed away) has been to resist the incentives that foster egoism, possessiveness, and competition over collaboration in science - and to instead lead with generosity, openness, and lifting others up.
i’ve been working on the ai team at stanford health care for about a year and the overwhelming take-home message for me so far is to be increasingly horrified at how aggressively ai vendors will market their products without any apparent obligation to demonstrate that they actually work
November 19, 2024 at 12:55 AM
i’ve been working on the ai team at stanford health care for about a year and the overwhelming take-home message for me so far is to be increasingly horrified at how aggressively ai vendors will market their products without any apparent obligation to demonstrate that they actually work
i’ve been off the internet (ie tw*tter) for so long that i actually don’t remember how to write in pithy short-form anymore. all of my “terminally online” references are from 2022. i have 0 memes saved in my camera roll. i have a phd now like the vibes have shifted bro what do i do
November 18, 2024 at 12:30 AM
i’ve been off the internet (ie tw*tter) for so long that i actually don’t remember how to write in pithy short-form anymore. all of my “terminally online” references are from 2022. i have 0 memes saved in my camera roll. i have a phd now like the vibes have shifted bro what do i do
Maybe I’ll actually start using this app. What’s the vibe? Who should I follow?
November 12, 2024 at 5:33 AM
Maybe I’ll actually start using this app. What’s the vibe? Who should I follow?
now that i’ve followed a few people i’m really eager to take this new recommendation algorithm for a spin
September 8, 2023 at 4:40 PM
now that i’ve followed a few people i’m really eager to take this new recommendation algorithm for a spin