Enrico Coiera
@ecoiera.bsky.social
AI for healthcare - Digital health and health informatics - climate change informatics
Pinned
Enrico Coiera
@ecoiera.bsky.social
· Dec 12
And for fun, here is one from the vault circa 2004: "Four rules for the reinvention of health care"
www.bmj.com/content/328/...
www.bmj.com/content/328/...
Reposted by Enrico Coiera
My thoughts @kffhealthnews.org on the proposed dismantling of AHRQ
We need safety research to protect our patients from harms in health care. No organization in the world does more for that than AHRQ.
Let the general public know.
kffhealthnews.org/news/article...
We need safety research to protect our patients from harms in health care. No organization in the world does more for that than AHRQ.
Let the general public know.
kffhealthnews.org/news/article...
What’s Lost: Trump Whacks Tiny Agency That Works To Make the Nation's Health Care Safer - KFF Health News
The Agency for Healthcare Research and Quality helped improve health care safety in a country where thousands die of medical errors each year. It was effectively dissolved Tuesday.
kffhealthnews.org
April 3, 2025 at 10:26 PM
My thoughts @kffhealthnews.org on the proposed dismantling of AHRQ
We need safety research to protect our patients from harms in health care. No organization in the world does more for that than AHRQ.
Let the general public know.
kffhealthnews.org/news/article...
We need safety research to protect our patients from harms in health care. No organization in the world does more for that than AHRQ.
Let the general public know.
kffhealthnews.org/news/article...
What does the 2025-26 Federal Budget mean for Australia’s investment in healthcare AI?
aihealthalliance.org/2025/03/28/w...
aihealthalliance.org/2025/03/28/w...
What does the 2025-26 Federal Budget mean for Australia’s investment in AI? | Ai Health Alliance
aihealthalliance.org
March 28, 2025 at 1:18 AM
What does the 2025-26 Federal Budget mean for Australia’s investment in healthcare AI?
aihealthalliance.org/2025/03/28/w...
aihealthalliance.org/2025/03/28/w...
In a new paper in Machine Learning, we recast AI explanation as a conversation between AI and human, allowing the explanation to be tailored fit the knowledge and needs of a human (or requesting AI agent)
link.springer.com/article/10.1...
link.springer.com/article/10.1...
A model for intelligible interaction between agents that predict and explain - Machine Learning
Machine Learning (ML) has emerged as a powerful form of data modelling with widespread applicability beyond its roots in the design of autonomous agents. However, relatively little attention has been ...
link.springer.com
February 24, 2025 at 11:57 PM
In a new paper in Machine Learning, we recast AI explanation as a conversation between AI and human, allowing the explanation to be tailored fit the knowledge and needs of a human (or requesting AI agent)
link.springer.com/article/10.1...
link.springer.com/article/10.1...
US NIH Grant review panels are suspended, and a freeze imposed on travel, communication with the public, hiring ....
www.science.org/content/arti...
www.science.org/content/arti...
Trump hits NIH with ‘devastating’ freezes on meetings, travel, communications, and hiring
Researchers facing
www.science.org
January 23, 2025 at 2:05 AM
US NIH Grant review panels are suspended, and a freeze imposed on travel, communication with the public, hiring ....
www.science.org/content/arti...
www.science.org/content/arti...
There is a growing US push for clinical AI safety to be certified by academic assurance labs rather than the FDA.
But there are many challenges - conflicts of interest via industry funding to universities, scaleability, and suitability to post-market monitoring.
link.springer.com/article/10.1...
But there are many challenges - conflicts of interest via industry funding to universities, scaleability, and suitability to post-market monitoring.
link.springer.com/article/10.1...
The Challenges of Establishing Assurance Labs for Health Artificial Intelligence (AI) - Journal of Medical Systems
Journal of Medical Systems -
link.springer.com
January 9, 2025 at 5:35 AM
There is a growing US push for clinical AI safety to be certified by academic assurance labs rather than the FDA.
But there are many challenges - conflicts of interest via industry funding to universities, scaleability, and suitability to post-market monitoring.
link.springer.com/article/10.1...
But there are many challenges - conflicts of interest via industry funding to universities, scaleability, and suitability to post-market monitoring.
link.springer.com/article/10.1...
Reposted by Enrico Coiera
TRIPOD-LLM is out! Check out our consensus guidelines for reporting #LLM research in biomedicine. TRIPOD-LLM is intended to be a living guideline to keep up with the rapid advances in LLMs. Kudos to lead author
Dr. Jack Gallifant
Dr. Jack Gallifant
January 8, 2025 at 8:13 PM
TRIPOD-LLM is out! Check out our consensus guidelines for reporting #LLM research in biomedicine. TRIPOD-LLM is intended to be a living guideline to keep up with the rapid advances in LLMs. Kudos to lead author
Dr. Jack Gallifant
Dr. Jack Gallifant
Reposted by Enrico Coiera
“While the study doesn't identify a lower bound, it does show that by the time misinformation accounts for 0.001 percent of the training data, the resulting LLM is compromised.”
It’s remarkably easy to inject new medical misinformation into LLMs
Changing just 0.001% of inputs to misinformation makes the AI less accurate.
arstechnica.com
January 9, 2025 at 12:54 AM
“While the study doesn't identify a lower bound, it does show that by the time misinformation accounts for 0.001 percent of the training data, the resulting LLM is compromised.”
[New digital scribe paper] Expert evaluation of large language
models for clinical dialogue summarization
www.nature.com/articles/s41...
In this study with @dafraile.bsky.social ChatGPT's ability to summarise primary care consultations was impressive but not yet at human skill level.
models for clinical dialogue summarization
www.nature.com/articles/s41...
In this study with @dafraile.bsky.social ChatGPT's ability to summarise primary care consultations was impressive but not yet at human skill level.
January 9, 2025 at 12:28 AM
[New digital scribe paper] Expert evaluation of large language
models for clinical dialogue summarization
www.nature.com/articles/s41...
In this study with @dafraile.bsky.social ChatGPT's ability to summarise primary care consultations was impressive but not yet at human skill level.
models for clinical dialogue summarization
www.nature.com/articles/s41...
In this study with @dafraile.bsky.social ChatGPT's ability to summarise primary care consultations was impressive but not yet at human skill level.
Who should certify health AI is safe? There is a push in the US for it not to be the FDA but instead, the industry that manufactures the technology.
Do we have good examples of high risk technology applications where there has been effective self regulation?
www.politico.com/news/2025/01...
Do we have good examples of high risk technology applications where there has been effective self regulation?
www.politico.com/news/2025/01...
The government can’t ensure artificial intelligence is safe. This man says he can.
Brian Anderson is ready to shape the future of AI in health care — if Donald Trump will let him.
www.politico.com
January 2, 2025 at 11:21 PM
Who should certify health AI is safe? There is a push in the US for it not to be the FDA but instead, the industry that manufactures the technology.
Do we have good examples of high risk technology applications where there has been effective self regulation?
www.politico.com/news/2025/01...
Do we have good examples of high risk technology applications where there has been effective self regulation?
www.politico.com/news/2025/01...
December 23, 2024 at 11:23 PM
Just one more damn thing to add into the polycrisis mix:
‘Unprecedented risk’ to life on Earth: scientists call for halt on ‘mirror life’ microbe research.
www.theguardian.com/science/2024...
‘Unprecedented risk’ to life on Earth: scientists call for halt on ‘mirror life’ microbe research.
www.theguardian.com/science/2024...
‘Unprecedented risk’ to life on Earth: Scientists call for halt on ‘mirror life’ microbe research
Experts warn that mirror bacteria, constructed from mirror images of molecules found in nature, could put humans, animals and plants at risk of lethal infections
www.theguardian.com
December 12, 2024 at 11:39 PM
Just one more damn thing to add into the polycrisis mix:
‘Unprecedented risk’ to life on Earth: scientists call for halt on ‘mirror life’ microbe research.
www.theguardian.com/science/2024...
‘Unprecedented risk’ to life on Earth: scientists call for halt on ‘mirror life’ microbe research.
www.theguardian.com/science/2024...
Reposted by Enrico Coiera
"The important thing is that paper makes it very clear that nobody should ever take LLMs at their word. They can easily tell you one thing and (especially if hooked up as agents) do another — possibly quite contrary to what they have alleged they are doing." - Gary Marcus, from the linked substack.
I am generally not a doomer-extinction still strikes me as a remote risk—but this new paper is definitely a wakeup call with respect to how bad actors could exploit LLMs in serious ways, causing a great deal of harm.
open.substack.com/pub/garymarc...
open.substack.com/pub/garymarc...
Humanity’s “Oh shit!” AI moment?
Not yet, but it could come sooner than you think. Not because we are close to AGI, but because we already have machines that can say one thing and do something else altogether.
open.substack.com
December 12, 2024 at 11:01 PM
"The important thing is that paper makes it very clear that nobody should ever take LLMs at their word. They can easily tell you one thing and (especially if hooked up as agents) do another — possibly quite contrary to what they have alleged they are doing." - Gary Marcus, from the linked substack.
And for fun, here is one from the vault circa 2004: "Four rules for the reinvention of health care"
www.bmj.com/content/328/...
www.bmj.com/content/328/...
December 12, 2024 at 6:45 AM
And for fun, here is one from the vault circa 2004: "Four rules for the reinvention of health care"
www.bmj.com/content/328/...
www.bmj.com/content/328/...
Can we design health services to resiliently respond to crises like climate change? In this paper we show innovation during COVID-19 depended on repurposing existing services into new "Innovation bundles". So should we should design "health services as platforms"?
link.springer.com/article/10.1...
link.springer.com/article/10.1...
Innovation bundles and platforms – a qualitative analysis of health system responses to the COVID-19 pandemic - BMC Health Services Research
Background Health systems underwent substantial changes to respond to COVID-19. Learning from the successes and failures of health system COVID-19 responses may help us understand how future health se...
link.springer.com
December 12, 2024 at 6:33 AM
Can we design health services to resiliently respond to crises like climate change? In this paper we show innovation during COVID-19 depended on repurposing existing services into new "Innovation bundles". So should we should design "health services as platforms"?
link.springer.com/article/10.1...
link.springer.com/article/10.1...
The 4 stages of digital scribes
1. Human led documentation
2. Mixed-initative documentation
3. Computer-led documentation
4. Intelligent clinical environment
How long until we work in smart, sensor dense, clinical spaces where documentation disappears as a human task?
www.nature.com/articles/s41...
1. Human led documentation
2. Mixed-initative documentation
3. Computer-led documentation
4. Intelligent clinical environment
How long until we work in smart, sensor dense, clinical spaces where documentation disappears as a human task?
www.nature.com/articles/s41...
The digital scribe - npj Digital Medicine
npj Digital Medicine - The digital scribe
www.nature.com
December 10, 2024 at 12:05 AM
The 4 stages of digital scribes
1. Human led documentation
2. Mixed-initative documentation
3. Computer-led documentation
4. Intelligent clinical environment
How long until we work in smart, sensor dense, clinical spaces where documentation disappears as a human task?
www.nature.com/articles/s41...
1. Human led documentation
2. Mixed-initative documentation
3. Computer-led documentation
4. Intelligent clinical environment
How long until we work in smart, sensor dense, clinical spaces where documentation disappears as a human task?
www.nature.com/articles/s41...
Reposted by Enrico Coiera
Interesting discussions on today's CIEHF webinar launching the new human-centred healthcare AI guidance. Questions around relying on AI vs monitoring the outputs critically. And what users need to know - and who's going to support them. ergonomics.org.uk/resource/int...
December 3, 2024 at 6:14 PM
Interesting discussions on today's CIEHF webinar launching the new human-centred healthcare AI guidance. Questions around relying on AI vs monitoring the outputs critically. And what users need to know - and who's going to support them. ergonomics.org.uk/resource/int...
New research from @aidybarnett.bsky.social shows published AUC values for some clinical prediction models are are over-inflated with excesses above 0.7, 0.8 and 0.9 and shortfalls below these thresholds, risking sub-optimal decisions
bmcmedicine.biomedcentral.com/articles/10....
bmcmedicine.biomedcentral.com/articles/10....
December 1, 2024 at 11:46 PM
New research from @aidybarnett.bsky.social shows published AUC values for some clinical prediction models are are over-inflated with excesses above 0.7, 0.8 and 0.9 and shortfalls below these thresholds, risking sub-optimal decisions
bmcmedicine.biomedcentral.com/articles/10....
bmcmedicine.biomedcentral.com/articles/10....
Reposted by Enrico Coiera
AI in health: A little less conversation, a little more action please!
How far have we progressed the AI in healthcare policy agenda over the last 12 months? More than we expected at the time, but there is so much still to do.
www.medicalrepublic.com.au/ai-in-health...
How far have we progressed the AI in healthcare policy agenda over the last 12 months? More than we expected at the time, but there is so much still to do.
www.medicalrepublic.com.au/ai-in-health...
AI in health: a little less conversation, a little more action, please - Medical Republic
While 2024 was a great year for consultation regarding the use of AI in healthcare, one expert feels 2025 needs to focus on translating these words into actions.
www.medicalrepublic.com.au
November 30, 2024 at 7:10 AM
AI in health: A little less conversation, a little more action please!
How far have we progressed the AI in healthcare policy agenda over the last 12 months? More than we expected at the time, but there is so much still to do.
www.medicalrepublic.com.au/ai-in-health...
How far have we progressed the AI in healthcare policy agenda over the last 12 months? More than we expected at the time, but there is so much still to do.
www.medicalrepublic.com.au/ai-in-health...
AI in health: A little less conversation, a little more action please!
How far have we progressed the AI in healthcare policy agenda over the last 12 months? More than we expected at the time, but there is so much still to do.
www.medicalrepublic.com.au/ai-in-health...
How far have we progressed the AI in healthcare policy agenda over the last 12 months? More than we expected at the time, but there is so much still to do.
www.medicalrepublic.com.au/ai-in-health...
AI in health: a little less conversation, a little more action, please - Medical Republic
While 2024 was a great year for consultation regarding the use of AI in healthcare, one expert feels 2025 needs to focus on translating these words into actions.
www.medicalrepublic.com.au
November 30, 2024 at 7:10 AM
AI in health: A little less conversation, a little more action please!
How far have we progressed the AI in healthcare policy agenda over the last 12 months? More than we expected at the time, but there is so much still to do.
www.medicalrepublic.com.au/ai-in-health...
How far have we progressed the AI in healthcare policy agenda over the last 12 months? More than we expected at the time, but there is so much still to do.
www.medicalrepublic.com.au/ai-in-health...
“What would things look like in a zero standards world? .. from the perspective of an autonomous and adaptive entity, we would see standards for what they are - a workaround when entities cannot adapt.”
academic.oup.com/jamia/articl...
academic.oup.com/jamia/articl...
November 29, 2024 at 6:10 AM
“What would things look like in a zero standards world? .. from the perspective of an autonomous and adaptive entity, we would see standards for what they are - a workaround when entities cannot adapt.”
academic.oup.com/jamia/articl...
academic.oup.com/jamia/articl...
When the clinical use of AI leads to patient harms, medico legal responsibility should not just fall on the shoulders doctors but all those who can manage or mitigate risk - including software developers. (Tracey Pickett, Avant) #aicare24
November 27, 2024 at 6:05 AM
When the clinical use of AI leads to patient harms, medico legal responsibility should not just fall on the shoulders doctors but all those who can manage or mitigate risk - including software developers. (Tracey Pickett, Avant) #aicare24
Reposted by Enrico Coiera
Kicking things off with @ecoiera.bsky.social at today’s health AI conference in Melbourne. Very useful scorecard and update on progress in AI for health in the last year. (Spoiler - it’s a lot of activity!) #digitalhealth
November 26, 2024 at 10:23 PM
Kicking things off with @ecoiera.bsky.social at today’s health AI conference in Melbourne. Very useful scorecard and update on progress in AI for health in the last year. (Spoiler - it’s a lot of activity!) #digitalhealth
Reposted by Enrico Coiera
A vertical takeoff of life science with #AI LLLMs.
Publication of 10 new foundation models of Proteins, DNA, RNA, methylation, cells, and interactions, evolution, and design in the past couple of weeks!
Unprecedented progress, reviewed in the new Ground Truths
erictopol.substack.com/p/learning-t...
Publication of 10 new foundation models of Proteins, DNA, RNA, methylation, cells, and interactions, evolution, and design in the past couple of weeks!
Unprecedented progress, reviewed in the new Ground Truths
erictopol.substack.com/p/learning-t...
November 24, 2024 at 6:12 PM
A vertical takeoff of life science with #AI LLLMs.
Publication of 10 new foundation models of Proteins, DNA, RNA, methylation, cells, and interactions, evolution, and design in the past couple of weeks!
Unprecedented progress, reviewed in the new Ground Truths
erictopol.substack.com/p/learning-t...
Publication of 10 new foundation models of Proteins, DNA, RNA, methylation, cells, and interactions, evolution, and design in the past couple of weeks!
Unprecedented progress, reviewed in the new Ground Truths
erictopol.substack.com/p/learning-t...
Reposted by Enrico Coiera
Use this starter pack to follow medical informatics leaders on BlueSky go.bsky.app/9FPTN8E
November 20, 2024 at 11:21 AM
Use this starter pack to follow medical informatics leaders on BlueSky go.bsky.app/9FPTN8E