Duke Health AI Evaluation & Governance Program
@dukeaievalgov.bsky.social
Evaluating and overseeing algorithms integrated into healthcare practices
As 2025 comes to a close, we remain focused on what matters most: our patients. By advancing safe, fair, and high-quality algorithmic solutions, we’re working to improve and responsibly transform healthcare. Thank you for being part of this progress. Wishing you Happy Holidays! 🥳
December 22, 2025 at 2:34 PM
As 2025 comes to a close, we remain focused on what matters most: our patients. By advancing safe, fair, and high-quality algorithmic solutions, we’re working to improve and responsibly transform healthcare. Thank you for being part of this progress. Wishing you Happy Holidays! 🥳
Today at 2:00 PM EST: @dukeaievalgov.bsky.social Director, Nicoleta Economou, PhD, will join Avanade's David Galich and David Gormley for the final installment of their Smart AI Masterclass series, where the speakers will discuss #AgenticAI. Register now. events.teams.microsoft.com/event/ebdde5...
December 10, 2025 at 3:48 PM
Today at 2:00 PM EST: @dukeaievalgov.bsky.social Director, Nicoleta Economou, PhD, will join Avanade's David Galich and David Gormley for the final installment of their Smart AI Masterclass series, where the speakers will discuss #AgenticAI. Register now. events.teams.microsoft.com/event/ebdde5...
👇 @dukeaievalgov.bsky.social welcomes Elijah Richardson, MPH, who is the new Evaluation & Governance Lead for our flagship ABCDS Oversight initiative. Learn more about his new role and his professional background here: healthaigovernance.duke.edu/personnel/el...
November 11, 2025 at 2:42 PM
👇 @dukeaievalgov.bsky.social welcomes Elijah Richardson, MPH, who is the new Evaluation & Governance Lead for our flagship ABCDS Oversight initiative. Learn more about his new role and his professional background here: healthaigovernance.duke.edu/personnel/el...
Nicoleta Economou, PhD, director of @dukeaievalgov.bsky.social has been appointed to the AI at Duke Steering Committee and will also serve as liaison for the Trustworthy & Responsible AI Advisory Committee. Provost Alec Gallimore launched the AI at Duke initiative in May 2025. duke.is/g/newp
AI at Duke Initiative Strengthens Leadership and Expands Faculty Engagement - AI at Duke
The AI at Duke steering committee continues to gain momentum as it enters a critical phase of strategic planning and university-wide engagement. Launched by Provost Alec Gallimore in May, the initiati...
duke.is
October 16, 2025 at 12:38 PM
Nicoleta Economou, PhD, director of @dukeaievalgov.bsky.social has been appointed to the AI at Duke Steering Committee and will also serve as liaison for the Trustworthy & Responsible AI Advisory Committee. Provost Alec Gallimore launched the AI at Duke initiative in May 2025. duke.is/g/newp
The @dukeaievalgov.bsky.social team was excited to present our work at the Duke Summit on AI for Health Innovation. Throughout the event, we observed meaningful engagement and genuine curiosity from attendees regarding our program, the ABCDS Oversight Initiative, and our published research.
October 10, 2025 at 5:46 PM
The @dukeaievalgov.bsky.social team was excited to present our work at the Duke Summit on AI for Health Innovation. Throughout the event, we observed meaningful engagement and genuine curiosity from attendees regarding our program, the ABCDS Oversight Initiative, and our published research.
@dukeaievalgov.bsky.social Director Nicoleta Economou, PhD, recently joined leading experts in #AI, data science, public health, and healthcare emergency management for an AI Panel Series hosted by the Academic Healthcare Emergency Management (AHEM) Consortium. ahemconsortium.org/from-chaos-t...
From Chaos to Coordination: Reimagining Healthcare Emergency Management with AI
This event is a part of the AHEM Expert Panel Series Join us for the fifth session in the Academic Healthcare Emergency Management (AHEM) Expert Panel Series, where leading voices in AI, healthcare…
ahemconsortium.org
October 10, 2025 at 5:17 PM
@dukeaievalgov.bsky.social Director Nicoleta Economou, PhD, recently joined leading experts in #AI, data science, public health, and healthcare emergency management for an AI Panel Series hosted by the Academic Healthcare Emergency Management (AHEM) Consortium. ahemconsortium.org/from-chaos-t...
👇 @dukeaievalgov.bsky.social Director Nicoleta Economou, PhD, recently delivered a keynote at the National Evaluation Center of Quality and Technology in Health Conference in Athens, which highlighted @dukehealth.bsky.social’s leadership in advancing trustworthy and responsible #AI for healthcare.
September 19, 2025 at 12:56 PM
👇 @dukeaievalgov.bsky.social Director Nicoleta Economou, PhD, recently delivered a keynote at the National Evaluation Center of Quality and Technology in Health Conference in Athens, which highlighted @dukehealth.bsky.social’s leadership in advancing trustworthy and responsible #AI for healthcare.
👇 @dukeaievalgov.bsky.social Director Nicoleta Economou, PhD, joined other AI leaders on a @sassoftware.bsky.social-hosted webinar exploring how agentic AI, generative AI, and AI governance are reshaping health and life sciences. Watch the webinar on demand here: www.sas.com/en_us/webina...
Agentic AI, Generative AI and AI Governance
Explore how agentic AI, generative AI and AI governance are driving transformation across health and life sciences.
www.sas.com
September 18, 2025 at 2:38 PM
👇 @dukeaievalgov.bsky.social Director Nicoleta Economou, PhD, joined other AI leaders on a @sassoftware.bsky.social-hosted webinar exploring how agentic AI, generative AI, and AI governance are reshaping health and life sciences. Watch the webinar on demand here: www.sas.com/en_us/webina...
🤔Typo or something more? The Verge's Hayden Field spoke with @dukehealth.bsky.social's Chief Data Scientist Michael Pencina, PhD, about the risks of "hallucinations" in medical #LLMs like Google's Med-Gemini, which mistakenly cited an anatomical structure that doesn’t exist, in a recent preprint.
Google’s healthcare AI made up a body part — what happens when doctors don’t notice?
The basilar ganglia does not exist.
www.theverge.com
September 9, 2025 at 3:44 PM
🤔Typo or something more? The Verge's Hayden Field spoke with @dukehealth.bsky.social's Chief Data Scientist Michael Pencina, PhD, about the risks of "hallucinations" in medical #LLMs like Google's Med-Gemini, which mistakenly cited an anatomical structure that doesn’t exist, in a recent preprint.
Looking to add some academic heat to your fall reading list, the @dukeaievalgov.bsky.social is spotlighting our latest research on algorithm oversight, #LLM evaluation, fairness, and safety in #healthAI. healthaigovernance.duke.edu/news/fall-re...
Fall Reading on AI Governance
Looking to add some academic heat to your fall reading list? The Duke Health AI Evaluation & Governance Program is spotlighting our latest research on algorithm oversight, LLM evaluation, fairness, an...
healthaigovernance.duke.edu
September 4, 2025 at 4:45 PM
Looking to add some academic heat to your fall reading list, the @dukeaievalgov.bsky.social is spotlighting our latest research on algorithm oversight, #LLM evaluation, fairness, and safety in #healthAI. healthaigovernance.duke.edu/news/fall-re...
North Carolina Public Radio (@wunc.org) reports on @dukehealth.bsky.social's national leadership in health #AI governance, spotlighting two new evaluation frameworks developed by Duke researchers to assess the safety, reliability, and clinical performance of #LLMs.
www.wunc.org/health/2025-...
www.wunc.org/health/2025-...
Duke innovates on implementing and assessing AI in health spaces
Researchers are creating evaluation frameworks to ensure the safe usage of LLMs, like ChatGPT, at Duke Health
www.wunc.org
June 27, 2025 at 4:22 PM
North Carolina Public Radio (@wunc.org) reports on @dukehealth.bsky.social's national leadership in health #AI governance, spotlighting two new evaluation frameworks developed by Duke researchers to assess the safety, reliability, and clinical performance of #LLMs.
www.wunc.org/health/2025-...
www.wunc.org/health/2025-...
👇@axios.com reports on how a team of Duke researchers led by Chief Data Scientist Michael Pencina has developed two important evaluation frameworks to assess the safety, accuracy, and reliability of large language models (LLMs) in clinical care. axios.com/local/raleig... @dukehealth.bsky.social
Duke researchers want to ensure AI is safe in a health care setting
Health systems across the country are investing heavily in AI as a way to reduce burnout for providers and potentially improve care
axios.com
June 26, 2025 at 7:54 PM
👇@axios.com reports on how a team of Duke researchers led by Chief Data Scientist Michael Pencina has developed two important evaluation frameworks to assess the safety, accuracy, and reliability of large language models (LLMs) in clinical care. axios.com/local/raleig... @dukehealth.bsky.social
Duke researchers, led by Dr. Michael Pencina and Dr. Chuan Hong, have developed two pioneering frameworks designed to evaluate the performance, safety, and reliability of large language models (LLMs) in healthcare. corporate.dukehealth.org/news/duke-un... 1/2
Duke University Sets New National Standard for Safe, Scalable AI in Health Care
DURHAM, N.C. — Duke University School of Medicine researchers have developed two pioneering frameworks designed to evaluate the performance, safety, and reliability of large-language models in health ...
corporate.dukehealth.org
June 26, 2025 at 1:24 PM
Duke researchers, led by Dr. Michael Pencina and Dr. Chuan Hong, have developed two pioneering frameworks designed to evaluate the performance, safety, and reliability of large language models (LLMs) in healthcare. corporate.dukehealth.org/news/duke-un... 1/2
New in @jamahealthforum.bsky.social: Duke’s Michael Pencina and colleagues make a case for third-party enablers, smarter local governance, and shared evidence networks to make health #AI safe, scalable, and truly impactful. jamanetwork.com/journals/jam... @dukehealth.bsky.social
Bridging the Gap Between Developers and Implementers in Health AI
This Viewpoint describes opportunities for health care organizations to close gaps between the development and implementation of artificial intelligence using third-party enablers for training, adhere...
jamanetwork.com
June 23, 2025 at 4:16 PM
New in @jamahealthforum.bsky.social: Duke’s Michael Pencina and colleagues make a case for third-party enablers, smarter local governance, and shared evidence networks to make health #AI safe, scalable, and truly impactful. jamanetwork.com/journals/jam... @dukehealth.bsky.social
ATTN: Duke faculty, staff, and students: Join @dukeaievalgov.bsky.social for a special webinar: 'Shaping the Future of Responsible Health #AI'. Learn how Duke is advancing the deployment of trustworthy and responsible AI across the institution. Register: qrcc.me/swb9tiwh8cw6... (Duke login required)
Welcome! You are invited to join a meeting: Shaping the Future of Responsible Health AI: Introducing the Duke Health AI Evaluation & Governance Program. After registering, you will receive a confirmat...
Speakers: Michael J. Pencina, PhD, Chief Data Scientist, Duke Health
Nicoleta J. Economou-Zavlanos, PhD, Director, Duke Health AI Evaluation & Governance (E&G) Program
Sophia Bessias, MPH, MSA, Assist...
qrcc.me
June 9, 2025 at 4:08 PM
ATTN: Duke faculty, staff, and students: Join @dukeaievalgov.bsky.social for a special webinar: 'Shaping the Future of Responsible Health #AI'. Learn how Duke is advancing the deployment of trustworthy and responsible AI across the institution. Register: qrcc.me/swb9tiwh8cw6... (Duke login required)
Exciting News! @dukeaievalgov.bsky.social Program proudly launches its new website. The Program promotes the safe, fair, and effective use of #AI in healthcare, ensuring AI innovations improve patient care ethically. Visit & explore here: healthaigovernance.duke.edu 1/2
May 28, 2025 at 2:31 PM
Exciting News! @dukeaievalgov.bsky.social Program proudly launches its new website. The Program promotes the safe, fair, and effective use of #AI in healthcare, ensuring AI innovations improve patient care ethically. Visit & explore here: healthaigovernance.duke.edu 1/2
Passionate about making clinical #AI safer, fairer, and more effective? The @dukeaievalgov.bsky.social Program is looking for an Evaluation Lead to support our flagship ABCDS Oversight initiative. Apply now or share with someone who should: careers.duke.edu/job-invite/2... 1/2
May 23, 2025 at 3:52 PM
Passionate about making clinical #AI safer, fairer, and more effective? The @dukeaievalgov.bsky.social Program is looking for an Evaluation Lead to support our flagship ABCDS Oversight initiative. Apply now or share with someone who should: careers.duke.edu/job-invite/2... 1/2
Thank you to all who joined @dukeaievalgov.bsky.social for a compelling seminar with Dr. Michel van Genderen, Associate Professor at Erasmus Medical Center and a thought leader in operationalizing responsible #AI, who shared insights from his work in #trustworthyAI development across Europe.
May 19, 2025 at 5:07 PM
Thank you to all who joined @dukeaievalgov.bsky.social for a compelling seminar with Dr. Michel van Genderen, Associate Professor at Erasmus Medical Center and a thought leader in operationalizing responsible #AI, who shared insights from his work in #trustworthyAI development across Europe.
Reposted by Duke Health AI Evaluation & Governance Program
Duke Health has partnered with Avanade to design, build and implement a Smart AI Governance Engine (SAIGE), a-first-of-its-kind, healthcare-specific AI governance platform that uses Microsoft Azure and Microsoft Fabric applications.
1/6
@dukeaievalgov.bsky.social
1/6
@dukeaievalgov.bsky.social
May 15, 2025 at 8:02 PM
Duke Health has partnered with Avanade to design, build and implement a Smart AI Governance Engine (SAIGE), a-first-of-its-kind, healthcare-specific AI governance platform that uses Microsoft Azure and Microsoft Fabric applications.
1/6
@dukeaievalgov.bsky.social
1/6
@dukeaievalgov.bsky.social
Hot off the press 👇 @dukeaievalgov.bsky.social's Matthew Elmore, Nicoleta Economou, and Michael Pencina have developed a practical heuristic to ensure patients are informed about #AI tools in their care. Read here: www.tandfonline.com/eprint/GWJTP...
A Heuristic for Notifying Patients About AI: From Institutional Declarations to Informed Consent
Published in The American Journal of Bioethics (Vol. 25, No. 3, 2025)
www.tandfonline.com
February 25, 2025 at 3:02 PM
Hot off the press 👇 @dukeaievalgov.bsky.social's Matthew Elmore, Nicoleta Economou, and Michael Pencina have developed a practical heuristic to ensure patients are informed about #AI tools in their care. Read here: www.tandfonline.com/eprint/GWJTP...
We are hiring! Join the Duke Health AI Evaluation & Governance Program as an Operations Leader and drive the future of #healthAI. Lead transformative projects, manage operations, and shape ethical, impactful AI in healthcare. Ready to innovate? Apply now: careers.duke.edu/job-invite/2...
January 15, 2025 at 4:39 PM
We are hiring! Join the Duke Health AI Evaluation & Governance Program as an Operations Leader and drive the future of #healthAI. Lead transformative projects, manage operations, and shape ethical, impactful AI in healthcare. Ready to innovate? Apply now: careers.duke.edu/job-invite/2...
As the year ends, we reflect on our commitment to advancing trustworthy AI for better healthcare. Thank you for supporting safe, fair, and high-quality solutions that prioritize patients. Wishing you a joyful season and a new year filled with health, hope, and progress. — The Duke Health AI E&G Team
December 24, 2024 at 1:31 PM
As the year ends, we reflect on our commitment to advancing trustworthy AI for better healthcare. Thank you for supporting safe, fair, and high-quality solutions that prioritize patients. Wishing you a joyful season and a new year filled with health, hope, and progress. — The Duke Health AI E&G Team
Congratulations to Nicoleta Economou on being named the Director of @dukeaievalgov.bsky.social! In this pivotal role, Dr. Economou will lead efforts to ensure the trustworthy, responsible, and equitable integration of #AI in healthcare. Learn more about her impactful work here: lnkd.in/d2_Tt3gj
November 22, 2024 at 7:47 PM
Congratulations to Nicoleta Economou on being named the Director of @dukeaievalgov.bsky.social! In this pivotal role, Dr. Economou will lead efforts to ensure the trustworthy, responsible, and equitable integration of #AI in healthcare. Learn more about her impactful work here: lnkd.in/d2_Tt3gj