There have been extensive evaluations of artificial intelligence (AI) systems for narrow medical tasks, but more work is needed to systematically evaluate and deploy AI systems that can perform a broad range of medical tasks. The medical training process itself might offer a template for addressing this challenge. Clinicians undergo rigorous education and training, progressing through stages of increasing responsibility and autonomy. Similarly, generalist medical AI systems could be subjected to a phased certification model before they are granted greater autonomy in patient care.

npj Digital Medicine - Ethical data acquisition for LLMs and AI algorithms in healthcare