Research
Explore our publications and preprints advancing healthcare through rigorous AI evaluation.
A clinical environment simulator for dynamic AI evaluation
Clinical evaluation of large language models (LLMs) currently relies on static datasets and isolated scenarios that fail to capture the […]
Merlin: a computed tomography vision–language foundation model and dataset
The large volume of abdominal computed tomography (CT) scans coupled with the shortage of radiologists have intensified the need for […]
Building The Health Chatbot Users’ Guide
General-purpose large language models (LLMs) are now commonplace throughout society, becoming de facto health advisors for millions worldwide1. The public […]
MedAgentBrief for Hospital Course Summarization: Safety, Use, and Discharge Documentation Burden
mportance: High-quality discharge summaries are essential for safe care transitions but contribute substantially to clinician documentation burden and burnout. While […]
Scaling medical AI across clinical contexts
Medical artificial intelligence (AI) tools, including clinical language models, vision–language models and multimodal health record models, are used to summarize […]
Uses of generative AI by non-clinician staff at an academic medical center
Large language model (LLM) chat tools have the potential to transform healthcare workflows by improving efficiency and reducing administrative burdens. […]
Adoption and Use of LLMs at an Academic Medical Center
While large language models (LLMs) can support clinical documentation needs, standalone tools struggle with “workflow friction” from manual data entry. […]
“I Double Checked It with My Own Knowledge:” Physician Perspectives on the Use of AI Chatbots for Clinical Decision-Making
AI chatbots are proliferating in healthcare systems. It is essential to explore how physicians use these tools in order to […]
Elevating Management Reasoning to Preserve Professional Identity in the AI Era
AI systems are rapidly approaching expert-level diagnostic reasoning; however, management reasoning —the art of translating diagnoses into personalized care—remains distinctly […]
Holistic evaluation of large language models for medical tasks with MedHELM
While large language models (LLMs) achieve near-perfect scores on medical licensing exams, these evaluations inadequately reflect the complexity and diversity […]
Latest News
View allGet the latest on our studies, grant awards, and media coverage.
