Sign In

Communications of the ACM

ACM News

The Rise of Artificial Intelligence: ChatGPT's Stunning Results on the U.S. Medical Licensing Exam

View as: Print Mobile App Share:

ChatGPT demonstrated its ability to perform at or around the passing threshold of 60% on the U.S. Medical Licensing Exam.

Credit: SciTechDaily

OpenAI's ChatGPT can score at or around the approximately 60 percent passing threshold for the United States Medical Licensing Exam (USMLE), with responses that make coherent, internal sense and contain frequent insights. This is according to a study by Tiffany Kung, Victor Tseng, and colleagues at AnsibleHealth, which was published on February 9, 2023, in the open-access journal PLOS Digital Health.

ChatGPT is a new artificial intelligence (AI) system, known as a large language model (LLM), designed to generate human-like writing by predicting upcoming word sequences. Unlike most chatbots, ChatGPT cannot search the internet. Instead, it generates text using word relationships predicted by its internal processes.

Kung and colleagues tested ChatGPT's performance on the USMLE, a highly standardized and regulated series of three exams (Steps 1, 2CK, and 3) required for medical licensure in the United States. Taken by medical students and physicians-in-training, the USMLE assesses knowledge spanning most medical disciplines, ranging from biochemistry, to diagnostic reasoning, to bioethics.

View Full Article


No entries found

Sign In for Full Access
» Forgot Password? » Create an ACM Web Account