2 medical exams ChatGPT has failed

Artificial intelligence bot ChatGPT has made waves in healthcare after passing multiple exams, however, it is not always successful.

Here are two medical exams that the chatbot has failed, that Becker's has reported on since May 3: 

1. ChatGPT failed the American College of Gastroenterology's pre-board assessment. When researchers asked it to take the 2021 and 2022 multiple-choice self-assessment tests, ChatGPT scored 65.1 percent and 62.4 percent, compared to the 70 percent required to pass the exam.

2. ChatGPT correctly answered less than half of practice questions from ophthalmology board certification examinations. Researchers asked the chatbot 125 multiple-choice questions from a free trial of ophthalmology board certification practice software.

Copyright © 2024 Becker's Healthcare. All Rights Reserved. Privacy Policy. Cookie Policy. Linking and Reprinting Policy.

 

Featured Webinars

Featured Whitepapers

Featured Podcast