Here are two medical exams that the chatbot has failed, that Becker’s has reported on since May 3:
1. ChatGPT failed the American College of Gastroenterology’s pre-board assessment. When researchers asked it to take the 2021 and 2022 multiple-choice self-assessment tests, ChatGPT scored 65.1 percent and 62.4 percent, compared to the 70 percent required to pass the exam.
2. ChatGPT correctly answered less than half of practice questions from ophthalmology board certification examinations. Researchers asked the chatbot 125 multiple-choice questions from a free trial of ophthalmology board certification practice software.
At the Becker’s 32nd Annual Meeting: The Business and Operations of ASCs, taking place October 29-31 in Chicago, ASC leaders, surgeons and healthcare executives will explore strategies to drive growth, enhance operational performance, navigate reimbursement challenges and prepare for the future of ambulatory surgery. Apply for complimentary registration now.