Here are two medical exams that the chatbot has failed, that Becker’s has reported on since May 3:
1. ChatGPT failed the American College of Gastroenterology’s pre-board assessment. When researchers asked it to take the 2021 and 2022 multiple-choice self-assessment tests, ChatGPT scored 65.1 percent and 62.4 percent, compared to the 70 percent required to pass the exam.
2. ChatGPT correctly answered less than half of practice questions from ophthalmology board certification examinations. Researchers asked the chatbot 125 multiple-choice questions from a free trial of ophthalmology board certification practice software.
At the Becker's 23rd Annual Spine, Orthopedic and Pain Management-Driven ASC + The Future of Spine Conference, taking place June 18–20 in Chicago, spine surgeons, orthopedic leaders and ASC executives will come together to explore minimally invasive techniques, ASC growth strategies and innovations shaping the future of outpatient spine care. Apply for complimentary registration now.
