Assessing the Competence of the ChatGPT-3.5 Artificial Intelligence System in Executing the ACLS Protocol of the AHA 2020
İbrahim Altundağ, Sinem Doğruyol, Burcu Genç Yavuz, Kaan Yusufoglu, Mustafa Ahmet Afacan, Şahin ÇolakDepartment of Emergency Medicine, University of Health Sciences Türkiye, Haydarpaşa Numune Training and Research Hospital, Istanbul, TürkiyeINTRODUCTION: Artificial intelligence (AI) has become the focus of recent studies, particularly due to its potential to reduce human labor and time loss. The most significant contribution of AI applications in the medical field is expected to be enhancing clinicians' efficiency, reducing costs, and improving public health. This study aims to assess the proficiency of ChatGPT-3.5, one of the most advanced AI applications available today, in its knowledge of current information based on the American Heart Association (AHA) 2020 guidelines.
METHODS: An 80-question quiz in a question-and-answer format, covering the current AHA 2020 application steps, was prepared and administered to ChatGPT-3.5 in both English (ChatGPT-3.5 English) and Turkish (ChatGPT-3.5 Turkish). The questions were originally prepared in Turkish for emergency medicine specialists.
RESULTS: We found a similar success rate of over 80% in all questions posed to ChatGPT-3.5 and two independent emergency medicine specialists with at least five years of experience who did not know each other. ChatGPT-3.5 achieved a 100% success rate in all questions related to the General Overview of the Current AHA Guidelines, Airway Management, and Ventilation chapters in English.
DISCUSSION AND CONCLUSION: Our study indicates that ChatGPT-3.5 provides responses that are as accurate and up-to-date as those given by experienced emergency specialists regarding the AHA 2020 Advanced Cardiac Life Support Guidelines. With future updated versions of ChatGPT, instant access to accurate and current information based on textbooks and guidelines will be increasingly feasible.
Manuscript Language: English