By Susha Cheriyedath, M.Sc.Oct 3 2023 In a recent study published in JAMA Network Open, a team of researchers from Vanderbilt University examined the potential role of the Chat-Generative Pre-Trained Transformer in providing medical information to patients and health professionals.
ChatGPT synthesizes immense amounts of information rapidly, making it an invaluable reference tool. Medical professionals could use this application to draw inferences from medical data and be informed about complex clinical decisions. This would make healthcare more efficient, as physicians would not need to look up multiple references to obtain necessary information. Similarly, patients would be able to access medical information without needing to rely solely on their doctor.
About the study Thirty-three physicians, faculty, and recent graduates from the Vanderbilt University Medical Center devised a list of 180 questions that belonged to 17 pediatric, surgical, and medical specialties. Two additional question sets included queries on melanomas, immunotherapy, and common medical conditions. In total, 284 questions were chosen.
Score results were reported as median [interquartile range ] and mean [standard deviation ]. Differences between groups were assessed using Mann-Whitney U tests, Kruskal-Wallis tests, and Wilcoxon signed-rank tests. When more than one physician scored a particular question, interrater agreement was also checked.
For the first set, completeness and accuracy were also slightly correlated, with a correlation coefficient of 0.4. There were no significant differences in the completeness and accuracy of ChatGPT’s answers across the easy, moderate, and hard questions and between descriptive and binary questions. “This study indicates that 3 months into its existence, chatbot has promise for providing accurate and comprehensive medical information. However, it remains well short of being completely reliable.”
Health Health Latest News, Health Health Headlines
Similar News:You can also read news stories similar to this one that we have collected from other news sources.
Source: NewsMedical - 🏆 19. / 71 Read more »