GPT-4 beats human doctors in medical soft skills

By Tarun Sai LomteOct 2 2023Reviewed by Susha Cheriyedath, M.Sc. In a recent study published in the journal Scientific Reports, researchers evaluated the performance of Generative Pre-trained Transformer-4 and ChatGPT in the United States Medical Licensing Examination soft skills.

The USMLE Step 2 Clinical Knowledge scores predict performance across performance domains, such as communication, professionalism, teamwork, and patient care. Artificial cognitive empathy is an emerging field of interest. Understanding the capacity of AI to accurately perceive and respond to patients' emotional states will be particularly relevant in patient-centered care and telemedicine.

Sample test questions were screened, and 21 questions were selected, which require professionalism, interpersonal and communication skills, cultural competence, leadership, organizational behavior, and legal/ethical issues. Questions that require medical or scientific knowledge were not selected. Findings The overall accuracy of ChatGPT was 62.5%. It was 66.6% accurate for the USMLE sample test and 61% for AMBOSS questions. GPT-4 showed superior performance, achieving an overall accuracy of 90%. GPT-4 answered the USMLE sample test with 100% accuracy; however, its accuracy for AMBOSS questions was 86.4%. Regardless of whether the initial response was correct, GPT-4 never changed its response when prompted to re-evaluate its initial answer.

Health Health Latest News, Health Health Headlines

Similar News:You can also read news stories similar to this one that we have collected from other news sources.

Researchers find potential target for prompting fat cells to expend energyA research team led by Emma Robinson, Ph.D., and Timothy McKinsey, Ph.D., at the University of Colorado School of Medicine has identified a potential target for treating obesity and metabolic disease that could enhance the effectiveness of existing anti-obesity drugs.
Source: medical_xpress - 🏆 101. / 51 Read more »

Researchers find education and occupation influence cardiovascular health and mortalityCardiovascular diseases such as heart attacks and strokes are the most common cause of death worldwide. According to the World Health Organization (WHO), they account for about 18 million deaths each year. The causes of cardiovascular disease are diverse and complex. International studies suggest that socioeconomic status (SES), among other factors, may have an impact on cardiovascular health. SES is defined by the educational attainment, employment status as well as income.
Source: medical_xpress - 🏆 101. / 51 Read more »

Researchers identify structure in circadian mRNA that affects the sleep-wake cycleCircadian rhythms, the internal biological clocks that regulate our daily activities, are essential for maintaining health and well-being. While the role of transcription in these rhythms is well-established, a new study sheds light on the critical importance of post-transcriptional processes.
Source: medical_xpress - 🏆 101. / 51 Read more »

Researchers find mitochondrial DNA damage triggers spread of Parkinson's disease-like pathologyUntil recently, our understanding of Parkinson's disease has been quite limited, which has been apparent in the limited treatment options for management of this debilitating condition.
Source: medical_xpress - 🏆 101. / 51 Read more »