Performance of Large Language Models in Medical Exams: A Review Focusing on Allergy, Immunology, and Related Fields

Küçük Resim Yok

Tarih

2024

Dergi Başlığı

Dergi ISSN

Cilt Başlığı

Yayıncı

Turkish Natl Soc Allergy and Clinical Immunology

Erişim Hakkı

info:eu-repo/semantics/closedAccess

Özet

The emergence of large language models (LLMs) presents significant opportunities in healthcare and medical education. This study evaluates the performance of LLMs in medical examinations, with a specific focus on allergy, immunology, and related specialties. LLMs have developed the ability to comprehend, interpret, and process language in a manner akin to humans. This advancement raises concerns about their potential role in disciplines like medicine, which require advanced cognitive skills and a deep, specialized knowledge base. Following PRISMA guidelines, our review investigates the performance of LLMs in medical tests, highlighting both their strengths and limitations. We found that LLMs demonstrate higher accuracy on English-language assessments but exhibit significant variation in performance across different medical disciplines. This underscores the need for discipline-specific training and raises ethical considerations regarding challenges in clinical reasoning and visual interpretation. Future research should address linguistic biases, develop specialized protocols, and enhance the capacity of LLMs in immunology and allergy. This study emphasizes the potential of LLMs to transform medical education and advocates for their careful integration to ensure adequate support for healthcare professionals in managing complex allergic and immunological conditions.

Açıklama

Anahtar Kelimeler

allergy, immunology, Large language models, LLMs, medical exam

Kaynak

Asthma Allergy Immunology

WoS Q Değeri

Q4

Scopus Q Değeri

Q4

Cilt

22

Sayı

3

Künye

DUMANOGLU, B., CAN BOSTAN, O., YILDIRIM, O. C., & CERCI, P. (2024). Performance of large language models in medical exams: A review focusing on allergy, immunology, and related fields. Astım Allerji Immünoloji, , 225-236.