Research Article

Accuracy and Completeness of Contemporary Large Language Models in Prosthodontics: An Expert-Based Comparative Study

Volume: 17 Number: July, August, September 2026 August 14, 2026

Accuracy and Completeness of Contemporary Large Language Models in Prosthodontics: An Expert-Based Comparative Study

Abstract

Purpose: To compare the scientific accuracy and response completeness of four contemporary LLMs: ChatGPT-5.2, Gemini 3, Copilot, and DeepSeek-V3.2 across major prosthodontic domains and question formats. Methods: Fifty prosthodontic questions covering removable prosthodontics, fixed prosthodontics, implantology, temporomandibular disorders and occlusion, dental materials science were developed from standard textbooks and clinical guidelines. Questions were presented in yes/no, multiple-choice, and open-ended formats to reflect different levels of clinical reasoning. Responses generated by ChatGPT-5.2 (OpenAI), Gemini 3 (Google), Microsoft Copilot (Microsoft), and DeepSeek-V3.2 were independently evaluated by five prosthodontists using Likert-based scales for accuracy and completeness. Inter-rater reliability was assessed to ensure scoring consistency, and model performances were compared across domains and question types using nonparametric statistical tests. Results: Overall accuracy differed significantly among the four models (p<0.05), with Gemini 3 achieving the highest median accuracy, followed by ChatGPT-5.2 and Copilot, while DeepSeek-V3.2 showed the lowest performance. No statistically significant differences were observed across question formats (all p>0.05), although descriptive trends suggested slightly higher scores for yes/no questions and lower scores for multiple-choice items. Response completeness also varied significantly across models (p<0.05), with Gemini 3 providing the most comprehensive responses. No statistically significant differences were observed between models within individual prosthodontic domains (p>0.05). Conclusion: Contemporary large language models demonstrate acceptable theoretical performance in prosthodontics; however, clinically relevant differences persist in response completeness and consistency. These models may support prosthodontic education and preliminary information retrieval, but cannot replace expert clinical judgment.

Keywords

References

  1. 1. Iannantuono GM, Bracken-Clarke D, Floudas CS, Roselli M, Gulley JL, Karzai F. Applications of large language models in cancer care: current evidence and future perspectives. Front Oncol. 2023;13:1268915.
  2. 2. Coskun BN, Yagiz B, Ocakoglu G, Dalkilic E, Pehlivan Y. Assessing the accuracy and completeness of artificial intelligence language models in providing information on methotrexate use. Rheumatol Int. 2024;44:509–15.
  3. 3. Tokgöz Kaplan T, Cankar M. Evidence‐Based Potential of Generative Artificial Intelligence Large Language Models on Dental Avulsion: ChatGPT Versus Gemini. Dent Traumatol. 2025;41:178–86.
  4. 4. Díaz-Flores García V, Freire Y, Tortosa M, Tejedor B, Estevez R, Suárez A. Google Gemini’s performance in endodontics: a study on answer precision and reliability. Appl Sci. 2024;14:6390.
  5. 5. Birkun AA, Gautam A. Large language model-based chatbot as a source of advice on first aid in heart attack. Curr Probl Cardiol. 2024;49:102048.
  6. 6. Birkun AA, Gautam A. Large language model (LLM)-powered chatbots fail to generate guideline-consistent content on resuscitation and may provide potentially harmful advice. Prehosp Disaster Med. 2023;38:757–63.
  7. 7. Özcivelek T, Özcan B. Comparative evaluation of responses from DeepSeek-R1, ChatGPT-o1, ChatGPT-4, and dental GPT chatbots to patient inquiries about dental and maxillofacial prostheses. BMC Oral Health. 2025;25:871.
  8. 8. Soltani P, Sohrabniya F, Mohammad-Rahimi H, Mehdizadeh M, Mohammadreza Mousavi S, Moaddabi A, et al. A two-stage deep learning model for determination of the contact of mandibular third molars with the mandibular canal on panoramic radiographs. BMC Oral Health. 2024;24:1373.

Details

Primary Language

English

Subjects

Bioinformatics and Computational Biology (Other)

Journal Section

Research Article

Publication Date

August 14, 2026

Submission Date

May 21, 2026

Acceptance Date

June 29, 2026

Published in Issue

Year 2026 Volume: 17 Number: July, August, September 2026

APA
Yiğit İren, E., & Üçkuyu, H. B. (2026). Accuracy and Completeness of Contemporary Large Language Models in Prosthodontics: An Expert-Based Comparative Study. Acıbadem Üniversitesi Sağlık Bilimleri Dergisi, 17(July, August, September 2026). https://doi.org/10.31067/acusaglik.1956329
AMA
1.Yiğit İren E, Üçkuyu HB. Accuracy and Completeness of Contemporary Large Language Models in Prosthodontics: An Expert-Based Comparative Study. Acibadem Univ Saglik Bilim Derg. 2026;17(July, August, September 2026). doi:10.31067/acusaglik.1956329
Chicago
Yiğit İren, Elif, and Hatice Betül Üçkuyu. 2026. “Accuracy and Completeness of Contemporary Large Language Models in Prosthodontics: An Expert-Based Comparative Study”. Acıbadem Üniversitesi Sağlık Bilimleri Dergisi 17 (July, August, September 2026). https://doi.org/10.31067/acusaglik.1956329.
EndNote
Yiğit İren E, Üçkuyu HB (August 1, 2026) Accuracy and Completeness of Contemporary Large Language Models in Prosthodontics: An Expert-Based Comparative Study. Acıbadem Üniversitesi Sağlık Bilimleri Dergisi 17 July, August, September 2026
IEEE
[1]E. Yiğit İren and H. B. Üçkuyu, “Accuracy and Completeness of Contemporary Large Language Models in Prosthodontics: An Expert-Based Comparative Study”, Acibadem Univ Saglik Bilim Derg, vol. 17, no. July, August, September 2026, Aug. 2026, doi: 10.31067/acusaglik.1956329.
ISNAD
Yiğit İren, Elif - Üçkuyu, Hatice Betül. “Accuracy and Completeness of Contemporary Large Language Models in Prosthodontics: An Expert-Based Comparative Study”. Acıbadem Üniversitesi Sağlık Bilimleri Dergisi 17/July, August, September 2026 (August 1, 2026). https://doi.org/10.31067/acusaglik.1956329.
JAMA
1.Yiğit İren E, Üçkuyu HB. Accuracy and Completeness of Contemporary Large Language Models in Prosthodontics: An Expert-Based Comparative Study. Acibadem Univ Saglik Bilim Derg. 2026;17. doi:10.31067/acusaglik.1956329.
MLA
Yiğit İren, Elif, and Hatice Betül Üçkuyu. “Accuracy and Completeness of Contemporary Large Language Models in Prosthodontics: An Expert-Based Comparative Study”. Acıbadem Üniversitesi Sağlık Bilimleri Dergisi, vol. 17, no. July, August, September 2026, Aug. 2026, doi:10.31067/acusaglik.1956329.
Vancouver
1.Elif Yiğit İren, Hatice Betül Üçkuyu. Accuracy and Completeness of Contemporary Large Language Models in Prosthodontics: An Expert-Based Comparative Study. Acibadem Univ Saglik Bilim Derg. 2026 Aug. 1;17(July, August, September 2026). doi:10.31067/acusaglik.1956329