ABSTRACT Recent claims of expert‐level endodontic diagnostic performance by large language models require cautious interpretation. In a 40‐case, text‐only comparison, methodological concerns limit reproducibility and clinical generalisability. The reported testing period preceded the public release of GPT‐5, making clarification of the exact model version, platform, access dates, and settings essential. Use of a single endodontist as the reference standard demonstrates agreement with one clinician rather than independently verified diagnostic accuracy. Binary yes/no vignettes may also simplify the diagnostic task and do not reflect routine multimodal assessment incorporating radiographic interpretation. Single‐query testing prevents evaluation of response consistency, while perfect accuracy in a small sample remains compatible with considerable statistical uncertainty. These findings are therefore best viewed as preliminary evidence of high concordance under controlled conditions. Future studies should use transparent model reporting, repeated runs, consensus reference standards, and clinically representative multimodal cases before expert‐level performance is inferred.
Satya Ranjan Misra, Rupsa Das. Before ‘Expert‐Level’ Performance: Reproducibility and Reference‐Standard Concerns in Evaluating Large Language Models for Endodontic Diagnosis. // Australian Endodontic Journal. – 2026. – DOI: 10.1111/aej.70127. – URL: https://onlinelibrary.wiley.com/doi/10.1111/aej.70127?af=R
Satya Ranjan Misra & Rupsa Das (2026). Before ‘Expert‐Level’ Performance: Reproducibility and Reference‐Standard Concerns in Evaluating Large Language Models for Endodontic Diagnosis. Australian Endodontic Journal. https://doi.org/10.1111/aej.70127
Satya Ranjan Misra and Rupsa Das. “Before ‘Expert‐Level’ Performance: Reproducibility and Reference‐Standard Concerns in Evaluating Large Language Models for Endodontic Diagnosis.” Australian Endodontic Journal, 2026. doi:10.1111/aej.70127.
@article{Misra2026,
title = {Before ‘Expert‐Level’ Performance: Reproducibility and Reference‐Standard Concerns in Evaluating Large Language Models for Endodontic Diagnosis},
author = {Misra, Satya Ranjan and Das, Rupsa},
journal = {Australian Endodontic Journal},
year = {2026},
doi = {10.1111/aej.70127},
url = {https://onlinelibrary.wiley.com/doi/10.1111/aej.70127?af=R}
}
Abstract The rotational path removable partial denture (RPRPD) design is a viable treatment approach for the esthetic and functional rehabilitation of Kennedy's Classification III and IV partially edentulous patients. The purpose of...
BDJ Open, Published online: 19 November 2026; doi:10.1038/s41405-026-00443-y Design and validation of a questionnaire to measure the knowledge and performance of dentists regarding dental considerations in patients receiving bisphosphonate
ABSTRACT Background Temporomandibular joint osteoarthritis (TMJOA) is characterized by progressive cartilage degeneration and inflammatory catabolism, but the mechanisms linking inflammatory stress to extracellular signalling remain...