Keywords
HPV-Positive Oropharyngeal Carcinoma; Extranodal Extension; Computed Tomography, Magnetic Resonance Imaging, Inter-Rater Concordance
Abstract
Purpose/Objective(s): The UICC and AJCC have recently added imaging-detected extranodal extension (iENE) as a cN modifier for the upcoming 9th edition TNM Classification (TNM9) of HPV-positive oropharyngeal carcinoma (HPV+ OPC). While academic radiologists demonstrate good inter-rater reliability in identifying imaging-detected extranodal extension (iENE), its reliability among community radiologists has not been studied. Therefore, we conducted an international study to assess the reliability and impact of training on iENE recognition by two groups of community radiologists in the USA and Canada. Materials/Methods: Community radiologists from The Permanente Medical Group (TPMG) and a Quebec Radiology Group (QR) who responded to “Expression-of-Interest” emails were recruited. They were asked to consult training material addressing the Head-and-Neck Cancer-International Group consensus definitions of iENE status before proceeding with a Round-1 (20 cases) and Round-2 (30 cases) iENE review. After each round, expert interpretations were provided to both groups for self-reflection. The TPMG group also had an online group review following Round-1. Gwet’s AC1 concordance score was estimated for the overall, TPMG, and QR groups. Results: A total of 10 radiologists (5 each from TPMG and QR groups) were recruited. The mean (standard deviation) agreement for Round-1 and Round-2 was 86.0% (7.4) and 86.0% (6.0), respectively. The Gwet’s AC1 concordance score were 0.72 (0.50-0.93) (moderate) and 0.76 (0.62-0.89) (substantial) in Round-1 and Round-2, respectively. Gwet’s AC1 score in Round-1 vs Round-2 was 0.74 (0.53-0.95) (moderate) vs 0.82 (0.69-0.94) (substantial) for the TPMG group, and 0.72 (0.48-0.97) (moderate) vs 0.69 (0.50-0.88)] (moderate) for the QR group, respectively. Conclusion: This study shows good inter-rater reliability for iENE status among community radiologists after applying the Head and-Neck-Cancer-International Group consensus definitions, and using high diagnostic certainty. With adherence to guidelines, wider dissemination of HPV+ OPC prognostic models that include iENE status appear feasible. Educational materials are also available to further augment reproducibility. Keywords: HPV-Positive Oropharyngeal Carcinoma; Extranodal Extension; Computed Tomography, Magnetic Resonance Imaging, Inter-Rater Concordance
Citation
O’Sullivan B, Huang SH, Yu E, Su J, Nelson K et al, (2025) Impact of Criteria, Training, and Diagnostic Certainty on Community Radiologists’ Assess ment of Imaging-Detected Extranodal Extension in HPV-Positive Oropharyngeal Carcinoma. SM J Radiol 8(1): 8.