ArticleRadiology. Imaging cancer2021
Interrater Reliability of NI-RADS on Posttreatment PET/Contrast-enhanced CT Scans in Head and Neck Squamous Cell Carcinoma.
Open access · diamondAbstract read
In one paragraph
Article in Radiology. Imaging cancer, 2021. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 10 papers, 1 of them a synthesis that pooled it.
0numbers the graph read from it
0cells of the map it votes in
10citing papers in PubMed, 1 pooled it
2.7field-weighted citation impact, top 9% of its field
What it found
Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.
The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.
The trial behind it
Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.
Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.
Who cites it
10 citing papers in PubMed, 1 synthesis or guideline pooled it, 17 citations in OpenAlex.
- Does Long-Term Surveillance Imaging Improve Survival in Patients Treated for Head and Neck Squamous Cell Carcinoma? A Systematic Review of the Current Evidence.AJNR. American journal of neuroradiology · 2025Pooled it
- American Society of Neuroradiology Consensus Statement: Integrating Neuro-PET Interpretation into Neuroradiology Training and Practice.AJNR. American journal of neuroradiology · 2026Article
- The Role of Neck Imaging Reporting and Data System (NI-RADS) in the Management of Head and Neck Cancers.Bioengineering (Basel, Switzerland) · 2025Review
- Interrater Agreement of BT-RADS for Evaluation of Follow-up MRI in Patients with Treated Primary Brain Tumor.AJNR. American journal of neuroradiology · 2024Article
- Interrater reliability of Brain Tumor Reporting and Data System (BT-RADS) in the follow up of adult primary brain tumors: a single institution experience in Italy.Quantitative imaging in medicine and surgery · 2023Article
- Discordance Between Oncology Clinician-Perceived and Radiologist-Intended Meaning of the Postradiotherapy Positron Emission Tomography/Computed Tomography Freeform Report for Head and Neck Cancer.JAMA otolaryngology-- head & neck surgery · 2022Article
- Adding MR Diffusion Imaging and T2 Signal Intensity to Neck Imaging Reporting and Data System Categories 2 and 3 in Primary Sites of Postsurgical Oral Cavity Carcinoma Provides Incremental Diagnostic Value.AJNR. American journal of neuroradiology · 2022Article
- Review
- Interrater Reliability among Radiologists Reading PET/Contrast-enhanced CT Scans Using NI-RADS: Methodologic Issues.Radiology. Imaging cancer · 2021Article
- NIRADS-based case assessment of post-treatment head and neck cancer and its clinical correlation: A validation study.National journal of maxillofacial surgeryArticle
Corrections and comments
- Commented on by
Authors and funding
14 authors at 3 institutions in 1 country.
Derek HsuFrom the Department of Radiology, Emory University School of Medicine, 1364 Clifton Rd NE, Room BG03, Atlanta, GA 30322 (D.H., A.H.A.); Department of Neuroradiology, Mayo Clinic, Phoenix, Ariz (T.J.R.); Departments of Radiology and Otolaryngology, University of Pittsburgh School of Medicine, Pittsburgh, Pa (B.F.B.); Department of Radiology and Imaging Sciences, University of Utah Health Sciences Center, Salt Lake City, Utah (Y.A., R.H.W.); Department of Neuroradiology, Weill Cornell Imaging at New York-Presbyterian, New York, NY (C.D.P.); Department of Radiology, Massachusetts Eye and Ear, Harvard Medical School, Boston, Mass (A.F.J.); Department of Radiology and Imaging Sciences, Indiana University School of Medicine, Indianapolis, Ind (K.M.K.); Department of Radiology, University of Vermont Medical Center, Burlington, Vt (M.P.B.); Radiology Imaging Associates, Englewood, Colo (S.M.P.); Department of Radiology, Mayo Clinic, Jacksonville, Fla (M.H.K.); Department of Biostatistics and Bioinformatics, Emory University Rollins School of Public Health, Atlanta, Ga (P.A.R.); and Department of Radiology and Imaging Sciences, Emory University Hospital, Atlanta, Ga (B.R.).ORCID 0000-0001-8969-1247
Tanya J RathFrom the Department of Radiology, Emory University School of Medicine, 1364 Clifton Rd NE, Room BG03, Atlanta, GA 30322 (D.H., A.H.A.); Department of Neuroradiology, Mayo Clinic, Phoenix, Ariz (T.J.R.); Departments of Radiology and Otolaryngology, University of Pittsburgh School of Medicine, Pittsburgh, Pa (B.F.B.); Department of Radiology and Imaging Sciences, University of Utah Health Sciences Center, Salt Lake City, Utah (Y.A., R.H.W.); Department of Neuroradiology, Weill Cornell Imaging at New York-Presbyterian, New York, NY (C.D.P.); Department of Radiology, Massachusetts Eye and Ear, Harvard Medical School, Boston, Mass (A.F.J.); Department of Radiology and Imaging Sciences, Indiana University School of Medicine, Indianapolis, Ind (K.M.K.); Department of Radiology, University of Vermont Medical Center, Burlington, Vt (M.P.B.); Radiology Imaging Associates, Englewood, Colo (S.M.P.); Department of Radiology, Mayo Clinic, Jacksonville, Fla (M.H.K.); Department of Biostatistics and Bioinformatics, Emory University Rollins School of Public Health, Atlanta, Ga (P.A.R.); and Department of Radiology and Imaging Sciences, Emory University Hospital, Atlanta, Ga (B.R.).ORCID 0000-0002-0359-7055
Barton F BranstetterFrom the Department of Radiology, Emory University School of Medicine, 1364 Clifton Rd NE, Room BG03, Atlanta, GA 30322 (D.H., A.H.A.); Department of Neuroradiology, Mayo Clinic, Phoenix, Ariz (T.J.R.); Departments of Radiology and Otolaryngology, University of Pittsburgh School of Medicine, Pittsburgh, Pa (B.F.B.); Department of Radiology and Imaging Sciences, University of Utah Health Sciences Center, Salt Lake City, Utah (Y.A., R.H.W.); Department of Neuroradiology, Weill Cornell Imaging at New York-Presbyterian, New York, NY (C.D.P.); Department of Radiology, Massachusetts Eye and Ear, Harvard Medical School, Boston, Mass (A.F.J.); Department of Radiology and Imaging Sciences, Indiana University School of Medicine, Indianapolis, Ind (K.M.K.); Department of Radiology, University of Vermont Medical Center, Burlington, Vt (M.P.B.); Radiology Imaging Associates, Englewood, Colo (S.M.P.); Department of Radiology, Mayo Clinic, Jacksonville, Fla (M.H.K.); Department of Biostatistics and Bioinformatics, Emory University Rollins School of Public Health, Atlanta, Ga (P.A.R.); and Department of Radiology and Imaging Sciences, Emory University Hospital, Atlanta, Ga (B.R.).ORCID 0000-0002-8502-6909
Yoshimi AnzaiFrom the Department of Radiology, Emory University School of Medicine, 1364 Clifton Rd NE, Room BG03, Atlanta, GA 30322 (D.H., A.H.A.); Department of Neuroradiology, Mayo Clinic, Phoenix, Ariz (T.J.R.); Departments of Radiology and Otolaryngology, University of Pittsburgh School of Medicine, Pittsburgh, Pa (B.F.B.); Department of Radiology and Imaging Sciences, University of Utah Health Sciences Center, Salt Lake City, Utah (Y.A., R.H.W.); Department of Neuroradiology, Weill Cornell Imaging at New York-Presbyterian, New York, NY (C.D.P.); Department of Radiology, Massachusetts Eye and Ear, Harvard Medical School, Boston, Mass (A.F.J.); Department of Radiology and Imaging Sciences, Indiana University School of Medicine, Indianapolis, Ind (K.M.K.); Department of Radiology, University of Vermont Medical Center, Burlington, Vt (M.P.B.); Radiology Imaging Associates, Englewood, Colo (S.M.P.); Department of Radiology, Mayo Clinic, Jacksonville, Fla (M.H.K.); Department of Biostatistics and Bioinformatics, Emory University Rollins School of Public Health, Atlanta, Ga (P.A.R.); and Department of Radiology and Imaging Sciences, Emory University Hospital, Atlanta, Ga (B.R.).ORCID 0000-0003-2988-7445
C Douglas PhillipsFrom the Department of Radiology, Emory University School of Medicine, 1364 Clifton Rd NE, Room BG03, Atlanta, GA 30322 (D.H., A.H.A.); Department of Neuroradiology, Mayo Clinic, Phoenix, Ariz (T.J.R.); Departments of Radiology and Otolaryngology, University of Pittsburgh School of Medicine, Pittsburgh, Pa (B.F.B.); Department of Radiology and Imaging Sciences, University of Utah Health Sciences Center, Salt Lake City, Utah (Y.A., R.H.W.); Department of Neuroradiology, Weill Cornell Imaging at New York-Presbyterian, New York, NY (C.D.P.); Department of Radiology, Massachusetts Eye and Ear, Harvard Medical School, Boston, Mass (A.F.J.); Department of Radiology and Imaging Sciences, Indiana University School of Medicine, Indianapolis, Ind (K.M.K.); Department of Radiology, University of Vermont Medical Center, Burlington, Vt (M.P.B.); Radiology Imaging Associates, Englewood, Colo (S.M.P.); Department of Radiology, Mayo Clinic, Jacksonville, Fla (M.H.K.); Department of Biostatistics and Bioinformatics, Emory University Rollins School of Public Health, Atlanta, Ga (P.A.R.); and Department of Radiology and Imaging Sciences, Emory University Hospital, Atlanta, Ga (B.R.).ORCID 0000-0003-1773-8899
Amy F JulianoFrom the Department of Radiology, Emory University School of Medicine, 1364 Clifton Rd NE, Room BG03, Atlanta, GA 30322 (D.H., A.H.A.); Department of Neuroradiology, Mayo Clinic, Phoenix, Ariz (T.J.R.); Departments of Radiology and Otolaryngology, University of Pittsburgh School of Medicine, Pittsburgh, Pa (B.F.B.); Department of Radiology and Imaging Sciences, University of Utah Health Sciences Center, Salt Lake City, Utah (Y.A., R.H.W.); Department of Neuroradiology, Weill Cornell Imaging at New York-Presbyterian, New York, NY (C.D.P.); Department of Radiology, Massachusetts Eye and Ear, Harvard Medical School, Boston, Mass (A.F.J.); Department of Radiology and Imaging Sciences, Indiana University School of Medicine, Indianapolis, Ind (K.M.K.); Department of Radiology, University of Vermont Medical Center, Burlington, Vt (M.P.B.); Radiology Imaging Associates, Englewood, Colo (S.M.P.); Department of Radiology, Mayo Clinic, Jacksonville, Fla (M.H.K.); Department of Biostatistics and Bioinformatics, Emory University Rollins School of Public Health, Atlanta, Ga (P.A.R.); and Department of Radiology and Imaging Sciences, Emory University Hospital, Atlanta, Ga (B.R.).ORCID 0000-0002-5088-5367
Kristine M MosierFrom the Department of Radiology, Emory University School of Medicine, 1364 Clifton Rd NE, Room BG03, Atlanta, GA 30322 (D.H., A.H.A.); Department of Neuroradiology, Mayo Clinic, Phoenix, Ariz (T.J.R.); Departments of Radiology and Otolaryngology, University of Pittsburgh School of Medicine, Pittsburgh, Pa (B.F.B.); Department of Radiology and Imaging Sciences, University of Utah Health Sciences Center, Salt Lake City, Utah (Y.A., R.H.W.); Department of Neuroradiology, Weill Cornell Imaging at New York-Presbyterian, New York, NY (C.D.P.); Department of Radiology, Massachusetts Eye and Ear, Harvard Medical School, Boston, Mass (A.F.J.); Department of Radiology and Imaging Sciences, Indiana University School of Medicine, Indianapolis, Ind (K.M.K.); Department of Radiology, University of Vermont Medical Center, Burlington, Vt (M.P.B.); Radiology Imaging Associates, Englewood, Colo (S.M.P.); Department of Radiology, Mayo Clinic, Jacksonville, Fla (M.H.K.); Department of Biostatistics and Bioinformatics, Emory University Rollins School of Public Health, Atlanta, Ga (P.A.R.); and Department of Radiology and Imaging Sciences, Emory University Hospital, Atlanta, Ga (B.R.).
Michael P BazylewiczFrom the Department of Radiology, Emory University School of Medicine, 1364 Clifton Rd NE, Room BG03, Atlanta, GA 30322 (D.H., A.H.A.); Department of Neuroradiology, Mayo Clinic, Phoenix, Ariz (T.J.R.); Departments of Radiology and Otolaryngology, University of Pittsburgh School of Medicine, Pittsburgh, Pa (B.F.B.); Department of Radiology and Imaging Sciences, University of Utah Health Sciences Center, Salt Lake City, Utah (Y.A., R.H.W.); Department of Neuroradiology, Weill Cornell Imaging at New York-Presbyterian, New York, NY (C.D.P.); Department of Radiology, Massachusetts Eye and Ear, Harvard Medical School, Boston, Mass (A.F.J.); Department of Radiology and Imaging Sciences, Indiana University School of Medicine, Indianapolis, Ind (K.M.K.); Department of Radiology, University of Vermont Medical Center, Burlington, Vt (M.P.B.); Radiology Imaging Associates, Englewood, Colo (S.M.P.); Department of Radiology, Mayo Clinic, Jacksonville, Fla (M.H.K.); Department of Biostatistics and Bioinformatics, Emory University Rollins School of Public Health, Atlanta, Ga (P.A.R.); and Department of Radiology and Imaging Sciences, Emory University Hospital, Atlanta, Ga (B.R.).ORCID 0000-0003-4392-8733
Stan M PoliashenkoFrom the Department of Radiology, Emory University School of Medicine, 1364 Clifton Rd NE, Room BG03, Atlanta, GA 30322 (D.H., A.H.A.); Department of Neuroradiology, Mayo Clinic, Phoenix, Ariz (T.J.R.); Departments of Radiology and Otolaryngology, University of Pittsburgh School of Medicine, Pittsburgh, Pa (B.F.B.); Department of Radiology and Imaging Sciences, University of Utah Health Sciences Center, Salt Lake City, Utah (Y.A., R.H.W.); Department of Neuroradiology, Weill Cornell Imaging at New York-Presbyterian, New York, NY (C.D.P.); Department of Radiology, Massachusetts Eye and Ear, Harvard Medical School, Boston, Mass (A.F.J.); Department of Radiology and Imaging Sciences, Indiana University School of Medicine, Indianapolis, Ind (K.M.K.); Department of Radiology, University of Vermont Medical Center, Burlington, Vt (M.P.B.); Radiology Imaging Associates, Englewood, Colo (S.M.P.); Department of Radiology, Mayo Clinic, Jacksonville, Fla (M.H.K.); Department of Biostatistics and Bioinformatics, Emory University Rollins School of Public Health, Atlanta, Ga (P.A.R.); and Department of Radiology and Imaging Sciences, Emory University Hospital, Atlanta, Ga (B.R.).
Matthew H KulzerFrom the Department of Radiology, Emory University School of Medicine, 1364 Clifton Rd NE, Room BG03, Atlanta, GA 30322 (D.H., A.H.A.); Department of Neuroradiology, Mayo Clinic, Phoenix, Ariz (T.J.R.); Departments of Radiology and Otolaryngology, University of Pittsburgh School of Medicine, Pittsburgh, Pa (B.F.B.); Department of Radiology and Imaging Sciences, University of Utah Health Sciences Center, Salt Lake City, Utah (Y.A., R.H.W.); Department of Neuroradiology, Weill Cornell Imaging at New York-Presbyterian, New York, NY (C.D.P.); Department of Radiology, Massachusetts Eye and Ear, Harvard Medical School, Boston, Mass (A.F.J.); Department of Radiology and Imaging Sciences, Indiana University School of Medicine, Indianapolis, Ind (K.M.K.); Department of Radiology, University of Vermont Medical Center, Burlington, Vt (M.P.B.); Radiology Imaging Associates, Englewood, Colo (S.M.P.); Department of Radiology, Mayo Clinic, Jacksonville, Fla (M.H.K.); Department of Biostatistics and Bioinformatics, Emory University Rollins School of Public Health, Atlanta, Ga (P.A.R.); and Department of Radiology and Imaging Sciences, Emory University Hospital, Atlanta, Ga (B.R.).
Patricia A RhynerFrom the Department of Radiology, Emory University School of Medicine, 1364 Clifton Rd NE, Room BG03, Atlanta, GA 30322 (D.H., A.H.A.); Department of Neuroradiology, Mayo Clinic, Phoenix, Ariz (T.J.R.); Departments of Radiology and Otolaryngology, University of Pittsburgh School of Medicine, Pittsburgh, Pa (B.F.B.); Department of Radiology and Imaging Sciences, University of Utah Health Sciences Center, Salt Lake City, Utah (Y.A., R.H.W.); Department of Neuroradiology, Weill Cornell Imaging at New York-Presbyterian, New York, NY (C.D.P.); Department of Radiology, Massachusetts Eye and Ear, Harvard Medical School, Boston, Mass (A.F.J.); Department of Radiology and Imaging Sciences, Indiana University School of Medicine, Indianapolis, Ind (K.M.K.); Department of Radiology, University of Vermont Medical Center, Burlington, Vt (M.P.B.); Radiology Imaging Associates, Englewood, Colo (S.M.P.); Department of Radiology, Mayo Clinic, Jacksonville, Fla (M.H.K.); Department of Biostatistics and Bioinformatics, Emory University Rollins School of Public Health, Atlanta, Ga (P.A.R.); and Department of Radiology and Imaging Sciences, Emory University Hospital, Atlanta, Ga (B.R.).
Benjamin RiskFrom the Department of Radiology, Emory University School of Medicine, 1364 Clifton Rd NE, Room BG03, Atlanta, GA 30322 (D.H., A.H.A.); Department of Neuroradiology, Mayo Clinic, Phoenix, Ariz (T.J.R.); Departments of Radiology and Otolaryngology, University of Pittsburgh School of Medicine, Pittsburgh, Pa (B.F.B.); Department of Radiology and Imaging Sciences, University of Utah Health Sciences Center, Salt Lake City, Utah (Y.A., R.H.W.); Department of Neuroradiology, Weill Cornell Imaging at New York-Presbyterian, New York, NY (C.D.P.); Department of Radiology, Massachusetts Eye and Ear, Harvard Medical School, Boston, Mass (A.F.J.); Department of Radiology and Imaging Sciences, Indiana University School of Medicine, Indianapolis, Ind (K.M.K.); Department of Radiology, University of Vermont Medical Center, Burlington, Vt (M.P.B.); Radiology Imaging Associates, Englewood, Colo (S.M.P.); Department of Radiology, Mayo Clinic, Jacksonville, Fla (M.H.K.); Department of Biostatistics and Bioinformatics, Emory University Rollins School of Public Health, Atlanta, Ga (P.A.R.); and Department of Radiology and Imaging Sciences, Emory University Hospital, Atlanta, Ga (B.R.).ORCID 0000-0003-1090-0777
Richard H WigginsFrom the Department of Radiology, Emory University School of Medicine, 1364 Clifton Rd NE, Room BG03, Atlanta, GA 30322 (D.H., A.H.A.); Department of Neuroradiology, Mayo Clinic, Phoenix, Ariz (T.J.R.); Departments of Radiology and Otolaryngology, University of Pittsburgh School of Medicine, Pittsburgh, Pa (B.F.B.); Department of Radiology and Imaging Sciences, University of Utah Health Sciences Center, Salt Lake City, Utah (Y.A., R.H.W.); Department of Neuroradiology, Weill Cornell Imaging at New York-Presbyterian, New York, NY (C.D.P.); Department of Radiology, Massachusetts Eye and Ear, Harvard Medical School, Boston, Mass (A.F.J.); Department of Radiology and Imaging Sciences, Indiana University School of Medicine, Indianapolis, Ind (K.M.K.); Department of Radiology, University of Vermont Medical Center, Burlington, Vt (M.P.B.); Radiology Imaging Associates, Englewood, Colo (S.M.P.); Department of Radiology, Mayo Clinic, Jacksonville, Fla (M.H.K.); Department of Biostatistics and Bioinformatics, Emory University Rollins School of Public Health, Atlanta, Ga (P.A.R.); and Department of Radiology and Imaging Sciences, Emory University Hospital, Atlanta, Ga (B.R.).
Ashley H AikenFrom the Department of Radiology, Emory University School of Medicine, 1364 Clifton Rd NE, Room BG03, Atlanta, GA 30322 (D.H., A.H.A.); Department of Neuroradiology, Mayo Clinic, Phoenix, Ariz (T.J.R.); Departments of Radiology and Otolaryngology, University of Pittsburgh School of Medicine, Pittsburgh, Pa (B.F.B.); Department of Radiology and Imaging Sciences, University of Utah Health Sciences Center, Salt Lake City, Utah (Y.A., R.H.W.); Department of Neuroradiology, Weill Cornell Imaging at New York-Presbyterian, New York, NY (C.D.P.); Department of Radiology, Massachusetts Eye and Ear, Harvard Medical School, Boston, Mass (A.F.J.); Department of Radiology and Imaging Sciences, Indiana University School of Medicine, Indianapolis, Ind (K.M.K.); Department of Radiology, University of Vermont Medical Center, Burlington, Vt (M.P.B.); Radiology Imaging Associates, Englewood, Colo (S.M.P.); Department of Radiology, Mayo Clinic, Jacksonville, Fla (M.H.K.); Department of Biostatistics and Bioinformatics, Emory University Rollins School of Public Health, Atlanta, Ga (P.A.R.); and Department of Radiology and Imaging Sciences, Emory University Hospital, Atlanta, Ga (B.R.).
University of Pittsburgh · USEmory University · USMassachusetts Eye and Ear Infirmary · US
Funding
No grant is acknowledged in the PubMed record.
Abstract
Purpose To evaluate the interrater reliability among radiologists examining posttreatment head and neck squamous cell carcinoma (HNSCC) fluorodeoxyglucose PET/contrast-enhanced CT (CECT) scans using Neck Imaging Reporting and Data System (NI-RADS). Materials and Methods In this retrospective study, images in 80 patients with HNSCC who underwent posttreatment surveillance PET/CECT and immediate prior comparison CECT or PET/CECT (from June 2014 to July 2016) were uploaded to the American College of Radiology's cloud-based website, Cortex. Eight radiologists from seven institutions with variable NI-RADS experience independently evaluated each case and assigned an appropriate prose description and NI-RADS category for the primary site and the neck site. Five of these individuals were experienced readers (> 5 years of experience), and three were novices (< 5 years of experience). In total, 640 lexicon-based and NI-RADS categories were assigned to lesions among the 80 included patients by the eight radiologists. Light generalization of Cohen κ for interrater reliability was performed. Results Of the 80 included patients (mean age, 63 years ± 10 [standard deviation]), there were 58 men (73%); 60 patients had stage IV HNSCC (75%), and the most common tumor location was oropharynx (
Indexed as
Head and Neck NeoplasmsPositron Emission Tomography Computed TomographyHumansMaleMiddle AgedPositron-Emission TomographyReproducibility of ResultsRetrospective StudiesSquamous Cell Carcinoma of Head and NeckTomography, X-Ray ComputedCTHead/NeckNeckNeoplasms-PrimaryObserver PerformancePET/CT
Identifiers
What OpenQuestion holds
Textmetadata
Read underepoch 390
Registered trials
None linked
Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.