Evidence map›Paper›PMID 37567818›Full record

ArticleAcademic radiology2024

Targeted Training Reduces Search Errors but Not Classification Errors for Hepatic Metastasis Detection at Contrast-Enhanced CT.

Scott S Hsieh, Akitoshi Inoue, Mariana Yalon, David A Cook, Hao Gong, Parvathy Sudhir Pillai, Matthew P Johnson, Jeff L Fidler, Shuai Leng, Lifeng Yu and 4 more

Open access · greenAbstract read
PubMed Full text at PMC Publisher
In one paragraph

Article in Academic radiology, 2024. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 4 papers.

0numbers the graph read from it
0cells of the map it votes in
4citing papers in PubMed
0.7field-weighted citation impact, top 35% of its field
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

4 citing papers in PubMed, 6 citations in OpenAlex.

  1. Evaluation of the performance of radiologists assisted by AI in detecting colorectal liver metastases on contrast-enhanced CT.Cancer imaging : the official publication of the International Cancer Imaging Society · 2026
    Article
  2. Article
  3. Article
  4. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

14 authors at 2 institutions in 1 country.

Scott S HsiehDepartment of Radiology, Mayo Clinic, 200 First St. SW, Rochester, MN 55905 (S.S.H., A.I., M.Y., H.G., P.S.P., J.L.F., S.L., L.Y., C.H.McC., J.G.F.); Department of General Internal Medicine, Mayo Clinic, 200 First St. SW, Rochester, MN 55905 (S.S.H.). Electronic address: hsieh.scott@mayo.edu.
Akitoshi InoueDepartment of Radiology, Mayo Clinic, 200 First St. SW, Rochester, MN 55905 (S.S.H., A.I., M.Y., H.G., P.S.P., J.L.F., S.L., L.Y., C.H.McC., J.G.F.).
Mariana YalonDepartment of Radiology, Mayo Clinic, 200 First St. SW, Rochester, MN 55905 (S.S.H., A.I., M.Y., H.G., P.S.P., J.L.F., S.L., L.Y., C.H.McC., J.G.F.).
David A CookQuantitative Health Services - Clinical Trials and Biostatistics, Mayo Clinic, 200 First St. SW, Rochester, MN 55905 (D.A.C.).
Hao GongDepartment of Radiology, Mayo Clinic, 200 First St. SW, Rochester, MN 55905 (S.S.H., A.I., M.Y., H.G., P.S.P., J.L.F., S.L., L.Y., C.H.McC., J.G.F.).
Parvathy Sudhir PillaiDepartment of Radiology, Mayo Clinic, 200 First St. SW, Rochester, MN 55905 (S.S.H., A.I., M.Y., H.G., P.S.P., J.L.F., S.L., L.Y., C.H.McC., J.G.F.).
Matthew P JohnsonDepartment of Physiology Biomedical Engineering, Mayo Clinic, 200 First St. SW, Rochester, MN 55905 (M.P.J., R.E.C.).
Jeff L FidlerDepartment of Radiology, Mayo Clinic, 200 First St. SW, Rochester, MN 55905 (S.S.H., A.I., M.Y., H.G., P.S.P., J.L.F., S.L., L.Y., C.H.McC., J.G.F.).
Shuai LengDepartment of Radiology, Mayo Clinic, 200 First St. SW, Rochester, MN 55905 (S.S.H., A.I., M.Y., H.G., P.S.P., J.L.F., S.L., L.Y., C.H.McC., J.G.F.).
Lifeng YuDepartment of Radiology, Mayo Clinic, 200 First St. SW, Rochester, MN 55905 (S.S.H., A.I., M.Y., H.G., P.S.P., J.L.F., S.L., L.Y., C.H.McC., J.G.F.).
Rickey E CarterDepartment of Physiology Biomedical Engineering, Mayo Clinic, 200 First St. SW, Rochester, MN 55905 (M.P.J., R.E.C.).
David R HolmesQuantitative Health Services - Clinical Trials and Biostatistics, Mayo Clinic, 4500 San Pablo Road, Jacksonville, FL 32224 (D.R.H. III).
Cynthia H McColloughDepartment of Radiology, Mayo Clinic, 200 First St. SW, Rochester, MN 55905 (S.S.H., A.I., M.Y., H.G., P.S.P., J.L.F., S.L., L.Y., C.H.McC., J.G.F.).
Joel G FletcherDepartment of Radiology, Mayo Clinic, 200 First St. SW, Rochester, MN 55905 (S.S.H., A.I., M.Y., H.G., P.S.P., J.L.F., S.L., L.Y., C.H.McC., J.G.F.).
Mayo Clinic · USMayo Clinic in Florida · US

Funding

Trade-offs in human observer performance, image quality metrics, and patient doseR01EB017095 · NIBIB · MAYO CLINIC ROCHESTER · PI Hao Gong, Cynthia H McCollough · 2012 to 2026
$7.0M
NIBIB NIH HHS R01 EB017095
6 · The paper itself

Abstract

RATIONALE AND

objectivesMethods are needed to improve the detection of hepatic metastases. Errors occur in both lesion detection (search) and decisions of benign versus malignant (classification). Our purpose was to evaluate a training program to reduce search errors and classification errors in the detection of hepatic metastases in contrast-enhanced abdominal computed tomography (CT). MATERIALS AND

methodsAfter Institutional Review Board approval, we conducted a single-group prospective pretest-posttest study. Pretest and posttest were identical and consisted of interpreting 40 contrast-enhanced abdominal CT exams containing 91 liver metastases under eye tracking. Between pretest and posttest, readers completed search training with eye-tracker feedback and coaching to increase interpretation time, use liver windows, and use coronal reformations. They also completed classification training with part-task practice, rating lesions as benign or malignant. The primary outcome was metastases missed due to search errors (<2 seconds gaze under eye tracker) and classification errors (>2 seconds). Jackknife free-response receiver operator characteristic (JAFROC) analysis was also conducted.

resultsA total of 31 radiologist readers (8 abdominal subspecialists, 8 nonabdominal subspecialists, 15 senior residents/fellows) participated. Search errors were reduced (pretest 11%, posttest 8%, difference 3% [95% confidence interval, 0.3%-5.1%], P = .01), but there was no difference in classification errors (difference 0%, P = .97) or in JAFROC figure of merit (difference -0.01, P = .36). In subgroup analysis, abdominal subspecialists demonstrated no evidence of change.

conclusionTargeted training reduced search errors but not classification errors for the detection of hepatic metastases at contrast-enhanced abdominal CT. Improvements were not seen in all subgroups.

Indexed as

Liver NeoplasmsTomography, X-Ray ComputedContrast MediaHumansProspective StudiesContrast MediaClassification errorsEye trackingRadiologist trainingSearch errors

Identifiers

PMID37567818
PMCPMC10853479
OpenAlexW4385778906

What OpenQuestion holds

Textmetadata
LicenceTDM
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.