Evidence map›Paper›PMID 35867062›Full record

ArticleJAMA network open2022

Analysis of Radiology Report Recommendation Characteristics and Rate of Recommended Action Performance.

Tiantian White, Mark D Aronson, Scot B Sternberg, Umber Shafiq, Seth J Berkowitz, James Benneyan, Russell S Phillips, Gordon D Schiff

Open access · goldAbstract read
In one paragraph

Article in JAMA network open, 2022. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 18 papers.

0numbers the graph read from it
0cells of the map it votes in
18citing papers in PubMed
4.5field-weighted citation impact, top 5% of its field
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

18 citing papers in PubMed, 32 citations in OpenAlex.

  1. Article
  2. Article
  3. Article
  4. Patient Perspectives on Delayed Specialty Follow-Up After a Primary Care Visit.Journal of the American Board of Family Medicine : JABFM · 2025
    Article
  5. Review
  6. Article
  7. Patient Photograph Association With Radiologist Recommendations for Additional Imaging.Journal of the American College of Radiology : JACR · 2025
    Observational
  8. Predictors of Physician Agreement With Radiologist-Recommended Follow-up Imaging.Journal of the American College of Radiology : JACR · 2025
    Article
  9. American College of Veterinary Radiology and European College of Veterinary Diagnostic Imaging consensus statement on imaging report foundations.Veterinary radiology & ultrasound : the official journal of the American College of Veterinary Radiology and the International Veterinary Radiology Association · 2025
    Article
  10. Article
  11. Article
  12. Article
  13. Observational
  14. Article
  15. Article
  16. Article
  17. Article
  18. Article
4 · The record

Corrections and comments

5 · Who and what money

Authors and funding

8 authors at 4 institutions in 1 country.

Tiantian WhiteHarvard Medical School, Boston, Massachusetts.
Mark D AronsonDepartment of Medicine, Beth Israel Deaconess Medical Center, Boston, Massachusetts.
Scot B SternbergDepartment of Medicine, Beth Israel Deaconess Medical Center, Boston, Massachusetts.
Umber ShafiqDepartment of Medicine, Beth Israel Deaconess Medical Center, Boston, Massachusetts.
Seth J BerkowitzHarvard Medical School, Boston, Massachusetts.
James BenneyanHealthcare Systems Engineering Institute, College of Engineering, Northeastern University, Boston, Massachusetts.
Russell S PhillipsDepartment of Medicine, Beth Israel Deaconess Medical Center, Boston, Massachusetts.
Gordon D SchiffHarvard Medical School, Center for Primary Care, Boston, Massachusetts.
Beth Israel Deaconess Medical Center · USHarvard University · USBrigham and Women's Hospital · USNortheastern University · US

Funding

R18 Closed Loop Diagnostics : AHRQ R18 Patient Safety Learning LaboratoriesR18HS027282 · AHRQ · HARVARD MEDICAL SCHOOL · PI BENNEYAN, JAMES C, PHILLIPS, RUSSELL SCOTT · 2019 to 2022
$2.4M
AHRQ HHS R18 HS027282
6 · The paper itself

Abstract

Importance: Following up on recommendations from radiologic findings is important for patient care, but frequently there are failures to carry out these recommendations. The lack of reliable systems to characterize and track completion of actionable radiology report recommendations poses an important patient safety challenge. Objectives: To characterize actionable radiology recommendations and, using this taxonomy, track and understand rates of loop closure for radiology recommendations in a primary care setting. Design, Setting, and Participants: Radiology reports in a primary care clinic at a large academic center were redesigned to include actionable recommendations in a separate dedicated field. Manual review of all reports generated from imaging tests ordered between January 1 and December 31, 2018, by primary care physicians that contained actionable recommendations was performed. For this quality improvement study, a taxonomy system that conceptualized recommendations was developed based on 3 domains: (1) what is recommended (eg, repeat a test or perform a different test, specialty referral), (2) specified time frame in which to perform the recommended action, and (3) contingency language qualifying the recommendation. Using this framework, a 2-stage process was used to review patients' records to classify recommendations and determine loop closure rates and factors associated with failure to complete recommended actions. Data analysis was conducted from April to July 2021. Main Outcomes and Measures: Radiology recommendations, time frames, and contingencies. Rates of carrying out vs not closing the loop on these recommendations in the recommended time frame were assessed. Results: A total of 598 radiology reports were identified with structured recommendations: 462 for additional or future radiologic studies and 196 for nonradiologic actions (119 specialty referrals, 47 invasive procedures, and 43 other actions). The overall rate of completed actions (loop closure) within the recommended time frame was 87.4%, with 31 open loop cases rated by quality expert reviewers to pose substantial clinical risks. Factors associated with successful loop closure included (1) absence of accompanying contingency language, (2) shorter recommended time frames, and (3) evidence of direct radiologist communication with the ordering primary care physicians. A clinically significant lack of loop closure was found in approximately 5% of cases. Conclusions and Relevance: The findings of this study suggest that creating structured radiology reports featuring a dedicated recommendations field permits the development of taxonomy to classify such recommendations and determine whether they were carried out. The lack of loop closure suggests the need for more reliable systems.

Indexed as

RadiologyCommunicationDiagnostic ImagingHumansRadiologistsReferral and Consultation

Identifiers

PMID35867062
PMCPMC9308057
OpenAlexW4286560906

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.