Evidence map›Paper›PMID 24853067›Full record

ArticleJournal of the American Medical Informatics Association : JAMIA

Supervised machine learning and active learning in classification of radiology reports.

Dung H M Nguyen, Jon D Patrick

Abstract read
In one paragraph

Article in Journal of the American Medical Informatics Association : JAMIA. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 18 papers.

0numbers the graph read from it
0cells of the map it votes in
18citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

18 citing papers in PubMed.

  1. Article
  2. Article
  3. Article
  4. Article
  5. Review
  6. Article
  7. Article
  8. Article
  9. Article
  10. Article
  11. Article
  12. Article
  13. Article
  14. Intelligent Word Embeddings of Free-Text Radiology Reports.AMIA ... Annual Symposium proceedings. AMIA Symposium · 2017
    Article
  15. Article
  16. Classification of radiology reports for falls in an HIV study cohort.Journal of the American Medical Informatics Association : JAMIA · 2016
    Article
  17. Article
  18. Trends in biomedical informatics: automated topic analysis of JAMIA articles.Journal of the American Medical Informatics Association : JAMIA · 2015
    Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

2 authors.

Dung H M NguyenSchool of Information Technologies, University of Sydney, Sydney, New South Wales, Australia.
Jon D PatrickSchool of Information Technologies, University of Sydney, Sydney, New South Wales, Australia.

Funding

No grant is acknowledged in the PubMed record.

6 · The paper itself

Abstract

objectiveThis paper presents an automated system for classifying the results of imaging examinations (CT, MRI, positron emission tomography) into reportable and non-reportable cancer cases. This system is part of an industrial-strength processing pipeline built to extract content from radiology reports for use in the Victorian Cancer Registry. MATERIALS AND

methodsIn addition to traditional supervised learning methods such as conditional random fields and support vector machines, active learning (AL) approaches were investigated to optimize training production and further improve classification performance. The project involved two pilot sites in Victoria, Australia (Lake Imaging (Ballarat) and Peter MacCallum Cancer Centre (Melbourne)) and, in collaboration with the NSW Central Registry, one pilot site at Westmead Hospital (Sydney).

resultsThe reportability classifier performance achieved 98.25% sensitivity and 96.14% specificity on the cancer registry's held-out test set. Up to 92% of training data needed for supervised machine learning can be saved by AL. DISCUSSION: AL is a promising method for optimizing the supervised training production used in classification of radiology reports. When an AL strategy is applied during the data selection process, the cost of manual classification can be reduced significantly.

conclusionsThe most important practical application of the reportability classifier is that it can dramatically reduce human effort in identifying relevant reports from the large imaging pool for further investigation of cancer. The classifier is built on a large real-world dataset and can achieve high performance in filtering relevant reports to support cancer registries.

Indexed as

AlgorithmsArtificial IntelligenceDiagnostic ImagingHumansMagnetic Resonance ImagingNeoplasmsPositron-Emission TomographyRadiology Information SystemsSensitivity and SpecificitySupport Vector MachineTomography, X-Ray ComputedVocabulary, Controlledactive learningClassificationmachine learningRadiology Information Systems

Identifiers

PMID24853067
PMCPMC4147614

What OpenQuestion holds

Textmetadata
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.