Evidence map›Paper›PMID 20595303›Full record

ArticleJournal of the American Medical Informatics Association : JAMIA

Evaluation of a generalizable approach to clinical information retrieval using the automated retrieval console (ARC).

Leonard W D'Avolio, Thien M Nguyen, Wildon R Farwell, Yongming Chen, Felicia Fitzmeyer, Owen M Harris, Louis D Fiore

Abstract read
In one paragraph

Article in Journal of the American Medical Informatics Association : JAMIA. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 31 papers.

0numbers the graph read from it
0cells of the map it votes in
31citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

31 citing papers in PubMed.

  1. Translational NLP: A New Paradigm and General Principles for Natural Language Processing Research.Proceedings of the conference. Association for Computational Linguistics. North American Chapter. Meeting · 2021
    Article
  2. Article
  3. Review
  4. Article
  5. Article
  6. Article
  7. Extracting Healthcare Quality Information from Unstructured Data.AMIA ... Annual Symposium proceedings. AMIA Symposium · 2017
    Article
  8. Article
  9. Article
  10. Review
  11. Functional evaluation of out-of-the-box text-mining tools for data-mining tasks.Journal of the American Medical Informatics Association : JAMIA · 2015
    Article
  12. Article
  13. Recent trends in biomedical informatics: a study based on JAMIA articles.Journal of the American Medical Informatics Association : JAMIA · 2013
    Article
  14. Article
  15. Article
  16. Article
  17. Article
  18. Clinical research informatics: a conceptual perspective.Journal of the American Medical Informatics Association : JAMIA · 2012
    Article
  19. Article
  20. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

7 authors.

Leonard W D'AvolioMassachusetts Veterans Epidemiology Research and Information Center Cooperative Studies Coordinating Center, VA Boston Healthcare System, Jamaica Plain, Massachusetts 02130, USA. leonard.davolio@va.gov
Thien M Nguyen
Wildon R Farwell
Yongming Chen
Felicia Fitzmeyer
Owen M Harris
Louis D Fiore

Funding

HSRD VA HIR 09-007
6 · The paper itself

Abstract

Reducing custom software development effort is an important goal in information retrieval (IR). This study evaluated a generalizable approach involving with no custom software or rules development. The study used documents "consistent with cancer" to evaluate system performance in the domains of colorectal (CRC), prostate (PC), and lung (LC) cancer. Using an end-user-supplied reference set, the automated retrieval console (ARC) iteratively calculated performance of combinations of natural language processing-derived features and supervised classification algorithms. Training and testing involved 10-fold cross-validation for three sets of 500 documents each. Performance metrics included recall, precision, and F-measure. Annotation time for five physicians was also measured. Top performing algorithms had recall, precision, and F-measure values as follows: for CRC, 0.90, 0.92, and 0.89, respectively; for PC, 0.97, 0.95, and 0.94; and for LC, 0.76, 0.80, and 0.75. In all but one case, conditional random fields outperformed maximum entropy-based classifiers. Algorithms had good performance without custom code or rules development, but performance varied by specific application.

Indexed as

Data MiningElectronic Health RecordsNatural Language ProcessingUser-Computer InterfaceAlgorithmsHumansInternational Classification of DiseasesNeoplasmsSoftware Validation

Identifiers

PMID20595303
PMCPMC2995644

What OpenQuestion holds

Textmetadata
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.