Evidence map›Paper›PMID 31872069›Full record

ReviewNPJ digital medicine2019

Desiderata for delivering NLP to accelerate healthcare AI advancement and a Mayo Clinic NLP-as-a-service implementation.

Andrew Wen, Sunyang Fu, Sungrim Moon, Mohamed El Wazir, Andrew Rosenbaum, Vinod C Kaggal, Sijia Liu, Sunghwan Sohn, Hongfang Liu, Jungwei Fan

Abstract readReview
In one paragraph

Review in NPJ digital medicine, 2019. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 70 papers.

0numbers the graph read from it
0cells of the map it votes in
70citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

70 citing papers in PubMed.

  1. Trial
  2. Trial
  3. Article
  4. Article
  5. Article
  6. Observational
  7. Article
  8. Article
  9. Review
  10. Article
  11. Article
  12. Article
  13. Article
  14. Article
  15. Article
  16. Article
  17. Article
  18. Article
  19. Article
  20. Review

10 more citing papers are in PubMed but not listed here.

4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

10 authors.

Andrew Wen1Division of Digital Health Sciences, Department of Health Sciences Research, Mayo Clinic, Rochester, MN USA.ORCID 0000-0001-9090-8028
Sunyang Fu1Division of Digital Health Sciences, Department of Health Sciences Research, Mayo Clinic, Rochester, MN USA.ORCID 0000-0003-1691-5179
Sungrim Moon1Division of Digital Health Sciences, Department of Health Sciences Research, Mayo Clinic, Rochester, MN USA.ORCID 0000-0002-9191-3897
Mohamed El Wazir2Department of Cardiovascular Medicine, Mayo Clinic, Rochester, MN USA.ORCID 0000-0002-9168-5855
Andrew Rosenbaum2Department of Cardiovascular Medicine, Mayo Clinic, Rochester, MN USA.ORCID 0000-0001-9202-0233
Vinod C Kaggal3Advanced Analytics Service Unit, Department of Information Technology, Mayo Clinic, Rochester, MN USA.
Sijia Liu1Division of Digital Health Sciences, Department of Health Sciences Research, Mayo Clinic, Rochester, MN USA.ORCID 0000-0001-9763-1164
Sunghwan Sohn1Division of Digital Health Sciences, Department of Health Sciences Research, Mayo Clinic, Rochester, MN USA.
Hongfang Liu1Division of Digital Health Sciences, Department of Health Sciences Research, Mayo Clinic, Rochester, MN USA.
Jungwei Fan1Division of Digital Health Sciences, Department of Health Sciences Research, Mayo Clinic, Rochester, MN USA.

Funding

Open Health Natural Language Processing CollaboratoryU01TR002062 · NCATS · MAYO CLINIC ROCHESTER · PI JIANG, XIAOQIAN, LIU, HONGFANG · 2017 to 2021
$7.6M
NCATS NIH HHS U01 TR002062
6 · The paper itself

Abstract

Data is foundational to high-quality artificial intelligence (AI). Given that a substantial amount of clinically relevant information is embedded in unstructured data, natural language processing (NLP) plays an essential role in extracting valuable information that can benefit decision making, administration reporting, and research. Here, we share several desiderata pertaining to development and usage of NLP systems, derived from two decades of experience implementing clinical NLP at the Mayo Clinic, to inform the healthcare AI community. Using a framework, we developed as an example implementation, the desiderata emphasize the importance of a user-friendly platform, efficient collection of domain expert inputs, seamless integration with clinical data, and a highly scalable computing infrastructure.

Indexed as

Health careMedical research

Identifiers

PMID31872069
PMCPMC6917754

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.