Evidence map›Paper›PMID 33021486›Full record

ArticleJMIR medical informatics2020

Implementation of a Cohort Retrieval System for Clinical Data Repositories Using the Observational Medical Outcomes Partnership Common Data Model: Proof-of-Concept System Validation.

Sijia Liu, Yanshan Wang, Andrew Wen, Liwei Wang, Na Hong, Feichen Shen, Steven Bedrick, William Hersh, Hongfang Liu

Abstract read
In one paragraph

Article in JMIR medical informatics, 2020. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 12 papers.

0numbers the graph read from it
0cells of the map it votes in
12citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

12 citing papers in PubMed.

  1. Article
  2. Article
  3. Clinical Information Retrieval: A Literature Review.Journal of healthcare informatics research · 2024
    Article
  4. Clinical Data Warehousing: A Scoping Review.Journal of the Society for Clinical Data Management · 2024
    Article
  5. Review
  6. Article
  7. Article
  8. Article
  9. Article
  10. Key Contributions in Clinical Research Informatics.Yearbook of medical informatics · 2021
    Review
  11. Article
  12. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

9 authors.

Sijia LiuDepartment of Health Sciences Research, Mayo Clinic, Rochester, MN, United States.ORCID https://orcid.org/0000-0001-9763-1164
Yanshan WangDepartment of Health Sciences Research, Mayo Clinic, Rochester, MN, United States.ORCID https://orcid.org/0000-0003-4433-7839
Andrew WenDepartment of Health Sciences Research, Mayo Clinic, Rochester, MN, United States.ORCID https://orcid.org/0000-0001-9090-8028
Liwei WangDepartment of Health Sciences Research, Mayo Clinic, Rochester, MN, United States.ORCID https://orcid.org/0000-0001-9970-8604
Na HongDepartment of Health Sciences Research, Mayo Clinic, Rochester, MN, United States.ORCID https://orcid.org/0000-0001-6798-1761
Feichen ShenDepartment of Health Sciences Research, Mayo Clinic, Rochester, MN, United States.ORCID https://orcid.org/0000-0002-7803-2331
Steven BedrickDepartment of Computer Science and Electrical Engineering, Oregon Health & Science University, Portland, OR, United States.ORCID https://orcid.org/0000-0002-0163-9397
William HershDepartment of Medical Informatics and Clinical Epidemiology, Oregon Health & Science University, Portland, OR, United States.ORCID https://orcid.org/0000-0002-4114-5148
Hongfang LiuDepartment of Health Sciences Research, Mayo Clinic, Rochester, MN, United States.ORCID https://orcid.org/0000-0003-2570-3741

Funding

Open Health Natural Language Processing CollaboratoryU01TR002062 · NCATS · MAYO CLINIC ROCHESTER · PI JIANG, XIAOQIAN, LIU, HONGFANG · 2017 to 2021
$7.6M
Semi-structured Information Retrieval in Clinical Text for Cohort IdentificationR01LM011934 · NLM · UNIVERSITY OF TEXAS HLTH SCI CTR HOUSTON · PI HERSH, WILLIAM R, LIU, HONGFANG · 2014 to 2025
$5.1M
Secondary use of EMRs for surgical complication surveillanceR01EB019403 · NIBIB · MAYO CLINIC ROCHESTER · PI LIU, HONGFANG, STORLIE, CURTIS · 2015 to 2022
$3.8M
Patient Medical History Representation, Extraction, and Inference from EHR DataR01LM011829 · NLM · UNIVERSITY OF TEXAS HLTH SCI CTR HOUSTON · PI TAO, CUI · 2014 to 2018
$1.7M
NCATS NIH HHS U01 TR002062NIBIB NIH HHS R01 EB019403NLM NIH HHS R01 LM011829NLM NIH HHS R01 LM011934
6 · The paper itself

Abstract

backgroundWidespread adoption of electronic health records has enabled the secondary use of electronic health record data for clinical research and health care delivery. Natural language processing techniques have shown promise in their capability to extract the information embedded in unstructured clinical data, and information retrieval techniques provide flexible and scalable solutions that can augment natural language processing systems for retrieving and ranking relevant records.

objectiveIn this paper, we present the implementation of a cohort retrieval system that can execute textual cohort selection queries on both structured data and unstructured text-Cohort Retrieval Enhanced by Analysis of Text from Electronic Health Records (CREATE).

methodsCREATE is a proof-of-concept system that leverages a combination of structured queries and information retrieval techniques on natural language processing results to improve cohort retrieval performance using the Observational Medical Outcomes Partnership Common Data Model to enhance model portability. The natural language processing component was used to extract common data model concepts from textual queries. We designed a hierarchical index to support the common data model concept search utilizing information retrieval techniques and frameworks.

resultsOur case study on 5 cohort identification queries, evaluated using the precision at 5 information retrieval metric at both the patient-level and document-level, demonstrates that CREATE achieves a mean precision at 5 of 0.90, which outperforms systems using only structured data or only unstructured text with mean precision at 5 values of 0.54 and 0.74, respectively.

conclusionsThe implementation and evaluation of Mayo Clinic Biobank data demonstrated that CREATE outperforms cohort retrieval systems that only use one of either structured data or unstructured text in complex textual cohort queries.

Indexed as

cohort retrievalcommon data modelelectronic health recordsinformation retrievalnatural language processing

Identifiers

PMID33021486
PMCPMC7576539

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.