Evidence map›Paper›PMID 33164061›Full record

ArticleJournal of the American Medical Informatics Association : JAMIA2021

Assessing the quality of clinical and administrative data extracted from hospitals: the General Medicine Inpatient Initiative (GEMINI) experience.

Amol A Verma, Sachin V Pasricha, Hae Young Jung, Vladyslav Kushnir, Denise Y F Mak, Radha Koppula, Yishan Guo, Janice L Kwan, Lauren Lapointe-Shaw, Shail Rawal and 3 more

Open access · bronzeAbstract read
In one paragraph

Article in Journal of the American Medical Informatics Association : JAMIA, 2021. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 62 papers, 4 of them syntheses that pooled it.

0numbers the graph read from it
0cells of the map it votes in
62citing papers in PubMed, 4 pooled it
8.3field-weighted citation impact, top 2% of its field
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

62 citing papers in PubMed, 4 syntheses or guidelines pooled it, 93 citations in OpenAlex.

  1. Pooled it
  2. Pooled it
  3. Pooled it
  4. Electronic health record data quality assessment and tools: a systematic review.Journal of the American Medical Informatics Association : JAMIA · 2023
    Pooled it
  5. Article
  6. Review
  7. Article
  8. Article
  9. Article
  10. Article
  11. Article
  12. Article
  13. Article
  14. Article
  15. Article
  16. Article
  17. Article
  18. Article
  19. Article
  20. Article

2 more citing papers are in PubMed but not listed here.

4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

13 authors at 5 institutions in 1 country.

Amol A VermaLi Ka Shing Knowledge Institute, St. Michael's Hospital, Toronto, Ontario, Canada.
Sachin V PasrichaLi Ka Shing Knowledge Institute, St. Michael's Hospital, Toronto, Ontario, Canada.
Hae Young JungLi Ka Shing Knowledge Institute, St. Michael's Hospital, Toronto, Ontario, Canada.
Vladyslav KushnirLi Ka Shing Knowledge Institute, St. Michael's Hospital, Toronto, Ontario, Canada.
Denise Y F MakLi Ka Shing Knowledge Institute, St. Michael's Hospital, Toronto, Ontario, Canada.
Radha KoppulaLi Ka Shing Knowledge Institute, St. Michael's Hospital, Toronto, Ontario, Canada.
Yishan GuoLi Ka Shing Knowledge Institute, St. Michael's Hospital, Toronto, Ontario, Canada.
Janice L KwanDepartment of Medicine, University of Toronto, Toronto, Ontario, Canada.
Lauren Lapointe-ShawDepartment of Medicine, University of Toronto, Toronto, Ontario, Canada.
Shail RawalDepartment of Medicine, University of Toronto, Toronto, Ontario, Canada.
Terence TangDepartment of Medicine, University of Toronto, Toronto, Ontario, Canada.
Adina WeinermanDepartment of Medicine, University of Toronto, Toronto, Ontario, Canada.
Fahad RazakLi Ka Shing Knowledge Institute, St. Michael's Hospital, Toronto, Ontario, Canada.
St. Michael's Hospital · CAUniversity Health Network · CAMount Sinai Hospital · CASunnybrook Health Science Centre · CAUniversity of Toronto · CA

Funding

No grant is acknowledged in the PubMed record.

6 · The paper itself

Abstract

objectiveLarge clinical databases are increasingly used for research and quality improvement. We describe an approach to data quality assessment from the General Medicine Inpatient Initiative (GEMINI), which collects and standardizes administrative and clinical data from hospitals.

methodsThe GEMINI database contained 245 559 patient admissions at 7 hospitals in Ontario, Canada from 2010 to 2017. We performed 7 computational data quality checks and iteratively re-extracted data from hospitals to correct problems. Thereafter, GEMINI data were compared to data that were manually abstracted from the hospital's electronic medical record for 23 419 selected data points on a sample of 7488 patients.

resultsComputational checks flagged 103 potential data quality issues, which were either corrected or documented to inform future analysis. For example, we identified the inclusion of canceled radiology tests, a time shift of transfusion data, and mistakenly processing the chemical symbol for sodium ("Na") as a missing value. Manual validation identified 1 important data quality issue that was not detected by computational checks: transfusion dates and times at 1 site were unreliable. Apart from that single issue, across all data tables, GEMINI data had high overall accuracy (ranging from 98%-100%), sensitivity (95%-100%), specificity (99%-100%), positive predictive value (93%-100%), and negative predictive value (99%-100%) compared to the gold standard. DISCUSSION AND

conclusionComputational data quality checks with iterative re-extraction facilitated reliable data collection from hospitals but missed 1 critical quality issue. Combining computational and manual approaches may be optimal for assessing the quality of large multisite clinical databases.

Indexed as

Data AccuracyData CollectionData ManagementElectronic Health RecordsHospital Information SystemsDatabases, FactualDatasets as TopicHospitalizationHumansOntarioSensitivity and Specificityclinical databasesdata extraction, electronic medical recordsdata qualitydata validation

Identifiers

PMID33164061
PMCPMC7936532
OpenAlexW3106195149

What OpenQuestion holds

Textmetadata
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.