Evidence map›Paper›PMID 39820599›Full record

ArticlePloS one2025

CohortDiagnostics: Phenotype evaluation across a network of observational data sources using population-level characterization.

Gowtham A Rao, Azza Shoaibi, Rupa Makadia, Jill Hardin, Joel Swerdel, James Weaver, Erica A Voss, Mitchell M Conover, Stephen Fortin, Anthony G Sena and 10 more

Abstract read
In one paragraph

Article in PloS one, 2025. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 12 papers.

0numbers the graph read from it
0cells of the map it votes in
12citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

12 citing papers in PubMed.

  1. Observational
  2. Article
  3. Article
  4. Article
  5. Article
  6. Observational
  7. PhenoFit: a framework for determining computable phenotyping algorithm fitness for purpose and reuse.Journal of the American Medical Informatics Association : JAMIA · 2026
    Article
  8. Observational
  9. Article
  10. Article
  11. Article
  12. Review
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

20 authors.

Gowtham A RaoObservational Health Data Analytics, Janssen Research and Development, LLC, Titusville, NJ, United States of America.ORCID 0000-0002-4949-7236
Azza ShoaibiObservational Health Data Analytics, Janssen Research and Development, LLC, Titusville, NJ, United States of America.ORCID 0000-0002-6976-2594
Rupa MakadiaObservational Health Data Analytics, Janssen Research and Development, LLC, Titusville, NJ, United States of America.
Jill HardinObservational Health Data Analytics, Janssen Research and Development, LLC, Titusville, NJ, United States of America.ORCID 0000-0003-2682-2187
Joel SwerdelObservational Health Data Analytics, Janssen Research and Development, LLC, Titusville, NJ, United States of America.
James WeaverObservational Health Data Analytics, Janssen Research and Development, LLC, Titusville, NJ, United States of America.ORCID 0000-0003-0755-5191
Erica A VossObservational Health Data Analytics, Janssen Research and Development, LLC, Titusville, NJ, United States of America.
Mitchell M ConoverObservational Health Data Analytics, Janssen Research and Development, LLC, Titusville, NJ, United States of America.
Stephen FortinObservational Health Data Analytics, Janssen Research and Development, LLC, Titusville, NJ, United States of America.
Anthony G SenaObservational Health Data Analytics, Janssen Research and Development, LLC, Titusville, NJ, United States of America.ORCID 0000-0001-8630-5347
Chris KnollObservational Health Data Analytics, Janssen Research and Development, LLC, Titusville, NJ, United States of America.
Nigel HughesObservational Health Data Analytics, Janssen Research and Development, LLC, Titusville, NJ, United States of America.
James P GilbertObservational Health Data Analytics, Janssen Research and Development, LLC, Titusville, NJ, United States of America.ORCID 0000-0003-2294-3459
Clair BlacketerObservational Health Data Analytics, Janssen Research and Development, LLC, Titusville, NJ, United States of America.
Alan AndrycObservational Health Data Analytics, Janssen Research and Development, LLC, Titusville, NJ, United States of America.
Frank DeFalcoObservational Health Data Analytics, Janssen Research and Development, LLC, Titusville, NJ, United States of America.
Anthony MolinaroObservational Health Data Analytics, Janssen Research and Development, LLC, Titusville, NJ, United States of America.
Jenna RepsObservational Health Data Analytics, Janssen Research and Development, LLC, Titusville, NJ, United States of America.ORCID 0000-0002-2970-0778
Martijn J SchuemieObservational Health Data Analytics, Janssen Research and Development, LLC, Titusville, NJ, United States of America.ORCID 0000-0002-0817-5361
Patrick B RyanObservational Health Data Analytics, Janssen Research and Development, LLC, Titusville, NJ, United States of America.

Funding

No grant is acknowledged in the PubMed record.

6 · The paper itself

Abstract

objectiveThis paper introduces a novel framework for evaluating phenotype algorithms (PAs) using the open-source tool, Cohort Diagnostics. MATERIALS AND

methodsThe method is based on several diagnostic criteria to evaluate a patient cohort returned by a PA. Diagnostics include estimates of incidence rate, index date entry code breakdown, and prevalence of all observed clinical events prior to, on, and after index date. We test our framework by evaluating one PA for systemic lupus erythematosus (SLE) and two PAs for Alzheimer's disease (AD) across 10 different observational data sources.

resultsBy utilizing CohortDiagnostics, we found that the population-level characteristics of individuals in the cohort of SLE closely matched the disease's anticipated clinical profile. Specifically, the incidence rate of SLE was consistently higher in occurrence among females. Moreover, expected clinical events like laboratory tests, treatments, and repeated diagnoses were also observed. For AD, although one PA identified considerably fewer patients, absence of notable differences in clinical characteristics between the two cohorts suggested similar specificity. DISCUSSION: We provide a practical and data-driven approach to evaluate PAs, using two clinical diseases as examples, across a network of OMOP data sources. Cohort Diagnostics can ensure the subjects identified by a specific PA align with those intended for inclusion in a research study.

conclusionDiagnostics based on large-scale population-level characterization can offer insights into the misclassification errors of PAs.

Indexed as

Alzheimer DiseaseLupus Erythematosus, SystemicAlgorithmsCohort StudiesFemaleHumansIncidenceInformation SourcesMaleMiddle AgedPhenotype

Identifiers

PMID39820599
PMCPMC11737733

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.