Evidence map›Paper›PMID 40694804›Full record

ArticleJournal of the American Medical Informatics Association : JAMIA2025

Evaluation of the impact of defining observable time in real-world data on outcome incidence.

Clair Blacketer, Frank J DeFalco, Mitchell M Conover, Patrick B Ryan, Martijn J Schuemie, Peter R Rijnbeek

Abstract read
In one paragraph

Article in Journal of the American Medical Informatics Association : JAMIA, 2025. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Not yet cited in PubMed.

0numbers the graph read from it
0cells of the map it votes in
0citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

0 citing papers in PubMed.

No citing paper in PubMed yet.

4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

6 authors.

Clair BlacketerCoordinating Center, Observational Health Data Sciences and Informatics (OHDSI), New York, NY, 10032, United States.ORCID 0000-0003-2570-2124
Frank J DeFalcoCoordinating Center, Observational Health Data Sciences and Informatics (OHDSI), New York, NY, 10032, United States.
Mitchell M ConoverCoordinating Center, Observational Health Data Sciences and Informatics (OHDSI), New York, NY, 10032, United States.ORCID 0000-0001-5682-3688
Patrick B RyanCoordinating Center, Observational Health Data Sciences and Informatics (OHDSI), New York, NY, 10032, United States.
Martijn J SchuemieCoordinating Center, Observational Health Data Sciences and Informatics (OHDSI), New York, NY, 10032, United States.
Peter R RijnbeekCoordinating Center, Observational Health Data Sciences and Informatics (OHDSI), New York, NY, 10032, United States.ORCID 0000-0003-0621-1979

Funding

European Medicines AgencyInnovative Medicines Initiative
6 · The paper itself

Abstract

objectiveIn real-world data (RWD), defining the observation period-the time during which a patient is considered observable-is critical for estimating incidence rates (IRs) and other outcomes. Yet, in the absence of explicit enrollment information, this period must often be inferred, introducing potential bias. MATERIALS AND

methodsThis study evaluates methods for defining observation periods and their impact on IR estimates across multiple database types. We applied 3 methods for defining observation periods: (1) a persistence + surveillance window approach, (2) an age- and gender-adjusted method based on time between healthcare events, and (3) the min/max method. These were tested across 11 RWD databases, including both enrollment-based and encounter-based sources. Enrollment time was used as the reference standard in eligible databases. To assess the impact on epidemiologic results, we replicated a prior study of adverse event incidence, comparing IRs and calculating mean squared error between methods.

resultsIncidence rates decreased as observation periods lengthened, driven by increases in the person-time denominator. The persistence + surveillance method produced estimates closest to enrollment-based rates when appropriately balanced. The min/max approach yielded inconsistent results, particularly in encounter-based databases, with greater error observed in databases with longer time spans. DISCUSSION: These findings suggest that assumptions about data completeness and population observability significantly affect incidence estimates. Observation period definitions substantially influence outcome measurement in RWD studies.

conclusionStandardized, transparent approaches are necessary to ensure valid, reproducible results-especially in databases lacking defined enrollment.

Indexed as

Outcome Assessment, Health CareDatabases, FactualFemaleHumansIncidenceMaleTime Factorsdata qualitydata standardizationincidence ratesobservation periodreal-world data

Identifiers

PMID40694804
PMCPMC12361855

What OpenQuestion holds

Textmetadata
LicenceCC BY-NC
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.