Evidence map›Paper›PMID 33933001›Full record

ArticleBMC medical research methodology2021

Intra-database validation of case-identifying algorithms using reconstituted electronic health records from healthcare claims data.

Nicolas H Thurin, Pauline Bosco-Levy, Patrick Blin, Magali Rouyer, Jérémy Jové, Stéphanie Lamarque, Séverine Lignot, Régis Lassalle, Abdelilah Abouelfath, Emmanuelle Bignon and 13 more

Abstract read
In one paragraph

Article in BMC medical research methodology, 2021. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 10 papers, 1 of them a synthesis that pooled it.

0numbers the graph read from it
0cells of the map it votes in
10citing papers in PubMed, 1 pooled it
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

10 citing papers in PubMed, 1 synthesis or guideline pooled it.

  1. Pooled it
  2. Article
  3. Article
  4. Article
  5. Article
  6. Article
  7. Article
  8. Article
  9. Article
  10. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

23 authors.

Nicolas H Thurin *INSERM CIC-P1401, Bordeaux PharmacoEpi, Univ. Bordeaux, Bordeaux, France. nicolas.thurin@u-bordeaux.fr.ORCID http://orcid.org/0000-0003-3589-0819
Pauline Bosco-Levy *INSERM CIC-P1401, Bordeaux PharmacoEpi, Univ. Bordeaux, Bordeaux, France.ORCID https://orcid.org/0000-0001-9763-5974
Patrick BlinINSERM CIC-P1401, Bordeaux PharmacoEpi, Univ. Bordeaux, Bordeaux, France.ORCID https://orcid.org/0000-0003-4005-7928
Magali RouyerINSERM CIC-P1401, Bordeaux PharmacoEpi, Univ. Bordeaux, Bordeaux, France.ORCID https://orcid.org/0000-0002-2560-4412
Jérémy JovéINSERM CIC-P1401, Bordeaux PharmacoEpi, Univ. Bordeaux, Bordeaux, France.
Stéphanie LamarqueINSERM CIC-P1401, Bordeaux PharmacoEpi, Univ. Bordeaux, Bordeaux, France.
Séverine LignotINSERM CIC-P1401, Bordeaux PharmacoEpi, Univ. Bordeaux, Bordeaux, France.
Régis LassalleINSERM CIC-P1401, Bordeaux PharmacoEpi, Univ. Bordeaux, Bordeaux, France.ORCID https://orcid.org/0000-0001-6726-6215
Abdelilah AbouelfathINSERM CIC-P1401, Bordeaux PharmacoEpi, Univ. Bordeaux, Bordeaux, France.
Emmanuelle BignonINSERM CIC-P1401, Bordeaux PharmacoEpi, Univ. Bordeaux, Bordeaux, France.
Pauline DiezINSERM CIC-P1401, Bordeaux PharmacoEpi, Univ. Bordeaux, Bordeaux, France.
Marine Gross-GoupilDepartment of Medical Oncology, Hôpital Saint André, CHU de Bordeaux, Bordeaux, France.
Michel SouliéDepartment of Urology, University Hospital of Rangueil, CHU de Toulouse, Toulouse, France.
Mathieu RoumiguiéDepartment of Urology, University Hospital of Rangueil, CHU de Toulouse, Toulouse, France.
Sylvestre Le MoulecDepartment of Oncology, Clinique Marzet, Pau, France.
Marc DebouverieDepartment of Neurology, CHRU de Nancy, Nancy, France.
Bruno BrochetCRC SEP, Neurology Department, CHU de Bordeaux, Bordeaux, France.ORCID https://orcid.org/0000-0003-3824-2796
Francis GuilleminUniversité de Lorraine, EA 4360 APEMAC, Nancy, France.
Céline LouapreSorbonne Université, Institut du cerveau, ICM, Hôpital de la Pitié Salpêtrière, INSERM UMR S 1127, CNRS UMR 7225, Paris, France.ORCID https://orcid.org/0000-0002-4987-1531
Elisabeth MaillartNeurology Department, Hôpital de la Pitié Salpêtrière, APHP, Paris, France.ORCID https://orcid.org/0000-0001-7699-0328
Olivier HeinzlefDepartment of Neurology, Hôpital CHI de Poissy/Saint-Germain-en-Laye, Paris, France.
Nicholas MooreINSERM CIC-P1401, Bordeaux PharmacoEpi, Univ. Bordeaux, Bordeaux, France.ORCID https://orcid.org/0000-0003-1212-2817
Cécile Droz-PerroteauINSERM CIC-P1401, Bordeaux PharmacoEpi, Univ. Bordeaux, Bordeaux, France.ORCID https://orcid.org/0000-0002-7697-1167

Funding

No grant is acknowledged in the PubMed record.

6 · The paper itself

Abstract

backgroundDiagnosis performances of case-identifying algorithms developed in healthcare database are usually assessed by comparing identified cases with an external data source. When this is not feasible, intra-database validation can present an appropriate alternative.

objectivesTo illustrate through two practical examples how to perform intra-database validations of case-identifying algorithms using reconstituted Electronic Health Records (rEHRs).

methodsPatients with 1) multiple sclerosis (MS) relapses and 2) metastatic castration-resistant prostate cancer (mCRPC) were identified in the French nationwide healthcare database (SNDS) using two case-identifying algorithms. A validation study was then conducted to estimate diagnostic performances of these algorithms through the calculation of their positive predictive value (PPV) and negative predictive value (NPV). To that end, anonymized rEHRs were generated based on the overall information captured in the SNDS over time (e.g. procedure, hospital stays, drug dispensing, medical visits) for a random selection of patients identified as cases or non-cases according to the predefined algorithms. For each disease, an independent validation committee reviewed the rEHRs of 100 cases and 100 non-cases in order to adjudicate on the status of the selected patients (true case/ true non-case), blinded with respect to the result of the corresponding algorithm.

resultsAlgorithm for relapses identification in MS showed a 95% PPV and 100% NPV. Algorithm for mCRPC identification showed a 97% PPV and 99% NPV.

conclusionThe use of rEHRs to conduct an intra-database validation appears to be a valuable tool to estimate the performances of a case-identifying algorithm and assess its validity, in the absence of alternative.

Indexed as

Electronic Health RecordsNeoplasm Recurrence, LocalAlgorithmsDatabases, FactualDelivery of Health CareHumansMaleCase-identifying algorithmClaims databaseMultiple sclerosisNegative predictive valuePositive predictive valueProstate CancerReconstituted electronic health recordValidation study

Identifiers

PMID33933001
PMCPMC8088022

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.