Evidence map›Paper›PMID 34294947›Full record

ArticleJournal of economic literature2020

How Well Do Automated Linking Methods Perform? Lessons from U.S. Historical Data.

Martha Bailey, Connor Cole, Morgan Henderson, Catherine Massey

Abstract read
In one paragraph

Article in Journal of economic literature, 2020. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 19 papers.

0numbers the graph read from it
0cells of the map it votes in
19citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

19 citing papers in PubMed.

  1. Article
  2. Article
  3. Article
  4. Article
  5. Article
  6. Article
  7. Article
  8. Article
  9. Article
  10. The Effects of the Great Depression on Children's Intergenerational Mobility.The Russell Sage Foundation journal of the social sciences : RSF · 2024
    Article
  11. Article
  12. Article
  13. Article
  14. A framework for a consistent and reproducible evaluation of manual review for patient matching algorithms.Journal of the American Medical Informatics Association : JAMIA · 2022
    Article
  15. Article
  16. Article
  17. (Almost) all of entity resolution.Science advances · 2022
    Review
  18. Article
  19. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

4 authors.

Martha BaileyUniversity of Michigan.
Connor ColeUniversity of Michigan.
Morgan HendersonUniversity of Michigan.
Catherine MasseyUniversity of Michigan.

Funding

Statistical Data EnclaveP30AG012846 · NIA · UNIVERSITY OF MICHIGAN AT ANN ARBOR · PI VICKI A. FREEDMAN · 1999 to 2026
$23.2M
Program Development (Pilot)P30AG012839 · NIA · UNIVERSITY OF CALIFORNIA BERKELEY · PI RONALD D LEE · 1999 to 2026
$18.6M
TRAINING IN SOCIAL AND ECONOMIC DEMOGRAPHYT32HD007339 · NICHD · UNIVERSITY OF MICHIGAN AT ANN ARBOR · PI Sarah A. Burgard · 1987 to 2026
$14.9M
Population Studies Center Infrastructure GrantR24HD041028 · NICHD · UNIVERSITY OF MICHIGAN AT ANN ARBOR · PI RODRIGUEZ, RICARDO LUIS · 2001 to 2016
$13.2M
Scientific and Technical CoreP2CHD041022 · NICHD · UNIVERSITY OF CALIFORNIA LOS ANGELES · PI Martha Jane Bailey · 2016 to 2026
$6.9M
Scientific/Technical CoreP2CHD041028 · NICHD · UNIVERSITY OF MICHIGAN AT ANN ARBOR · PI Sarah A. Burgard · 2017 to 2026
$6.5M
How Does Automated Record Linkage Affect Inferences about Population Health?R21AG056912 · NIA · UNIVERSITY OF MICHIGAN AT ANN ARBOR · PI BAILEY, MARTHA JANE · 2017 to 2018
$427k
NIA NIH HHS P30 AG012839NIA NIH HHS P30 AG012846NIA NIH HHS R21 AG056912NICHD NIH HHS P2C HD041022NICHD NIH HHS P2C HD041028NICHD NIH HHS R24 HD041028NICHD NIH HHS T32 HD007339
6 · The paper itself

Abstract

This paper reviews the literature in historical record linkage in the U.S. and examines the performance of widely-used record linking algorithms and common variations in their assumptions. We use two high-quality, hand-linked datasets and one synthetic ground truth to examine the direct effects of linking algorithms on data quality. We find that (1) no algorithm (including hand-linking) consistently produces representative samples; (2) 15 to 37 percent of links chosen by widely-used algorithms are classified as errors by trained human reviewers; and (3) false links are systematically related to baseline sample characteristics, showing that some algorithms may induce systematic measurement error into analyses. A case study shows that the combined effects of (1)-(3) attenuate estimates of the intergenerational income elasticity by up to 20 percent, and common variations in algorithm assumptions result in greater attenuation. As current practice moves to automate linking and increase link rates, these results highlight the important potential consequences of linking errors on inferences with linked data. We conclude with constructive suggestions for reducing linking errors and directions for future research.

Identifiers

PMID34294947
PMCPMC8294155

What OpenQuestion holds

Textmetadata
LicenceTDM
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.