Evidence map›Paper›PMID 33895712›Full record

ArticleBMJ open2021

Implementing the US Department of Health and Human Services definition of multimorbidity: a comparison between billing codes and medical record review in a population-based sample of persons 40

Jennifer L St Sauver, Alanna M Chamberlain, William V Bobo, Cynthia M Boyd, Lila J Finney Rutten, Debra J Jacobson, Michaela E McGree, Brandon R Grossardt, Walter A Rocca

Abstract read
In one paragraph

Article in BMJ open, 2021. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 27 papers.

0numbers the graph read from it
0cells of the map it votes in
27citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

27 citing papers in PubMed.

  1. Article
  2. Article
  3. Article
  4. Article
  5. Article
  6. Article
  7. The Influence of Body Mass Index on Biomarkers of Cellular Senescence in Older Adults.The journals of gerontology. Series A, Biological sciences and medical sciences · 2025
    Article
  8. Article
  9. Article
  10. Article
  11. Article
  12. Article
  13. Article
  14. Article
  15. Article
  16. Article
  17. Article
  18. Article
  19. Article
  20. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

9 authors.

Jennifer L St SauverDivision of Epidemiology, Department of Quantitative Health Sciences, Mayo Clinic, Rochester, Minnesota, USA stsauver.jennifer@mayo.edu.ORCID 0000-0002-9789-8544
Alanna M ChamberlainDivision of Epidemiology, Department of Quantitative Health Sciences, Mayo Clinic, Rochester, Minnesota, USA.
William V BoboDepartment of Psychiatry and Psychology, Mayo Clinic, Jacksonville, Florida, USA.
Cynthia M BoydDivision of Geriatric Medicine and Gerontology, Department of Medicine, Johns Hopkins University, Baltimore, Maryland, USA.
Lila J Finney RuttenDivision of Epidemiology, Department of Quantitative Health Sciences, Mayo Clinic, Rochester, Minnesota, USA.
Debra J JacobsonDivision of Clinical Trials and Biostatistics, Department of Quantitative Health Sciences, Mayo Clinic, Rochester, Minnesota, USA.
Michaela E McGreeDivision of Clinical Trials and Biostatistics, Department of Quantitative Health Sciences, Mayo Clinic, Rochester, Minnesota, USA.
Brandon R GrossardtDivision of Clinical Trials and Biostatistics, Department of Quantitative Health Sciences, Mayo Clinic, Rochester, Minnesota, USA.
Walter A RoccaDivision of Epidemiology, Department of Quantitative Health Sciences, Mayo Clinic, Rochester, Minnesota, USA.ORCID 0000-0002-1832-7664

Funding

Rochester Epidemiology ProjectR01AG034676 · NIA · MAYO CLINIC ROCHESTER · PI ROCCA, WALTER A, ST SAUVER, JENNIFER LYNN · 2010 to 2019
$9.5M
Multiple Chronic Conditions and AgingR01AG052425 · NIA · MAYO CLINIC ROCHESTER · PI ROCCA, WALTER A, ST SAUVER, JENNIFER LYNN · 2017 to 2021
$3.3M
Interdisciplinary Infrastructure for Aging Research: Rochester Epidemiology ProjectR33AG058738 · NIA · MAYO CLINIC ROCHESTER · PI LEBRASSEUR, NATHAN K, OLSON, JANET E · 2020 to 2022
$2.4M
NIA NIH HHS R01 AG034676NIA NIH HHS R01 AG052425NIA NIH HHS R33 AG058738
6 · The paper itself

Abstract

objectiveTo assess the validity of the US Department of Health and Human Services (DHHS) definition of multimorbidity using International Classification of Diseases, ninth edition (ICD-9) codes from administrative data.

designCross-sectional comparison of two ICD-9 billing code algorithms to data abstracted from medical records.

settingOlmsted County, Minnesota, USA.

participantsAn age-stratified and sex-stratified random sample of 1509 persons ages 40-84 years old residing in Olmsted County on 31 December 2010. STUDY MEASURES: Seventeen chronic conditions identified by the US DHHS as important in studies of multimorbidity were identified through medical record review of each participant between 2006 and 2010. ICD-9 administrative billing codes corresponding to the 17 conditions were extracted using the Rochester Epidemiology Project records-linkage system. Persons were classified as having each condition using two algorithms: at least one code or at least two codes separated by more than 30 days. We compared the ICD-9 code algorithms with the diagnoses obtained through medical record review to identify persons with multimorbidity (defined as ≥2, ≥3 or ≥4 chronic conditions).

resultsUse of a single code to define each of the 17 chronic conditions resulted in sensitivity and positive predictive values (PPV) ≥70%, and in specificity and negative predictive values (NPV) ≥70% for identifying multimorbidity in the overall study population. PPV and sensitivity were highest in persons 65-84 years of age, whereas NPV and specificity were highest in persons 40-64 years. The results varied by condition, and by age and sex. The use of at least two codes reduced sensitivity, but increased specificity.

conclusionsThe use of a single code to identify each of the 17 chronic conditions may be a simple and valid method to identify persons who meet the DHHS definition of multimorbidity in populations with similar demographic, socioeconomic, and health care characteristics.

Indexed as

International Classification of DiseasesMultimorbidityAdultAgedAged, 80 and overAlgorithmsCross-Sectional StudiesHumansMedical RecordsMiddle AgedMinnesotaUnited StatesUnited States Dept. of Health and Human Servicesgeriatric medicinehealth services administration & managementstatistics & research methods

Identifiers

PMID33895712
PMCPMC8074567

What OpenQuestion holds

Textmetadata
LicenceCC BY-NC
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.