Evidence map›Paper›PMID 29495970›Full record

ArticleBMC medicine2018

Large-scale external validation and comparison of prognostic models: an application to chronic obstructive pulmonary disease.

Beniamino Guerra, Sarah R Haile, Bernd Lamprecht, Ana S Ramírez, Pablo Martinez-Camblor, Bernhard Kaiser, Inmaculada Alfageme, Pere Almagro, Ciro Casanova, Cristóbal Esteban-González and 26 more

Abstract readNetwork Meta-Analysis
In one paragraph

Article in BMC medicine, 2018. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 16 papers, 1 of them a synthesis that pooled it.

0numbers the graph read from it
0cells of the map it votes in
16citing papers in PubMed, 1 pooled it
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

16 citing papers in PubMed, 1 synthesis or guideline pooled it.

  1. Pooled it
  2. Article
  3. Observational
  4. The Disproportionate Burden of Cardiovascular Disease in Mild-to-Moderate COPD.International journal of chronic obstructive pulmonary disease · 2026
    Article
  5. Article
  6. Article
  7. Article
  8. Article
  9. Article
  10. Article
  11. A Risk Prediction Model for Mortality Among Smokers in the COPDGene® Study.Chronic obstructive pulmonary diseases (Miami, Fla.) · 2020
    Article
  12. Article
  13. Article
  14. Article
  15. Article
  16. External Validation Of The Updated ADO Score In COPD Patients From The Birmingham COPD Cohort.International journal of chronic obstructive pulmonary disease · 2019
    Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

36 authors.

Beniamino GuerraEpidemiology, Biostatistics and Prevention Institute, University of Zurich, Zurich, Switzerland.
Sarah R HaileEpidemiology, Biostatistics and Prevention Institute, University of Zurich, Zurich, Switzerland.
Bernd LamprechtDepartment of Pulmonary Medicine, Kepler Universitatsklinikum GmbH, Linz, Austria.
Ana S RamírezFacultad de Medicina UASLP, Universidad Autonoma de San Luis Potosi, San Luis Potosi, Mexico.
Pablo Martinez-CamblorDartmouth College Geisel School of Medicine, Dartmouth, NH, USA.
Bernhard KaiserDepartment of Pulmonary Medicine, Paracelsus Medizinische Privatuniversitat, Salzburg, Austria.
Inmaculada AlfagemeHospital Universitario de Valme, Sevilla, Spain.
Pere AlmagroInternal Medicine, Hospital Universitario Mutua de Terrassa, Terrassa, Spain.
Ciro CasanovaPulmonary Department and Research Unit, Hospital Universitario NS La Candelaria, Tenerife, Spain.
Cristóbal Esteban-GonzálezNetwork and Health Services Research Chronic Diseases (REDISSEC), Hospital Galdakao, Bizkaia, Spain.
Juan J Soler-CataluñaServicio de Neumología, Hospital Universitari Arnau de Vilanova, Lleida, Spain.
Juan P de-TorresPulmonary Department, Clinica Universidad de Navarra, Pamplona, Spain.
Marc MiravitllesEuropean Respiratory Society (ERS) Guidelines Director, Barcelona, Spain.
Bartolome R CelliPulmonary and Critical Care Medicine, Brigham and Women's Hospital, Boston, MA, USA.
Jose M MarinIISAragón and CIBERES, Hospital Universitario Miguel Servet, Zaragoza, Spain.
Gerben Ter RietDepartment of General Practice, Academic Medical Center, University of Amsterdam, Amsterdam, The Netherlands.
Patricia SobradilloHospital Univarsitario de Cruces, Barakaldo, Vizcaya, Spain.
Peter LangeDepartment of Public Health, Section of Social Medicine, University of Copenhagen, Copenhagen, Denmark.
Judith Garcia-AymerichISGlobal, CIBER Epidemiología y Salud Pública (CIBERESP), Universitat Pompeu Fabra (UPF), Barcelona, Spain.
Josep M AntóISGlobal, Centre for Research in Environmental Epidemiology (CREAL), IMIM (Hospital del Mar Medical Research Institute, Universitat Pompeu Fabra (UPF), CIBER Epidemiología y Salud Pública (CIBERESP), Barcelona, Spain.
Alice M TurnerInstitute of Applied Health Research, University of Birmingham, Birmingham, UK.
Meilan K HanDivision of Pulmonary and Critical Care, University of Michigan, Ann Arbor, MI, USA.
Arnulf LanghammerDepartment of Public Health and Nursing, Norvegian University of Science and Technology, Trondheim, Norway.
Linda LeivsethCentre for Clinical Documentation and Evaluation, Northern Norway Regional Health Authority, Bodø, Norway.
Per BakkeUniversity of Bergen, Haukeland University Hospital, Bergen, Norway.
Ane JohannessenDepartment of Global Public Health and Primary Care, University of Bergen, Bergen, Norway.
Toru OgaDepartment of Respiratory Care and Sleep Control Medicine, Graduate School of Medicine, Kyoto University, Kyoto, Japan.
Borja CosioDepartment of Respiratory Medicine, Hospital Son Espases-IdISBa-CIBERES, Palma de Mallorca, Spain.
Julio Ancochea-BermúdezInstituto de Investigación Sanitaria Princesa (IISP)-Servicio de Neumología- Hospital Universitario de la Princesa, Universidad Autónoma de Madrid, Madrid, Spain.
Andres EchazarretaUniversidad Nacional de la Plata, Hospital San Juan de Dios de La Plata, Buenos Aires, Argentina.
Nicolas RocheHopitaux Universitaires Paris Centre, Service de Pneumologie AP-HP, Paris, France.
Pierre-Régis BurgelHopital Cochin; Universite Paris Descartes, Paris, France.
Don D SinUniversity of British Columbia, James Hogg Research Centre, Vancouver, Canada.
Joan B SorianoInstituto de Investigación del Hospital Universitario de la Princesa (IISP), Universidad Autónoma de Madrid, Servicio de Neumología, Madrid, Spain.
Milo A PuhanEpidemiology, Biostatistics and Prevention Institute, University of Zurich, Hirschengraben 84, Room HRS G29, CH -8001, Zurich, Switzerland. miloalan.puhan@uzh.ch.
3CIA collaboration

Funding

No grant is acknowledged in the PubMed record.

6 · The paper itself

Abstract

backgroundExternal validations and comparisons of prognostic models or scores are a prerequisite for their use in routine clinical care but are lacking in most medical fields including chronic obstructive pulmonary disease (COPD). Our aim was to externally validate and concurrently compare prognostic scores for 3-year all-cause mortality in mostly multimorbid patients with COPD.

methodsWe relied on 24 cohort studies of the COPD Cohorts Collaborative International Assessment consortium, corresponding to primary, secondary, and tertiary care in Europe, the Americas, and Japan. These studies include globally 15,762 patients with COPD (1871 deaths and 42,203 person years of follow-up). We used network meta-analysis adapted to multiple score comparison (MSC), following a frequentist two-stage approach; thus, we were able to compare all scores in a single analytical framework accounting for correlations among scores within cohorts. We assessed transitivity, heterogeneity, and inconsistency and provided a performance ranking of the prognostic scores.

resultsDepending on data availability, between two and nine prognostic scores could be calculated for each cohort. The BODE score (body mass index, airflow obstruction, dyspnea, and exercise capacity) had a median area under the curve (AUC) of 0.679 [1st quartile-3rd quartile = 0.655-0.733] across cohorts. The ADO score (age, dyspnea, and airflow obstruction) showed the best performance for predicting mortality (difference AUC

conclusionsOur analyses showed best discriminatory performance for the ADO and updated BODE scores in patients with COPD. A limitation to be addressed in future studies is the extension of MSC network meta-analysis to measures of calibration. MSC network meta-analysis can be applied to prognostic scores in any medical field to identify the best scores, possibly paving the way for stratified medicine, public health, and research.

Indexed as

Pulmonary Disease, Chronic ObstructiveAgedCohort StudiesFemaleHumansMaleMiddle AgedPrognosisSeverity of Illness IndexCOPDLarge-scale external validationNetwork meta-analysisPerformance comparisonPrognostic scores

Identifiers

PMID29495970
PMCPMC5833113

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.