Evidence map›Paper›PMID 34587892›Full record

ArticleBMC medical research methodology2021

Statistical model building: Background "knowledge" based on inappropriate preselection causes misspecification.

Lorena Hafermann, Heiko Becher, Carolin Herrmann, Nadja Klein, Georg Heinze, Geraldine Rauch

Abstract read
In one paragraph

Article in BMC medical research methodology, 2021. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 8 papers, 1 of them a synthesis that pooled it.

0numbers the graph read from it
0cells of the map it votes in
8citing papers in PubMed, 1 pooled it
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

8 citing papers in PubMed, 1 synthesis or guideline pooled it.

  1. Causal Model Building in the Context of Cardiac Rehabilitation: A Systematic Review.International journal of environmental research and public health · 2023
    Pooled it
  2. Autistic young people's psychological well-being in school.Autism : the international journal of research and practice · 2026
    Article
  3. Article
  4. Article
  5. Article
  6. Article
  7. Observational
  8. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

6 authors.

Lorena HafermannCharité - Universitätsmedizin Berlin, corporate member of Freie Universität Berlin and Humboldt-Universität zu Berlin, Institute of Biometry and Clinical Epidemiology, Charitéplatz 1, Berlin, 10117, Germany. lorena.hafermann@charite.de.
Heiko BecherInstitute of Medical Biometry and Epidemiology, University Hospital Hamburg-Eppendorf, Martinistraße 52, Hamburg, 20246, Germany.
Carolin HerrmannCharité - Universitätsmedizin Berlin, corporate member of Freie Universität Berlin and Humboldt-Universität zu Berlin, Institute of Biometry and Clinical Epidemiology, Charitéplatz 1, Berlin, 10117, Germany.
Nadja KleinHumboldt Universität zu Berlin, School of Business and Economics, Unter den Linden 6, Berlin, 10099, Germany.
Georg HeinzeSection for Clinical Biometrics, Center for Medical Statistics, Informatics and Intelligent Systems, Medical University of Vienna, Spitalgasse 23, Vienna, 1090, Austria.
Geraldine RauchCharité - Universitätsmedizin Berlin, corporate member of Freie Universität Berlin and Humboldt-Universität zu Berlin, Institute of Biometry and Clinical Epidemiology, Charitéplatz 1, Berlin, 10117, Germany.

Funding

No grant is acknowledged in the PubMed record.

6 · The paper itself

Abstract

backgroundStatistical model building requires selection of variables for a model depending on the model's aim. In descriptive and explanatory models, a common recommendation often met in the literature is to include all variables in the model which are assumed or known to be associated with the outcome independent of their identification with data driven selection procedures. An open question is, how reliable this assumed "background knowledge" truly is. In fact, "known" predictors might be findings from preceding studies which may also have employed inappropriate model building strategies.

methodsWe conducted a simulation study assessing the influence of treating variables as "known predictors" in model building when in fact this knowledge resulting from preceding studies might be insufficient. Within randomly generated preceding study data sets, model building with variable selection was conducted. A variable was subsequently considered as a "known" predictor if a predefined number of preceding studies identified it as relevant.

resultsEven if several preceding studies identified a variable as a "true" predictor, this classification is often false positive. Moreover, variables not identified might still be truly predictive. This especially holds true if the preceding studies employed inappropriate selection methods such as univariable selection.

conclusionsThe source of "background knowledge" should be evaluated with care. Knowledge generated on preceding studies can cause misspecification.

Indexed as

Models, StatisticalCausalityComputer SimulationHumansBackground knowledgeBackward eliminationNeed for more data sharingRegression modelSimulation studyUnivariable selectionVariable selection

Identifiers

PMID34587892
PMCPMC8480029

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.