Evidence map›Paper›PMID 40117240›Full record

ArticlePloS one2025

The InterModel Vigorish (IMV) as a flexible and portable approach for quantifying predictive accuracy with binary outcomes.

Benjamin W Domingue, Charles Rahal, Jessica Faul, Jeremy Freese, Klint Kanopka, Alexandros Rigos, Ben Stenhaug, Ajay Shanker Tripathi

Abstract read
In one paragraph

Article in PloS one, 2025. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 4 papers.

0numbers the graph read from it
0cells of the map it votes in
4citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

4 citing papers in PubMed.

  1. Article
  2. Better Accuracy for Better Science . . . Through Random Conclusions.Perspectives on psychological science : a journal of the Association for Psychological Science · 2024
    Article
  3. The Mode Effect of Web-Based Surveying on the 2018 U.S. Health and Retirement Study Measure of Cognitive Functioning.The journals of gerontology. Series B, Psychological sciences and social sciences · 2023
    Article
  4. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

8 authors.

Benjamin W DomingueGraduate School of Education, Stanford University, Stanford, California, United States of America.ORCID https://orcid.org/0000-0002-3894-9049
Charles RahalDemographic Science Unit and Nuffield College, University of Oxford, Oxford, United Kingdom.
Jessica FaulMichigan Center on the Demography of Aging, University of Michigan, Ann Arbor, Michigan, United States of America.
Jeremy FreeseDepartment of Sociology, Stanford University, Stanford, California, United States of America.
Klint KanopkaSteinhardt School of Culture, Education, and Human Development, New York University, New York, New York, United States of America.
Alexandros RigosInstitute for Futures Studies, Stockholm, Sweden.ORCID https://orcid.org/0000-0003-3787-5030
Ben StenhaugGraduate School of Education, Stanford University, Stanford, California, United States of America.
Ajay Shanker TripathiDepartment of Electrical Engineering, Stanford University, Stanford, California, United States of America.

Funding

HRS Yrs29-34: Y33 SSA CoFundingU01AG009740 · NIA · UNIVERSITY OF MICHIGAN AT ANN ARBOR · PI Jessica Faul, KENNETH M LANGA · 1990 to 2026
$555.8M
NIA NIH HHS U01 AG009740
6 · The paper itself

Abstract

Understanding the "fit" of models designed to predict binary outcomes has been a long-standing problem across the social sciences. We propose a flexible, portable, and intuitive metric for quantifying the change in accuracy between two predictive systems in the case of a binary outcome: the InterModel Vigorish (IMV). The IMV is based on an analogy to weighted coins, well-characterized physical systems with tractable probabilities. The IMV is always a statement about the change in fit relative to some baseline model-which can be as simple as the prevalence-whereas other metrics are stand-alone measures that need to be further manipulated to yield indices related to differences in fit across models. Moreover, the IMV is consistently interpretable independent of baseline prevalence. We contrast this metric with alternatives in numerous simulations. The IMV is more sensitive to estimation error than many alternatives and also shows distinctive sensitivity to prevalence. We consider its performance using examples spanning the social and natural sciences. The IMV allows for precise answers to questions about changes in model fit in a variety of settings in a manner that will be useful for furthering research and the understanding of social outcomes.

Indexed as

Models, Statistical

Identifiers

PMID40117240
PMCPMC11927910

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.