Evidence map›Paper›PMID 23295578›Full record

ArticleMedical care2013

Improving the reliability of physician "report cards".

Kimberly A Smith, Jeremy B Sussman, Steven J Bernstein, Rodney A Hayward

Open access · greenAbstract readMulticenter Study
In one paragraph

Article in Medical care, 2013. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 6 papers.

0numbers the graph read from it
0cells of the map it votes in
6citing papers in PubMed
5.5field-weighted citation impact, top 5% of its field
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

6 citing papers in PubMed, 16 citations in OpenAlex.

  1. Article
  2. Article
  3. Article
  4. Article
  5. Article
  6. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

4 authors at 4 institutions in 2 countries.

Kimberly A SmithRobert Wood Johnson Foundation Clinical Scholars Program Divisions of General Internal Medicine, University of Michigan, Ann Arbor, MI 48109-5604, USA.
Jeremy B Sussman
Steven J Bernstein
Rodney A Hayward
General Department of Preventive Medicine · VNHealth Services Research & Development · USRobert Wood Johnson Foundation · USVA Center for Clinical Management Research · US

Funding

PUBLIC HEALTH DEMONSTRATIONP60DK020572 · NIDDK · UNIVERSITY OF MICHIGAN AT ANN ARBOR · PI MYERS, MARTIN G · 1985 to 2012
$26.5M
Research BaseP30DK092926 · NIDDK · UNIVERSITY OF MICHIGAN AT ANN ARBOR · PI MARY ELLEN MICHELE HEISLER, ADESUWA B OLOMU · 2011 to 2026
$10.0M
NIDDK NIH HHS P30 DK092926NIDDK NIH HHS P60 DK020572NIDDK NIH HHS P60 DK-20572
6 · The paper itself

Abstract

backgroundPerformance measures are widely used to profile primary care physicians (PCPs) but their reliability is often limited by small sample sizes. We evaluated the reliability of individual PCP profiles and whether they can be improved by combining measures into composites or by profiling practice groups.

methodsWe performed a cross-sectional analysis of electronic health record data for patients with diabetes (DM), congestive heart failure (CHF), ischemic vascular disease (IVD), or eligible for preventive care services seen by a PCP within a large, integrated health care system between April 2009 and May 2010. We evaluated performance on 14 measures of DM care, 9 of CHF, 7 of IVD, and 4 of preventive care.

resultsThere were 51,771 patients observed by 163 physicians in 17 clinics. Few PCPs (0%-60%) could be profiled with 80% reliability using single process or intermediate-outcome measures. Combining measures into single-disease composites improved reliability for DM and preventive care with 74.5% and 76.7% of PCPs having sufficient panel sizes, but composites remained unreliable for CHF and IVD. A total of 85.3% of PCPs could be reliably profiled using a single overall composite. Aggregating PCPs into practice groups (3 to 21 PCPs per group) did not improve reliability in most cases because of little between-group practice variation.

conclusionsSingle measures rarely differentiate between individual PCPs or groups of PCPs reliably. Combining measures into single-disease or multidisease composites can improve reliability for some common conditions, but not all. Assessing PCP practice groups within a single health care system, rather than individual PCPs, did not substantially improve reliability.

Indexed as

General PracticeGeriatricsPediatricsAdolescentAdultAgedBenchmarkingCross-Sectional StudiesHumansLogistic ModelsMiddle AgedMultivariate AnalysisPrimary Health CareReproducibility of ResultsUnited States

Identifiers

PMID23295578
PMCPMC3669898
OpenAlexW1984026457

What OpenQuestion holds

Textmetadata
LicenceTDM
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.