Evidence map›Paper›PMID 18466617›Full record

Trial reportBMC health services research2008

Does delayed measurement affect patient reports of provider performance? Implications for performance measurement of medical assistance with tobacco cessation: a Dental PBRN study.

Thomas K Houston, Joshua S Richman, Heather L Coley, Midge N Ray, Jeroan J Allison, Gregg H Gilbert, Judith S Gordon, Catarina I Kiefe, DPBRN Collaborative Group

Abstract readComparative StudyRandomized Controlled Trial
In one paragraph

Trial report in BMC health services research, 2008. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 10 papers, 2 of them syntheses that pooled it.

0numbers the graph read from it
0cells of the map it votes in
10citing papers in PubMed, 2 pooled it
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

10 citing papers in PubMed, 2 syntheses or guidelines pooled it.

  1. Interventions for tobacco cessation delivered by dental professionals.The Cochrane database of systematic reviews · 2021
    Pooled it
  2. Interventions for tobacco cessation in the dental setting.The Cochrane database of systematic reviews · 2012
    Pooled it
  3. Trial
  4. Trial
  5. Trial
  6. Article
  7. Article
  8. Article
  9. Article
  10. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

9 authors.

Thomas K HoustonDeep South Center on Effectiveness Research, a VA HSR&D REAP, Birmingham VA Medical Center, Birmingham, AL, USA. thouston@uab.edu
Joshua S Richman
Heather L Coley
Midge N Ray
Jeroan J Allison
Gregg H Gilbert
Judith S Gordon
Catarina I Kiefe
DPBRN Collaborative Group

Funding

Dental PBRN Network ChairU01DE016747 · NIDCR · UNIVERSITY OF ALABAMA AT BIRMINGHAM · PI GILBERT, GREGG H · 2005 to 2011
$17.3M
Dental Practice-Based Research Network Coordinating CtrU01DE016746 · NIDCR · UNIVERSITY OF ALABAMA AT BIRMINGHAM · PI FUNKHOUSER, ELLEN M · 2005 to 2011
$7.0M
Dental Tobacco Control Net Improving PracticeR01DA017971 · NIDA · UNIVERSITY OF ALABAMA AT BIRMINGHAM · PI HOUSTON, THOMAS K. · 2003 to 2007
$2.2M
NIDA NIH HHS R01 DA017971NIDA NIH HHS R01-DA-17971NIDCR NIH HHS U01 DE016746NIDCR NIH HHS U01 DE016747NIDCR NIH HHS U01-DE-16746NIDCR NIH HHS U01-DE-16747
6 · The paper itself

Abstract

backgroundWe compared two methods of measuring provider performance of tobacco control activities: immediate "exit cards" versus delayed telephone follow-up surveys. Current standards, e.g. HEDIS, use delayed patient measures that may over or under-estimate overall performance.

methodsPatients completed exit cards in 60 dental practices immediately after a visit to measure whether the provider "asked" about tobacco use, and "advised" the patient to quit. One to six months later patients were asked the same questions by telephone survey. Using the exit cards as the standard, we quantified performance and calculated sensitivity (agreement of those responding yes on telephone surveys compared with exit cards) and specificity (agreement of those responding no) of the delayed measurement.

resultsAmong 150 patients, 21% reporting being asked about tobacco use on the exit cards and 30% reporting being asked in the delayed surveys. The sensitivity and specificity were 50% and 75%, respectively. Similarly, among 182 tobacco users, 38% reported being advised to quit on the exit cards and this increased to 51% on the delayed surveys. The sensitivity and specificity were 75% and 64%, respectively. Increasing the delay from the visit to the telephone survey resulted in increasing disagreement.

conclusionPatient reports differed considerably in immediate versus delayed measures. These results have important implications because they suggest that our delayed measures may over-estimate performance. The immediate exit cards should be included in the armamentarium of tools for measuring providers' performance of tobacco control, and perhaps other service delivery.

Indexed as

Clinical CompetenceComputer-Assisted InstructionData CollectionDental ResearchDentistryEducation, Dental, ContinuingFemaleHumansInternetMaleMiddle AgedPractice Patterns, Dentists'Quality Assurance, Health CareSoutheastern United StatesSurveys and QuestionnairesTobacco Use Cessation

Identifiers

PMID18466617
PMCPMC2405777

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.