Evidence map›Paper›PMID 16646956›Full record

ArticleBMC medical informatics and decision making2006

Assessment of the potential impact of a reminder system on the reduction of diagnostic errors: a quasi-experimental study.

Padmanabhan Ramnarayan, Graham C Roberts, Michael Coren, Vasantha Nanduri, Amanda Tomlinson, Paul M Taylor, Jeremy C Wyatt, Joseph F Britto

Open access · goldAbstract read
In one paragraph

Article in BMC medical informatics and decision making, 2006. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 31 papers, 2 of them syntheses that pooled it.

0numbers the graph read from it
0cells of the map it votes in
31citing papers in PubMed, 2 pooled it
2.8field-weighted citation impact, top 10% of its field
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

31 citing papers in PubMed, 2 syntheses or guidelines pooled it, 63 citations in OpenAlex.

  1. Pooled it
  2. Pooled it
  3. Trial
  4. Early diagnostic suggestions improve accuracy of GPs: a randomised controlled trial using computer-simulated patients.The British journal of general practice : the journal of the Royal College of General Practitioners · 2015
    Trial
  5. Collective Intelligence Increases Diagnostic Accuracy in a General Practice Setting.Medical decision making : an international journal of the Society for Medical Decision Making · 2024
    Article
  6. Observational
  7. Article
  8. Article
  9. Article
  10. Article
  11. Article
  12. Clinical Decision Support Systems for Diagnosis in Primary Care: A Scoping Review.International journal of environmental research and public health · 2021
    Article
  13. Article
  14. Development of an Experimental System "Computer-Aided Diagnosis in Neurotology (CADINO)" for Vertigo.Indian journal of otolaryngology and head and neck surgery : official publication of the Association of Otolaryngologists of India · 2019
    Article
  15. Article
  16. Article
  17. Article
  18. Article
  19. Review
  20. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

8 authors at 7 institutions in 1 country.

Padmanabhan RamnarayanChildren's Acute Transport Service (CATS), 44B Bedford Row, London, WC1H 4LL, UK. ramnarayan@msn.com
Graham C Roberts
Michael Coren
Vasantha Nanduri
Amanda Tomlinson
Paul M Taylor
Jeremy C Wyatt
Joseph F Britto
Haslemere Hospital · GBDepartment for Transport · GBHealth Education England · GBSt Mary's Hospital · GBUniversity of Dundee · GBUniversity of Southampton · GBWatford General Hospital · GB

Funding

No grant is acknowledged in the PubMed record.

6 · The paper itself

Abstract

backgroundComputerized decision support systems (DSS) have mainly focused on improving clinicians' diagnostic accuracy in unusual and challenging cases. However, since diagnostic omission errors may predominantly result from incomplete workup in routine clinical practice, the provision of appropriate patient- and context-specific reminders may result in greater impact on patient safety. In this experimental study, a mix of easy and difficult simulated cases were used to assess the impact of a novel diagnostic reminder system (ISABEL) on the quality of clinical decisions made by various grades of clinicians during acute assessment.

methodsSubjects of different grades (consultants, registrars, senior house officers and medical students), assessed a balanced set of 24 simulated cases on a trial website. Subjects recorded their clinical decisions for the cases (differential diagnosis, test-ordering and treatment), before and after system consultation. A panel of two pediatric consultants independently provided gold standard responses for each case, against which subjects' quality of decisions was measured. The primary outcome measure was change in the count of diagnostic errors of omission (DEO). A more sensitive assessment of the system's impact was achieved using specific quality scores; additional consultation time resulting from DSS use was also calculated.

results76 subjects (18 consultants, 24 registrars, 19 senior house officers and 15 students) completed a total of 751 case episodes. The mean count of DEO fell from 5.5 to 5.0 across all subjects (repeated measures ANOVA, p < 0.001); no significant interaction was seen with subject grade. Mean diagnostic quality score increased after system consultation (0.044; 95% confidence interval 0.032, 0.054). ISABEL reminded subjects to consider at least one clinically important diagnosis in 1 in 8 case episodes, and prompted them to order an important test in 1 in 10 case episodes. Median extra time taken for DSS consultation was 1 min (IQR: 30 sec to 2 min).

conclusionThe provision of patient- and context-specific reminders has the potential to reduce diagnostic omissions across all subject grades for a range of cases. This study suggests a promising role for the use of future reminder-based DSS in the reduction of diagnostic error.

Indexed as

Decision Support Systems, ClinicalOutcome and Process Assessment, Health CareReminder SystemsAnalysis of VarianceBenchmarkingDiagnosis, Computer-AssistedDiagnostic ErrorsEpisode of CareHumansMedical Staff, HospitalMedicineSafety ManagementSensitivity and SpecificitySpecializationStudents, MedicalUnited Kingdom

Identifiers

PMID16646956
PMCPMC1513379
OpenAlexW1785098166

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.