Evidence map›Paper›PMID 34383663›Full record

Observational studyJournal of medical Internet research2021

The Use and Effectiveness of an Online Diagnostic Support System for Blood Film Interpretation: Comparative Observational Study.

Claire Hutchinson, Michelle Brereton, Julie Adams, Barbara De La Salle, Jon Sims, Keith Hyde, Richard Chasty, Rachel Brown, Karen Rees-Unwin, John Burthem

Abstract readObservational Study
In one paragraph

Observational study in Journal of medical Internet research, 2021. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 1 paper.

0numbers the graph read from it
0cells of the map it votes in
1citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

1 citing paper in PubMed.

  1. Review
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

10 authors.

Claire HutchinsonMedicine, Dentistry and Human Sciences, Faculty of Health, University of Plymouth, Plymouth, United Kingdom.ORCID 0000-0003-2314-6558
Michelle BreretonManchester Foundation Trust, Manchester, United Kingdom.ORCID 0000-0003-0584-909X
Julie AdamsManchester Foundation Trust, Manchester, United Kingdom.ORCID 0000-0001-5953-5622
Barbara De La SalleUK NEQAS Haematology, Watford, United Kingdom.ORCID 0000-0002-2926-7441
Jon SimsUK NEQAS Haematology, Watford, United Kingdom.ORCID 0000-0002-3172-5173
Keith HydeManchester Foundation Trust, Manchester, United Kingdom.ORCID 0000-0003-2137-5955
Richard ChastyThe Christie NHS Foundation Trust, Manchester, United Kingdom.ORCID 0000-0001-5388-4565
Rachel BrownManchester Foundation Trust, Manchester, United Kingdom.ORCID 0000-0001-8956-8724
Karen Rees-UnwinDivision of Cancer Sciences, University of Manchester, Manchester, United Kingdom.ORCID 0000-0002-3088-2695
John BurthemManchester Foundation Trust, Manchester, United Kingdom.ORCID 0000-0002-7361-9328

Funding

No grant is acknowledged in the PubMed record.

6 · The paper itself

Abstract

backgroundThe recognition and interpretation of abnormal blood cell morphology is often the first step in diagnosing underlying serious systemic illness or leukemia. Supporting the staff who interpret blood film morphology is therefore essential for a safe laboratory service. This paper describes an open-access, web-based decision support tool, developed by the authors to support morphological diagnosis, arising from earlier studies identifying mechanisms of error in blood film reporting. The effectiveness of this intervention was assessed using the unique resource offered by the online digital morphology Continuing Professional Development scheme (DM scheme) offered by the UK National External Quality Assessment Service for Haematology, with more than 3000 registered users. This allowed the effectiveness of decision support to be tested within a defined user group, each of whom viewed and interpreted the morphology of identical digital blood films.

objectiveThe primary objective of the study was to test the effectiveness of the decision support system in supporting users to identify and interpret abnormal morphological features. The secondary objective was to determine the pattern and frequency of use of the system for different case types, and to determine how users perceived the support in terms of their confidence in decision-making.

methodsThis was a comparative study of identical blood films evaluated either with or without decision support. Selected earlier cases from the DM scheme were rereleased as new cases but with decision support made available; this allowed a comparison of data sets for identical cases with or without decision support. To address the primary objectives, the study used quantitative evaluation and statistical comparisons of the identification and interpretation of morphological features between the two different case releases. To address the secondary objective, the use of decision support was assessed using web analytical tools, while a questionnaire was used to assess user perceptions of the system.

resultsCases evaluated with the aid of decision support had significantly improved accuracy of identification for relevant morphological features (mean improvement 9.8%) and the interpretation of those features (mean improvement 11%). The improvement was particularly significant for cases with higher complexity or for rarer diagnoses. Analysis of website usage demonstrated a high frequency of access for web pages relevant to each case (mean 9298 for each case, range 2661-24,276). Users reported that the decision support website increased their confidence for feature identification (4.8/5) and interpretation (4.3/5), both within the context of training (4.6/5) and also in their wider laboratory practice (4.4/5).

conclusionsThe findings of this study demonstrate that directed online decision support for blood morphology evaluation improves accuracy and confidence in the context of educational evaluation of digital films, with effectiveness potentially extending to wider laboratory use.

Indexed as

Online SystemsHumansSurveys and Questionnairesblood cell morphologydecision supportdiagnosisdigital morphologyexternal quality assessment in hematologymorphology education

Identifiers

PMID34383663
PMCPMC8386359

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.