Evidence map›Paper›PMID 22749840›Full record

ArticleInternational journal of medical informatics2013

Detection and characterization of usability problems in structured data entry interfaces in dentistry.

Muhammad F Walji, Elsbeth Kalenderian, Duong Tran, Krishna K Kookal, Vickie Nguyen, Oluwabunmi Tokede, Joel M White, Ram Vaderhobli, Rachel Ramoni, Paul C Stark and 3 more

Abstract read
In one paragraph

Article in International journal of medical informatics, 2013. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 30 papers, 1 of them a synthesis that pooled it.

0numbers the graph read from it
0cells of the map it votes in
30citing papers in PubMed, 1 pooled it
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

30 citing papers in PubMed, 1 synthesis or guideline pooled it.

  1. Pooled it
  2. Article
  3. Article
  4. Review
  5. Article
  6. Article
  7. Article
  8. Observational
  9. Article
  10. Article
  11. Article
  12. Article
  13. Lost in Translation: Diagnosis Records Show More Inaccuracies After Biopsy in Oncology Care EHRs.AMIA Joint Summits on Translational Science proceedings. AMIA Joint Summits on Translational Science · 2019
    Article
  14. Article
  15. Article
  16. Article
  17. Article
  18. Article
  19. Article
  20. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

13 authors.

Muhammad F WaljiThe University of Texas Health Science Center at Houston, USA. Muhammad.F.Walji@uth.tmc.edu
Elsbeth Kalenderian
Duong Tran
Krishna K Kookal
Vickie Nguyen
Oluwabunmi Tokede
Joel M White
Ram Vaderhobli
Rachel Ramoni
Paul C Stark
Nicole S Kimmes
Meta E Schoonheim-Klein
Vimla L Patel

Funding

U OF TEXAS HLTH SCI CTR HOUSTON CENTER FOR CLINICAL AND TRANSLATIONAL SCIENCESUL1RR024148 · NCRR · UNIVERSITY OF TEXAS HLTH SCI CTR HOUSTON · PI MCPHERSON, DAVID D · 2006 to 2010
$27.9M
A Cognitive Approach to Refine and Enhance Use of a Dental Diagnostic TerminologyR01DE021051 · NIDCR · HARVARD MEDICAL SCHOOL · PI KALENDERIAN, ELSBETH · 2010 to 2014
$3.7M
NCRR NIH HHS UL1 RR024148NIDCR NIH HHS R01 DE021051
6 · The paper itself

Abstract

backgroundPoor usability is one of the major barriers for optimally using electronic health records (EHRs). Dentists are increasingly adopting EHRs, and are using structured data entry interfaces to enter data such that the data can be easily retrieved and exchanged. Until recently, dentists have lacked a standardized terminology to consistently represent oral health diagnoses.

objectivesIn this study we evaluated the usability of a widely used EHR interface that allow the entry of diagnostic terms, using multi-faceted methods to identify problems and work with the vendor to correct them using an iterative design method.

methodsFieldwork was undertaken at two clinical sites, and dental providers as subjects participated in user testing (n=32), interviews (n=36) and observations (n=24).

resultsUser testing revealed that only 22-41% of users were able to successfully complete a simple task of entering one diagnosis, while no user was able to complete a more complex task. We identified and characterized 24 high-level usability problems reducing efficiency and causing user errors. Interface-related problems included unexpected approaches for displaying diagnosis, lack of visibility, and inconsistent use of UI widgets. Terminology related issues included missing and mis-categorized concepts. Work domain issues involved both absent and superfluous functions. In collaboration with the vendor, each usability problem was prioritized and a timeline set to resolve the concerns. DISCUSSION: Mixed methods evaluations identified a number of critical usability issues relating to the user interface, underlying terminology of the work domain. The usability challenges were found to prevent most users from successfully completing the tasks. Our further work we will determine if changes to the interface, terminology and work domain do result in improved usability.

Indexed as

Health Records, PersonalTerminology as TopicUser-Computer InterfaceVocabulary, ControlledDentistryDiagnosis, OralElectronic Health RecordsNatural Language ProcessingUnited StatesUtilization Review

Identifiers

PMID22749840
PMCPMC3492538

What OpenQuestion holds

Textmetadata
LicenceTDM
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.