Evidence map›Paper›PMID 38470476›Full record

ArticleJMIR research protocols2024

Improving Quality of ICD-10 (International Statistical Classification of Diseases, Tenth Revision) Coding Using AI: Protocol for a Crossover Randomized Controlled Trial.

Taridzo Chomutare, Anastasios Lamproudis, Andrius Budrionis, Therese Olsen Svenning, Lill Irene Hind, Phuong Dinh Ngo, Karl Øyvind Mikalsen, Hercules Dalianis

Registry-linked trialAbstract read
In one paragraph

Article in JMIR research protocols, 2024. The graph could read no effect estimate from its abstract, so it casts no vote on the map. It is linked to trial NCT06286865 (Improving Quality of ICD-10), which is not on this map. Cited by 4 papers.

0numbers the graph read from it
0cells of the map it votes in
4citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

NCT06286865 nacompletednot on this map

Improving Quality of ICD-10 (International Statistical Classification of Diseases, Tenth Revision) Coding Using AI: Protocol for a Crossover Randomized Controlled Trial

TypeinterventionalSponsorUniversity Hospital of North NorwayRan2023 to 2024Enrolled15ConditionsGastrointestinal DiseasesArmsEasy-ICD
3 · Its place in the literature

Who cites it

4 citing papers in PubMed.

  1. Trial
  2. Article
  3. Article
  4. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

8 authors.

Taridzo ChomutareHealth Data Analytics, Norwegian Centre for E-health Research, Tromsø, Norway.ORCID https://orcid.org/0000-0003-3603-175X
Anastasios LamproudisHealth Data Analytics, Norwegian Centre for E-health Research, Tromsø, Norway.ORCID https://orcid.org/0009-0000-5405-2648
Andrius BudrionisHealth Data Analytics, Norwegian Centre for E-health Research, Tromsø, Norway.ORCID https://orcid.org/0000-0002-9525-1923
Therese Olsen SvenningHealth Data Analytics, Norwegian Centre for E-health Research, Tromsø, Norway.ORCID https://orcid.org/0000-0002-0552-2145
Lill Irene HindClinic for Surgery, Oncology and Women Health, University Hospital of North Norway, Tromsø, Norway.ORCID https://orcid.org/0009-0000-7712-2469
Phuong Dinh NgoHealth Data Analytics, Norwegian Centre for E-health Research, Tromsø, Norway.ORCID https://orcid.org/0000-0002-0057-8801
Karl Øyvind MikalsenDepartment of Physics and Technology, UiT The Arctic University of Norway, Tromsø, Norway.ORCID https://orcid.org/0000-0003-4672-7865
Hercules DalianisHealth Data Analytics, Norwegian Centre for E-health Research, Tromsø, Norway.ORCID https://orcid.org/0000-0003-0165-9926

Funding

No grant is acknowledged in the PubMed record.

6 · The paper itself

Abstract

backgroundComputer-assisted clinical coding (CAC) tools are designed to help clinical coders assign standardized codes, such as the ICD-10 (International Statistical Classification of Diseases, Tenth Revision), to clinical texts, such as discharge summaries. Maintaining the integrity of these standardized codes is important both for the functioning of health systems and for ensuring data used for secondary purposes are of high quality. Clinical coding is an error-prone cumbersome task, and the complexity of modern classification systems such as the ICD-11 (International Classification of Diseases, Eleventh Revision) presents significant barriers to implementation. To date, there have only been a few user studies; therefore, our understanding is still limited regarding the role CAC systems can play in reducing the burden of coding and improving the overall quality of coding.

objectiveThe objective of the user study is to generate both qualitative and quantitative data for measuring the usefulness of a CAC system, Easy-ICD, that was developed for recommending ICD-10 codes. Specifically, our goal is to assess whether our tool can reduce the burden on clinical coders and also improve coding quality.

methodsThe user study is based on a crossover randomized controlled trial study design, where we measure the performance of clinical coders when they use our CAC tool versus when they do not. Performance is measured by the time it takes them to assign codes to both simple and complex clinical texts as well as the coding quality, that is, the accuracy of code assignment.

resultsWe expect the study to provide us with a measurement of the effectiveness of the CAC system compared to manual coding processes, both in terms of time use and coding quality. Positive outcomes from this study will imply that CAC tools hold the potential to reduce the burden on health care staff and will have major implications for the adoption of artificial intelligence-based CAC innovations to improve coding practice. Expected results to be published summer 2024.

conclusionsThe planned user study promises a greater understanding of the impact CAC systems might have on clinical coding in real-life settings, especially with regard to coding time and quality. Further, the study may add new insights on how to meaningfully exploit current clinical text mining capabilities, with a view to reducing the burden on clinical coders, thus lowering the barriers and paving a more sustainable path to the adoption of modern coding systems, such as the new ICD-11.

trial registrationclinicaltrials.gov NCT06286865; https://clinicaltrials.gov/study/NCT06286865. INTERNATIONAL REGISTERED REPORT IDENTIFIER (IRRID): DERR1-10.2196/54593.

Indexed as

artificial intelligenceclinical codingdeep learningEasy-ICDICD-10ICD-11International Classification of Diseases, Eleventh RevisionInternational Classification of Diseases, Tenth Revisionmachine learning

Identifiers

PMID38470476
PMCPMC10966438

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.