ArticleJournal of the American Medical Informatics Association : JAMIA
Variation of SNOMED CT coding of clinical research concepts among coding experts.
Article in Journal of the American Medical Informatics Association : JAMIA. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 29 papers, 1 of them a synthesis that pooled it.
What it found
Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.
The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.
The trial behind it
Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.
Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.
Who cites it
29 citing papers in PubMed, 1 synthesis or guideline pooled it.
- The ACGT Master Ontology and its applications--towards an ontology-driven cancer research and management system.Journal of biomedical informatics · 2011Pooled it
- Development and Validation of Human-AI Collaborative Workflow in SNOMED CT Mapping of Bilingual Clinical Text.Journal of medical systems · 2026Article
- Variation in multimorbidity estimates due to clinical coding: a cross-sectional study of 7.2 million adults in England.BMJ public health · 2026Article
- Semantics in action: a guide for representing clinical data elements with SNOMED CT.Journal of biomedical semantics · 2025Article
- Clinical characteristics and outcomes of community acquired-acute kidney injury.International urology and nephrology · 2023Article
- Inter-rater agreement for the annotation of neurologic signs and symptoms in electronic health records.Frontiers in digital health · 2023Article
- Linguistic and ontological challenges of multiple domains contributing to transformed health ecosystems.Frontiers in medicine · 2023Article
- Ambiguity in medical concept normalization: An analysis of types and coverage in electronic health record datasets.Journal of the American Medical Informatics Association : JAMIA · 2021Article
- Recording COVID-19 consultations: review of symptoms, risk factors, and proposed SNOMED CT terms.BJGP open · 2020Article
- Evaluation of standard and semantically-augmented distance metrics for neurology patients.BMC medical informatics and decision making · 2020Article
- A Neuro-ontology for the neurological examination.BMC medical informatics and decision making · 2020Article
- SNOMEDtxt: Natural Language Generation from SNOMED Ontology.Studies in health technology and informatics · 2019Article
- Enhancing Clinical Data and Clinical Research Data with Biomedical Ontologies - Insights from the Knowledge Representation Perspective.Yearbook of medical informatics · 2019Article
- Web-Based Information Infrastructure Increases the Interrater Reliability of Medical Coders: Quasi-Experimental Study.Journal of medical Internet research · 2018Article
- CUILESS2016: a clinical corpus applying compositional normalization of text mentions.Journal of biomedical semantics · 2018Article
- Article
- Article
- Methods and applications for visualization of SNOMED CT concept sets.Applied clinical informatics · 2014Article
- Comparison of Knowledge Levels Required for SNOMED CT Coding of Diagnosis and Operation Names in Clinical Records.Healthcare informatics research · 2012Article
- Auditing consistency and usefulness of LOINC use among three large institutions - using version spaces for grouping LOINC codes.Journal of biomedical informatics · 2012Article
Corrections and comments
PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.
Authors and funding
3 authors.
Funding
Abstract
objectiveTo compare consistency of coding among professional SNOMED CT coders representing three commercial providers of coding services when coding clinical research concepts with SNOMED CT.
designA sample of clinical research questions from case report forms (CRFs) generated by the NIH-funded Rare Disease Clinical Research Network (RDCRN) were sent to three coding companies with instructions to code the core concepts using SNOMED CT. The sample consisted of 319 question/answer pairs from 15 separate studies. The companies were asked to select SNOMED CT concepts (in any form, including post-coordinated) that capture the core concept(s) reflected in the question. Also, they were asked to state their level of certainty, as well as how precise they felt their coding was. MEASUREMENTS: Basic frequencies were calculated to determine raw level agreement among the companies and other descriptive information. Krippendorff's alpha was used to determine a statistical measure of agreement among the coding companies for several measures (semantic, certainty, and precision).
resultsNo significant level of agreement among the experts was found.
conclusionThere is little semantic agreement in coding of clinical research data items across coders from 3 professional coding services, even using a very liberal definition of agreement.
Indexed as
Identifiers
What OpenQuestion holds
Registered trials
Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.