ArticleJournal of the American Medical Informatics Association : JAMIA2015
Scalable quality assurance for large SNOMED CT hierarchies using subject-based subtaxonomies.
Article in Journal of the American Medical Informatics Association : JAMIA, 2015. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 34 papers.
What it found
Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.
The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.
The trial behind it
Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.
Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.
Who cites it
34 citing papers in PubMed.
- Development and Validation of Human-AI Collaborative Workflow in SNOMED CT Mapping of Bilingual Clinical Text.Journal of medical systems · 2026Article
- Leveraging logical definitions and lexical features to detect missing IS-A relations in biomedical terminologies.Journal of biomedical semantics · 2024Article
- An Automated Approach for Identifying Erroneous IS-A Relations in SNOMED CT.AMIA Joint Summits on Translational Science proceedings. AMIA Joint Summits on Translational Science · 2024Article
- The standard problem.Journal of the American Medical Informatics Association : JAMIA · 2023Article
- A deep learning approach to identify missing is-a relations in SNOMED CT.Journal of the American Medical Informatics Association : JAMIA · 2023Article
- Visual comprehension and orientation into the COVID-19 CIDO ontology.Journal of biomedical informatics · 2021Article
- A Comparison of Exhaustive and Non-lattice-based Methods for Auditing Hierarchical Relations in Gene Ontology.AMIA ... Annual Symposium proceedings. AMIA Symposium · 2021Article
- Outlier concepts auditing methodology for a large family of biomedical ontologies.BMC medical informatics and decision making · 2020Article
- Detecting missing IS-A relations in the NCI Thesaurus using an enhanced hybrid approach.BMC medical informatics and decision making · 2020Article
- Missing lateral relationships in top-level concepts of an ontology.BMC medical informatics and decision making · 2020Article
- A lexical-based approach for exhaustive detection of missing hierarchical IS-A relations in SNOMED CT.AMIA ... Annual Symposium proceedings. AMIA Symposium · 2020Article
- Leveraging Non-lattice Subgraphs to Audit Hierarchical Relations in NCI Thesaurus.AMIA ... Annual Symposium proceedings. AMIA Symposium · 2019Article
- Complex overlapping concepts: An effective auditing methodology for families of similarly structured BioPortal ontologies.Journal of biomedical informatics · 2018Article
- Assessing the practice of biomedical ontology evaluation: Gaps and opportunities.Journal of biomedical informatics · 2018Review
- Auditing SNOMED CT hierarchical relations based on lexical features of concepts in non-lattice subgraphs.Journal of biomedical informatics · 2018Article
- Overlapping Complex Concepts Have More Commission Errors, Especially in Intensive Terminology Auditing.AMIA ... Annual Symposium proceedings. AMIA Symposium · 2018Article
- Leveraging Horizontal Density Differences between Ontologies to Identify Missing Child Concepts: A Proof of Concept.AMIA ... Annual Symposium proceedings. AMIA Symposium · 2018Article
- Identifying Similar Non-Lattice Subgraphs in Gene Ontology based on Structural Isomorphism and Semantic Similarity of Concept Labels.AMIA ... Annual Symposium proceedings. AMIA Symposium · 2018Article
- Quality assurance of chemical ingredient classification for the National Drug File - Reference Terminology.Journal of biomedical informatics · 2017Article
- Mining non-lattice subgraphs for detecting missing hierarchical relations and concepts in SNOMED CT.Journal of the American Medical Informatics Association : JAMIA · 2017Article
Corrections and comments
PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.
Authors and funding
8 authors.
Funding
Abstract
objectiveStandards terminologies may be large and complex, making their quality assurance challenging. Some terminology quality assurance (TQA) methodologies are based on abstraction networks (AbNs), compact terminology summaries. We have tested AbNs and the performance of related TQA methodologies on small terminology hierarchies. However, some standards terminologies, for example, SNOMED, are composed of very large hierarchies. Scaling AbN TQA techniques to such hierarchies poses a significant challenge. We present a scalable subject-based approach for AbN TQA.
methodsAn innovative technique is presented for scaling TQA by creating a new kind of subject-based AbN called a subtaxonomy for large hierarchies. New hypotheses about concentrations of erroneous concepts within the AbN are introduced to guide scalable TQA.
resultsWe test the TQA methodology for a subject-based subtaxonomy for the Bleeding subhierarchy in SNOMED's large Clinical finding hierarchy. To test the error concentration hypotheses, three domain experts reviewed a sample of 300 concepts. A consensus-based evaluation identified 87 erroneous concepts. The subtaxonomy-based TQA methodology was shown to uncover statistically significantly more erroneous concepts when compared to a control sample. DISCUSSION: The scalability of TQA methodologies is a challenge for large standards systems like SNOMED. We demonstrated innovative subject-based TQA techniques by identifying groups of concepts with a higher likelihood of having errors within the subtaxonomy. Scalability is achieved by reviewing a large hierarchy by subject.
conclusionsAn innovative methodology for scaling the derivation of AbNs and a TQA methodology was shown to perform successfully for the largest hierarchy of SNOMED.
Indexed as
Identifiers
What OpenQuestion holds
Registered trials
Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.