Evidence map›Paper›PMID 36781405›Full record

ArticleJournal of public health dentistry2023

Calibration and reliability testing of a novel asynchronous photographic plaque scoring system in young children.

David M Avenetti, Molly A Martin, Stuart A Gansky, Francisco J Ramos-Gomez, Susan Hyde, Rebecca Van Horn, Bonnie Jue, Genesis F Rosales, Nancy F Cheng, Caroline H Shiboski

Abstract read
In one paragraph

Article in Journal of public health dentistry, 2023. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 4 papers.

0numbers the graph read from it
0cells of the map it votes in
4citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

4 citing papers in PubMed.

  1. Article
  2. Article
  3. Article
  4. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

10 authors.

David M AvenettiDepartment of Pediatric Dentistry, UIC College of Dentistry, University of Illinois Chicago, Chicago, Illinois, USA.ORCID 0000-0002-6351-9315
Molly A MartinDepartment of Pediatrics, UIC College of Medicine, University of Illinois Chicago, Chicago, Illinois, USA.
Stuart A GanskyDepartment Preventive and Restorative Dental Sciences, UCSF School of Dentistry, University of California, San Francisco, California, USA.
Francisco J Ramos-GomezDivision of Preventative and Restorative Sciences, Section of Pediatric Dentistry, UCLA School of Dentistry, University of California, Los Angeles, California, USA.
Susan HydeDepartment Preventive and Restorative Dental Sciences, UCSF School of Dentistry, University of California, San Francisco, California, USA.
Rebecca Van HornDepartment of Pediatric Dentistry, UIC College of Dentistry, University of Illinois Chicago, Chicago, Illinois, USA.
Bonnie JueDepartment Preventive and Restorative Dental Sciences, UCSF School of Dentistry, University of California, San Francisco, California, USA.
Genesis F RosalesInstitute for Health Research and Policy, University of Illinois at Chicago, Chicago, Illinois, USA.
Nancy F ChengDepartment Preventive and Restorative Dental Sciences, UCSF School of Dentistry, University of California, San Francisco, California, USA.
Caroline H ShiboskiDepartment of Orofacial Sciences, UCSF School of Dentistry, University of California, San Francisco, California, USA.

Funding

COORDINATING CENTER TO HELP ELIMINATE/REDUCE ORAL HEALTH INEQUALITIES IN CHILDRENU01DE025507 · NIDCR · UNIVERSITY OF CALIFORNIA, SAN FRANCISCO · PI GANSKY, STUART A · 2015 to 2020
$11.9M
Influence of Financial Incentives on Oral Disease Management in Young ChildrenUH3DE025514 · NIDCR · UNIVERSITY OF CALIFORNIA, SAN FRANCISCO · PI GANSKY, STUART A · 2017 to 2019
$4.2M
Coordinated Oral Health Promotion (CO-OP) ChicagoUH3DE025483 · NIDCR · UNIVERSITY OF ILLINOIS AT CHICAGO · PI MARTIN, MOLLY A · 2017 to 2020
$3.7M
Influence of Financial Incentives on Oral Disease Management in Young ChildrenUH2DE025514 · NIDCR · UNIVERSITY OF CALIFORNIA, SAN FRANCISCO · PI GANSKY, STUART A, KAHN, JAMES GUSTAVE · 2015 to 2016
$1.3M
COordinated Oral health Promotion (CO-OP) ChicagoUH2DE025483 · NIDCR · UNIVERSITY OF ILLINOIS AT CHICAGO · PI MARTIN, MOLLY A · 2015 to 2016
$1.2M
NIDCR NIH HHS U01 DE025507NIDCR NIH HHS UH2 DE025483NIDCR NIH HHS UH2 DE025514NIDCR NIH HHS UH3 DE025483NIDCR NIH HHS UH3 DE025514
6 · The paper itself

Abstract

objectivesThe Simplified Oral Hygiene Index for Maxillary Incisors (OHI-MIS) is a novel plaque scoring system adapted for young children. This study describes calibration training and testing used to establish the inter- and intra-rater reliability for OHI-MIS measured from clinical photographs.

methodsTwo raters from the Coordinated Oral Health Promotion Chicago (CO-OP) and one from the Behavioral EConomics for Oral health iNnovation (BEECON) randomized controlled trials (RCTs) underwent calibration with gold standard raters, followed by annual re-calibration. Raters from CO-OP also completed inter-rater reliability testing; all three raters completed intra-rater reliability testing rounds. Photographs were obtained from children aged 9-39 months.

resultsAll three raters achieved greater than 0.77 Lin's Concordance Correlation (LCC) versus gold standard consensus during calibration. All three raters had LCC ≥0.83 at recalibration 1 year later. CO-OP trial raters scored 604 photos (151 sets of 4 photographs); mostly both raters were somewhat/very confident in their scoring (≥89%), describing the most photos as "clear" (90% and 81%). The CO-OP inter-rater LCC for total OHI-MIS score was 0.86, changing little when low quality or confidence photos were removed. All three raters demonstrated high intra-rater reliability (≥0.83).

conclusionsThe OHI-MIS plaque scoring system on photos had good reliability within and between trials following protocol training and calibration. OHI-MIS provides a novel asynchronous plaque scoring system for use in young children. Non-clinicians in field or clinical settings can obtain photographs, offering new opportunities for research and clinical care.

Indexed as

CalibrationChildChild, PreschoolHumansReproducibility of Resultschildrendental plaqueepidemiologic methodsoral healthoral hygienepediatric dentistrypublic health dentistry

Identifiers

PMID36781405
PMCPMC10329468

What OpenQuestion holds

Textmetadata
LicenceTDM
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.