Evidence map›Paper›PMID 24932076›Full record

ArticleJournal of Korean medical science2014

Improving the reliability of clinical practice guideline appraisals: effects of the Korean AGREE II scoring guide.

Moo-Kyung Oh, Heuisug Jo, You Kyoung Lee

Abstract read
In one paragraph

Article in Journal of Korean medical science, 2014. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 15 papers, 5 of them syntheses that pooled it.

0numbers the graph read from it
0cells of the map it votes in
15citing papers in PubMed, 5 pooled it
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

15 citing papers in PubMed, 5 syntheses or guidelines pooled it.

  1. Clinical Practice Guidelines on Normal Labour and Childbirth: A Systematic Review.BJOG : an international journal of obstetrics and gynaecology · 2026
    Pooled it
  2. Pooled it
  3. Pooled it
  4. Guideline
  5. Pooled it
  6. History of the Task Force for the Korean Clinical Guidelines of the Developmental Disorders.Journal of the Korean Academy of Child and Adolescent Psychiatry · 2024
    Article
  7. Article
  8. Article
  9. Review
  10. Article
  11. Article
  12. Article
  13. Article
  14. Article
  15. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

3 authors.

Moo-Kyung OhDepartment of Preventive Medicine, Kangwon National University Hospital, Chuncheon, Korea.ORCID 0000-0002-2011-5708
Heuisug JoDepartment of Preventive Medicine, Kangwon National University Hospital, Chuncheon, Korea. ; Department of Health Management and Policy, Kangwon National University School of Medicine, Chuncheon, Korea. ; The Executive Committee for Clinical Practice Guideline, The Korean Academy of Medical Sciences, Seoul, Korea.ORCID 0000-0003-0245-3583
You Kyoung LeeThe Executive Committee for Clinical Practice Guideline, The Korean Academy of Medical Sciences, Seoul, Korea. ; Department of Laboratory Medicine and Genetics, Soonchunhyang University Bucheon Hospital, Bucheon, Korea. ; Department of Laboratory Medicine and Genetics, Soonchunhyang University College of Medicine, Cheonan, Korea.ORCID 0000-0003-1835-2007

Funding

No grant is acknowledged in the PubMed record.

6 · The paper itself

Abstract

The Korean translated Appraisal of Guidelines for Research and Evaluation II (Korean AGREE II) instrument was distributed into Korean medical societies in 2011. However, inter-rater disagreement issues still exist. The Korean AGREE II scoring guide was therefore developed to reduce inter-rater differences. This study examines the effects of the Korean AGREE II scoring guide to reduce inter-rater differences. Appraisers were randomly assigned to two groups (Scoring Guide group and Non-Scoring Guide group). The Korean AGREE II instrument was provided to both groups. However, the scoring guide was offered to Scoring Guide group only. Total 14 appraisers were participated and each guideline was assessed by 8 appraisers. To evaluate the reliability of the Korean AGREE II scoring guide, correlation of scores among appraisers and domain-specific intra-class correlation (ICC) were compared. Most scores of two groups were comparable. Scoring Guide group showed higher reliability at all guidelines. They showed higher correlation among appraisers and higher ICC values at almost all domains. The scoring guide reduces the inter-rater disagreement and improves the overall reliability of the Korean-AGREE II instrument.

Indexed as

Practice Guidelines as TopicAsian PeopleEvidence-Based MedicineHumansReproducibility of ResultsRepublic of KoreaSocieties, MedicalTranslatingClinical Practice GuidelineObserver VariationReproducibility of Results

Identifiers

PMID24932076
PMCPMC4055808

What OpenQuestion holds

Textmetadata
LicenceCC BY-NC
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.