Evidence map›Paper›PMID 37663665›Full record

ArticleFrontiers in medicine2023

Inter-rater reliability of the extended Composite Quality Score (CQS-2).

Steffen Mickenautsch, Stefan Rupf, Ivana Miletić, Ulf Tilman Strähle, Richard Sturm, Faheema Kimmie-Dhansay, Kata Vidosusić, Veerasamy Yengopal

Open access · goldAbstract read
In one paragraph

Article in Frontiers in medicine, 2023. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 4 papers.

0numbers the graph read from it
0cells of the map it votes in
4citing papers in PubMed
1.0field-weighted citation impact, top 22% of its field
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

4 citing papers in PubMed, 3 citations in OpenAlex.

  1. Article
  2. Article
  3. Review
  4. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

8 authors at 5 institutions in 3 countries.

Steffen MickenautschFaculty of Dentistry, University of the Western Cape, Bellville, South Africa.
Stefan RupfSynoptic Dentistry, Saarland University, Homburg, Germany.
Ivana MiletićDepartment of Endodontics and Restorative Dentistry, School of Dental Medicine, University of Zagreb, Zagreb, Croatia.
Ulf Tilman SträhleSynoptic Dentistry, Saarland University, Homburg, Germany.
Richard SturmDepartment of Operative, Preventive and Paediatric Dentistry, Charité - Universitätsmedizin Berlin, Berlin, Germany.
Faheema Kimmie-DhansayDepartment of Community Oral Health, Faculty of Dentistry, University of the Western Cape, Bellville, South Africa.
Kata VidosusićDepartment of Endodontics and Restorative Dentistry, School of Dental Medicine, University of Zagreb, Zagreb, Croatia.
Veerasamy YengopalFaculty of Dentistry, University of the Western Cape, Bellville, South Africa.
Saarland University · DEUniversity of the Western Cape · ZAUniversity of Zagreb · HRCharité - Universitätsmedizin Berlin · DEUniversity of the Witwatersrand · ZA

Funding

No grant is acknowledged in the PubMed record.

6 · The paper itself

Abstract

Aim: To establish the inter-rater reliability of the Composite Quality Score (CQS-2) and to test the null hypothesis that it did not differ significantly from that of the first CQS version (CQS-1). Materials and methods: Four independent raters were selected to rate 45 clinical trial reports using CQS-1 and CQS-2. The raters remained unaware of each other's participation in this study until all rating had been completed. Each rater received only one rating template at a time in a random sequence for CQS-1 and CQS-2 rating. Raters completed each template and sent these back to the principal investigator. Each rater received their next template 2 weeks after submission of the completed previous template. The inter-rater reliabilities for the overall appraisal score of the CQS-1 and the CQS-2 were established by using the Brennan-Prediger coefficient (BPC). The coefficients of both CQS versions were compared by using the two-sample Results: The BPC for the CQS-1 was 0.85 (95% CI: 0.64-1.00) and for the CQS-2 it was 1.00 (95% CI: 0.94-1.00), suggesting a very high inter-rater reliability for both. The difference between the two CQS versions was statistically not significant ( Conclusion: The CQS-2 is still under development, This study shows that it is associated with a very high inter-rater reliability, which did not statistically significantly differ from that of the CQS-1. The promising results of this study warrant further investigation in the applicability of the CQS-2 as an appraisal tool for prospective controlled clinical therapy trials.

Indexed as

clinical rialComposite Quality Scoreinter-rater reliabilitysystematic reviewtrial appraisal

Identifiers

PMID37663665
PMCPMC10469905
OpenAlexW4385982674

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.