ArticleJournal of clinical epidemiology2006
When to use agreement versus reliability measures.
Article in Journal of clinical epidemiology, 2006. The graph could read no effect estimate from its abstract, so it casts no vote on the map. It is linked to 3 registered trials, which are not on this map. Cited by 656 papers, 6 of them syntheses that pooled it.
What it found
Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.
The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.
The trial behind it
Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.
Short and Long Term Fampridine Treatment in Persons With Multiple Sclerosis: Cognitive and Motor Performances
Validation of a Record-based Frailty Assessment According to the Multidimensional Prognostic Index
Translation And Psychometric Evaluation Of The Turkish Fugl-Meyer Assessment For Upper And Lower Extremities
Who cites it
656 citing papers in PubMed, 6 syntheses or guidelines pooled it.
- Pooled it
- The Psychometric Properties of the Braden Scale to Assess Pressure Injury Risk in Acute Care: A Systematic Review.Journal of clinical nursing · 2025Pooled it
- Instruments for Measuring Psychological Dimensions in Human-Robot Interaction: Systematic Review of Psychometric Properties.Journal of medical Internet research · 2024Pooled it
- Measures of Subjective Memory for People with Epilepsy: A Systematic Review of Measurement Properties.Neuropsychology review · 2024Pooled it
- Interobserver variability studies in diagnostic imaging: a methodological systematic review.The British journal of radiology · 2023Pooled it
- Reliability of Muscle Strength and Muscle Power Assessments Using Isokinetic Dynamometry in Neuromuscular Diseases: A Systematic Review.Physical therapy · 2022Pooled it
- Measuring health-related quality of life and well-being in adults with fecal incontinence: a comparative psychometric evaluation.Health and quality of life outcomes · 2026Trial
- The Minimal Clinically Important Difference of the American Orthopaedic Foot and Ankle Society Ankle Hindfoot Scale in Patients with Unstable Ankle Fracture.Clinics in orthopedic surgery · 2026Trial
- Trial
- Trial
- The minimal clinically important difference (MCID) of the Olerud Molander Ankle Score (OMAS) in patients with unstable ankle fracture.Archives of orthopaedic and trauma surgery · 2023Trial
- Sustained Benefits of a Multidomain Lifestyle Intervention in Multiple Sclerosis in the LIMS Study: A 24-Month Follow-Up.Neurology · 2026Observational
- Greek Translation and Preliminary Test-Retest Reliability of the AQUA CHILD Questionnaire in Children With Developmental Disabilities.Physiotherapy research international : the journal for researchers and clinicians in physical therapy · 2026Article
- Expert Rater Agreement for Symptoms and Diagnosis of Bipolar Disorder in Youth.Child psychiatry and human development · 2026Article
- Reliability of CEUS and MRI for grading knee-joint inflammation in juvenile idiopathic arthritis.European radiology · 2026Article
- Longitudinal Awake Mouse Brain Imaging Using Functional Ultrasound and Functional Ultrasound Localization Microscopy.Advanced science (Weinheim, Baden-Wurttemberg, Germany) · 2026Article
- Inter-Session Repeatability of a Smartphone-Based Markerless System to Measure Segment Length and Lower-Limb Kinematics in Patients With End-Stage Knee Osteoarthritis.Orthopaedic surgery · 2026Article
- The Dutch patient-based Constant Murley score cannot be used interchangeably with the clinician-based Constant Murley score in shoulder arthroplasty patients.Journal of shoulder and elbow arthroplasty · 2026Article
- Ultrasound gap measurement after acute Achilles rupture is reliable overall but uncertain near a 5-mm decision threshold.Skeletal radiology · 2026Article
- Cross-Cultural Adaptation and Psychometric Evaluation of the Persian Cognitive Assessment Scale for Stroke Patients: A Cross-Sectional Study.Health science reports · 2026Article
596 more citing papers are in PubMed but not listed here.
Corrections and comments
- Commented on by
Authors and funding
4 authors.
Funding
No grant is acknowledged in the PubMed record.
Abstract
backgroundReproducibility concerns the degree to which repeated measurements provide similar results. Agreement parameters assess how close the results of the repeated measurements are, by estimating the measurement error in repeated measurements. Reliability parameters assess whether study objects, often persons, can be distinguished from each other, despite measurement errors. In that case, the measurement error is related to the variability between persons. Consequently, reliability parameters are highly dependent on the heterogeneity of the study sample, while the agreement parameters, based on measurement error, are more a pure characteristic of the measurement instrument. METHODS AND
resultsUsing an example of an interrater study, in which different physical therapists measure the range of motion of the arm in patients with shoulder complaints, the differences and relationships between reliability and agreement parameters for continuous variables are illustrated.
conclusionIf the research question concerns the distinction of persons, reliability parameters are the most appropriate. But if the aim is to measure change in health status, which is often the case in clinical practice, parameters of agreement are preferred.
Indexed as
Identifiers
16980142What OpenQuestion holds
Registered trials
Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.