Evidence map›Paper›PMID 11768925›Full record

ArticleCanadian family physician Medecin de famille canadien2001

[Evaluation of medical web sites. Interobserver and intraobserver reliability of an evaluation tool].

P Frémont, M Labrecque, F Légaré, L Baillargeon, L Misson

Abstract readEnglish Abstract
In one paragraph

Article in Canadian family physician Medecin de famille canadien, 2001. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 2 papers.

0numbers the graph read from it
0cells of the map it votes in
2citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

2 citing papers in PubMed.

  1. Article
  2. Evaluation of dengue-related health information on the internet.Perspectives in health information managemen · 2012
    Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

5 authors.

P FrémontDépartement de médecine familiale à l'Université Laval au Québec. Pierre.Fremont@crchul.ulaval.ca
M Labrecque
F Légaré
L Baillargeon
L Misson

Funding

No grant is acknowledged in the PubMed record.

6 · The paper itself

Abstract

objectiveTo develop and test the reliability of a tool for rating websites that provide information on evidence-based medicine.

designFor each site, 60% of the score was given for content (eight criteria) and 40% was given for organization and presentation (nine criteria). Five of 10 randomly selected sites met the inclusion criteria and were used by three observers to test the accuracy of the tool. Each site was rated twice by each observer, with a 3-week interval between ratings.

settingLaval University, Quebec city.

participantsThree observers.

main outcome measuresThe intraclass correlation coefficient (ICC) was used to rate the reliability of the tool.

resultsAverage overall scores for the five sites were 40%, 79%, 83%, 88%, and 89%. All three observers rated the same two sites in fourth and fifth place and gave the top three ratings to the other three sites. The overall rating of the five sites by the three observers yielded an ICC of 0.93 to 0.97. An ICC of 0.87 was obtained for the two overall ratings conducted 3 weeks apart.

conclusionThis new tool offers excellent intraobserver and interobserver measurement reliability and is an excellent means of distinguishing between medical websites of varying quality. For best results, we recommend that the tool be used simultaneously by two observers and that differences be resolved by consensus.

Indexed as

Evaluation Studies as TopicInformation ServicesInternetHumansObserver VariationQuebecReproducibility of Results

Identifiers

PMID11768925
PMCPMC2018466

What OpenQuestion holds

Textmetadata
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.