Evidence map›Paper›PMID 39316332›Full record

ArticleAnnals of nuclear medicine2025

Interrater agreement and variability in visual reading of [18F] flutemetamol PET images.

Akinori Takenaka, Takashi Nihashi, Keita Sakurai, Keiji Notomi, Hokuto Ono, Yoshitaka Inui, Shinji Ito, Yutaka Arahata, Akinori Takeda, Kazunari Ishii and 6 more

Abstract read
In one paragraph

Article in Annals of nuclear medicine, 2025. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 8 papers.

0numbers the graph read from it
0cells of the map it votes in
8citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

8 citing papers in PubMed.

  1. Article
  2. Article
  3. Article
  4. Article
  5. Article
  6. Article
  7. Article
  8. Comparison of Amyloid-PET Analysis Software UsingDiagnostics (Basel, Switzerland) · 2025
    Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

16 authors.

Akinori TakenakaDepartment of Radiology, Fujita Health University School of Medicine, Toyoake, Japan.
Takashi NihashiDepartment of Radiology, National Center for Geriatrics and Gerontology, Obu, Japan.
Keita SakuraiDepartment of Radiology, National Center for Geriatrics and Gerontology, Obu, Japan.
Keiji NotomiMicron Inc. Imaging Service Dept., Tokyo, Japan.
Hokuto OnoMicron Inc. Imaging Service Dept., Tokyo, Japan.
Yoshitaka InuiDepartment of Radiology, Fujita Health University School of Medicine, Toyoake, Japan.
Shinji ItoDepartment of Radiology, Anjo Kosei Hospital, Anjo, Japan.
Yutaka ArahataDepartment of Neurology, National Center for Geriatrics and Gerontology, Obu, Japan.
Akinori TakedaDepartment of Neurology, National Center for Geriatrics and Gerontology, Obu, Japan.
Kazunari IshiiDepartment of Radiology, Faculty of Medicine, Kindai University, Osakasayama, Japan.
Kenji IshiiTeam for Neuroimaging Research, Tokyo Metropolitan Institute of Gerontology, Tokyo, Japan.
Kengo ItoDepartment of Radiology, National Center for Geriatrics and Gerontology, Obu, Japan.
Hiroshi ToyamaDepartment of Radiology, Fujita Health University School of Medicine, Toyoake, Japan.
Akinori NakamuraDepartment of Clinical and Experimental Neuroimaging, National Center for Geriatrics and Gerontology, Obu, Japan.
Takashi KatoDepartment of Radiology, National Center for Geriatrics and Gerontology, Obu, Japan. tkato@ncgg.go.jp.ORCID http://orcid.org/0000-0002-4293-4333
BATON Study Group

Funding

AMED JP23ae0101077AMED JP23dk0207052National Center for Geriatrics and Gerontology 21-11National Center for Geriatrics and Gerontology 22-17
6 · The paper itself

Abstract

objectiveThe purpose of this study was to validate the concordance of visual ratings of [18F] flutemetamol amyloid positron emission tomography (PET) images and to investigate the correlation between the agreement of each rater and the Centiloid (CL) scale.

methodsA total of 192 participants, clinically classified as cognitively normal (CN) (n = 59), mild cognitive impairment (MCI) (n = 65), Alzheimer's disease (AD) (n = 55), or non-AD dementia (n = 13), participated in this study. Three experts conducted visual ratings of the amyloid PET images for all 192 patients, assigning a confidence level to each rating on a three-point scale (certain, probable, or neither). The positive or negative determination of amyloid PET results was made by majority vote. The CL value was calculated using the CapAIBL pipeline.

resultsOverall, 101 images were determined to be positive, and 91 images were negative. Of the 101 positive images, the three raters were in complete agreement for 92 images and in disagreement for 9 images. Of the 91 negative images, the three raters were in complete agreement for 75 images and in disagreement for 16 images. Interrater reliability among the three experts was particularly high, with both Fleiss' kappa and Conger's kappa measuring 0.83 (0.76-0.89). The CL values of the unanimous positive group were significantly greater than those of the other groups, whereas the CL values of the unanimous negative group were significantly lower than those of the other groups. Images with rater disagreement had intermediate CLs. In cases with a high confidence level, the positive or negative visual ratings were in almost complete agreement. However, as confidence levels decreased, experts' visual ratings became more variable. The lower the confidence level was, the greater the number of cases with disagreement in the visual ratings.

conclusionThree experts independently rated 192 amyloid PET images, achieving a high level of interrater agreement. However, in patients with intermediate amyloid accumulation, visual ratings varied. Therefore, determining positive and negative decisions in these patients should be performed with caution.

Indexed as

Aniline CompoundsBenzothiazolesObserver VariationPositron-Emission TomographyAgedAged, 80 and overAlzheimer DiseaseCognitive DysfunctionFemaleHumansMaleMiddle AgedAniline CompoundsBenzothiazolesflutemetamolAmyloidCentiloid scalePositron emission tomographyVisual rating

Identifiers

PMID39316332
PMCPMC11706841

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.