Evidence map›Paper›PMID 41030129›Full record

ArticleAlzheimer's & dementia : the journal of the Alzheimer's Association2025

Calibration of multisite raters for prospective visual reads of amyloid PET scans.

David N Soleimani-Meigooni, Stefania Pezzoli, Ganna Blazhenets, Renaud La Joie, Zoe Lin, Carol L Soppe, Derek R Johnson, Mary Ellen I Koran, Jonathan E McConathy, Ilya M Nasrallah and 15 more

Abstract readMulticenter Study
In one paragraph

Article in Alzheimer's & dementia : the journal of the Alzheimer's Association, 2025. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 2 papers.

0numbers the graph read from it
0cells of the map it votes in
2citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

2 citing papers in PubMed.

  1. Article
  2. Calibration of multisite raters for prospective visual reads of amyloid PET scans.Alzheimer's & dementia : the journal of the Alzheimer's Association · 2025
    Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

25 authors.

David N Soleimani-MeigooniMemory and Aging Center, Department of Neurology, University of California, San Francisco, San Francisco, California, USA.ORCID 0000-0003-4197-3039
Stefania PezzoliMemory and Aging Center, Department of Neurology, University of California, San Francisco, San Francisco, California, USA.
Ganna BlazhenetsMemory and Aging Center, Department of Neurology, University of California, San Francisco, San Francisco, California, USA.
Renaud La JoieMemory and Aging Center, Department of Neurology, University of California, San Francisco, San Francisco, California, USA.
Zoe LinMemory and Aging Center, Department of Neurology, University of California, San Francisco, San Francisco, California, USA.
Carol L SoppeMemory and Aging Center, Department of Neurology, University of California, San Francisco, San Francisco, California, USA.
Derek R JohnsonDepartment of Radiology, Mayo Clinic, Rochester, Minnesota, USA.
Mary Ellen I KoranDepartment of Radiology, Mayo Clinic, Phoenix, Arizona, USA.
Jonathan E McConathyUniversity of Alabama at Birmingham, Birmingham, Alabama, USA.
Ilya M NasrallahDepartment of Radiology, University of Pennsylvania, Philadelphia, Pennsylvania, USA.
Maria Rosana PonisioDivision of Nuclear Medicine, Mallinckrodt Institute of Radiology, Washington University in St. Louis School of Medicine, St. Louis, Missouri, USA.
Jeremy A TannerGlenn Biggs Institute for Alzheimer's and Neurodegenerative Diseases, University of Texas Health Science Center, San Antonio, Texas, USA.
Victor L VillemagneDepartment of Psychiatry, University of Pittsburgh School of Medicine, Pittsburgh, Pennsylvania, USA.
Charles C WindonMemory and Aging Center, Department of Neurology, University of California, San Francisco, San Francisco, California, USA.
Michael ZeinehStanford University School of Medicine, Stanford, California, USA.
Sarah BiberNational Alzheimer's Coordinating Center, University of Washington, Seattle, Washington, USA.
Walter A KukullNational Alzheimer's Coordinating Center, University of Washington, Seattle, Washington, USA.
Heather O'ConnellNational Alzheimer's Coordinating Center, University of Washington, Seattle, Washington, USA.
Daniel J PetersonNational Alzheimer's Coordinating Center, University of Washington, Seattle, Washington, USA.
Elizabeth C MorminoStanford University School of Medicine, Stanford, California, USA.
Sterling C JohnsonWisconsin Alzheimer's Disease Research Center, University of Wisconsin-Madison School of Medicine and Public Health, Madison, Wisconsin, USA.
Gil D RabinoviciMemory and Aging Center, Department of Neurology, University of California, San Francisco, San Francisco, California, USA.
LEADS Consortium
PREVENT‐AD Research Group
Alzheimer's Disease Neuroimaging Initiative

Funding

Project 1U19AG024904 · NIA · NORTHERN CALIFORNIA INSTITUTE/RES/EDU · PI ARTHUR W TOGA · 2016 to 2026
$226.7M
ADRC Consortium for Clarity in ADRD Research Through ImagingU01AG082350 · NIA · UNIVERSITY OF WISCONSIN-MADISON · PI Sarah Biber, BRADFORD C DICKERSON · 2023 to 2026
$90.0M
Early Onset AD Consortium - the LEAD Study (LEADS)U01AG057195 · NIA · INDIANA UNIVERSITY INDIANAPOLIS · PI APOSTOLOVA, LIANA G, CARRILLO, MARIA C · 2018 to 2023
$70.3M
National Alzheimer's Coordinating CenterU24AG072122 · NIA · UNIVERSITY OF WASHINGTON · PI STEPHENS, KARI A · 2021 to 2025
$45.8M
South Texas Alzheimer's Disease Research CenterP30AG066546 · NIA · UNIVERSITY OF TEXAS HLTH SCIENCE CENTER · PI Agustin Ruiz Laza · 2021 to 2026
$24.0M
Development of Emergent PET Tracers in Frontotemporal Lobar DegenerationK23AG076960 · NIA · UNIVERSITY OF CALIFORNIA, SAN FRANCISCO · PI David Nima Soleimani-Meigooni · 2022 to 2026
$951k
Bridging Gaps to Translate Plasma Alzheimer's Disease Biomarkers to Diverse PopulationsK08AG090815 · NIA · UNIVERSITY OF TEXAS HLTH SCIENCE CENTER · PI Jeremy Adam Tanner · 2025 to 2026
$326k
Brain Canada FoundationNational Institute of Biomedical Imaging and Bioengineering, the Canadian Institutes of Health ResearchNIA NIH HHS K08 AG090815NIA NIH HHS K23 AG076960NIA NIH HHS P30 AG066546NIA NIH HHS R56/U01 AG057195NIA NIH HHS U01 AG057195NIA NIH HHS U01 AG082350NIA NIH HHS U19 AG024904NIA NIH HHS U24 AG072122Northern California Institute for Research and Education
6 · The paper itself

Abstract

introductionIn multicenter Alzheimer's disease studies, amyloid positron emission tomography (PET) visual reads are typically performed centrally by a few experts. Incorporating a broader reader network enhances scalability and generalizability.

methodsTen neuroimaging experts from eight Alzheimer's Disease Research Centers (ADRCs) visually read 180 amyloid PET scans (30 scans and 15 duplicate scans for each of four tracers, imaged across a wide variety of scanners), using preferred reading software without anatomical imaging or quantitation. Scans were classified as elevated or non-elevated per tracer-specific criteria. Inter- and intra-rater agreement was assessed.

resultsInter-rater agreement was substantial (Fleiss' κ = 0.78), with full consensus on 69% of scans. Inter-rater reliability was substantial to perfect across tracers (Fleiss' κ = 0.70-0.87). Intra-rater agreement was substantial to perfect (Cohen's κ = 0.79-1). Scans with intermediate (10-40 Centiloid) quantitation had lower reader agreement. DISCUSSION: A multicenter expert network achieved substantial agreement classifying amyloid PET scans. These scans provide a standard for reader training and reliability assurance in future studies. HIGHLIGHTS: Calibration methods ensure reliable amyloid positron emission tomography (PET) visual reads across multiple raters. Substantial agreement is possible across readers using their preferred tools. Agreement is also substantial regardless of the amyloid PET tracer used. Scans with intermediate (10-40 Centiloid) quantitation have lower reader agreement. The calibration set will become a training tool for amyloid PET visual read studies.

Indexed as

Alzheimer DiseaseAmyloidBrainPositron-Emission TomographyCalibrationHumansObserver VariationReproducibility of ResultsAmyloidAmyloid positron emission tomographyinter‐rater reliabilityintra‐rater reliabilityvisual reader calibrationvisual reads

Identifiers

PMID41030129
PMCPMC12484700

What OpenQuestion holds

Textmetadata
LicenceCC BY-NC
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.