Evidence map›Paper›PMID 26376841›Full record

ArticleAcademic radiology2015

Inter-Method Performance Study of Tumor Volumetry Assessment on Computed Tomography Test-Retest Data.

Andrew J Buckler, Jovanna Danagoulian, Kjell Johnson, Adele Peskin, Marios A Gavrielides, Nicholas Petrick, Nancy A Obuchowski, Hubert Beaumont, Lubomir Hadjiiski, Rudresh Jarecha and 12 more

Abstract read
In one paragraph

Article in Academic radiology, 2015. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 6 papers.

0numbers the graph read from it
0cells of the map it votes in
6citing papers in PubMed
1.9field-weighted citation impact, top 16% of its field
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

6 citing papers in PubMed, 13 citations in OpenAlex.

  1. Article
  2. Article
  3. Article
  4. Article
  5. Article
  6. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

22 authors at 12 institutions in 5 countries.

Andrew J BucklerElucid Bioimaging Inc., 225 Main Street, Wenham, MA 01984. Electronic address: andrew.buckler@elucidbio.com.
Jovanna DanagoulianElucid Bioimaging Inc., 225 Main Street, Wenham, MA 01984.
Kjell JohnsonArbor Analytics LLC, Ann Arbor, Michigan.
Adele PeskinNational Institute of Standards and Technology, Boulder, Colorado.
Marios A GavrielidesU.S. Food and Drug Administration, Silver Spring, Maryland.
Nicholas PetrickU.S. Food and Drug Administration, Silver Spring, Maryland.
Nancy A ObuchowskiCleveland Clinic, Cleveland, Ohio.
Hubert BeaumontMEDIAN Technologies, Valbonne, France.
Lubomir HadjiiskiDepartment of Radiology, University of Michigan, Ann Arbor, Michigan.
Rudresh JarechaPerceptive Informatics, Sundew Properties SEZ Pvt Ltd Mindspace, Hyderabad, Andhra Pradesh, India.
Jan-Martin KuhnigkFraunhofer MEVIS, Institute for Medical Image Computing, Bremen, Germany.
Ninad MantriICON Medical Imaging, Warrington, Pennsylvania.
Michael McNitt-GrayDepartment of Radiology, University of California at Los Angeles, Los Angeles, California.
Jan H MoltzFraunhofer MEVIS, Institute for Medical Image Computing, Bremen, Germany.
Gergely NyiriGE Healthcare, Buc, France.
Sam PetersonVital Images, Inc., Los Angeles, California.
Pierre TervéKEOSYS, Saint-Herblain, France.
Christian TietjenSiemens AG, Healthcare Sector, Imaging and Therapy Division, Forchheim, Germany.
Etienne von LavanteMirada Medical Ltd., Oxford Center for Innovation, Oxford, United Kingdom.
Xiaonan MaElucid Bioimaging Inc., 225 Main Street, Wenham, MA 01984.
Samantha St PierreElucid Bioimaging Inc., 225 Main Street, Wenham, MA 01984.
Maria AthelogouDefiniens AG, München, Germany.
Elucid Bioimaging · USFraunhofer Institute for Digital Medicine · DEUnited States Food and Drug Administration · USCleveland Clinic · USGeneral Electric (Spain) · ESInstitut Génétique Nantes Atlantique · FRMirada Medical (United Kingdom) · GBNational Institute of Standards and Technology · USSiemens Healthineers (Germany) · DEUniversity of California, Los Angeles · USUniversity of Michigan · USVital Research · US

Funding

NIBIB NIH HHS HHSN268201300071CPHS HHS HHSN268201300071C
6 · The paper itself

Abstract

RATIONALE AND

objectivesTumor volume change has potential as a biomarker for diagnosis, therapy planning, and treatment response. Precision was evaluated and compared among semiautomated lung tumor volume measurement algorithms from clinical thoracic computed tomography data sets. The results inform approaches and testing requirements for establishing conformance with the Quantitative Imaging Biomarker Alliance (QIBA) Computed Tomography Volumetry Profile. MATERIALS AND

methodsIndustry and academic groups participated in a challenge study. Intra-algorithm repeatability and inter-algorithm reproducibility were estimated. Relative magnitudes of various sources of variability were estimated using a linear mixed effects model. Segmentation boundaries were compared to provide a basis on which to optimize algorithm performance for developers.

resultsIntra-algorithm repeatability ranged from 13% (best performing) to 100% (least performing), with most algorithms demonstrating improved repeatability as the tumor size increased. Inter-algorithm reproducibility was determined in three partitions and was found to be 58% for the four best performing groups, 70% for the set of groups meeting repeatability requirements, and 84% when all groups but the least performer were included. The best performing partition performed markedly better on tumors with equivalent diameters greater than 40 mm. Larger tumors benefitted by human editing but smaller tumors did not. One-fifth to one-half of the total variability came from sources independent of the algorithms. Segmentation boundaries differed substantially, not ony in overall volume but also in detail.

conclusionsNine of the 12 participating algorithms pass precision requirements similar to what is indicated in the QIBA Profile, with the caveat that the present study was not designed to explicitly evaluate algorithm profile conformance. Change in tumor volume can be measured with confidence to within ±14% using any of these nine algorithms on tumor sizes greater than 10 mm. No partition of the algorithms was able to meet the QIBA requirements for interchangeability down to 10 mm, although the partition comprising best performing algorithms did meet this requirement for a tumor size of greater than approximately 40 mm.

Indexed as

Tomography, X-Ray ComputedTumor BurdenAlgorithmsCarcinoma, Non-Small-Cell LungFemaleHumansLinear ModelsLungLung NeoplasmsReproducibility of ResultsCTlung cancerquantitative imagingsegmentationvolumetry

Identifiers

PMID26376841
PMCPMC4609285
OpenAlexW1877749330

What OpenQuestion holds

Textmetadata
LicenceTDM
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.