Evidence map›Paper›PMID 37057360›Full record

ArticleMedical physics2023

Discrimination tasks in simulated low-dose CT noise.

Craig K Abbey, Frank W Samuelson, Rongping Zeng, John M Boone, Kyle J Myers, Miguel P Eckstein

Open access · hybridAbstract read
In one paragraph

Article in Medical physics, 2023. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Not yet cited in PubMed.

0numbers the graph read from it
0cells of the map it votes in
0citing papers in PubMed
0.2field-weighted citation impact, top 44% of its field
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

0 citing papers in PubMed, 1 citations in OpenAlex.

No citing paper in PubMed yet.

4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

6 authors at 4 institutions in 1 country.

Craig K AbbeyDepartment of Psychological and Brain Sciences, University of California, Santa Barbara, California, USA.
Frank W SamuelsonDivision of Imaging, Diagnostics and Software Reliability, US Food and Drug Administration, Silver Spring, Maryland, USA.
Rongping ZengDivision of Imaging, Diagnostics and Software Reliability, US Food and Drug Administration, Silver Spring, Maryland, USA.
John M BooneDepartments of Radiology and Biomedical Engineering, University of California, Davis, California, USA.
Kyle J MyersPuente Solutions, LLC, Phoenix, Arizona, USA.
Miguel P EcksteinDepartment of Psychological and Brain Sciences, University of California, Santa Barbara, California, USA.
United States Food and Drug Administration · USUniversity of California, Santa Barbara · USArizona Department of Education · USUniversity of California, Davis · US

Funding

Visual Search in 3D Medical Imaging ModalitiesR01EB026427 · NIBIB · UNIVERSITY OF CALIFORNIA SANTA BARBARA · PI Miguel Patricio Eckstein · 2018 to 2026
$2.5M
Modeling observer performance in low-dose CT assessmentsR01EB025829 · NIBIB · UNIVERSITY OF CALIFORNIA SANTA BARBARA · PI ABBEY, CRAIG KENDALL · 2018 to 2021
$1.7M
Assessment of medical image quality with foveated search modelsR01EB018958 · NIBIB · UNIVERSITY OF CALIFORNIA SANTA BARBARA · PI ECKSTEIN, MIGUEL PATRICIO · 2015 to 2018
$1.7M
NIBIB NIH HHS R01 EB018958NIBIB NIH HHS R01 EB025829NIBIB NIH HHS R01 EB026427NIH HHS R01 EB018958NIH HHS R01-EB025829NIH HHS R01 EB026427
6 · The paper itself

Abstract

backgroundThis study reports the results of a set of discrimination experiments using simulated images that represent the appearance of subtle lesions in low-dose computed tomography (CT) of the lungs. Noise in these images has a characteristic ramp-spectrum before apodization by noise control filters. We consider three specific diagnostic features that determine whether a lesion is considered malignant or benign, two system-resolution levels, and four apodization levels for a total of 24 experimental conditions. PURPOSE: The goal of the investigation is to better understand how well human observers perform subtle discrimination tasks like these, and the mechanisms of that performance. We use a forced-choice psychophysical paradigm to estimate observer efficiency and classification images. These measures quantify how effectively subjects can read the images, and how they use images to perform discrimination tasks across the different imaging conditions. MATERIALS AND

methodsThe simulated CT images used as stimuli in the psychophysical experiments are generated from high-resolution objects passed through a modulation transfer function (MTF) before down-sampling to the image-pixel grid. Acquisition noise is then added with a ramp noise-power spectrum (NPS), with subsequent smoothing through apodization filters. The features considered are lesion size, indistinct lesion boundary, and a nonuniform lesion interior. System resolution is implemented by an MTF with resolution (10% max.) of 0.47 or 0.58 cyc/mm. Apodization is implemented by a Shepp-Logan filter (Sinc profile) with various cutoffs. Six medically naïve subjects participated in the psychophysical studies, entailing training and testing components for each condition. Training consisted of staircase procedures to find the 80% correct threshold for each subject, and testing involved 2000 psychophysical trials at the threshold value for each subject. Human-observer performance is compared to the Ideal Observer to generate estimates of task efficiency. The significance of imaging factors is assessed using ANOVA. Classification images are used to estimate the linear template weights used by subjects to perform these tasks. Classification-image spectra are used to analyze subject weights in the spatial-frequency domain.

resultsOverall, average observer efficiency is relatively low in these experiments (10%-40%) relative to detection and localization studies reported previously. We find significant effects for feature type and apodization level on observer efficiency. Somewhat surprisingly, system resolution is not a significant factor. Efficiency effects of the different features appear to be well explained by the profile of the linear templates in the classification images. Increasingly strong apodization is found to both increase the classification-image weights and to increase the mean-frequency of the classification-image spectra. A secondary analysis of "Unapodized" classification images shows that this is largely due to observers undoing (inverting) the effects of apodization filters.

conclusionsThese studies demonstrate that human observers can be relatively inefficient at feature-discrimination tasks in ramp-spectrum noise. Observers appear to be adapting to frequency suppression implemented in apodization filters, but there are residual effects that are not explained by spatial weighting patterns. The studies also suggest that the mechanisms for improving performance through the application of noise-control filters may require further investigation.

Indexed as

Image Processing, Computer-AssistedTomography, X-Ray ComputedAlgorithmsHumansPhantoms, Imagingdiscrimination tasksobserver performanceramp-spectrum noise

Identifiers

PMID37057360
PMCPMC11181787
OpenAlexW4365479480

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.