Evidence map›Paper›PMID 42877609›Full record

ArticleNeurocomputing2026

Segment Anything for Video: A Comprehensive Review of Video Object Segmentation and Tracking from Past to Future.

Guoping Xu, Jayaram K Udupa, Yajun Yu, Hua-Chieh Shao, Songlin Zhao, Wei Liu, You Zhang

Abstract read
In one paragraph

Article in Neurocomputing, 2026. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Not yet cited in PubMed.

0numbers the graph read from it
0cells of the map it votes in
0citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

0 citing papers in PubMed.

No citing paper in PubMed yet.

4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

7 authors.

Guoping XuThe Medical Artificial Intelligence and Automation (MAIA) Laboratory, Department of Radiation Oncology, University of Texas Southwestern Medical Center, Dallas, TX 75390, USA.
Jayaram K UdupaMedical Image Processing Group, Department of Radiology, University of Pennsylvania, Philadelphia, PA 19104, USA.
Yajun YuThe Medical Artificial Intelligence and Automation (MAIA) Laboratory, Department of Radiation Oncology, University of Texas Southwestern Medical Center, Dallas, TX 75390, USA.
Hua-Chieh ShaoThe Medical Artificial Intelligence and Automation (MAIA) Laboratory, Department of Radiation Oncology, University of Texas Southwestern Medical Center, Dallas, TX 75390, USA.
Songlin ZhaoDepartment of Radiation Oncology, Mayo Clinic, Phoenix, 85054, AZ, USA.
Wei LiuDepartment of Radiation Oncology, Mayo Clinic, Phoenix, 85054, AZ, USA.
You ZhangThe Medical Artificial Intelligence and Automation (MAIA) Laboratory, Department of Radiation Oncology, University of Texas Southwestern Medical Center, Dallas, TX 75390, USA.

Funding

Artificial Intelligence-Based Quality Assurance for Online Adaptive RadiotherapyR01CA258987 · NCI · UT SOUTHWESTERN MEDICAL CENTER · PI Steve Bin Jiang, Dan Nguyen · 2022 to 2026
$2.8M
High-Precision Proton Therapy for Liver Cancer: Developing an End-to-end Strategy with Real-time Liver Tumor Localization and On-the-fly Plan Delivery AdaptationR01CA280135 · NCI · UT SOUTHWESTERN MEDICAL CENTER · PI Weiguo Lu, You Zhang · 2024 to 2026
$1.8M
High-Precision Lung Radiotherapy by Intra-treatment Dynamic Cone-beam CT imaging and Dosimetry-guided Plan AdaptationR01EB034691 · NIBIB · UT SOUTHWESTERN MEDICAL CENTER · PI Weiguo Lu, You Zhang · 2024 to 2026
$1.5M
Accurate 4D Liver Tumor Localization for Radiotherapy using Contrast-Agent-Free X-ray Imaging and Liver Biomechanical ModelingR01CA240808 · NCI · UT SOUTHWESTERN MEDICAL CENTER · PI ZHANG, YOU · 2020 to 2024
$1.5M
NCI NIH HHS R01 CA240808NCI NIH HHS R01 CA258987NCI NIH HHS R01 CA280135NIBIB NIH HHS R01 EB034691
6 · The paper itself

Abstract

Video Object Segmentation and Tracking (VOST) presents a complex yet critical challenge in computer vision, requiring robust integration of segmentation and tracking across temporally dynamic frames. Traditional methods have struggled with domain generalization, temporal consistency, and computational efficiency. The emergence of foundation models like the Segment Anything Model (SAM) and its successor, SAM2, has introduced a paradigm shift, enabling prompt-driven segmentation with strong generalization capabilities. Building upon these advances, this survey offers a comprehensive review of SAM-based methods for VOST, structured along three temporal dimensions: past, present, and future. We examined strategies for retaining and updating historical information (past), approaches for extracting and optimizing discriminative features from the current frame (present), and motion prediction and trajectory estimation mechanisms for anticipating object dynamics in subsequent frames (future). In doing so, we highlighted the evolution from early memory-based architectures to the streaming memory and real-time segmentation capabilities of SAM-based approaches. We also discussed recent innovations, such as motion-aware memory selection and trajectory-guided prompting, that aim to enhance both accuracy and efficiency. Finally, we identified several open challenges, including efficient memory feature updating, support for open-vocabulary and multi-modal settings, and prior-guided motion estimation for real-time inference, aiming for robust handling of fast motion, motion blur, occlusions, visually similar objects, and cross- or multi-modal VOST scenarios. We also conclude by outlining promising directions for future research to advance long-term and real-time video object segmentation. This survey provides a timely and structured overview of the field, aiming to guide researchers and practitioners in advancing the state of VOST through the lens of foundation models. We provide a public website compiling representative works, datasets, and download links: https://github.com/apple1986/sam_vost.

Indexed as

MemorySegment AnythingSegmentationVideo Object Segmentation and Tracking

Identifiers

PMID42877609
PMCPMC13663583

What OpenQuestion holds

Textmetadata
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.