Evidence map›Paper›PMID 39807354›Full record

ArticleGROUP ... : proceedings of the International ACM SIGCHI Conference on Supporting Group Work. ACM SIGCHI International Conference on Supporting Group Work2025

Enhancing the Travel Experience for People with Visual Impairments through Multimodal Interaction: NaviGPT, A Real-Time AI-Driven Mobile Navigation System.

He Zhang, Nicholas J Falletta, Jingyi Xie, Rui Yu, Sooyeon Lee, Syed Masum Billah, John M Carroll

Abstract read
In one paragraph

Article in GROUP ... : proceedings of the International ACM SIGCHI Conference on Supporting Group Work. ACM SIGCHI International Conference on Supporting Group Work, 2025. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 6 papers.

0numbers the graph read from it
0cells of the map it votes in
6citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

6 citing papers in PubMed.

  1. Article
  2. Article
  3. Article
  4. Say It My Way: Exploring Control in Conversational Visual Question Answering with Blind Users.Proceedings of the SIGCHI conference on human factors in computing systems. CHI Conference · 2026
    Article
  5. MapIO: A Gestural and Conversational Interface for Tactile Maps.IEEE access : practical innovations, open solutions · 2025
    Article
  6. Beyond Visual Perception: Insights from Smartphone Interaction of Visually Impaired Users with Large Multimodal Models.Proceedings of the SIGCHI conference on human factors in computing systems. CHI Conference
    Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

7 authors.

He ZhangCollege of Information Sciences and Technology, The Pennsylvania State University, University Park, Pennsylvania, USA.
Nicholas J FallettaCollege of Information Sciences and Technology, The Pennsylvania State University, University Park, Pennsylvania, USA.
Jingyi XieCollege of Information Sciences and Technology, The Pennsylvania State University, University Park, Pennsylvania, USA.
Rui YuDepartment of Computer Science and Engineering, University of Louisville, Louisville, KY, USA.
Sooyeon LeeYing Wu College of Computing, New Jersey Institute of Technology Newark, NJ, USA.
Syed Masum BillahCollege of Information Sciences and Technology, The Pennsylvania State University, University Park, Pennsylvania, USA.
John M CarrollCollege of Information Sciences and Technology, The Pennsylvania State University, University Park, Pennsylvania, USA.

Funding

SCH: INT: Conversations for Vision: Human-Computer Synergies in Prosthetic Interactions R01LM013330 · NLM · PENNSYLVANIA STATE UNIVERSITY, THE · PI CARROLL, JOHN MILLAR · 2019 to 2021
$713k
NLM NIH HHS R01 LM013330
6 · The paper itself

Abstract

Assistive technologies for people with visual impairments (PVI) have made significant advancements, particularly with the integration of artificial intelligence (AI) and real-time sensor technologies. However, current solutions often require PVI to switch between multiple apps and tools for tasks like image recognition, navigation, and obstacle detection, which can hinder a seamless and efficient user experience. In this paper, we present NaviGPT, a high-fidelity prototype that integrates LiDAR-based obstacle detection, vibration feedback, and large language model (LLM) responses to provide a comprehensive and real-time navigation aid for PVI. Unlike existing applications such as Be My AI and Seeing AI, NaviGPT combines image recognition and contextual navigation guidance into a single system, offering continuous feedback on the user's surroundings without the need for app-switching. Meanwhile, NaviGPT compensates for the response delays of LLM by using location and sensor data, aiming to provide practical and efficient navigation support for PVI in dynamic environments.

Indexed as

accessibilityAI-assisted tooldisabilityllmmobile applicationmultimodal interactionnavigationPeople with visual impairmentsprototype

Identifiers

PMID39807354
PMCPMC11727231

What OpenQuestion holds

Textmetadata
LicenceTDM
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.