Evidence map›Paper›PMID 35274577›Full record

SynthesisHuman factors2024

Agent Transparency, Situation Awareness, Mental Workload, and Operator Performance: A Systematic Literature Review.

Koen van de Merwe, Steven Mallam, Salman Nazir

Abstract readSystematic Review
In one paragraph

Synthesis in Human factors, 2024. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 16 papers, 2 of them syntheses that pooled it.

0numbers the graph read from it
0cells of the map it votes in
16citing papers in PubMed, 2 pooled it
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

16 citing papers in PubMed, 2 syntheses or guidelines pooled it.

  1. Pooled it
  2. Pooled it
  3. Socio-Technical Risk-Informed AI-Driven Automation Trustworthiness Evaluation (ST-RATE): Part 1-Conceptualization.Risk analysis : an official publication of the Society for Risk Analysis · 2026
    Article
  4. Article
  5. Article
  6. Article
  7. Article
  8. Article
  9. Article
  10. Article
  11. Article
  12. Article
  13. How do humans learn about the reliability of automation?Cognitive research: principles and implications · 2024
    Article
  14. Article
  15. Article
  16. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

3 authors.

Koen van de MerweDNV, Høvik, Norway.ORCID 0000-0002-0168-872X
Steven MallamUniversity of South-Eastern Norway, Borre, Norway.ORCID 0000-0003-1713-2977
Salman NazirUniversity of South-Eastern Norway, Borre, Norway.ORCID 0000-0002-2058-6147

Funding

No grant is acknowledged in the PubMed record.

6 · The paper itself

Abstract

objectiveIn this review, we investigate the relationship between agent transparency, Situation Awareness, mental workload, and operator performance for safety critical domains.

backgroundThe advancement of highly sophisticated automation across safety critical domains poses a challenge for effective human oversight. Automation transparency is a design principle that could support humans by making the automation's inner workings observable (i.e., "seeing-into"). However, experimental support for this has not been systematically documented to date.

methodBased on the PRISMA method, a broad and systematic search of the literature was performed focusing on identifying empirical research investigating the effect of transparency on central Human Factors variables.

resultsOur final sample consisted of 17 experimental studies that investigated transparency in a controlled setting. The studies typically employed three human-automation interaction types: responding to agent-generated proposals, supervisory control of agents, and monitoring only. There is an overall trend in the data pointing towards a beneficial effect of transparency. However, the data reveals variations in Situation Awareness, mental workload, and operator performance for specific tasks, agent-types, and level of integration of transparency information in primary task displays.

conclusionOur data suggests a promising effect of automation transparency on Situation Awareness and operator performance, without the cost of added mental workload, for instances where humans respond to agent-generated proposals and where humans have a supervisory role. APPLICATION: Strategies to improve human performance when interacting with intelligent agents should focus on allowing humans to see into its information processing stages, considering the integration of information in existing Human Machine Interface solutions.

Indexed as

AwarenessTask Performance and AnalysisAutomationCognitionHumansMan-Machine SystemsWorkloadautomation transparencyhuman-automation interactioninformation disclosurePRISMAseeing into

Identifiers

PMID35274577
PMCPMC10756021

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.