Evidence map›Paper›PMID 42841223›Full record

ArticleRisk analysis : an official publication of the Society for Risk Analysis2026

Socio-Technical Risk-Informed AI-Driven Automation Trustworthiness Evaluation (ST-RATE): Part 1-Conceptualization.

Muhammad Hammad Khalid, Ha Bui, Ahmad Al Rashdan, Zahra Mohaghegh

Abstract read
In one paragraph

Article in Risk analysis : an official publication of the Society for Risk Analysis, 2026. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Not yet cited in PubMed.

0numbers the graph read from it
0cells of the map it votes in
0citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

0 citing papers in PubMed.

No citing paper in PubMed yet.

4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

4 authors.

Muhammad Hammad KhalidSocio-Technical Risk Analysis (SoTeRiA) Laboratory, Urbana, Illinois, USA.ORCID https://orcid.org/0000-0002-2027-6659
Ha BuiSocio-Technical Risk Analysis (SoTeRiA) Laboratory, Urbana, Illinois, USA.
Ahmad Al RashdanIdaho National Laboratory (INL), Idaho Falls, Idaho, USA.
Zahra MohagheghSocio-Technical Risk Analysis (SoTeRiA) Laboratory, Urbana, Illinois, USA.

Funding

U.S. Department of Energy (DOE) through the Nuclear Energy University Program (NEUP) Federal Grant Number: DE-NE-0009201U.S. Department of Energy (DOE) through the Nuclear Energy University Program (NEUP) Project ID: 21-24380
6 · The paper itself

Abstract

The growing integration of artificial intelligence (AI)-driven technologies into nuclear power plant (NPP) operations and maintenance holds significant potential to enhance safety, operational efficiency, and reliability. However, deploying such AI-driven automation technologies in high-consequence settings requires a rigorous, traceable, and risk-informed evaluation of their trustworthiness. Although researchers across various domains have proposed definitions and metrics for AI-driven automation trustworthiness, no agreed-upon formal or quantitative method exists that is suitable for the highly regulated nuclear sector. To address this gap, this paper, the first in a two-part series, presents three contributions: (I) a cross-disciplinary literature review that categorizes existing definitions and evaluation methodologies for AI-driven automation trustworthiness and identifies their inherent limitations with respect to applicability in the nuclear domain; (II) develops a new definition of AI-driven automation trustworthiness as "the degree of confidence that the AI-driven automation system will function as expected across its conditions of use" to address the limitations identified in Contribution I; and (III) building on the new definition, conceptualizes the Socio-Technical Risk-informed AI-driven Automation Trustworthiness Evaluation (ST-RATE) methodology, grounded in three foundational pillars: (a) risk-informed performance expectations, (b) socio-technical context across operational conditions, and (c) uncertainty-based trustworthiness evaluation. While developed primarily for the nuclear domain, the definition and ST-RATE methodology has the potential to be adapted for other safety-critical domains with appropriate modifications. The ST-RATE methodological framework is operationalized and demonstrated through an AI-driven automated firewatch case study in a companion paper (Companion paper Part 2, 2025). ST-RATE is the first-of-its-kind methodology that enables risk-informed and uncertainty-based quantification of trustworthiness despite limited empirical data and without over-reliance on subjective expert judgment, addressing the key limitations of existing approaches identified in the literature review.

Indexed as

AI‐driven automation trustworthinessartificial intelligence (AI)nuclear power plantsrisk‐informedsocio‐technicaluncertainty analysis

Identifiers

PMID42841223
PMCPMC13643605

What OpenQuestion holds

Textmetadata
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.