Evidence map›Paper›PMID 41922702›Full record

ArticleNature2026

General scales unlock AI evaluation with explanatory and predictive power.

Lexin Zhou, Lorenzo Pacchiardi, Fernando Martínez-Plumed, Katherine M Collins, Yael Moros-Daval, Seraphina Zhang, Qinlin Zhao, Yitian Huang, Luning Sun, Jonathan E Prunty and 16 more

Abstract read
In one paragraph

Article in Nature, 2026. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Not yet cited in PubMed.

0numbers the graph read from it
0cells of the map it votes in
0citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

0 citing papers in PubMed.

No citing paper in PubMed yet.

4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

26 authors.

Lexin ZhouPrinceton University, Princeton, NJ, USA. lz5066@princeton.edu.ORCID 0000-0003-1161-4270
Lorenzo PacchiardiLeverhulme Centre for the Future of Intelligence, University of Cambridge, Cambridge, UK.ORCID 0000-0003-4760-7638
Fernando Martínez-PlumedValencian Research Institute for Artificial Intelligence (VRAIN), Universitat Politècnica de València, València, Spain.ORCID 0000-0003-2902-6477
Katherine M CollinsDepartment of Engineering, University of Cambridge, Cambridge, UK.ORCID 0000-0002-7032-716X
Yael Moros-DavalValencian Research Institute for Artificial Intelligence (VRAIN), Universitat Politècnica de València, València, Spain.ORCID 0000-0001-5442-2055
Seraphina ZhangLeverhulme Centre for the Future of Intelligence, University of Cambridge, Cambridge, UK.ORCID 0009-0009-3587-385X
Qinlin ZhaoMicrosoft Research Asia, Beijing, China.
Yitian HuangMicrosoft Research Asia, Beijing, China.
Luning SunThe Psychometrics Centre, University of Cambridge, Cambridge, UK.ORCID 0000-0002-2470-4278
Jonathan E PruntyLeverhulme Centre for the Future of Intelligence, University of Cambridge, Cambridge, UK.ORCID 0000-0002-9180-1932
Zongqian LiDepartment of Theoretical and Applied Linguistics, University of Cambridge, Cambridge, UK.
Pablo Sánchez-GarcíaKU Leuven, Leuven, Belgium.
Kexin Jiang-ChenValencian Research Institute for Artificial Intelligence (VRAIN), Universitat Politècnica de València, València, Spain.ORCID 0009-0005-2492-6531
Pablo A M CasaresValencian Research Institute for Artificial Intelligence (VRAIN), Universitat Politècnica de València, València, Spain.ORCID 0000-0001-5500-9115
Jiyun ZuEducational Testing Service, Princeton, NJ, USA.
John BurdenLeverhulme Centre for the Future of Intelligence, University of Cambridge, Cambridge, UK.
Behzad MehrbakhshValencian Research Institute for Artificial Intelligence (VRAIN), Universitat Politècnica de València, València, Spain.ORCID 0000-0001-9017-989X
David StillwellThe Psychometrics Centre, University of Cambridge, Cambridge, UK.
Manuel CebrianCenter for Automation and Robotics (CAR), Spanish National Research Council (CSIC-UPM), Madrid, Spain.ORCID 0000-0002-3681-7982
Jindong WangWilliam & Mary, Williamsburg, VA, USA.
Peter HendersonPrinceton University, Princeton, NJ, USA.
Sherry Tongshuang WuCarnegie Mellon University, Pittsburgh, PA, USA.
Patrick C KyllonenEducational Testing Service, Princeton, NJ, USA.
Lucy ChekeLeverhulme Centre for the Future of Intelligence, University of Cambridge, Cambridge, UK.
Xing XieMicrosoft Research Asia, Beijing, China. xing.xie@microsoft.com.ORCID 0009-0009-3257-3077
José Hernández-OralloLeverhulme Centre for the Future of Intelligence, University of Cambridge, Cambridge, UK. josephorallo@gmail.com.ORCID 0000-0001-9746-7632

Funding

Microsoft Accelerate Foundation Models Research
6 · The paper itself

Abstract

Ensuring safe and effective use of artificial intelligence (AI) requires understanding and anticipating its performance on new tasks, from advanced scientific challenges to transformed workplace activities

Indexed as

Artificial IntelligenceBenchmarkingCognitionHumansLarge Language ModelsReproducibility of ResultsTask Performance and Analysis

Identifiers

PMID41922702
PMCPMC13043289

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.