Evidence map›Paper›PMID 39961605›Full record

ArticleHistopathology2025

Comparative performance of PD-L1 scoring by pathologists and AI algorithms.

Markus Plass, Gheorghe-Emilian Olteanu, Sanja Dacic, Izidor Kern, Martin Zacharias, Helmut Popper, Junya Fukuoka, Sosuke Ishijima, Michaela Kargl, Christoph Murauer and 2 more

Abstract readComparative Study
In one paragraph

Article in Histopathology, 2025. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 12 papers.

0numbers the graph read from it
0cells of the map it votes in
12citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

12 citing papers in PubMed.

  1. Article
  2. Article
  3. Review
  4. Article
  5. Review
  6. Endometrial immune dysregulation shapes CD8Frontiers in immunology · 2026
    Article
  7. Article
  8. Article
  9. Article
  10. Review
  11. Article
  12. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

12 authors.

Markus PlassDiagnostic and Research Institute of Pathology, Medical University of Graz, Graz, Austria.ORCID https://orcid.org/0000-0003-2718-7648
Gheorghe-Emilian OlteanuDepartment of Pathology, British Columbia Cancer Agency, Vancouver, BC, Canada.ORCID https://orcid.org/0000-0001-5921-4634
Sanja DacicUniversity of Pittsburgh Medical Center, Pittsburgh, PA, USA.ORCID https://orcid.org/0000-0003-4197-3354
Izidor KernCytology and Pathology Laboratory, University Clinic of Respiratory and Allergic Diseases, Golnik, Slovenia.ORCID https://orcid.org/0000-0002-2418-5025
Martin ZachariasDiagnostic and Research Institute of Pathology, Medical University of Graz, Graz, Austria.ORCID https://orcid.org/0000-0003-3021-1047
Helmut PopperDiagnostic and Research Institute of Pathology, Medical University of Graz, Graz, Austria.ORCID https://orcid.org/0000-0003-4970-1265
Junya FukuokaDepartment of Pathology Informatics, Nagasaki University Graduate School of Biomedical Sciences, Nagasaki, Japan.ORCID https://orcid.org/0000-0002-2496-3050
Sosuke IshijimaDepartment of Pathology Informatics, Nagasaki University Graduate School of Biomedical Sciences, Nagasaki, Japan.ORCID https://orcid.org/0009-0001-1279-5432
Michaela KarglDiagnostic and Research Institute of Pathology, Medical University of Graz, Graz, Austria.ORCID https://orcid.org/0000-0001-8431-9710
Christoph MurauerDiagnostic and Research Institute of Pathology, Medical University of Graz, Graz, Austria.
Lipika KalsonDiagnostic and Research Institute of Pathology, Medical University of Graz, Graz, Austria.ORCID https://orcid.org/0009-0007-1150-2814
Luka BrcicDiagnostic and Research Institute of Pathology, Medical University of Graz, Graz, Austria.ORCID https://orcid.org/0000-0002-9098-8416

Funding

Austrian Science FundEuropean Commission
6 · The paper itself

Abstract

aimThis study evaluates the comparative effectiveness of pathologists versus artificial intelligence (AI) algorithms in scoring PD-L1 expression in non-small cell lung carcinoma (NSCLC). Immune-checkpoint inhibitors have revolutionized NSCLC treatment, with PD-L1 expression, measured as the tumour proportion score (TPS), serving as a critical predictive biomarker for therapeutic response. METHODS AND

resultsIn our analysis, 51 SP263-stained NSCLC cases were scored by six pathologists using light microscopy and whole-slide images (WSI), alongside evaluations by two commercially available software tools: uPath software (Roche) and the PD-L1 Lung Cancer TME application (Visiopharm). The study examined intra- and interobserver agreement among pathologists at TPS cutoffs of 1% and 50%, revealing moderate interobserver agreement (Fleiss' kappa 0.558) for TPS <1% and almost perfect agreement (Fleiss' kappa 0.873) for TPS ≥50%. Intraobserver consistency was high, with Cohen's kappa ranging from 0.726 to 1.0. Comparisons between the AI algorithms and the median pathologist scores showed fair agreement for uPath (Fleiss' kappa 0.354) and substantial agreement for the Visiopharm application (Fleiss' kappa 0.672) at the 50% TPS cutoff.

conclusionThese results indicate that while there is strong interobserver concordance among pathologists at higher TPS levels, the performance of AI algorithms is less consistent. The study underscores the need for further refinement of AI tools to match the reliability of expert human evaluation, particularly in critical clinical decision-making contexts.

Indexed as

AlgorithmsArtificial IntelligenceB7-H1 AntigenBiomarkers, TumorCarcinoma, Non-Small-Cell LungLung NeoplasmsHumansImmunohistochemistryObserver VariationPathologistsB7-H1 AntigenBiomarkers, TumorCD274 protein, humanAI algorithmsNSCLCpathologistsPD‐L1 expressiontumour proportion score (TPS)

Identifiers

PMID39961605
PMCPMC12129605

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.