Evidence map›Paper›PMID 33775151›Full record

ArticlePhilosophical transactions. Series A, Mathematical, physical, and engineering sciences2021

VECMAtk: a scalable verification, validation and uncertainty quantification toolkit for scientific simulations.

D Groen, H Arabnejad, V Jancauskas, W N Edeling, F Jansson, R A Richardson, J Lakhlili, L Veen, B Bosak, P Kopta and 16 more

Abstract read
In one paragraph

Article in Philosophical transactions. Series A, Mathematical, physical, and engineering sciences, 2021. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 10 papers.

0numbers the graph read from it
0cells of the map it votes in
10citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

10 citing papers in PubMed.

  1. Uncertainty Quantification forChemical reviews · 2026
    Review
  2. Decoding uncertainty for clinical decision-making.Philosophical transactions. Series A, Mathematical, physical, and engineering sciences · 2025
    Article
  3. Article
  4. Article
  5. Ensemble-Based Approaches Ensure Reliability and Reproducibility.Journal of chemical information and modeling · 2023
    Article
  6. Article
  7. Article
  8. Article
  9. Article
  10. Review
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

26 authors.

D GroenDepartment of Computer Science, Brunel University London, London, UK.
H ArabnejadDepartment of Computer Science, Brunel University London, London, UK.
V JancauskasLeibniz Supercomputing Centre, Garching, Germany.
W N EdelingCentrum Wiskunde and Informatica, Amsterdam, The Netherlands.
F JanssonCentrum Wiskunde and Informatica, Amsterdam, The Netherlands.
R A RichardsonCentre for Computational Science, University College London, London, UK.
J LakhliliMax Planck Institute for Plasma Physics - Garching, Munich, Germany.
L VeenNetherlands eScience Center, Amsterdam, The Netherlands.
B BosakPoznań Supercomputing and Networking Center, Poznań, Poland.
P KoptaPoznań Supercomputing and Networking Center, Poznań, Poland.
D W WrightCentre for Computational Science, University College London, London, UK.
N MonnierCEPP - Center for Excellence in Performance Programming, Atos Bull, Rennes, France.
P KarlshoeferCEPP - Center for Excellence in Performance Programming, Atos Bull, Rennes, France.
D SuleimenovaDepartment of Computer Science, Brunel University London, London, UK.
R SinclairCentre for Computational Science, University College London, London, UK.
M VassauxCentre for Computational Science, University College London, London, UK.
A NikishovaComputational Science Lab, Institute for Informatics, University of Amsterdam, Amsterdam, The Netherlands.
M BieniekCentre for Computational Science, University College London, London, UK.
Onnie O LukMax Planck Institute for Plasma Physics - Garching, Munich, Germany.
M KulczewskiPoznań Supercomputing and Networking Center, Poznań, Poland.
E RaffinCEPP - Center for Excellence in Performance Programming, Atos Bull, Rennes, France.
D CrommelinCentrum Wiskunde and Informatica, Amsterdam, The Netherlands.
O HoenenMax Planck Institute for Plasma Physics - Garching, Munich, Germany.
D P CosterMax Planck Institute for Plasma Physics - Garching, Munich, Germany.
T PiontekPoznań Supercomputing and Networking Center, Poznań, Poland.
P V CoveneyCentre for Computational Science, University College London, London, UK.

Funding

No grant is acknowledged in the PubMed record.

6 · The paper itself

Abstract

We present the VECMA toolkit (VECMAtk), a flexible software environment for single and multiscale simulations that introduces directly applicable and reusable procedures for verification, validation (V&V), sensitivity analysis (SA) and uncertainty quantication (UQ). It enables users to verify key aspects of their applications, systematically compare and validate the simulation outputs against observational or benchmark data, and run simulations conveniently on any platform from the desktop to current multi-petascale computers. In this sequel to our paper on VECMAtk which we presented last year [1] we focus on a range of functional and performance improvements that we have introduced, cover newly introduced components, and applications examples from seven different domains such as conflict modelling and environmental sciences. We also present several implemented patterns for UQ/SA and V&V, and guide the reader through one example concerning COVID-19 modelling in detail. This article is part of the theme issue 'Reliability and reproducibility in computational science: implementing verification, validation and uncertainty quantification

Indexed as

multiscale simulationsuncertainty quantificationvalidationverification

Identifiers

PMID33775151
PMCPMC8059654

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.