Evidence map›Paper›PMID 33204215›Full record

ArticleJournal of artificial societies and social simulation : JASSS2020

Leveraging Modularity During Replication of High-Fidelity Models: Lessons from Replicating an Agent-Based Model for HIV Prevention.

Wouter Vermeer, Arthur Hjorth, Samuel M Jenness, Hendrick Brown, Uri Wilensky

Abstract read
In one paragraph

Article in Journal of artificial societies and social simulation : JASSS, 2020. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 22 papers.

0numbers the graph read from it
0cells of the map it votes in
22citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

22 citing papers in PubMed.

  1. Article
  2. Review
  3. Article
  4. Article
  5. Article
  6. Article
  7. Article
  8. Article
  9. Article
  10. Article
  11. High-Fidelity Agent-Based Modeling to Support Prevention Decision-Making: an Open Science Approach.Prevention science : the official journal of the Society for Prevention Research · 2022
    Article
  12. Review
  13. Article
  14. Article
  15. Article
  16. Article
  17. Article
  18. Article
  19. Article
  20. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

5 authors.

Wouter VermeerDepartment of Psychiatry and Behavioral Sciences, Feinberg School of Medicine, Northwestern University, 750 N lakeshore Dr, Chicago, IL 60611, United States.
Arthur HjorthCenter for Hybrid Intelligence, Department of Management, Aarhus University Fuglesangs Allé 4, Aarhus V, DK - 8210, Denmark.
Samuel M JennessDepartment of Epidemiology, Rollins School of Public Health, Emory University, 1520 Clifton Road, Atlanta, GA 30322, United States.
Hendrick BrownDepartment of Psychiatry and Behavioral Sciences, Feinberg School of Medicine, Northwestern University, 750 N lakeshore Dr, Chicago, IL 60611, United States.
Uri WilenskySchool of Social Policy and Education, Northwestern University, 2120 Campus Dr Evanston, IL 60208, United States.

Funding

EpiModel 2.0: Integrated Network Models for HIV/STI Prevention ScienceR01AI138783 · NIAID · EMORY UNIVERSITY · PI JENNESS, SAMUEL · 2018 to 2021
$3.0M
NIAID NIH HHS R01 AI138783
6 · The paper itself

Abstract

High-fidelity models are increasingly used to predict, and guide decision making. Prior work has emphasized the importance of replication in ensuring reliable modeling, and has yielded important replication strategies. However, this work is based on relatively simple theory generating models, and its lessons might not translate to high-fidelity models used for decision support. Using NetLogo we replicate a recently published high-fidelity model examining the effects of a HIV biomedical intervention. We use a modular approach to build our model from the ground up, and provide examples of the replication process investigating the replication of two sub-modules as well as the overall simulation experiment. For the first module, we achieved numerical identity during replication, whereas we obtained distributional equivalence in replicating the second module. We achieved relational equivalence among the overall model behaviors, with a 0.98 correlation across the two implementations for our outcome measure even without strictly following the original model in the formation of the sexual network. Our results show that replication of high-fidelity models is feasible when following a set of systematic strategies that leverage the modularity, and highlight the role of replication standards, modular testing, and functional code in facilitating such strategies.

Indexed as

Agent-Based ModelsHigh-FidelityHIVModularReplication

Identifiers

PMID33204215
PMCPMC7668565

What OpenQuestion holds

Textmetadata
LicenceTDM
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.