Evidence map›Paper›PMID 36778584›Full record

ArticleCell genomics2021

Empirical validation of an automated approach to data use oversight.

Moran N Cabili, Jonathan Lawson, Andrea Saltzman, Greg Rushton, Pearl O'Rourke, John Wilbanks, Laura Lyman Rodriguez, Tommi Nyronen, Mélanie Courtot, Stacey Donnelly and 1 more

Abstract read
In one paragraph

Article in Cell genomics, 2021. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 20 papers.

0numbers the graph read from it
0cells of the map it votes in
20citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

20 citing papers in PubMed.

  1. Article
  2. Toward ethical provenance tracking: The GA4GH model data access agreement (DAA).Genetics in medicine : official journal of the American College of Medical Genetics · 2026
    Article
  3. Article
  4. Review
  5. Review
  6. Article
  7. Article
  8. Article
  9. Article
  10. Review
  11. Review
  12. Article
  13. Review
  14. Article
  15. Article
  16. Article
  17. Article
  18. Article
  19. Article
  20. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

11 authors.

Moran N CabiliBroad Institute of Harvard and the Massachusetts Institute of Technology, Cambridge, MA, USA.
Jonathan LawsonBroad Institute of Harvard and the Massachusetts Institute of Technology, Cambridge, MA, USA.
Andrea SaltzmanBroad Institute of Harvard and the Massachusetts Institute of Technology, Cambridge, MA, USA.
Greg RushtonBroad Institute of Harvard and the Massachusetts Institute of Technology, Cambridge, MA, USA.
Pearl O'RourkeMassachusetts General Brigham, Boston, MA, USA.
John WilbanksSage Bionetworks, Seattle, WA, USA.
Laura Lyman RodriguezPatient-Centered Outcomes Research Institute (PCORI), Washington, DC, USA.
Tommi NyronenELIXIR Finland, CSC - IT Center for Science, Espoo, Finland.
Mélanie CourtotEuropean Molecular Biology Laboratory - European Bioinformatics Institute (EMBL-EBI), Hinxton, UK.
Stacey DonnellyBroad Institute of Harvard and the Massachusetts Institute of Technology, Cambridge, MA, USA.
Anthony A PhilippakisBroad Institute of Harvard and the Massachusetts Institute of Technology, Cambridge, MA, USA.

Funding

The AnVIL Data Ecosystem DACReS SupplementU24HG010262 · NHGRI · BROAD INSTITUTE, INC. · PI Robert J Carroll, Jonathan Lawson · 2018 to 2026
$40.5M
NHGRI NIH HHS U24 HG010262Wellcome Trust
6 · The paper itself

Abstract

The current paradigm for data use oversight of biomedical datasets is onerous, extending the timescale and resources needed to obtain access for secondary analyses, thus hindering scientific discovery. For a researcher to utilize a controlled-access dataset, a data access committee must review her research plans to determine whether they are consistent with the data use limitations (DULs) specified by the informed consent form. The newly created GA4GH data use ontology (DUO) holds the potential to streamline this process by making data use oversight computable. Here, we describe an open-source software platform, the Data Use Oversight System (DUOS), that connects with DUO terminology to enable automated data use oversight. We analyze dbGaP data acquired since 2006, finding an exponential increase in data access requests, which will not be sustainable with current manual oversight review. We perform an empirical evaluation of DUOS and DUO on selected datasets from the Broad Institute's data repository. We were able to structure 118/123 of the evaluated DULs (96%) and 52/52 (100%) of research proposals using DUO terminology, and we find that DUOS' automated data access adjudication in all cases agreed with the DAC manual review. This first empirical evaluation of the feasibility of automated data use oversight demonstrates comparable accuracy to human-based data access oversight in real-world data governance.

Indexed as

Data Access CommitteeData UseGA4GHPassport

Identifiers

PMID36778584
PMCPMC9903839

What OpenQuestion holds

Textmetadata
LicenceCC BY-NC-ND
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.