Evidence map›Paper›PMID 30890172›Full record

ArticleGenome biology2019

Measuring the reproducibility and quality of Hi-C data.

Galip Gürkan Yardımcı, Hakan Ozadam, Michael E G Sauria, Oana Ursu, Koon-Kiu Yan, Tao Yang, Abhijit Chakraborty, Arya Kaul, Bryan R Lajoie, Fan Song and 9 more

Open access · goldAbstract read
In one paragraph

Article in Genome biology, 2019. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 96 papers.

0numbers the graph read from it
0cells of the map it votes in
96citing papers in PubMed
9.1field-weighted citation impact, top 1% of its field
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

96 citing papers in PubMed, 197 citations in OpenAlex.

  1. Article
  2. Article
  3. Article
  4. Article
  5. Article
  6. Article
  7. Article
  8. Article
  9. Article
  10. Article
  11. Article
  12. Article
  13. Article
  14. Article
  15. Review
  16. Article
  17. CWL-Based Analysis Pipeline for Hi-C Data: From FASTQ Files to Matrices.Methods in molecular biology (Clifton, N.J.) · 2025
    Article
  18. Article
  19. Article
  20. Article

36 more citing papers are in PubMed but not listed here.

4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

19 authors at 9 institutions in 1 country.

Galip Gürkan YardımcıDepartment of Genome Sciences, University of Washington, Seattle, USA.
Hakan OzadamProgram in Systems Biology, University of Massachusetts Medical School, Worcester, USA.
Michael E G SauriaBiology Department, Johns Hopkins University, Baltimore, USA.
Oana UrsuDepartment of Genetics, Stanford University, Stanford, USA.
Koon-Kiu YanDepartment of Computational Biology, St. Jude Children's Research Hospital, Memphis, USA.
Tao YangBioinformatics and Genomics Program, Huck Institutes of the Life Sciences, Penn State University, State College, USA.
Abhijit ChakrabortyComputational Biology Division, La Jolla Institute for Allergy and Immunology, San Diego, USA.
Arya KaulComputational Biology Division, La Jolla Institute for Allergy and Immunology, San Diego, USA.
Bryan R LajoieProgram in Systems Biology, University of Massachusetts Medical School, Worcester, USA.
Fan SongBioinformatics and Genomics Program, Huck Institutes of the Life Sciences, Penn State University, State College, USA.
Ye ZhanUniversity of Massachusetts Medical School, Worcester, USA.
Ferhat AyComputational Biology Division, La Jolla Institute for Allergy and Immunology, San Diego, USA.
Mark GersteinProgram in Computational Biology and Bioinformatics, Yale University, New Haven, USA.
Anshul KundajeDepartment of Genetics, Stanford University, Stanford, USA.
Qunhua LiDepartment of Statistics, Penn State University, State College, USA.
James TaylorBiology Department, Johns Hopkins University, Baltimore, USA.
Feng YueBioinformatics and Genomics Program, Huck Institutes of the Life Sciences, Penn State University, State College, USA.
Job DekkerProgram in Systems Biology, University of Massachusetts Medical School, Worcester, USA. job.dekker@umassmed.edu.
William S NobleDepartment of Genome Sciences, University of Washington, Seattle, USA. william-noble@uw.edu.ORCID 0000-0001-7283-4715
Pennsylvania State University · USLa Jolla Institute for Immunology · USUniversity of Massachusetts Chan Medical School · USJohns Hopkins University · USStanford University · USUniversity of Washington · USHoward Hughes Medical Institute · USSt. Jude Children's Research Hospital · USYale University · US

Funding

A Data Coordinating Center for ENCODEU24HG009397 · NHGRI · STANFORD UNIVERSITY · PI CHERRY, J. MICHAEL · 2017 to 2023
$26.0M
Structural Annotation of the Human GenomeR01HG003143 · NHGRI · UNIV OF MASSACHUSETTS MED SCH WORCESTER · PI Job Dekker · 2003 to 2026
$15.4M
A Comprehensive catalog of human DNasel hypersensitive sitesU54HG004592 · NHGRI · UNIVERSITY OF WASHINGTON · PI STAMATOYANNOPOULOS, JOHN A · 2007 to 2011
$15.0M
Center for 3D Structure and Physics of the GenomeU54DK107980 · NIDDK · UNIV OF MASSACHUSETTS MED SCH WORCESTER · PI DEKKER, JOB, MIRNY, LEONID A · 2015 to 2019
$14.9M
Democratization of Data Analysis in Life Sciences Through GalaxyU41HG006620 · NHGRI · PENNSYLVANIA STATE UNIVERSITY, THE · PI NEKRUTENKO, ANTON, SCHATZ, MICHAEL · 2012 to 2020
$14.4M
EDAC: ENCODE Data Analysis CenterU24HG009446 · NHGRI · UNIV OF MASSACHUSETTS MED SCH WORCESTER · PI GERSTEIN, MARK BENDER, WENG, ZHIPING · 2017 to 2022
$10.4M
EDAC: ENCODE Data Analysis CenterU41HG007000 · NHGRI · UNIV OF MASSACHUSETTS MED SCH WORCESTER · PI WENG, ZHIPING · 2012 to 2016
$9.8M
VISION: ValIdated Systematic IntegratiON of epigenomic dataR24DK106766 · NIDDK · PENNSYLVANIA STATE UNIVERSITY, THE · PI BLOBEL, GERD A, BODINE, DAVID M. · 2016 to 2020
$6.2M
Computation, Bioinformatics, and Statistics (CBIOS) Training ProgramT32GM102057 · NIGMS · PENNSYLVANIA STATE UNIVERSITY, THE · PI CHIAROMONTE, FRANCESCA, GIRIRAJAN, SANTHOSH · 2013 to 2022
$2.7M
Statistical methods for improving reproducibility and utility of sequencing dataR01GM109453 · NIGMS · PENNSYLVANIA STATE UNIVERSITY, THE · PI LI, QUNHUA · 2013 to 2022
$2.3M
Computational methods for modeling lineage-specific gene regulationR01ES025009 · NIEHS · STANFORD UNIVERSITY · PI PRITCHARD, JONATHAN K · 2014 to 2016
$788k
Howard Hughes Medical Institute Howard Hughes Medical Institute International Student Research Fellowship and a Gabilan Stanford Graduate FellowshipNHGRI NIH HHS HG003143NHGRI NIH HHS HG004592NHGRI NIH HHS R01 HG003143NHGRI NIH HHS U24 HG009397NHGRI NIH HHS U24HG009397NHGRI NIH HHS U24 HG009446NHGRI NIH HHS U24HG009446NHGRI NIH HHS U41 HG006620NHGRI NIH HHS U41 HG007000NHGRI NIH HHS U41HG007000NHGRI NIH HHS U54 HG004592NIDDK NIH HHS DK107980NIDDK NIH HHS R24 DK106766NIDDK NIH HHS U54 DK107980NIEHS NIH HHS R01 ES025009NIEHS NIH HHS R01ES025009-02S1NIGMS NIH HHS R01 GM109453NIGMS NIH HHS R01GM109453NIGMS NIH HHS T32 GM102057NIH HHS DP2OD022870
6 · The paper itself

Abstract

backgroundHi-C is currently the most widely used assay to investigate the 3D organization of the genome and to study its role in gene regulation, DNA replication, and disease. However, Hi-C experiments are costly to perform and involve multiple complex experimental steps; thus, accurate methods for measuring the quality and reproducibility of Hi-C data are essential to determine whether the output should be used further in a study.

resultsUsing real and simulated data, we profile the performance of several recently proposed methods for assessing reproducibility of population Hi-C data, including HiCRep, GenomeDISCO, HiC-Spector, and QuASAR-Rep. By explicitly controlling noise and sparsity through simulations, we demonstrate the deficiencies of performing simple correlation analysis on pairs of matrices, and we show that methods developed specifically for Hi-C data produce better measures of reproducibility. We also show how to use established measures, such as the ratio of intra- to interchromosomal interactions, and novel ones, such as QuASAR-QC, to identify low-quality experiments.

conclusionsIn this work, we assess reproducibility and quality measures by varying sequencing depth, resolution and noise levels in Hi-C data from 13 cell lines, with two biological replicates each, as well as 176 simulated matrices. Through this extensive validation and benchmarking of Hi-C data, we describe best practices for reproducibility and quality assessment of Hi-C experiments. We make all software publicly available at http://github.com/kundajelab/3DChromatin_ReplicateQC to facilitate adoption in the community.

Indexed as

Quality ControlSoftwareGenomicsHigh-Throughput Nucleotide SequencingHumansNeoplasmsReproducibility of ResultsTumor Cells, Cultured

Identifiers

PMID30890172
PMCPMC6423771
OpenAlexW2951050465

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.