Evidence map›Paper›PMID 31600197›Full record

ArticlePLoS biology2019

The NIH Open Citation Collection: A public access, broad coverage resource.

B Ian Hutchins, Kirk L Baker, Matthew T Davis, Mario A Diwersy, Ehsanul Haque, Robert M Harriman, Travis A Hoppe, Stephen A Leicht, Payam Meyer, George M Santangelo

Abstract read
In one paragraph

Article in PLoS biology, 2019. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 54 papers, 1 of them a synthesis that pooled it.

0numbers the graph read from it
0cells of the map it votes in
54citing papers in PubMed, 1 pooled it
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

54 citing papers in PubMed, 1 synthesis or guideline pooled it.

  1. Pooled it
  2. Review
  3. Article
  4. Article
  5. Review
  6. Article
  7. Article
  8. Productivity of National Cancer Institute K Awardees and Their Transition to Independent Funding.Journal of cancer education : the official journal of the American Association for Cancer Education · 2025
    Article
  9. Prediction of transformative breakthroughs in biomedical research.bioRxiv : the preprint server for biology · 2025
    Article
  10. Article
  11. Article
  12. Article
  13. Article
  14. Article
  15. IMPC impact on preclinical mouse models.Mammalian genome : official journal of the International Mammalian Genome Society · 2025
    Article
  16. Bibliometrics and National Institutes of Health Funding: Associated Factors in Academic Rhinology.Indian journal of otolaryngology and head and neck surgery : official publication of the Association of Otolaryngologists of India · 2025
    Article
  17. Article
  18. Article
  19. Review
  20. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

10 authors.

B Ian HutchinsOffice of Portfolio Analysis, Division of Program Coordination, Planning, and Strategic Initiatives, Office of the Director, National Institutes of Health, Bethesda, Maryland, United States of America.ORCID 0000-0001-7657-552X
Kirk L BakerOffice of Portfolio Analysis, Division of Program Coordination, Planning, and Strategic Initiatives, Office of the Director, National Institutes of Health, Bethesda, Maryland, United States of America.ORCID 0000-0002-9004-3041
Matthew T DavisOffice of Portfolio Analysis, Division of Program Coordination, Planning, and Strategic Initiatives, Office of the Director, National Institutes of Health, Bethesda, Maryland, United States of America.ORCID 0000-0002-2485-6458
Mario A DiwersyUberResearch GmbH, Cologne, Germany.ORCID 0000-0003-0294-2424
Ehsanul HaqueOffice of Portfolio Analysis, Division of Program Coordination, Planning, and Strategic Initiatives, Office of the Director, National Institutes of Health, Bethesda, Maryland, United States of America.
Robert M HarrimanOffice of Portfolio Analysis, Division of Program Coordination, Planning, and Strategic Initiatives, Office of the Director, National Institutes of Health, Bethesda, Maryland, United States of America.
Travis A HoppeOffice of Portfolio Analysis, Division of Program Coordination, Planning, and Strategic Initiatives, Office of the Director, National Institutes of Health, Bethesda, Maryland, United States of America.
Stephen A LeichtUberResearch GmbH, Cologne, Germany.ORCID 0000-0002-6577-3106
Payam MeyerOffice of Portfolio Analysis, Division of Program Coordination, Planning, and Strategic Initiatives, Office of the Director, National Institutes of Health, Bethesda, Maryland, United States of America.
George M SantangeloOffice of Portfolio Analysis, Division of Program Coordination, Planning, and Strategic Initiatives, Office of the Director, National Institutes of Health, Bethesda, Maryland, United States of America.ORCID 0000-0002-7201-3164

Funding

Intramural NIH HHS Z99 OD999999
6 · The paper itself

Abstract

Citation data have remained hidden behind proprietary, restrictive licensing agreements, which raises barriers to entry for analysts wishing to use the data, increases the expense of performing large-scale analyses, and reduces the robustness and reproducibility of the conclusions. For the past several years, the National Institutes of Health (NIH) Office of Portfolio Analysis (OPA) has been aggregating and enhancing citation data that can be shared publicly. Here, we describe the NIH Open Citation Collection (NIH-OCC), a public access database for biomedical research that is made freely available to the community. This dataset, which has been carefully generated from unrestricted data sources such as MedLine, PubMed Central (PMC), and CrossRef, now underlies the citation statistics delivered in the NIH iCite analytic platform. We have also included data from a machine learning pipeline that identifies, extracts, resolves, and disambiguates references from full-text articles available on the internet. Open citation links are available to the public in a major update of iCite (https://icite.od.nih.gov).

Indexed as

Organizational PolicyBibliometricsBiomedical ResearchHumansInformation DisseminationMachine LearningManuscripts as TopicNational Institutes of Health (U.S.)Open Access PublishingUnited States

Identifiers

PMID31600197
PMCPMC6786512

What OpenQuestion holds

Textmetadata
LicenceCC0
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.