Evidence map›Paper›PMID 30199376›Full record

ArticlePhysiological measurement2018

An open source benchmarked toolbox for cardiovascular waveform and interval analysis.

Adriana N Vest, Giulia Da Poian, Qiao Li, Chengyu Liu, Shamim Nemati, Amit J Shah, Gari D Clifford

Abstract readValidation Study
In one paragraph

Article in Physiological measurement, 2018. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 134 papers, 1 of them a synthesis that pooled it.

0numbers the graph read from it
0cells of the map it votes in
134citing papers in PubMed, 1 pooled it
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

134 citing papers in PubMed, 1 synthesis or guideline pooled it.

  1. Guideline
  2. Trial
  3. Trial
  4. Trial
  5. Article
  6. From electrocardiography to energetics: methods, constraints, and practical considerations for heart rate biologging in small animals.Journal of comparative physiology. B, Biochemical, systemic, and environmental physiology · 2026
    Review
  7. Article
  8. Article
  9. Article
  10. Article
  11. Article
  12. Article
  13. Article
  14. Article
  15. Article
  16. Federated Function-on-function Regression with an Efficient Gradient Boosting Algorithm for Privacy-Preserving Telemedicine.IEEE transactions on automation science and engineering : a publication of the IEEE Robotics and Automation Society · 2026
    Article
  17. Article
  18. Article
  19. Review
  20. Article

74 more citing papers are in PubMed but not listed here.

4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

7 authors.

Adriana N VestDepartment of Biomedical Informatics, Emory University School of Medicine, Woodruff Memorial Research Bldg, Suite 4100, 101 Woodruff Circle, Atlanta, GA 30322, United States of America.ORCID 0000-0001-7889-1956
Giulia Da PoianDepartment of Biomedical Informatics, Emory University School of Medicine, Woodruff Memorial Research Bldg, Suite 4100, 101 Woodruff Circle, Atlanta, GA 30322, United States of America.ORCID 0000-0002-8960-1077
Qiao LiDepartment of Biomedical Informatics, Emory University School of Medicine, Woodruff Memorial Research Bldg, Suite 4100, 101 Woodruff Circle, Atlanta, GA 30322, United States of America.
Chengyu LiuDepartment of Biomedical Informatics, Emory University School of Medicine, Woodruff Memorial Research Bldg, Suite 4100, 101 Woodruff Circle, Atlanta, GA 30322, United States of America.
Shamim NematiDepartment of Biomedical Informatics, Emory University School of Medicine, Woodruff Memorial Research Bldg, Suite 4100, 101 Woodruff Circle, Atlanta, GA 30322, United States of America.
Amit J ShahDepartment of Epidemiology, Rollins School of Public Health at Emory University, 1518 Clifton Road NE, Room 3053, Atlanta, GA 30322, United States of America.
Gari D CliffordDepartment of Biomedical Informatics, Emory University School of Medicine, Woodruff Memorial Research Bldg, Suite 4100, 101 Woodruff Circle, Atlanta, GA 30322, United States of America.

Funding

Research Resource for Complex Physiologic SignalsR01GM104987 · NIGMS · BETH ISRAEL DEACONESS MEDICAL CENTER · PI GOLDBERGER, ARY LOUIS, MARK, ROGER GREENWOOD · 2012 to 2019
$5.8M
PTSD and Ischemic Heart Disease Progression: A Longitudinal Twin StudyR01HL125246 · NHLBI · EMORY UNIVERSITY · PI VACCARINO, VIOLA · 2015 to 2018
$3.4M
Sleep Disturbance as a Mechanism for Ischemic Heart Disease in PTSDR01HL136205 · NHLBI · EMORY UNIVERSITY · PI VACCARINO, VIOLA · 2017 to 2020
$3.1M
Deep Learning and Streaming Analytics for Prediction of Adverse Events in the ICUK01ES025445 · NIEHS · UNIVERSITY OF CALIFORNIA, SAN DIEGO · PI NEMATI, SHAMIM · 2015 to 2019
$951k
Emotional Stress as a Risk Factor for Arrhythmia: Ischemic and Genetic MechanismsK23HL127251 · NHLBI · EMORY UNIVERSITY · PI SHAH, AMIT JASVANT · 2016 to 2019
$749k
Mobile Health Intervention to Improve Perinatal Continuum of Care in GuatemalaR21HD084114 · NICHD · EMORY UNIVERSITY · PI CLIFFORD, GARI DAVID · 2015 to 2016
$374k
NHLBI NIH HHS K23 HL127251NHLBI NIH HHS R01 HL125246NHLBI NIH HHS R01 HL136205NICHD NIH HHS R21 HD084114NIEHS NIH HHS K01 ES025445NIGMS NIH HHS R01 GM104987
6 · The paper itself

Abstract

objectiveThis work aims to validate a set of data processing methods for variability metrics, which hold promise as potential indicators for autonomic function, prediction of adverse cardiovascular outcomes, psychophysiological status, and general wellness. Although the investigation of heart rate variability (HRV) has been prevalent for several decades, the methods used for preprocessing, windowing, and choosing appropriate parameters lacks consensus among academic and clinical investigators. Moreover, many of the important steps are omitted from publications, preventing reproducibility. APPROACH: To address this, we have compiled a comprehensive and open-source modular toolbox for calculating HRV metrics and other related variability indices, on both raw cardiovascular time series and RR intervals. The software, known as the PhysioNet Cardiovascular Signal Toolbox, is implemented in the MATLAB programming language, with standard (open) input and output formats, and requires no external libraries. The functioning of our software is compared with other widely used and referenced HRV toolboxes to identify important differences. MAIN

resultsOur findings demonstrate how modest differences in the approach to HRV analysis can lead to divergent results, a factor that might have contributed to the lack of repeatability of studies and clinical applicability of HRV metrics. SIGNIFICANCE: Existing HRV toolboxes do not include standardized preprocessing, signal quality indices (for noisy segment removal), and abnormal rhythm detection and are therefore likely to lead to significant errors in the presence of moderate to high noise or arrhythmias. We therefore describe the inclusion of validated tools to address these issues. We also make recommendations for default values and testing/reporting.

Indexed as

Heart RateSignal Processing, Computer-AssistedSoftwareAlgorithmsArtifactsAtrial FibrillationBlood Pressure DeterminationComputer SimulationDiagnosis, Computer-AssistedElectrocardiographyHeart Rate DeterminationHumansPhotoplethysmographyReproducibility of Results

Identifiers

PMID30199376
PMCPMC6442742

What OpenQuestion holds

Textmetadata
LicenceTDM
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.