Evidence map›Paper›PMID 35695837›Full record

ArticleIEEE transactions on information theory2021

How to reduce dimension with PCA and random projections?

Fan Yang, Sifan Liu, Edgar Dobriban, David P Woodruff

Abstract read
In one paragraph

Article in IEEE transactions on information theory, 2021. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 5 papers, 1 of them a synthesis that pooled it.

0numbers the graph read from it
0cells of the map it votes in
5citing papers in PubMed, 1 pooled it
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

5 citing papers in PubMed, 1 synthesis or guideline pooled it.

  1. Pooled it
  2. Article
  3. Robust angle-based transfer learning in high dimensions.Journal of the Royal Statistical Society. Series B, Statistical methodology · 2025
    Article
  4. Article
  5. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

4 authors.

Fan YangWharton Statistics Department, University of Pennsylvania, Philadelphia, PA 19104, USA.
Sifan LiuDepartment of Statistics, Stanford University, Stanford, CA 94305, USA.
Edgar DobribanWharton Statistics Department, University of Pennsylvania, Philadelphia, PA 19104, USA.
David P WoodruffDepartment of Computer Science, Carnegie Mellon University, Pittsburgh, PA 15213, USA.

Funding

Secure and Privacy-preserving Genome-wide and Phenome-wide Association Studies via Intel Software Guard Extensions (SGX)R01HG010798 · NHGRI · TRUSTEES OF INDIANA UNIVERSITY · PI TANG, HAIXU, WANG, XIAOFENG · 2019 to 2022
$1.4M
NHGRI NIH HHS R01 HG010798
6 · The paper itself

Abstract

In our "big data" age, the size and complexity of data is steadily increasing. Methods for dimension reduction are ever more popular and useful. Two distinct types of dimension reduction are "data-oblivious" methods such as random projections and sketching, and "data-aware" methods such as principal component analysis (PCA). Both have their strengths, such as speed for random projections, and data-adaptivity for PCA. In this work, we study how to combine them to get the best of both. We study "sketch and solve" methods that take a random projection (or sketch) first, and compute PCA after. We compute the performance of several popular sketching methods (random iid projections, random sampling, subsampled Hadamard transform, CountSketch, etc) in a general "signal-plus-noise" (or spiked) data model. Compared to well-known works, our results (1) give asymptotically exact results, and (2) apply when the signal components are only slightly above the noise, but the projection dimension is non-negligible. We also study stronger signals allowing more general covariance structures. We find that (a) signal strength decreases under projection in a delicate way depending on the structure of the data and the sketching method, (b) orthogonal projections are slightly more accurate, (c) randomization does not hurt too much, due to concentration of measure, (d) CountSketch can be somewhat improved by a normalization method. Our results have implications for statistical learning and data analysis. We also illustrate that the results are highly accurate in simulations and in analyzing empirical data.

Indexed as

Dimension reductionprincipal component analysisrandom matrix theoryrandom projectionsketching

Identifiers

PMID35695837
PMCPMC9173709

What OpenQuestion holds

Textmetadata
LicenceTDM
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.