Evidence map›Paper›PMID 35585485›Full record

ArticleBMC bioinformatics2022

Evaluation of statistical approaches for association testing in noisy drug screening data.

Petr Smirnov, Ian Smith, Zhaleh Safikhani, Wail Ba-Alawi, Farnoosh Khodakarami, Eva Lin, Yihong Yu, Scott Martin, Janosch Ortmann, Tero Aittokallio and 2 more

Abstract read
In one paragraph

Article in BMC bioinformatics, 2022. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 8 papers.

0numbers the graph read from it
0cells of the map it votes in
8citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

8 citing papers in PubMed.

  1. Review
  2. Article
  3. Article
  4. Article
  5. Article
  6. Article
  7. Article
  8. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

12 authors.

Petr Smirnov *Department of Medical Biophysics, University of Toronto, Toronto, Canada.
Ian Smith *Department of Medical Biophysics, University of Toronto, Toronto, Canada.
Zhaleh SafikhaniPrincess Margaret Cancer Center, University Health Network, Toronto, Canada.
Wail Ba-AlawiPrincess Margaret Cancer Center, University Health Network, Toronto, Canada.
Farnoosh KhodakaramiPrincess Margaret Cancer Center, University Health Network, Toronto, Canada.
Eva LinDepartment of Discovery Oncology, Genentech Inc., South San Francisco, USA.
Yihong YuDepartment of Discovery Oncology, Genentech Inc., South San Francisco, USA.
Scott MartinDepartment of Discovery Oncology, Genentech Inc., South San Francisco, USA.
Janosch OrtmannDépartement d'analytique, opérations et technologies de l'information, École des sciences de la gestion, Université du Québec à Montréal, Montréal, Canada.
Tero AittokallioInstitute for Molecular Medicine Finland (FIMM), Helsinki Institute of Life Science (HiLIFE), University of Helsinki, Helsinki, Finland.
Marc HafnerDepartment of Oncology Bioinformatics, Genentech Inc., South San Francisco, USA.
Benjamin Haibe-KainsDepartment of Medical Biophysics, University of Toronto, Toronto, Canada. bhaibeka@uhnresearch.ca.

Funding

No grant is acknowledged in the PubMed record.

6 · The paper itself

Abstract

backgroundIdentifying associations among biological variables is a major challenge in modern quantitative biological research, particularly given the systemic and statistical noise endemic to biological systems. Drug sensitivity data has proven to be a particularly challenging field for identifying associations to inform patient treatment.

resultsTo address this, we introduce two semi-parametric variations on the commonly used concordance index: the robust concordance index and the kernelized concordance index (rCI, kCI), which incorporate measurements about the noise distribution from the data. We demonstrate that common statistical tests applied to the concordance index and its variations fail to control for false positives, and introduce efficient implementations to compute p-values using adaptive permutation testing. We then evaluate the statistical power of these coefficients under simulation and compare with Pearson and Spearman correlation coefficients. Finally, we evaluate the various statistics in matching drugs across pharmacogenomic datasets.

conclusionsWe observe that the rCI and kCI are better powered than the concordance index in simulation and show some improvement on real data. Surprisingly, we observe that the Pearson correlation was the most robust to measurement noise among the different metrics.

Indexed as

Models, StatisticalComputer SimulationDrug Evaluation, PreclinicalHumansAssociation testingBiomarkerDrug sensitivityNon-parametric statisticsPharmacogenomicsPower analysisStatistics

Identifiers

PMID35585485
PMCPMC9118710

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.