Evidence map›Paper›PMID 30180167›Full record

ArticlePloS one2018

Cross-laboratory evaluation of multiplex bead assays including independent common reference standards for immunological monitoring of observational and interventional human studies.

Krista E van Meijgaarden, Bhagwati Khatri, Steven G Smith, Anne M F H Drittij, Roelof A de Paus, Jelle J Goeman, Mei M Ho, Hazel M Dockrell, Helen McShane, Simone A Joosten and 1 more

Open access · goldAbstract readEvaluation Study
In one paragraph

Article in PloS one, 2018. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 13 papers.

0numbers the graph read from it
0cells of the map it votes in
13citing papers in PubMed
0.6field-weighted citation impact, top 31% of its field
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

13 citing papers in PubMed, 15 citations in OpenAlex.

  1. Trial
  2. Review
  3. Review
  4. Strategies for Multiplexing Plasmonic Biosensing.Sensors (Basel, Switzerland) · 2026
    Review
  5. Article
  6. Article
  7. Article
  8. Biomarkers to identifyThe European respiratory journal · 2022
    Article
  9. Observational
  10. Article
  11. Article
  12. Article
  13. Cell-Mediated Immune Responses toFrontiers in immunology · 2020
    Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

11 authors at 4 institutions in 2 countries.

Krista E van MeijgaardenDepartment of Infectious Diseases, Leiden University Medical Center, Leiden, The Netherlands.ORCID 0000-0003-2818-9805
Bhagwati KhatriBacteriology Division, Medicines and Healthcare Products Regulatory Agency-National Institute for Biological Standards and Controls, South Mimms, Potters Bar, Hertfordshire, United Kingdom.
Steven G SmithDepartment of Immunology and Infection, London School of Hygiene and Tropical Medicine, Keppel Street, London, United Kingdom.
Anne M F H DrittijDepartment of Infectious Diseases, Leiden University Medical Center, Leiden, The Netherlands.
Roelof A de PausDepartment of Infectious Diseases, Leiden University Medical Center, Leiden, The Netherlands.
Jelle J GoemanDepartment of Medical Statistics and Bioinformatics, Leiden University Medical Center, Leiden, The Netherlands.
Mei M HoBacteriology Division, Medicines and Healthcare Products Regulatory Agency-National Institute for Biological Standards and Controls, South Mimms, Potters Bar, Hertfordshire, United Kingdom.
Hazel M DockrellDepartment of Immunology and Infection, London School of Hygiene and Tropical Medicine, Keppel Street, London, United Kingdom.
Helen McShaneThe Jenner Institute, University of Oxford, Oxford, United Kingdom.
Simone A JoostenDepartment of Infectious Diseases, Leiden University Medical Center, Leiden, The Netherlands.
Tom H M OttenhoffDepartment of Infectious Diseases, Leiden University Medical Center, Leiden, The Netherlands.
Leiden University Medical Center · NLLondon School of Hygiene & Tropical Medicine · GBNational Institute for Biological Standards and Control · GBUniversity of Oxford · GB

Funding

No grant is acknowledged in the PubMed record.

6 · The paper itself

Abstract

backgroundMultiplex assays are increasingly applied to analyze multicomponent signatures of human immune responses, including the dynamics of cytokine and chemokine production, in observational as well as interventional studies following treatment or vaccination. However, relatively limited information is available on the performance of the different available multiplex kits, and comparative evaluations addressing this important issue are lacking. STUDY

designTo fill this knowledge gap we performed a technical comparison of multiplex bead assays from 4 manufacturers, each represented by 3 different lots, and with the assays performed by 3 different laboratories. To cross compare kits directly, spiked samples, biological samples and a newly made reference standard were included in all assays. Analyses were performed on 324 standard curves to allow for evaluation of the quality of the standard curves and the subsequent interpretation of biological specimens.

resultsManufacturer was the factor which contributed most to the observed variation whereas variation in lots, laboratory or type of detection reagent contributed minimally. Inclusion of a common reference standard allowed us to overcome observed differences in cytokine and chemokine levels between manufacturers.

conclusionsWe strongly recommend using multiplex assays from the same manufacturer within a single study and across studies that are likely to compare results in a quantitative manner. Incorporation of common reference standards, and application of the same analysis method in assays can overcome many analytical biases and thus could bridge comparison of independent immune profiling (e.g. vaccine immunogenicity) studies. With these recommendations taken into account, the multiplex bead assays performed as described here are useful tools in capturing complex human immune-signatures in observational and interventional studies.

Indexed as

CytokinesFemaleFluoroimmunoassayHumansMaleReagent Kits, DiagnosticReference StandardsCytokinesReagent Kits, Diagnostic

Identifiers

PMID30180167
PMCPMC6122788
OpenAlexW2890425018

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.