Evidence map›Paper›PMID 35040967›Full record

SynthesisJAMA network open2022

Frequency of Adverse Events in the Placebo Arms of COVID-19 Vaccine Trials: A Systematic Review and Meta-analysis.

Julia W Haas, Friederike L Bender, Sarah Ballou, John M Kelley, Marcel Wilhelm, Franklin G Miller, Winfried Rief, Ted J Kaptchuk

Erratum issuedOpen access · goldAbstract readMeta-AnalysisSystematic Review
In one paragraph

Synthesis in JAMA network open, 2022. The graph could read no effect estimate from its abstract, so it casts no vote on the map. An erratum has been issued. Cited by 72 papers, 4 of them syntheses that pooled it.

0numbers the graph read from it
0cells of the map it votes in
72citing papers in PubMed, 4 pooled it
18.0field-weighted citation impact, top 1% of its field
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

72 citing papers in PubMed, 4 syntheses or guidelines pooled it, 154 citations in OpenAlex.

  1. Pooled it
  2. Pooled it
  3. Pooled it
  4. Pooled it
  5. Trial
  6. Changing Mindsets About Side Effects of the COVID-19 Vaccination: A Randomized Controlled Trial.Annals of behavioral medicine : a publication of the Society of Behavioral Medicine · 2023
    Trial
  7. Trial
  8. Trial
  9. Article
  10. Article
  11. Article
  12. Article
  13. Article
  14. Article
  15. Review
  16. Article
  17. Article
  18. Article
  19. Article
  20. Article

12 more citing papers are in PubMed but not listed here.

4 · The record

Corrections and comments

5 · Who and what money

Authors and funding

8 authors at 4 institutions in 2 countries.

Julia W HaasProgram in Placebo Studies, Beth Israel Deaconess Medical Center, Harvard Medical School, Boston, Massachusetts.
Friederike L BenderDepartment of Clinical Psychology and Psychotherapy, Philipps University Marburg, Marburg, Germany.
Sarah BallouProgram in Placebo Studies, Beth Israel Deaconess Medical Center, Harvard Medical School, Boston, Massachusetts.
John M KelleyProgram in Placebo Studies, Beth Israel Deaconess Medical Center, Harvard Medical School, Boston, Massachusetts.
Marcel WilhelmDepartment of Clinical Psychology and Psychotherapy, Philipps University Marburg, Marburg, Germany.
Franklin G MillerWeill Cornell Medical College, New York, New York.
Winfried RiefDepartment of Clinical Psychology and Psychotherapy, Philipps University Marburg, Marburg, Germany.
Ted J KaptchukProgram in Placebo Studies, Beth Israel Deaconess Medical Center, Harvard Medical School, Boston, Massachusetts.
Beth Israel Deaconess Medical Center · USPhilipps University of Marburg · DECornell University · USHarvard University · US

Funding

No grant is acknowledged in the PubMed record.

6 · The paper itself

Abstract

Importance: Adverse events (AEs) after placebo treatment are common in randomized clinical drug trials. Systematic evidence regarding these nocebo responses in vaccine trials is important for COVID-19 vaccination worldwide especially because concern about AEs is reported to be a reason for vaccination hesitancy. Objective: To compare the frequencies of AEs reported in the placebo groups of COVID-19 vaccine trials with those reported in the vaccine groups. Data Sources: For this systematic review and meta-analysis, the Medline (PubMed) and Cochrane Central Register of Controlled Trials (CENTRAL) databases were searched systematically using medical subheading terms and free-text keywords for trials of COVID-19 vaccines published up to July 14, 2021. Study Selection: Randomized clinical trials of COVID-19 vaccines that investigated adults aged 16 years or older were selected if they assessed solicited AEs within 7 days of injection, included an inert placebo arm, and provided AE reports for both the vaccine and placebo groups separately. Full texts were reviewed for eligibility by 2 independent reviewers. Data Extraction and Synthesis: Data extraction and quality assessment were performed independently by 2 reviewers, adhering to the Preferred Reporting Items for Systematic Reviews and Meta-analyses (PRISMA) guideline and using the Cochrane risk-of-bias tool. Meta-analyses were based on random-effects models. Main Outcomes and Measures: The primary outcomes were the proportions of placebo recipients reporting overall, systemic, and local (injection-site) AEs as well as logarithmic odds ratios (ORs) to evaluate group differences. Outcomes were tested for significance using z tests with 95% CIs. Results: Twelve articles with AE reports for 45 380 participants (22 578 placebo recipients and 22 802 vaccine recipients) were analyzed. After the first dose, 35.2% (95% CI, 26.7%-43.7%) of placebo recipients experienced systemic AEs, with headache (19.3%; 95% CI, 13.6%-25.1%) and fatigue (16.7%; 95% CI, 9.8%-23.6%) being most common. After the second dose, 31.8% (95% CI, 28.7%-35.0%) of placebo recipients reported systemic AEs. The ratio between placebo and vaccine arms showed that nocebo responses accounted for 76.0% of systemic AEs after the first COVID-19 vaccine dose and for 51.8% after the second dose. Significantly more vaccine recipients reported AEs, but the group difference for systemic AEs was small after the first dose (OR, -0.47; 95% CI, -0.54 to -0.40; P < .001; standardized mean difference, -0.26; 95% CI, -0.30 to -0.22) and large after the second dose (OR, -1.36; 95% CI, -1.86 to -0.86; P < .001; standardized mean difference, -0.75; 95% CI, -1.03 to -0.47). Conclusions and Relevance: In this systematic review and meta-analysis, significantly more AEs were reported in vaccine groups compared with placebo groups, but the rates of reported AEs in the placebo arms were still substantial. Public vaccination programs should consider these high rates of AEs in placebo arms.

Indexed as

Arm InjuriesCOVID-19COVID-19 VaccinesFatigueHeadacheHumansInjections, IntramuscularPlacebosSARS-CoV-2COVID-19 VaccinesPlacebos

Identifiers

PMID35040967
PMCPMC8767431
OpenAlexW4206097200

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.