Evidence map›Paper›PMID 37962940›Full record

Observational studyJMIR infodemiology2023

Addressing Antivaccine Sentiment on Public Social Media Forums Through Web-Based Conversations Based on Motivational Interviewing Techniques: Observational Study.

David Scales, Lindsay Hurth, Wenna Xi, Sara Gorman, Malavika Radhakrishnan, Savannah Windham, Azubuike Akunne, Julia Florman, Lindsey Leininger, Jack Gorman

Open access · goldAbstract readObservational Study
In one paragraph

Observational study in JMIR infodemiology, 2023. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 3 papers, 1 of them a synthesis that pooled it.

0numbers the graph read from it
0cells of the map it votes in
3citing papers in PubMed, 1 pooled it
1.7field-weighted citation impact, top 12% of its field
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

3 citing papers in PubMed, 1 synthesis or guideline pooled it, 3 citations in OpenAlex.

  1. Pooled it
  2. Review
  3. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

10 authors at 3 institutions in 1 country.

David ScalesWeill Cornell Medicine, New York City, NY, United States.ORCID 0000-0001-5727-7148
Lindsay HurthCritica, Bronx, NY, United States.ORCID 0009-0009-1000-8106
Wenna XiWeill Cornell Medicine, New York City, NY, United States.ORCID 0000-0002-5427-5689
Sara GormanCritica, Bronx, NY, United States.ORCID 0009-0000-8255-0310
Malavika RadhakrishnanCritica, Bronx, NY, United States.ORCID 0009-0001-0213-0576
Savannah WindhamCritica, Bronx, NY, United States.ORCID 0009-0002-5732-5191
Azubuike AkunneCritica, Bronx, NY, United States.ORCID 0009-0004-8795-1235
Julia FlormanCritica, Bronx, NY, United States.ORCID 0009-0000-5297-8201
Lindsey LeiningerTuck School of Business, Dartmouth College, Hannover, NH, United States.ORCID 0000-0001-7980-0083
Jack GormanCritica, Bronx, NY, United States.ORCID 0000-0002-5308-5832
The Bronx Defenders · USCornell University · USDartmouth College · US

Funding

No grant is acknowledged in the PubMed record.

6 · The paper itself

Abstract

backgroundHealth misinformation shared on social media can have negative health consequences; yet, there is a dearth of field research testing interventions to address health misinformation in real time, digitally, and in situ on social media.

objectiveWe describe a field study of a pilot program of "infodemiologists" trained with evidence-informed intervention techniques heavily influenced by principles of motivational interviewing. Here we provide a detailed description of the nature of infodemiologists' interventions on posts sharing misinformation about COVID-19 vaccines, present an initial evaluation framework for such field research, and use available engagement metrics to quantify the impact of these in-group messengers on the web-based threads on which they are intervening.

methodsWe monitored Facebook (Meta Platforms, Inc) profiles of news organizations marketing to 3 geographic regions (Newark, New Jersey; Chicago, Illinois; and central Texas). Between December 2020 and April 2021, infodemiologists intervened in 145 Facebook news posts that generated comments containing either false or misleading information about vaccines or overt antivaccine sentiment. Engagement (emojis plus replies) data were collected on Facebook news posts, the initial comment containing misinformation (level 1 comment), and the infodemiologist's reply (level 2 reply comment). A comparison-group evaluation design was used, with numbers of replies, emoji reactions, and engagements for level 1 comments compared with the median metrics of matched comments using the Wilcoxon signed rank test. Level 2 reply comments (intervention) were also benchmarked against the corresponding metric of matched reply comments (control) using the Wilcoxon signed rank test (paired at the level 1 comment level). Infodemiologists' level 2 reply comments (intervention) and matched reply comments (control) were further compared using 3 Poisson regression models.

resultsIn total, 145 interventions were conducted on 132 Facebook news posts. The level 1 comments received a median of 3 replies, 3 reactions, and 7 engagements. The matched comments received a median of 1.5 (median of IQRs 3.75) engagements. Infodemiologists made 322 level 2 reply comments, precipitating 189 emoji reactions and a median of 0.5 (median of IQRs IQR 0) engagements. The matched reply comments received a median of 1 (median of IQRs 2.5) engagement. Compared to matched comments, level 1 comments received more replies, emoji reactions, and engagements. Compared to matched reply comments, level 2 reply comments received fewer and narrower ranges of replies, reactions, and engagements, except for the median comparison for replies.

conclusionsOverall, empathy-first communication strategies based on motivational interviewing garnered less engagement relative to matched controls. One possible explanation is that our interventions quieted contentious, misinformation-laden threads about vaccines on social media. This work reinforces research on accuracy nudges and cyberbullying interventions that also reduce engagement. More research leveraging field studies of real-time interventions is needed, yet data transparency by technology platforms will be essential to facilitate such experiments.

Indexed as

Motivational InterviewingSocial MediaAttitudeCommunicationCOVID-19 VaccinesHumansCOVID-19 Vaccinesanti-vaccinedigital environmentengagementhealth misinformationinfodemicinfodemiologyinformation environmentmedical misinformationmisinformationobservational studysocial mediasocial media engagement metrics

Identifiers

PMID37962940
PMCPMC10685291
OpenAlexW4387210922

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.