Evidence map›Paper›PMID 32750006›Full record

ArticleJMIR public health and surveillance2020

Big Data, Natural Language Processing, and Deep Learning to Detect and Characterize Illicit COVID-19 Product Sales: Infoveillance Study on Twitter and Instagram.

Tim Ken Mackey, Jiawei Li, Vidya Purushothaman, Matthew Nali, Neal Shah, Cortni Bardier, Mingxiang Cai, Bryan Liang

Open access · goldAbstract read
In one paragraph

Article in JMIR public health and surveillance, 2020. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 35 papers, 1 of them a synthesis that pooled it.

0numbers the graph read from it
0cells of the map it votes in
35citing papers in PubMed, 1 pooled it
38.2field-weighted citation impact, top 1% of its field
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

35 citing papers in PubMed, 1 synthesis or guideline pooled it, 120 citations in OpenAlex.

  1. Pooled it
  2. Article
  3. Article
  4. Article
  5. Article
  6. Article
  7. Article
  8. Review
  9. Article
  10. Article
  11. Article
  12. Article
  13. Article
  14. Article
  15. Article
  16. Article
  17. Article
  18. Article
  19. Social media mining under the COVID-19 context: Progress, challenges, and opportunities.International journal of applied earth observation and geoinformation : ITC journal · 2022
    Article
  20. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

8 authors at 2 institutions in 1 country.

Tim Ken MackeyDepartment of Anesthesiology and Division of Infectious Diseases and Global Public Health, School of Medicine, University of California, San Diego, La Jolla, CA, United States.ORCID 0000-0002-2191-7833
Jiawei LiDepartment of Healthcare Research and Policy, University of California, San Diego, La Jolla, CA, United States.ORCID 0000-0001-9801-4715
Vidya PurushothamanGlobal Health Policy and Data Institute, San Diego, CA, United States.ORCID 0000-0002-6270-448X
Matthew NaliDepartment of Anesthesiology and Division of Infectious Diseases and Global Public Health, School of Medicine, University of California, San Diego, La Jolla, CA, United States.ORCID 0000-0002-0565-8202
Neal ShahDepartment of Healthcare Research and Policy, University of California, San Diego, La Jolla, CA, United States.ORCID 0000-0001-8670-6124
Cortni BardierMasters Program in Global Health, Department of Anthropology, University of California, San Diego, La Jolla, CA, United States.ORCID 0000-0002-2165-7867
Mingxiang CaiGlobal Health Policy and Data Institute, San Diego, CA, United States.ORCID 0000-0001-6816-5192
Bryan LiangGlobal Health Policy and Data Institute, San Diego, CA, United States.ORCID 0000-0001-7801-5673
University of California San Diego · USGlobal Policy Institute · US

Funding

No grant is acknowledged in the PubMed record.

6 · The paper itself

Abstract

backgroundThe coronavirus disease (COVID-19) pandemic is perhaps the greatest global health challenge of the last century. Accompanying this pandemic is a parallel "infodemic," including the online marketing and sale of unapproved, illegal, and counterfeit COVID-19 health products including testing kits, treatments, and other questionable "cures." Enabling the proliferation of this content is the growing ubiquity of internet-based technologies, including popular social media platforms that now have billions of global users.

objectiveThis study aims to collect, analyze, identify, and enable reporting of suspected fake, counterfeit, and unapproved COVID-19-related health care products from Twitter and Instagram.

methodsThis study is conducted in two phases beginning with the collection of COVID-19-related Twitter and Instagram posts using a combination of web scraping on Instagram and filtering the public streaming Twitter application programming interface for keywords associated with suspect marketing and sale of COVID-19 products. The second phase involved data analysis using natural language processing (NLP) and deep learning to identify potential sellers that were then manually annotated for characteristics of interest. We also visualized illegal selling posts on a customized data dashboard to enable public health intelligence.

resultsWe collected a total of 6,029,323 tweets and 204,597 Instagram posts filtered for terms associated with suspect marketing and sale of COVID-19 health products from March to April for Twitter and February to May for Instagram. After applying our NLP and deep learning approaches, we identified 1271 tweets and 596 Instagram posts associated with questionable sales of COVID-19-related products. Generally, product introduction came in two waves, with the first consisting of questionable immunity-boosting treatments and a second involving suspect testing kits. We also detected a low volume of pharmaceuticals that have not been approved for COVID-19 treatment. Other major themes detected included products offered in different languages, various claims of product credibility, completely unsubstantiated products, unapproved testing modalities, and different payment and seller contact methods.

conclusionsResults from this study provide initial insight into one front of the "infodemic" fight against COVID-19 by characterizing what types of health products, selling claims, and types of sellers were active on two popular social media platforms at earlier stages of the pandemic. This cybercrime challenge is likely to continue as the pandemic progresses and more people seek access to COVID-19 testing and treatment. This data intelligence can help public health agencies, regulatory authorities, legitimate manufacturers, and technology platforms better remove and prevent this content from harming the public.

Indexed as

Big DataCommerceCoronavirus InfectionsCOVID-19Deep LearningFraudHumansMarketingNatural Language ProcessingPandemicsPneumonia, ViralSocial MediaUnited StatescoronavirusCOVID-19cybercrimefraudinfectious diseaseinfodemicinfodemiologyinfoveillancesocial mediasurveillance

Identifiers

PMID32750006
PMCPMC7451110
OpenAlexW3047131763

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.