Evidence map›Paper›PMID 39977859›Full record

ArticleJournal of medical Internet research2025

Leveraging Large Language Models for Infectious Disease Surveillance-Using a Web Service for Monitoring COVID-19 Patterns From Self-Reporting Tweets: Content Analysis.

Jiacheng Xie, Ziyang Zhang, Shuai Zeng, Joel Hilliard, Guanghui An, Xiaoting Tang, Lei Jiang, Yang Yu, Xiufeng Wan, Dong Xu

Abstract read
In one paragraph

Article in Journal of medical Internet research, 2025. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 5 papers.

0numbers the graph read from it
0cells of the map it votes in
5citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

5 citing papers in PubMed.

  1. Article
  2. Review
  3. Article
  4. Review
  5. A Risk Taxonomy and Reflection Tool for Large Language Model Adoption in Public Health.Proceedings of the ACM on human-computer interaction · 2025
    Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

10 authors.

Jiacheng XieDepartment of Electrical Engineering and Computer Science, University of Missouri, Columbia, MO, United States.ORCID 0000-0003-3733-4349
Ziyang ZhangDepartment of Electrical Engineering and Computer Science, University of Missouri, Columbia, MO, United States.ORCID 0009-0009-5714-3495
Shuai ZengDepartment of Electrical Engineering and Computer Science, University of Missouri, Columbia, MO, United States.ORCID 0000-0001-7632-427X
Joel HilliardDepartment of Electrical Engineering and Computer Science, University of Missouri, Columbia, MO, United States.ORCID 0009-0009-6926-0373
Guanghui AnChristopher S. Bond Life Sciences Center, University of Missouri, Columbia, MO, United States.ORCID 0009-0001-2669-3963
Xiaoting TangChristopher S. Bond Life Sciences Center, University of Missouri, Columbia, MO, United States.ORCID 0000-0002-6635-1044
Lei JiangDepartment of Electrical Engineering and Computer Science, University of Missouri, Columbia, MO, United States.ORCID 0000-0002-6365-1965
Yang YuDepartment of Electrical Engineering and Computer Science, University of Missouri, Columbia, MO, United States.ORCID 0009-0006-1475-7487
Xiufeng WanDepartment of Electrical Engineering and Computer Science, University of Missouri, Columbia, MO, United States.ORCID 0000-0003-2629-9234
Dong XuDepartment of Electrical Engineering and Computer Science, University of Missouri, Columbia, MO, United States.ORCID 0000-0002-4809-0514

Funding

Multi-view self-supervised deep learning for biological sequences and beyondR35GM126985 · NIGMS · UNIVERSITY OF SOUTH FLORIDA · PI DONG XU · 2018 to 2026
$3.8M
NIGMS NIH HHS R35 GM126985
6 · The paper itself

Abstract

backgroundThe emergence of new SARS-CoV-2 variants, the resulting reinfections, and post-COVID-19 condition continue to impact many people's lives. Tracking websites like the one at Johns Hopkins University no longer report the daily confirmed cases, posing challenges to accurately determine the true extent of infections. Many COVID-19 cases with mild symptoms are self-assessed at home and reported on social media, which provides an opportunity to monitor and understand the progression and evolving trends of the disease.

objectiveWe aim to build a publicly available database of COVID-19-related tweets and extracted information about symptoms and recovery cycles from self-reported tweets. We have presented the results of our analysis of infection, reinfection, recovery, and long-term effects of COVID-19 on a visualization website that refreshes data on a weekly basis.

methodsWe used Twitter (subsequently rebranded as X) to collect COVID-19-related data, from which 9 native English-speaking annotators annotated a training dataset of COVID-19-positive self-reporters. We then used large language models to identify positive self-reporters from other unannotated tweets. We used the Hibert transform to calculate the lead of the prediction curve ahead of the reported curve. Finally, we presented our findings on symptoms, recovery, reinfections, and long-term effects of COVID-19 on the Covlab website.

resultsWe collected 7.3 million tweets related to COVID-19 between January 1, 2020, and April 1, 2024, including 262,278 self-reported cases. The predicted number of infection cases by our model is 7.63 days ahead of the official report. In addition to common symptoms, we identified some symptoms that were not included in the list from the US Centers for Disease Control and Prevention, such as lethargy and hallucinations. Repeat infections were commonly occurring, with rates of second and third infections at 7.49% (19,644/262,278) and 1.37% (3593/262,278), respectively, whereas 0.45% (1180/262,278) also reported that they had been infected >5 times. We identified 723 individuals who shared detailed recovery experiences through tweets, indicating a substantially reduction in recovery time over the years. Specifically, the average recovery period decreased from around 30 days in 2020 to approximately 12 days in 2023. In addition, geographic information collected from confirmed individuals indicates that the temporal patterns of confirmed cases in states such as California and Texas closely mirror the overall trajectory observed across the United States.

conclusionsAlthough with some biases and limitations, self-reported tweet data serves as a valuable complement to clinical data, especially in the postpandemic era dominated by mild cases. Our web-based analytic platform can play a significant role in continuously tracking COVID-19, finding new uncommon symptoms, detecting and monitoring the manifestation of long-term effects, and providing necessary insights to the public and decision-makers.

Indexed as

COVID-19Population SurveillanceSelf ReportSocial MediaHumansInternetLarge Language ModelsSARS-CoV-2COVID-19large language modelmachine learningnatural language processingself-reporting datasocial media analysisTwitter

Identifiers

PMID39977859
PMCPMC11888100

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.