Evidence map›Paper›PMID 35107423›Full record

ArticleJMIR formative research2022

Quantifying the Quality of Web-Based Health Information on Student Health Center Websites Using a Software Tool: Design and Development Study.

Anagha Kulkarni, Mike Wong, Tejasvi Belsare, Risha Shah, Diana Yu Yu, Bera Coskun, Carrie Holschuh, Venoo Kakar, Sepideh Modrek, Anastasia Smirnova

Abstract read
In one paragraph

Article in JMIR formative research, 2022. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 2 papers.

0numbers the graph read from it
0cells of the map it votes in
2citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

2 citing papers in PubMed.

  1. Article
  2. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

10 authors.

Anagha KulkarniDepartment of Computer Science, San Francisco State University, San Francisco, CA, United States.ORCID https://orcid.org/0000-0002-1442-9153
Mike WongDepartment of Computer Science, San Francisco State University, San Francisco, CA, United States.ORCID https://orcid.org/0000-0002-9013-1041
Tejasvi BelsareDepartment of Computer Science, San Francisco State University, San Francisco, CA, United States.ORCID https://orcid.org/0000-0003-3021-4408
Risha ShahDepartment of Computer Science, San Francisco State University, San Francisco, CA, United States.ORCID https://orcid.org/0000-0001-6680-1239
Diana Yu YuDepartment of Computer Science, San Francisco State University, San Francisco, CA, United States.ORCID https://orcid.org/0000-0001-7342-9893
Bera CoskunDepartment of Computer Science, San Francisco State University, San Francisco, CA, United States.ORCID https://orcid.org/0000-0002-3651-3188
Carrie Holschuh *School of Nursing, San Francisco State University, San Francisco, CA, United States.ORCID https://orcid.org/0000-0002-5061-7637
Venoo Kakar *Department of Economics, San Francisco State University, San Francisco, CA, United States.ORCID https://orcid.org/0000-0001-9881-2004
Sepideh Modrek *Department of Economics, San Francisco State University, San Francisco, CA, United States.ORCID https://orcid.org/0000-0003-4557-7156
Anastasia Smirnova *Department of English Language and Literature, San Francisco State University, San Francisco, CA, United States.ORCID https://orcid.org/0000-0003-3640-2688

Funding

No grant is acknowledged in the PubMed record.

6 · The paper itself

Abstract

backgroundThe internet has become a major source of health information, especially for adolescents and young adults. Unfortunately, inaccurate, incomplete, or outdated health information is widespread on the web. Often adolescents and young adults turn to authoritative websites such as the student health center (SHC) website of the university they attend to obtain reliable health information. Although most on-campus SHC clinics comply with the American College Health Association standards, their websites are not subject to any standards or code of conduct. In the absence of quality standards or guidelines, monitoring and compliance processes do not exist for SHC websites. Thus, there is no oversight of the health information published on SHC websites by any central governing body.

objectiveThe aim of this study is to develop, describe, and validate an open-source software that can effectively and efficiently assess the quality of health information on SHC websites in the United States.

methodsOur cross-functional team designed and developed an open-source software, QMOHI (Quantitative Measures of Online Health Information), that assesses information quality for a specified health topic from all SHC websites belonging to a predetermined list of universities. The tool was designed to compute 8 different quality metrics that quantify various aspects of information quality based on the retrieved text. We conducted and reported results from 3 experiments that assessed the QMOHI tool in terms of its scalability, generalizability in health topics, and robustness to changes in universities' website structure.

resultsEmpirical evaluation has shown the QMOHI tool to be highly scalable and substantially more efficient than manually assessing web-based information quality. The tool's runtime was dominated by network-related tasks (98%), whereas the metric computations take <2 seconds. QMOHI demonstrated topical versatility, evaluating SHC website information quality for four disparate and broad health topics (COVID, cancer, long-acting reversible contraceptives, and condoms) and two narrowly focused topics (hormonal intrauterine device and copper intrauterine device). The tool exhibited robustness, correctly measuring information quality despite changes in SHC website structure. QMOHI can support longitudinal studies by being robust to such website changes.

conclusionsQMOHI allows public health researchers and practitioners to conduct large-scale studies of SHC websites that were previously too time- and cost-intensive. The capability to generalize broadly or focus narrowly allows a wide range of applications of QMOHI, allowing researchers to study both mainstream and underexplored health topics. QMOHI's ability to robustly analyze SHC websites periodically promotes longitudinal investigations and allows QMOHI to be used as a monitoring tool. QMOHI serves as a launching pad for our future work that aims to develop a broadly applicable public health tool for web-based health information studies with potential applications far beyond SHC websites.

Indexed as

adolescentsautomated quantification tooldigital healthhealth informationhealth information websiteshealth websitesinfodemiologyinformation quality metricsonline healthonline health information qualitypublic healthstudent health center websites

Identifiers

PMID35107423
PMCPMC8851325

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.