Evidence map›Paper›PMID 37164474›Full record

ArticleBMJ open2023

Validity of patients' online reviews at direct-to-consumer teleconsultation platforms: a protocol for a cross-sectional study using unannounced standardised patients.

Yunyun Xie, Wenjun He, Yuting Wan, Huanyuan Luo, Yiyuan Cai, Wenjie Gong, Siyuan Liu, Dongmei Zhong, Wenping Hu, Lanping Zhang and 10 more

Abstract read
In one paragraph

Article in BMJ open, 2023. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 2 papers.

0numbers the graph read from it
0cells of the map it votes in
2citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

2 citing papers in PubMed.

  1. Article
  2. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

20 authors.

Yunyun XieSchool of Health Management, Southern Medical University, Guangzhou, China.
Wenjun HeSchool of Public Health, Southern Medical University, Guangzhou, Guangdong, China.
Yuting WanSchool of Health Management, Southern Medical University, Guangzhou, China.
Huanyuan LuoDermatology Hospital, Southern Medical University, Guangzhou, Guangdong, China.
Yiyuan CaiDepartment of Epidemiology and Medical Statistic, School of Public Health, Sun Yat-Sen University, Guangzhou, Guangdong, China.
Wenjie GongSchool of Public Health, Central South University, Changsha, China.ORCID 0000-0002-7943-4041
Siyuan LiuSchool of Public Health, Southern Medical University, Guangzhou, Guangdong, China.
Dongmei ZhongSchool of Public Health, Southern Medical University, Guangzhou, Guangdong, China.
Wenping HuDepartment of Social Medicine and Health Management, Lanzhou University, Lanzhou, Gansu Province, China.
Lanping ZhangSchool of Health Management, Southern Medical University, Guangzhou, China.
Jiaqi LiSchool of Health Management, Southern Medical University, Guangzhou, China.
Qing ZhaoAcacia Lab for Implementation Science, School of Health Management and Dermatology Hospital, Southern Medical University, Guangzhou, China.
Sensen LvSchool of Health Management, Southern Medical University, Guangzhou, China.
Chunping LiSchool of Health Management, Southern Medical University, Guangzhou, China.
Zhang ZhangGillings School of Global Public Health, The University of North Carolina at Chapel Hill Gillings School of Global Public Health, Chapel Hill, North Carolina, USA.ORCID 0000-0001-9344-6578
Changchang LiDermatology Hospital, Southern Medical University, Guangzhou, Guangdong, China.
Xiaoshan ChenSchool of Health Management, Southern Medical University, Guangzhou, China.
Wangqing HuangSchool of Health Management, Southern Medical University, Guangzhou, China.
Yutong WangDepartment of Epidemiology and Biostatistics, School of Public Health, Xi'an Jiaotong University, Xi'an, Shaanxi, China.
Dong XuSouthern Medical University Institute for Global Health (SIGHT), Dermatology Hospital of Southern Medical University, Guangzhou, China roman.xu@gmail.com.ORCID 0000-0001-7438-632X

Funding

POPULATION STUDIEST32HD007168 · NICHD · UNIV OF NORTH CAROLINA CHAPEL HILL · PI ELIZABETH A FRANKENBERG · 1985 to 2026
$13.8M
NICHD NIH HHS T32 HD007168World Health Organization 001
6 · The paper itself

Abstract

introductionAs direct-to-consumer teleconsultation (hereafter referred to as 'teleconsultation') has gained popularity, an increasing number of patients have been leaving online reviews of their teleconsultation experiences. These reviews can help guide patients in identifying doctors for teleconsultation. However, few studies have examined the validity of online reviews in assessing the quality of teleconsultation against a gold standard. Therefore, we aim to use unannounced standardised patients (USPs) to validate online reviews in assessing both the technical and patient-centred quality of teleconsultations. We hypothesise that online review results will be more consistent with the patient-centred quality, rather than the technical quality, as assessed by the USPs. METHODS AND ANALYSIS: In this cross-sectional study, USPs representing 11 common primary care conditions will randomly visit 253 physicians via the three largest teleconsultation platforms in China. Each physician will receive a text-based and a voice/video-based USP visit, resulting in a total of 506 USP visits. The USP will complete a quality checklist to assess the proportion of clinical practice guideline-recommended items during teleconsultation. After each visit, the USP will also complete the Patient Perception of Patient-Centeredness Rating. The USP-assessed results will be compared with online review results using the intraclass correlation coefficient (ICC). If ICC >0.4 (p<0.05), we will assume reasonable concordance between the USP-assessed quality and online reviews. Furthermore, we will use correlation analysis, Lin's Coordinated Correlation Coefficient and Kappa as supplementary analyses. ETHICS AND DISSEMINATION: This study has received approval from the Institutional Review Board of Southern Medical University (#Southern Medical Audit (2022) No. 013). Results will be actively disseminated through print and social media, and USP tools will be made available for other researchers.

trial registrationThe study has been registered at the China Clinical Trials Registry (ChiCTR2200062975).

Indexed as

PhysiciansRemote ConsultationChinaCross-Sectional StudiesHumansPatientshealth & safetyprotocols & guidelinesquality in health care

Identifiers

PMID37164474
PMCPMC10173992

What OpenQuestion holds

Textmetadata
LicenceCC BY-NC
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.