Evidence map›Paper›PMID 37973547›Full record

ArticleInternational journal of technology assessment in health care2023

Can knowledgeable experts assess costs and outcomes as if they were ignorant? An experiment within precision medicine evaluation.

Thamonwan Dulsamphan, Parntip Juntama, Chotika Suwanpanich, Wanrudee Isaranuwatchai, Madison Silzle, Sathida Poonmaksatit, Ponghatai Boonsimma, Vorasuk Shotelersuk, Anannit Visudtibhan, Apasri Lusawat and 7 more

Abstract read
In one paragraph

Article in International journal of technology assessment in health care, 2023. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 1 paper.

0numbers the graph read from it
0cells of the map it votes in
1citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

1 citing paper in PubMed.

  1. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

17 authors.

Thamonwan DulsamphanHealth Intervention and Technology Assessment Program, Ministry of Public Health, Nonthaburi, Thailand.
Parntip JuntamaHealth Intervention and Technology Assessment Program, Ministry of Public Health, Nonthaburi, Thailand.
Chotika SuwanpanichHealth Intervention and Technology Assessment Program, Ministry of Public Health, Nonthaburi, Thailand.
Wanrudee IsaranuwatchaiHealth Intervention and Technology Assessment Program, Ministry of Public Health, Nonthaburi, Thailand.
Madison SilzleHealth Intervention and Technology Assessment Program, Ministry of Public Health, Nonthaburi, Thailand.ORCID https://orcid.org/0000-0003-3345-8117
Sathida PoonmaksatitDivision of Neurology, Department of Pediatrics, Faculty of Medicine, Chulalongkorn University, Bangkok, Thailand.
Ponghatai BoonsimmaCenter of Excellence for Medical Genomics, Medical Genomics Cluster, Department of Pediatrics, Faculty of Medicine, Chulalongkorn University, Bangkok, Thailand.
Vorasuk ShotelersukCenter of Excellence for Medical Genomics, Medical Genomics Cluster, Department of Pediatrics, Faculty of Medicine, Chulalongkorn University, Bangkok, Thailand.
Anannit VisudtibhanDivision of Neurology, Department of Pediatrics, Faculty of Medicine, Ramathibodi Hospital, Mahidol University, Bangkok, Thailand.
Apasri LusawatNeurological Institute of Thailand, Bangkok, Thailand.
Wuttichart KamolvisitCenter of Excellence for Medical Genomics, Medical Genomics Cluster, Department of Pediatrics, Faculty of Medicine, Chulalongkorn University, Bangkok, Thailand.
Nattiya KapolDepartment of Health Consumer Protection and Pharmacy Administration, Faculty of Pharmacy, Silpakorn University, Nakhon Pathom, Thailand.
Surasit Lochid-AmnuayDepartment of Health Consumer Protection and Pharmacy Administration, Faculty of Pharmacy, Silpakorn University, Nakhon Pathom, Thailand.
Namfon SribunditDepartment of Health Consumer Protection and Pharmacy Administration, Faculty of Pharmacy, Silpakorn University, Nakhon Pathom, Thailand.
Nathapol SamprasitBangpakok 8 Hospital, Bangpakok Hospital Group, Bangkok, Thailand.
Alec MortonDepartment of Management Science, Strathclyde Business School, University of Strathclyde, Glasgow, UK.ORCID https://orcid.org/0000-0003-3803-8517
Yot TeerawattananonHealth Intervention and Technology Assessment Program, Ministry of Public Health, Nonthaburi, Thailand.

Funding

Health Systems Research Institute 65-040
6 · The paper itself

Abstract

objectivesThe purpose of this study is to evaluate the validity of the standard approach in expert judgment for evaluating precision medicines, in which experts are required to estimate outcomes as if they did not have access to diagnostic information, whereas in fact, they do.

methodsFourteen clinicians participated in an expert judgment task to estimate the cost and medical outcomes of the use of exome sequencing in pediatric patients with intractable epilepsy in Thailand. Experts were randomly assigned to either an "unblind" or "blind" group; the former was provided with the exome sequencing results for each patient case prior to the judgment task, whereas the latter was not provided with the exome sequencing results. Both groups were asked to estimate the outcomes for the counterfactual scenario, in which patients had not been tested by exome sequencing.

resultsOur study did not show significant results, possibly due to the small sample size of both participants and case studies.

conclusionsA comparison of the unblind and blind approach did not show conclusive evidence that there is a difference in outcomes. However, until further evidence suggests otherwise, we recommend the blind approach as preferable when using expert judgment to evaluate precision medicines because this approach is more representative of the counterfactual scenario than the unblind approach.

Indexed as

JudgmentPrecision MedicineChildHumansThailandexome sequencinghealthcare costshindsight biasjudgmentprecision medicine

Identifiers

PMID37973547
PMCPMC10859837

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.