Evidence map›Paper›PMID 31543057›Full record

ArticleJournal of health communication2019

An Efficient Message Evaluation Protocol: Two Empirical Analyses on Positional Effects and Optimal Sample Size.

Minji Kim, Joseph N Cappella

Abstract read
In one paragraph

Article in Journal of health communication, 2019. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 10 papers.

0numbers the graph read from it
0cells of the map it votes in
10citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

10 citing papers in PubMed.

  1. Trial
  2. Identifying Promising Message Themes for Youth Who Use Multiple Tobacco Products.The Journal of adolescent health : official publication of the Society for Adolescent Medicine · 2025
    Trial
  3. Trial
  4. Young Adult Responses to Peer Crowd-Based Targeting in E-cigarette Advertisements: An Experimental Study.Nicotine & tobacco research : official journal of the Society for Research on Nicotine and Tobacco · 2023
    Trial
  5. Article
  6. Article
  7. Article
  8. An Overview of Innovative Approaches to Support Timely and Agile Health Communication Research and Practice.International journal of environmental research and public health · 2022
    Review
  9. Article
  10. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

2 authors.

Minji KimCenter for Tobacco Control Research and Education, University of California, San Francisco, San Francisco, California, USA.
Joseph N CappellaAnnenberg School for Communication, University of Pennsylvania, Philadelphia, Pennsylvania, USA.

Funding

UPENN TCORS: Tobacco Product Messaging in a Complex Communication EnvironmentP50CA179546 · NCI · UNIVERSITY OF PENNSYLVANIA · PI HORNIK, ROBERT C., LERMAN, CARYN · 2013 to 2017
$18.7M
Training / Career DevelopmentP20CA095856 · NCI · UNIVERSITY OF PENNSYLVANIA · PI HORNIK, ROBERT C. · 2008 to 2012
$8.7M
Constructing Recommender Systems for Effective Health Messages: Smoking CessationR01CA160226 · NCI · UNIVERSITY OF PENNSYLVANIA · PI CAPPELLA, JOSEPH NICHOLAS · 2011 to 2014
$980k
NCI NIH HHS P20 CA095856NCI NIH HHS P50 CA179546NCI NIH HHS R01 CA160226
6 · The paper itself

Abstract

Reliable and valid message evaluation has a central role in effective health communication and message effects research. The authors have employed a message testing protocol to efficiently acquire valid and reliable message evaluation results: (a) use multiple messages, (b) recruit evaluators from the target population, (c) use valid and reliable effectiveness measures, (d) expose an evaluator to multiple messages, and (e) ensure enough evaluations per message. Two secondary analyses of anti-tobacco message evaluation studies provide evidence for reliability and validity regarding points (d) and (e). Seven studies where adult smokers evaluated the effectiveness of various anti-smoking campaign messages were examined. The first analysis shows that the position in which a message appears has little or no impact on its evaluation, supporting the validity of multiple-exposure design. The second analysis suggests having 25 evaluations per message can achieve a fair balance between accuracy and efficiency.

Indexed as

Smoking PreventionAdultEmpirical ResearchFemaleHealth CommunicationHumansMaleReproducibility of ResultsSample Size

Identifiers

PMID31543057
PMCPMC6906244

What OpenQuestion holds

Textmetadata
LicenceTDM
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.