Using Communication Research to Design Effective Messages for Public Health: The cases of HPV vaccine and anti-smoking PSAs 1 Joseph N. Cappella Annenberg.

Slides:



Advertisements
Similar presentations
Things we can manipulate
Advertisements

Blindsight Seeing without Awareness. What is Blindsight ‘Blindsight’ (Weiskrantz): residual visual function after V1 damage in the lack of any visual.
Emotional Intelligence predicts individual differences in social exchange reasoning D. Reis, M. Brackett, N. Shamosh, K. Kiehl, P. Salovey & J. Gray.
Social Influence and Persuasion
Effects of Sexualization in Advertisements Alyssa Zaid and Phillip Walker Hanover College.
Persuasion Dr. K. A. Korb University of Jos. Outline McGuire’s Attitude Change Model Yale Programme Elaboration Likelihood Model (ELM) Fear Appeals Dr.
Theory of Planned Behaviour and Physical Activity EPHE 348.
Post-test review session Tuesday Nov in TH241.
Persuading Mothers to Perform Breast Cancer Prevention Practices with their Pre-adolescent Daughters: A Pilot Message Study Silk KS 1, Atkin C 1, Yun D.
Wells, Moriarty, Burnett & Lwin - Xth EditionADVERTISING Principles and Effective IMC Practice1 The Creative Side and Message Strategy Part 4: Effective.
Chapter Fourteen Planning Presentations McGraw-Hill/Irwin Copyright © 2014 by The McGraw-Hill Companies, Inc. All rights reserved.
Dorsal and Ventral Pathways and What They Do. Dorsal and Ventral Pathways visual information arrives at V1 via the retinostriate pathway it is already.
Session 6: Writing from Sources Audience: 6-12 ELA & Content Area Teachers.
Attitudes & Attitude Change Chapter 7. What are attitudes?  Evaluations of people, objects and/or ideas that often determine what we do.
Attitudes and Attitude Change: Influencing Thoughts and Feelings
Session 6: Writing from Sources Audience: K-5 Teachers.
 Dillon Harrison – Organic versus Non-Organic Agriculture  Aaron Pacheco – Ethics of Meat Consumption  Priscila Olague – Genetically Modified Organisms.
 Dillon Harrison – Organic versus Non-Organic Agriculture  Aaron Pacheco – Ethics of Meat Consumption  Priscila Olague – Genetically Modified Organisms.
Attitudes, Attitude Change, and Persuasion Joshua Phelps February 14 th 2005.
Chapter Eight Theories of Message Processing. Classic Models of Persuasion: Cognitive Dissonance Theory Developed by Festinger Developed by Festinger.
ELABORATION LIKELIHOOD MODEL CTU LIVE CHAT Developed by. Richard Petty. & John Cacioppo.
ELABORATION LIKELIHOOD MODEL Routes to Persuasion Richard Petty, John Cacioppo.
Bellwork Write Questions 1.What do you think makes a good speech? List three qualities. 2. What do you think are your strong and weak points as a presenter?
Using Social Practices in Language David Murphy English Language Fellow Toluca, Mexico
Rediscovering Research: A Path to Standards Based Learning Authentic Learning that Motivates, Constructs Meaning, and Boosts Success.
CCSS: Types of Writing.
The strength of your argument
How do we develop attitudes?. Describe your attitude to this TV show. Is it positive, negative or ambivalent? Describe the factors that you think have.
Saur et al. (2008) PNAS Ventral and dorsal pathways for language (14 authors!) Hickok & Poeppel’s (2004, 2008) Model –Dual-streams for auditory language.
Introduction to Theories of Communication Effects: Emotional Appeals With special emphasis on Fear Appeals A service of the Communication Science & Research.
Empowering volunteers to perform smoking- cessation service with a workshop training program using participatory action research Presenter: I-chuan Li.
Bookheimer 2003 Annual Rev. Neurosci.. Phonology in IFG Gelfand and Bookheimer, Neuron 2002.
©2007 by the McGraw-Hill Companies, Inc. All rights reserved. 2/e PPTPPT.
How People make Decisions
Is There Evidence That Memory Is Separated Into Implicit and Explicit Systems? John Chuckalovcak, Megan Rathburn Q301 Brain and Cognition, Indiana University.
Training Phase Results The RT difference between gain and loss was numerically larger for the second half of the trials than the first half, as predicted,
Coricelli and Nagel (2008) Introduction Methods Results Conclusion.
INTRODUCTION TO MOTIVATIONAL INTERVIEWING Lynn S. Massey, LMSW Department of Psychiatry Department of Emergency Medicine University of Michigan.
Age effects on hippocampal functional connectivity during multifeatural encoding Chris Foster 1, Milton Picklesimer 1, Neil Mulligan, Ph.D. 1, and Kelly.
Persuasion Attitude change through communication Attitude change through communication.
Persuasion Copyright © 2008 by The McGraw-Hill Companies, Inc. Social Psychology by David G. Myers 9 th Edition Persuasion.
Role of Working Memory in Visual Selective Attention de Fockert, Rees, Frith, Lavie (2001)
Chapter 6 Attitudes.
Chapter 20 Presentation Effects © 2013 Cengage Learning. All Rights Reserved. May not be scanned, copied or duplicated, or posted to a publicly accessible.
This study is a mixed 3 (Information Density) X 2 (Structural Complexity) x 4 (Message) x 4 (Order) design. Except for Order, all are within subject factors.
Pattern Classification of Attentional Control States S. G. Robison, D. N. Osherson, K. A. Norman, & J. D. Cohen Dept. of Psychology, Princeton University,
Human Anatomy & Physiology FIFTH EDITION Elaine N. Marieb PowerPoint ® Lecture Slide Presentation by Vince Austin Copyright © 2003 Pearson Education, Inc.
Articulatory Net I.2 Oct 14, 2015 – DAY 21
Introduction Ruth Adam & Uta Noppeney Max Planck Institute for Biological Cybernetics, Tübingen Scientific Aim Experimental.
DIFFERENTIAL COMPONENTS OF PROSPECTIVE MEMORY? EVIDENCE FROM FMRI J. Simons, M. Scholvinck, S. Gilbert, C. Frith, P. Burgess By Alex Gustafson.
Daily Warm-up: What points would you make if you were presenting an argument against the uniforms to Ms. Rains and Ms. Roach? Homework: Reading Plus due.
Persuasive Speaking. The nature of persuasive speeches Persuasive Speeches attempt to influence audience members Speakers want to: –have audience adopt.
CLICKER QUESTION #1 The central route and the peripheral route refer to two actual physiological pathways found in the human brain. TRUE = A FALSE = B.
Introduction  Recent neuroimaging studies of memory retrieval have reported the activation of a medial and left – lateralised memory network that includes.
INTRODUCTION Advertisement choice is a marketing tool that allows online users to select the type of content to watch during a commercial break. This choice.
Are Resonant Ads More Persuasive? The Moderating Role of Regulatory Focus and Need for Cognition Choi, Ji Eun, Doo Hee LEE, and Charles R. Taylor Journal.
The distributed human neural system for face perception
Persuasive Essay.
Karen Thomson Department of Psychology Glasgow Caledonian University
Symbolic messages from repressed areas of our minds.
Elaboration Likelihood Model (ELM)
45 points total for Brain Helmet
Thinking In College In this lesson, we’ll explore what it means to be a college-level thinker, and how to develop strong thinking skills. Any questions.
Neural Changes following Remediation in Adult Developmental Dyslexia
Thinking In College In this lesson, we’ll explore what it means to be a college-level thinker, and how to develop strong thinking skills. Any questions.
Experimental Design in Functional Neuroimaging
Neural Changes following Remediation in Adult Developmental Dyslexia
Developing Arguments for Persuasive Speeches
Chapter 16 Persuasive Speaking.
A POCKET GUIDE TO PUBLIC SPEAKING 5TH EDITION Chapter 24
Presentation transcript:

Using Communication Research to Design Effective Messages for Public Health: The cases of HPV vaccine and anti-smoking PSAs 1 Joseph N. Cappella Annenberg School for Communication University of Pennsylvania Effects of Public Information in Cancer an NCI Center of Excellence in Cancer Communication Research at the Annenberg School for Communication, University of Pennsylvania Presented OBSSR, NIH June 15, 2009

Message: Effects versus Design Effects: content and consequents Design: –Components –Analysis –Chosen: theoretically & based on real world content –Target audience:  effects –Translation: Re-engineer for public health Avoid Select 2

Message Components Content: what the message is about –Persuasive  Claims Offer reasons for and reject reasons against Implicit or explicit Format: how the “what” is presented –Equivalence Logical Topical, conceptual, propositional 3

Message Effects via Design Choose content & format To achieve acceptance –(by target audience) 4

Conventional (theoretical) Wisdom Strong arguments (involved targets) Attention-getting messages Public education overcomes resistance –Psychological –Social 5

For Example Content –Strong, weak arguments ( Petty & Cacioppo, 1986 ) –Altruistic versus self-interested Format –Framing: effective 70%; ineffective 30% –Sensation value 6

Goals for Today Are hi sensation value PSAs effective for smokers? Are PSAs using smoking cues effective? Are there arguments about smoking that appeal to all smokers? How do health messages about the HPV vaccine interact with public discourse about the vaccine? 7

MSV X AS (Strasser, Cappella et al 2009) H: Outcomes enhanced for Hi-hi Especially for hi SS smokers Physio, intention, beliefs re smoking

Message Sensation Value (Morgan et al, 2003) Content: Acted out, narrative, unexpected format, twist ending, Visual: cuts, edits, faces, unusual colors, intense moments (implicit, explicit) Auditory: music, sound saturation, unusual sounds, esp slow or fast voices Validity? 9

DESIGN 200 adult smokers (lowest M=19/day) MSV (2) X Arg Strg (2) X SS (2) 4 ads per condition (16) Careful selection from set of 600, 100 tested Method: real ads, multiple per condition

Key Results For high MSV –Corrugator Hi > Lo (p <.02) –Personal efficacy (low SS) Lo > Hi (p <.04); (hi SS = lo SS, hi MSV) For high AS ads –Skin conductance strong > weak (p =.05) –Heart rate (strong > weak) (p=.02)

Believable MSV? Subtle test Recall accuracy Recall RT Brain response

fMRI, MSV, & Recall (Langleben, Loughead, Hakun, Ruparel, Strasser, Halloway, Cappella, & Lerman, 2009) Sample: 18 regular smokers, 18-48, 13 cigs/day, 12 M PSAs: 8 pre-selected from set of 99; anti-smoking Design: 2 arg strength X 2 MSV, w/i subjects, 2 examples of each Procedures: 8 PSAs, 8 control, pseudo- random order, recognition

16

Results: Recognition

Results: Brain response The hiMSV PSAs were associated with extensive activation in the occipital (including the fusiform gyrus) cortex and the parahippocampus, while the loMSV PSAs were accompanied by higher orbitofrontal, superior and inferior frontal, temporal and posterior parietal activation. Thus, the activations associated with loMSV PSA are suggestive of deeper cognitive processing than the hiMSV PSA. Moreover, absence of differences between the loMSV and hiMSV in the anterior cingulate cortex and higher posterior parietal activation suggests that higher MSV does not translate to higher endogenous attention.

Conclude High MSV can distract Cognitive resources to irrelevant features Consistent with Kang, Cappella, & Fishbein (2006) 19

Kang, Cappella & Fishbein Anti-marijuana Ads Adolescents Two ad features –Message sensation Value (MSV, Morgan et al., 2003) –Argument strength MSV -- attention –Focus on argument, stronger argument  more persuasive –Focus on stylistic features, distracter, weak argument  more persuasive –MSV as a moderator of argument quality on ad effectiveness 20

Key Finding 21

Why? Dominant thoughts disrupted by hi MSV ads MSV features distracting from core processing Which features? Under what conditions? What else could distract? 22

Smoking Cues In anti-smoking PSAs 40% roughly When outside PSAs create urge What about inside PSAs –When args vs smoking are strong –Approach -- avoid 23

Methods Participants –Screening criteria –N=96, 54% male, age =33, 14 yrs edu, 59% Caucasian, 17 cig/day, 29 days smoking in the previous 30 days –N=82 follow-up Argument Strength (between- subject) Smoking Cue (within-subject) NoYes Strong 3 PSAs Weak 3 PSAs Yahui Kang Kang, et al, 2009

Smoking Urge

Learning

27 Kang, Cappella, & Fishbein (in press) P <.05

Eye Tracking Smoking Cues 28

Design 3(I-squared high vs. I-squared low vs. smoking) x 43 (repeats of cues in each category taken from the 16 PSAs available) Participants (N=84) – 44 male – 47 African American, 27 white – Age 18 to 65 years, mean=36.9

30 F(2,62)=3.59, p<0.05 Sanders-Jackson, et al, unpublished

Conclusions Variance of looking is less with smoking cues (and hi Information Introduced, I 2 ) Cue—Visual Correlation: –Mean Pearson r =.37 (range: -23 to.98) For active smoking scenes (more urge), hi arg strength lowers attention to cues (smaller r) 31

Next Steps Three cue (none, peripheral, central) X two argument (high, low) factorial, smokers –Urge, physio, eye tracking (Strasser, Lerman & Cappella, CECCR II) –fMRI (Loughead, NCI CECCR II) Former smokers 32

The Problem with Arguments Argument strength important in acceptance in previous work Strong-weak is rated by smokers No a priori predictions Are there structural diffs between effective and ineffective anti-smoking arguments? 33

Anti-smoking Arguments Archive of > 1000 ads 199 selected: English, 30 sec, adult targets, neg consequences, treatment seeking Argument “extraction” 8 item arg strength (Zhao et al under review) 2004 –99 arguments, 300 adult smokers, 12 of 99 random, mall intercept 2008 –100 args, 487 adult smokers, 8 of 100 random, KN sample 34 Young Min Baek

Data Texts of arguments (10 predictors) –Automap (Carley) and LIWC (Pennebacker) –Synonym sets Individual differences (9 predictors) –Demographic characteristics (5) –# of cigarettes/last seven days –Need for cognition –Perceived vulnerability (2) –SOC, intention to quit combined 35

survey (n = 99) 2008 survey (n = 100) Word-categoryMeanSDMeanSDtest statistic People (Intimate) t =.39 People (Distant) t = 3.98*** Smoking cessation t = -4.61*** SHS (secondhand smoking) t = 2.42* Causation words t = Death-related words t =.85 Disease/Body t = 1.39 Poison/Chemical t = 2.09* Tobacco Company t = Lifestyle/Cosmetics t = -2.66** Argument strength evaluated t = 12.25* Note. * p <.05 ** p <.01 *** p < arguments are evaluated in 2004; and 100 arguments in 2008.

Data Analysis Strategy Arg, Person, Arg X Person  AS MLM, specifically HCM Retention of interaction terms only if replicated 37

Key Findings 38

39

40

Variance (in rated AS) Mostly individual (49%) Significant argument (9%) Little interactions (< 1%) Implications:

Argument Effects Positive –People (Close) –SHS –Death Negative –People (distant) –Cosmetic (lifestyle) 42

Person X Argument SHS –For females (+) –For younger (+) Disease/body –For educated (+) Chemical/Poison –For educated (+) 43

Person Effects Stage of Change (+++) Perceived vulnerability to disease (++) 44

Conclusions Argument strength highly individualized but –Early SOC –Perceived invulnerability to smoking harm Effective arguments focus on –intimates, death, and second hand smoke Some targeting: –Young & women: SHS –Educated: disease, poison, chemicals 45

Other Studies Emery Collaboration: into the field Death PSAs: PSAs with death themes  –more fear, perceived risk & effectiveness (adults) Narrative & efficacy (print news):  – transportation  intention to quit Fear X efficacy  intention to quit –both nec’y for early SOC –efficacy only for later SOC 46

HPV Resistance is social, political (also) Rolling cross section re HPV –One year, rep sample, monthly –Knowledge and news coverage Two experiments –HPV, STIs, promiscuity, rep sample –HPV, pos-neg frame, rep sample

Conclusions re HPV Public and public health agendas diverged Message framing mattered Ideology mattered Ideology affected message interpretation

The Public Debate Kelly et al Media coverage  (+) knowledge

Human Papillomavirus (HPV) Most common STI in the US, infecting more than 20 million Americans Leading cause of cervical cancer; also associated with genital warts Despite the strong link between HPV and cervical cancer, until recently, most Americans were unaware of HPV and did not know that it is the primary cause of cervical cancer

HPV Vaccine The FDA approved June 8, 2006 Vaccine prevents infection against 4 strains of HPV Recommendation: vaccination to girls and women ages 9-26 The vaccine effective only if prior to infection with HPV

HPV Vaccine Debate Being vaccinated allows for increased and riskier sexual behavior Anti-cancer vs. Anti-STI vaccine Voluntary vs. Mandatory vaccination

Liberals in Congress and elsewhere have warned that the Bush administration and religious groups should not interfere with Gardasil's approval or required use. In response, many conservative groups have made statements supporting the vaccine. "Despite rumors to the contrary, our organization doesn't oppose the vaccine and we have taken no position regarding mandatory laws," said Wendy Wright, president of Concerned Women of America, a conservative group based in Washington. Some groups support the vaccine but oppose mandatory vaccinations because cervical cancer is caused by a sexually transmitted virus. vaccinationsvirus "We can prevent it by the best public health method, and that's not having sex before marriage," said Linda Klepacki of Focus on the Family, a Christian advocacy organization based in Colorado Springs. U.S. Approves Use of Vaccine for Cervical Cancer U.S. Approves Use of Vaccine for Cervical Cancer By GARDINER HARRIS

Texas Is First to Require Cancer Shots for Schoolgirls By RALPH BLUMENTHAL Published: February 3, 2007RALPH BLUMENTHAL Some parents have voiced concern that the plan could send a message that sexual activity was condoned or that vaccinations made it safe. On the whole, however, conservative and religious groups have not come out strongly against the vaccinations as long as families can opt out. The Texas Freedom Network, a nonpartisan advocacy group often critical of Mr. Perry, issued a statement praising his move. “Today’s decision by the governor is not just a positive step forward in efforts to promote women’s health,” said the group’s president, Kathy Miller. “It is also an important acknowledgment that health and science should not be held hostage to politics and ideology.”

Groups wary of drug industry motives find themselves on the same side of the anti-vaccination debate with unexpected political allies: religious and cultural conservatives who oppose mandatory use of the vaccine because they say it would encourage sexual activity by young girls. And in Illinois, a bill introduced by a legislator who had the virus the vaccine is intended to prevent prompted a conservative group’s blog to speculate that she had been promiscuous. “I’m offended by their ignorance, but if I have to take a hit to educate people, I’m willing to do it,” said the bill’s sponsor, Debbie Halvorson, the Democratic majority leader in the Illinois Senate. | February 17, 2007 Furor on Rush to Require Cervical Cancer Vaccine By STEPHANIE SAUL and ANDREW POLLACK Furor on Rush to Require Cervical Cancer Vaccine

Fox News PROPOSALS FOR MANDATES HAVE POPPED UP FROM CALIFORNIA TO CONNECTICUT SINCE THE FIRST PIECE OF LEGISLATION WAS INTRODUCED IN SEPTEMBER IN MICHIGAN. MICHIGAN'S BILL WAS NARROWLY DEFEATED LAST MONTH. LAWMAKERS SAID THE REQUIREMENT WOULD INTRUDE ON FAMILIES' PRIVACY, EVEN THOUGH, AS IN MOST STATES' PROPOSALS, PARENTS COULD OPT OUT EVEN WITH SUCH OPT-OUT PROVISIONS, MANDATES TAKE AWAY PARENTS' RIGHTS TO MAKE MEDICAL DECISIONS FOR THEIR CHILDREN, SAID LINDA KLEPACKI OF THE COLORADO- BASED EVANGELICAL ORGANIZATION FOCUS ON THE FAMILY. THE GROUP CONTENDS THE VACCINE SHOULD BE AVAILABLE FOR PARENTS WHO WANT IT, BUT NOT FORCED ON THOSE WHO DON'T.

Colbert Report Vision America If you have sex, God will give you cancer. ad/index.jhtml?ml_video=82235http:// ad/index.jhtml?ml_video=82235

Religious Groups Respond Nor we can not overlook the moral dimension," Scarborough cautioned, ungrammatically, in a press release. "The governor's action seems to signify that God's moral law regarding sex outside of marriage can be transgressed without consequence." Family Research Council, which sponsored last fall's Values Voter Summit, claimed in its e-letter today that Texas had "erupted in protest," and couched its opposition to the vaccine as a parents-rights issue. "[T]he issue at hand is not whether to make the drug available to young women — few would argue otherwise — but whether or not it should be a requirement of school attendance for schoolgirls and who should literally call the shots," wrote FRC president Tony Perkins. "Parents should not have to 'opt-out'; rather they should be able to 'opt-in' their daughters for the vaccination."

Methods Annenberg National Health Communication Survey, a monthly online survey with a nationally-representative sample of adults Participants selected through RDD, one participant per household Survey ran in June 2006 Survey completion rate= 74%

Methods Survey consisted of three parts: –Experimental manipulation of information –Attitudes toward HPV vaccine policies Participants were randomized to read one of three versions (framing manipulations) describing the vaccine Sample: N=635; 51% female; 75% non- Hispanic white, mean age=47.6 yrs

Framing Manipulations HPV causes cervical cancer HPV is a sexually transmitted infection The vaccine may/may not lead to increased sexual promiscuity Message 1  Message 2  Message 3 

Vaccination Intentions Intention measures: –How likely are you to get the HPV vaccine if it is available at little or no cost to you or your family? –How likely are you to get the HPV vaccine if you or your family has to pay for it?

Intentions to Vaccinate (1= very unlikely, 5= very likely) PAY, p<.20 NO COST, p<.005

Policy, Framing Version, and Ideology IdeologyMean (std) CervicalExt. Conservative Conservative Moderate Liberal Ext. Liberal 2.71 (1.496) 3.34 (1.295) 3.77 (1.150) 3.74 (0.976) 4.00 (1.732) Vaccines for the Uninsured STIExt. Conservative Conservative Moderate Liberal Ext. Liberal 3.57 (1.618) 3.66 (1.200) 3.65 (1.131) 3.67 (1.226) 4.00 (1.001) SexualExt. Conservative Conservative Moderate Liberal Ext. Liberal 2.08 (1.379) 2.78 (1.488) 3.60 (1.218) 4.14 (1.229) 4.43 (0.787) Ideology: p <.001

Attribute Framing HPV vaccine Media and Public Health Frames varied Affect judged effectiveness? Affect policy judgments? Cabral Bigman

Scope of Work Rolling cross section re HPV –One year, rep sample, monthly –Knowledge and news coverage Two experiments –HPV, STIs, promiscuity, rep sample –HPV, pos-neg frame, rep sample 5/9/2006

Framing Literature Kahneman and Tversky’s Prospect Theory (1979,1981)  health communication framing studies Logically equivalent information  different health preferences and behavior (e.g. Rothman et al., 2006 ) Framing of efficacy information represent attribute frames (Levin, Schneider & Gaeth, 1998) Efficacy attribute framing example: –Condom has 90% success rate vs. 10% failure rate (Linville et al., 1993)

Framing Media coverage -- positive attribute frame: “A vaccine licensed by the Food and Drug Administration in June protects against two strains of HPV that cause nearly 70 percent of cervical cancer cases. The same vaccine, Gardasil, produced by Merck &. Co., also prevents two other strains linked to 90 percent of genital wart cases.” (Howard Price, J. 2007, Feb 28, “Nearly 25% of females ages have HPV, study finds” The Washington Times)

Framing Media coverage -- negative attribute frame: “Millions of women have annual Pap smears to test for cervical cancer, and tens of thousands undergo further expensive testing and procedures after receiving false positive tests. Such testing will continue in part because the vaccine’s preventive effects are years away but also because Gardasil does not protect against viral strains that cause up to 30 percent of cervical cancers.” (Harris, G., 2006, June 30, Panel Unanimously Recommends Cervical Cancer Vaccine for Girls 11 and Up, The New York Times)

Framing Media coverage -- mixed attribute frame “Called Gardasil, the vaccine has been proved to prevent two types of human papilloma virus infection, the strains responsible for 70 percent of cervical cancers. It is also effective against about 90 percent of the HPV strains that cause genital warts. Even then, Gardasil cannot protect against 30 percent of HPV strains that cause cervical cancer, so regular Pap smears are still recommended for cancer screening.” (Griffith, D. 2006, Aug. 31, Some parents not sold on cervical cancer shot. Sacramento Bee)

How Information Presented

2007 Data

F(4, 323)=5.91, <.001 Pos > Cont > Neg, p<.05

Framing Effects for Mandate and Non-mandate Related Items. Note. Black bars reflect t-test differences of p≤.05.

2007 & 2008

78 Framing Effects for Mandate Opinion Support by Ideology and Year Note. Framing effects reflect the mean difference between positive and negative frame conditions with prior mandate opinion as a covariate.

Amy Leader Cabral Bigman Caryn Lerman Hyun Suk Kim Jean Brechman Chul-joo Lee

Collaborators Amy Leader Cabral Bigman Young Min Baek Caryn Lerman Hyun Suk Kim Jean Brechman Chul-joo Lee Andrew Strasser Alyssa Bindman Heather Forquer Mario Giorno Yahui Kang Marty Fishbein Robert Hornik CECCR PI

Lessons Conventional wisdom Resistance: social & psychological Design: art & science Science: long way to go But …