Idaho Test of Accurate Person Perception: Initial Creation of a Standardized Test Tera D. Letzring, Douglas E. Colman, Jared Vineyard Idaho State University

Overview Background and need for a standardized measure Step 1: Select stimulus videos Step 2: Optimal video-length Step 3: Ideal number of targets Step 4: Test-retest reliability Step 5: Convergent validity Next Step Conclusion

Background Judging traits and states of others – Big Five, dominance, personal values, emotions Consensus Self-other agreement Realistic accuracy

Background Why accuracy is important

Background Realistic Accuracy Model (Funder, 1995) Relevance Availability Detection Utilization

Background Moderators of accuracy – Good target – Good trait – Good information (quantity and quality) – Good judge

Background Need for a standardized test – Creation of unique stimulus materials – Difficult to compare findings Idaho Test of Accurate Person Perception (ITAPP)

Overview Background and need for a standardized measure Step 1: Select stimulus videos Step 2: Optimal video-length Step 3: Ideal number of targets Step 4: Test-retest reliability Step 5: Convergent validity Conclusion

Step 1: Select stimulus videos Existing videos from four projects – Individuals, dyads, triads Accuracy criteria: self and acquaintances Half female and half male Variability across traits: Big Five, ego-control and ego-resiliency, subjective happiness or satisfaction with life, dominance, state affect

Overview Background and need for a standardized measure Step 1: Select stimulus videos Step 2: Optimal video-length Step 3: Ideal number of targets Step 4: Test-retest reliability Step 5: Convergent validity Conclusion

Step 2: Optimal Video-Length Method – Amazon’s Mechanical Turk (MTurk) – N=437, 68% females; M age =36.23 (12.02), 76% White, 9% Black/African American, 6% Asian, 8% biracial/other – 4 conditions: 30-seconds, 1-minute, 3-minutes, and 5-minutes – Observed and rated 8 videos

Step 2: Optimal Video-Length Analysis – Social Accuracy Model (SAM; Biesanz, 2010) – Normative accuracy – Distinctive accuracy – Computed scores for each judge – Examined variability of scores (SD)

Step 2: Optimal Video-Length Results for Big Five traits only

Step 2: Optimal Video-Length Results for Big Five traits only

Overview Background and need for a standardized measure Step 1: Select stimulus videos Step 2: Optimal video-length Step 3: Ideal number of targets Step 4: Test-retest reliability Step 5: Convergent validity Conclusion

Step 3: Ideal Number of Targets Method – Amazon’s MTurk – N=433, 72% female; M age =37.46 (12.72), 82% White, 7% Black/African American, 5% Asian, 6% biracial/other – Observed and rated 10 3-minute videos

Step 3: Ideal Number of Targets Analysis – SAM: normative and distinctive accuracy variance across accuracy scores of Reliability = individual judges overall random effects variance

Step 3: Ideal Number of Targets Results for Big Five traits only

Step 3: Ideal Number of Targets

Overview Background and need for a standardized measure Step 1: Select stimulus videos Step 2: Optimal video-length Step 3: Ideal number of targets Step 4: Test-retest reliability Step 5: Convergent validity Conclusion

Step 4: Test-Retest Reliability Method – Time 1: Step 3 data – Time 2 About 2 weeks later (M=13.93 days, SD=1.82) Observed and rated 10 new targets N for both time points = 211 (71% female; M age =37.86 (12.5), 78.7% White, 6.8% Black/African American, 3.6% Asian, 10.9% biracial/other)

Step 4: Test-Retest Reliability Analyses – SAM: normative and distinctive accuracy scores per judge at each time point – Correlate across time points

Step 4: Test-Retest Reliability Results Distinctive Accuracy Normative Accuracy All 10 targets Note. All significant at p <.001

Step 4: Test-Retest Reliability Results Distinctive Accuracy Normative Accuracy All 10 targets First 6 targets Note. All significant at p <.001

Overview Background and need for a standardized measure Step 1: Select stimulus videos Step 2: Optimal video-length Step 3: Ideal number of targets Step 4: Test-retest reliability Step 5: Convergent validity Conclusion

Step 5: Convergent Validity Accuracy based on six 3-minute videos

Step 5: Convergent Validity Big Five traits Ego-control & resiliency Satisfaction with life Interpersonal reactivity Trait affect Psychological well-being Interpersonal support Interpersonal problems Shyness and sociability Narcissism Self-esteem Depression Attributional complexity Motivation

Next Step Create new stimuli videos – Males and females – College students and other young adults – Various ethnic backgrounds, regions of US and Switzerland, religious affiliations, sexual orientations

Next Step Expand constructs – Personality traits – Personal values – Perspective-taking or empathy – State affect – Sexual orientation – Pain detection – Satisfaction with life – Deception

Conclusion Valuable first step toward creating a standardized measure of accurate person perception Move the field of judgment accuracy forward at a faster pace Make results more comparable

Acknowledgements ISU Office for Research Faculty Seed Grant Co-authors: Doug Colman and Jared Vineyard

Acknowledgements ISU Office for Research Faculty Seed Grant Co-authors: Doug Colman and Jared Vineyard Thank you