1. Idaho Test of Accurate Person Perception: Initial Creation of a Standardized Test Tera D. Letzring, Douglas E. Colman, Jared Vineyard Idaho State University

2. Overview Background and need for a standardized measure Step 1: Select stimulus videos Step 2: Optimal video-length Step 3: Ideal number of targets Step 4: Test-retest reliability Step 5: Convergent validity Next Step Conclusion

3. Background Judging traits and states of others – Big Five, dominance, personal values, emotions Consensus Self-other agreement Realistic accuracy

4. Background Why accuracy is important

5. Background Realistic Accuracy Model (Funder, 1995) Relevance Availability Detection Utilization

6. Background Moderators of accuracy – Good target – Good trait – Good information (quantity and quality) – Good judge

7. Background Need for a standardized test – Creation of unique stimulus materials – Difficult to compare findings Idaho Test of Accurate Person Perception (ITAPP)

8. Overview Background and need for a standardized measure Step 1: Select stimulus videos Step 2: Optimal video-length Step 3: Ideal number of targets Step 4: Test-retest reliability Step 5: Convergent validity Conclusion

9. Step 1: Select stimulus videos Existing videos from four projects – Individuals, dyads, triads Accuracy criteria: self and acquaintances Half female and half male Variability across traits: Big Five, ego-control and ego-resiliency, subjective happiness or satisfaction with life, dominance, state affect

10. Overview Background and need for a standardized measure Step 1: Select stimulus videos Step 2: Optimal video-length Step 3: Ideal number of targets Step 4: Test-retest reliability Step 5: Convergent validity Conclusion

11. Step 2: Optimal Video-Length Method – Amazon’s Mechanical Turk (MTurk) – N=437, 68% females; M age =36.23 (12.02), 76% White, 9% Black/African American, 6% Asian, 8% biracial/other – 4 conditions: 30-seconds, 1-minute, 3-minutes, and 5-minutes – Observed and rated 8 videos

12. Step 2: Optimal Video-Length Analysis – Social Accuracy Model (SAM; Biesanz, 2010) – Normative accuracy – Distinctive accuracy – Computed scores for each judge – Examined variability of scores (SD)

13. Step 2: Optimal Video-Length Results for Big Five traits only

14. Step 2: Optimal Video-Length Results for Big Five traits only

15. Overview Background and need for a standardized measure Step 1: Select stimulus videos Step 2: Optimal video-length Step 3: Ideal number of targets Step 4: Test-retest reliability Step 5: Convergent validity Conclusion

16. Step 3: Ideal Number of Targets Method – Amazon’s MTurk – N=433, 72% female; M age =37.46 (12.72), 82% White, 7% Black/African American, 5% Asian, 6% biracial/other – Observed and rated 10 3-minute videos

17. Step 3: Ideal Number of Targets Analysis – SAM: normative and distinctive accuracy variance across accuracy scores of Reliability = individual judges overall random effects variance

18. Step 3: Ideal Number of Targets Results for Big Five traits only

19. Step 3: Ideal Number of Targets

20. Overview Background and need for a standardized measure Step 1: Select stimulus videos Step 2: Optimal video-length Step 3: Ideal number of targets Step 4: Test-retest reliability Step 5: Convergent validity Conclusion

21. Step 4: Test-Retest Reliability Method – Time 1: Step 3 data – Time 2 About 2 weeks later (M=13.93 days, SD=1.82) Observed and rated 10 new targets N for both time points = 211 (71% female; M age =37.86 (12.5), 78.7% White, 6.8% Black/African American, 3.6% Asian, 10.9% biracial/other)

22. Step 4: Test-Retest Reliability Analyses – SAM: normative and distinctive accuracy scores per judge at each time point – Correlate across time points

23. Step 4: Test-Retest Reliability Results Distinctive Accuracy Normative Accuracy All 10 targets.49.77 Note. All significant at p <.001

24. Step 4: Test-Retest Reliability Results Distinctive Accuracy Normative Accuracy All 10 targets.49.77 First 6 targets.29.69 Note. All significant at p <.001

25. Overview Background and need for a standardized measure Step 1: Select stimulus videos Step 2: Optimal video-length Step 3: Ideal number of targets Step 4: Test-retest reliability Step 5: Convergent validity Conclusion

26. Step 5: Convergent Validity Accuracy based on six 3-minute videos

27. Step 5: Convergent Validity Big Five traits Ego-control & resiliency Satisfaction with life Interpersonal reactivity Trait affect Psychological well-being Interpersonal support Interpersonal problems Shyness and sociability Narcissism Self-esteem Depression Attributional complexity Motivation

28. Next Step Create new stimuli videos – Males and females – College students and other young adults – Various ethnic backgrounds, regions of US and Switzerland, religious affiliations, sexual orientations

29. Next Step Expand constructs – Personality traits – Personal values – Perspective-taking or empathy – State affect – Sexual orientation – Pain detection – Satisfaction with life – Deception

30. Conclusion Valuable first step toward creating a standardized measure of accurate person perception Move the field of judgment accuracy forward at a faster pace Make results more comparable

31. Acknowledgements ISU Office for Research Faculty Seed Grant Co-authors: Doug Colman and Jared Vineyard

32. Acknowledgements ISU Office for Research Faculty Seed Grant Co-authors: Doug Colman and Jared Vineyard Thank you