Presentation is loading. Please wait.

Presentation is loading. Please wait.

Evaluation After presenting the results, I asked students to rate the classroom activity according to whether it (1) was enjoyable to them, (2) was helpful.

Similar presentations


Presentation on theme: "Evaluation After presenting the results, I asked students to rate the classroom activity according to whether it (1) was enjoyable to them, (2) was helpful."— Presentation transcript:

1 Evaluation After presenting the results, I asked students to rate the classroom activity according to whether it (1) was enjoyable to them, (2) was helpful in providing understanding of personality research, and (3) should be used in future classes. Each question was rated on a 7-point Likert-type scale (1 = “not at all,” 4 = “neutral,” 7 = “very much”). Student evaluations of the activity were largely favorable. Mean ratings for enjoyment, understanding, and future use were 5.7, 5.6, and 5.9, respectively. The median ratings were 6 on all items. The distributions of ratings on each question are shown in Figure 2. I left room for open-ended comments or suggestions on the evaluation form. All open- ended comments that were given are shown below Figure 2. Below are a few benefits of the Facebook activity (in my opinion): 1.Most students are involved in social networking, so they are likely to be intrinsically interested in the question of how we use online information to make inferences about each other (and whether our inferences are right). 2.The activity helps reinforce student understanding of the nature of the Big Five traits (i.e., the particular facets that are reflected in each global trait). 3.It provides an opportunity to clarify the distinction between rater consistency and rater accuracy in personality assessment (i.e., agreement does not imply accuracy or truth). 4.The activity was fun and generated a lot of interesting discussion. During the activity, students spontaneously began discussing whether the subject was using “impression management” that might not reflect a true picture of his personality. This gave me an opportunity to discuss Gosling’s distinction between deliberate identity statements and inadvertent behavioral residues. 5.The activity was fairly easy to implement. Results Presented to Class I first presented data on rater consistency in judgments of the Big Five factors. Because only one target subject was rated, rater consistency could not be calculated for each of the traits separately (as is typically done in published research). Instead, I computed Cronbach’s alpha coefficients for ratings over the five traits. Essentially this involves treating each rater as a test item, and each trait as a “subject” to be rated. In this way, Cronbach’s alpha coefficient provides an estimate of the degree to which raters were consistent in their relative rankings of the five traits (e.g., whether the subject was higher in conscientiousness than in openness, etc.). For “close other” ratings, Cronbach’s alpha was.94; for the class ratings, alpha was.96. These results indicated that in both sources of ratings there was high consistency in judgments of the target subject’s relative standing on the five traits. Next I presented data on rater accuracy. Again, because only one target subject was rated, the typical quantitative measures of accuracy could not be used. Instead, I presented error bar charts for each Big Five factor showing (1) the target subject’s self-ratings, (2) the mean “close other” ratings, and (3) the mean class ratings. The standard deviations of the ratings were used to define the error bars. A reference line was displayed at the neutral point (rating of 4). If all 3 sources of ratings were above the neutral point or below the neutral point (within the error limits), this could be viewed as a crude assessment of accuracy. The error bar charts for each of the Big Five are shown in Figure 1. On all factors, “close other” ratings were closer to the target subject’s self-report than were class ratings (which was to be expected). Class ratings were fairly accurate for extraversion, conscientiousness, and openness (all sources of ratings consistently above or below the neutral point), but less so for emotional stability and agreeableness. I showed the class the accuracy data for Facebook ratings provided in Gosling et al. (2007), which is also shown in Figure 1. Their results (based on ratings of 133 target subjects) also indicated less accuracy of ratings for agreeableness and neuroticism (reverse of emotional stability). So the results of the classroom rating activity were broadly compatible with published research. Abstract I describe a classroom activity designed to reinforce student understanding of the nature of the Big Five personality traits and to illustrate recent research on how people make personality judgments on the basis of environmental cues, including cues provided in online (virtual) spaces. Students rated the personality of a subject (unknown by them) based solely on his Facebook page. Class ratings were compared to the target subject’s self-ratings and to ratings of five people who know the target subject well. Most students enjoyed the activity, thought it helped them understand personality research and concepts, and believed that the activity should be used in future classes. A Classroom Activity Illustrating Big Five Personality Judgments from Facebook Cues Jack W. Berry, Samford University Introduction Trait theories are central in research-based approaches to personality psychology. The dominant trait theory today is the Big Five personality theory, which centers on the measurement and predictive value of five broad personality dimensions: extraversion, agreeableness, neuroticism, conscientiousness, and openness to experience. When I teach about trait theories, students seem particularly interested in recent research on the sources of information in everyday life that reflect a person’s personality, such as handshakes, musical preferences, occupational choices, and cues from a person’s living spaces such as offices and bedrooms. Personality researchers have begun to examine whether a person’s “online presence,” such as personal websites and social network sites, provide useful cues for making valid judgments about personality (Back et al., 2010; Gosling, Gaddis, & Vazine, 2007). In these studies, research participants make personality ratings on many target subjects based solely on the cues evident in the targets’ online spaces. Personality ratings are assessed for rater consistency (agreement) and accuracy. Accuracy is typically assessed by comparison to target subjects’ self-reports and to proxy ratings by people who know the targets well. In my Theories of Personality class in the Fall 2012 semester, I adapted methods used by Gosling et al. (2007) in their Facebook research to create a classroom activity to give students the experience of making their own personality judgments about a person unknown to them based on the person’s Facebook page. Although 36 students were enrolled in the course, 32 students were present for the activity. Figure 1. Personality Ratings by Source Figure 2. Student Evaluations of Classroom Activity Student Comments This activity was a great way to get students involved and better understand the concepts we’re studying in class. I enjoyed this activity and liked the idea of comparing the results to Gosling’s research. I thought it was a great activity and something you should definitely do in future classes. ☺ It was very enjoyable but wasn’t extremely helpful. It was helpful because it gave us practice doing something we do on a normal basis. Expand it. A one-off study is less useful than doing 5. If we did more it would be better. Get students to indicate what influenced their decisions (what parts of Facebook page).. Description of Classroom Activity After describing previous research on personality judgments based on living spaces and online cues, I asked the class whether they would like to try making ratings of someone’s personality based only on the person’s Facebook page. The students seemed excited by the prospect. I explained that I had already obtained the self-report ratings of the target subject (my nephew, a recent college graduate), who completed the Ten Item Personality Inventory (TIPI; Gosling, Rentfrow, & Swann, 2003) of the Big Five traits. The TIPI consists of 10 items, each rated on a Likert-type scale ranging from 1 (strongly disagree) to 7 (strongly agree), with 4 representing the neutral point. Each of the Big Five traits is estimated by the average of two items. Students were already familiar with the TIPI, having completed it themselves earlier. The TIPI is moderately correlated with longer scales of the Big Five but takes only a few minutes to complete and score, which made it ideal for completing in a single class period. I had also obtained TIPI ratings of the target subject from five people who know the subject well (his fiancé, brother, sister, mother, and me, his uncle). I took the average of these ratings as a “close other” estimate of the target’s personality profile. In class, I projected my computer screen so students could view the target subject’s Facebook page. One student volunteered to navigate the page for the class. After 15 minutes, students rated the target subject using the TIPI, which they completed, scored, and returned to me. I conducted several analyses on the data and presented the results the next class meeting. Contact: Jack W. Berry, Department of Psychology, Samford University, 800 Lakeshore Drive, Birmingham, AL 35229; 205-726-2358; jwberry@samford.edu


Download ppt "Evaluation After presenting the results, I asked students to rate the classroom activity according to whether it (1) was enjoyable to them, (2) was helpful."

Similar presentations


Ads by Google