Mere Presence and PowerPoint: Examining Social Facilitation and Software By: Will Osnato and Matt Worley.

Slides:



Advertisements
Similar presentations
YOU CANT RECYCLE WASTED TIME Victoria Hinkson. EXPERIMENT #1 :
Advertisements

Validity (cont.)/Control RMS – October 7. Validity Experimental validity – the soundness of the experimental design – Not the same as measurement validity.
 AGE Different ages have different needs, competences, and cognitive skills. Steven Pinker – acquisition of language (L1, L2 or Foreign) is guaranteed.
Inadequate Designs and Design Criteria
Gould on Baseball: The demise of the.400 hitter (Notes from Full House)
Relating Error Diagnosis and Performance Characteristics for Affect Perception and Empathy in an Educational Software Application Maria Virvou, George.
Inference for a population mean BPS chapter 18 © 2006 W. H. Freeman and Company.
Competitive state anxiety and self- confidence: Intensity and direction as relative predictors of performance on a golf putting task By: Group Two.
Copyright ©2011 Brooks/Cole, Cengage Learning Testing Hypotheses about Means Chapter 13.
Method IntroductionResults Discussion Effects of Plans and Workloads on Academic Performance Mark C. Schroeder University of Nebraska – Lincoln College.
The Methods of Social Psychology
Chapter 10 - Part 1 Factorial Experiments.
Chapter 6 Variables Used in Experimentation ♣ ♣ Types of Variables   The Independent Variable   The Dependent Variable   Demo: Identifying IVs and.
Research Methods Steps in Psychological Research Experimental Design
Smith/Davis (c) 2005 Prentice Hall Chapter Ten Designing and Conducting, Experiments with Two Groups PowerPoint Presentation created by Dr. Susan R. Burns.
1 Chapter 20 Two Categorical Variables: The Chi-Square Test.
An Examination of Learning Processes During Critical Incident Training: Implications for the Development of Adaptable Trainees Andrew Neal, Stuart T. Godley,
Pilot: Customizing a Commercially Available Digital Game to Assess Cognitive Function William C. M. Grenhart, John F. Sprufera, Jason C. Allaire, & Anne.
1 Psych 5500/6500 Confounding Variables Fall, 2008.
Integrating Data Analysis At Berea College Jill Bouma Berea College August 13,
Experiments & Statistics. Experiment Design Playtesting Experiments don’t have to be “big”--many game design experiments take only 30 minutes to design.
GROUP DIFFERENCES: THE SEQUEL. Last time  Last week we introduced a few new concepts and one new statistical test:  Testing for group differences 
Evidence Based Medicine
A Comparison Between the Mets and the Yankees Many baseball fans criticize the New York Yankees for “buying” the best players in Major League Baseball.
Competitive state anxiety and self-confidence: Intensity and direction as relative predictors of performance on a golf putting task SEAN T. CHAMBERLAIN1.
THE RELATIONSHIP BETWEEN PRE-SERVICE TEACHERS’ PERCEPTIONS TOWARD ACTIVE LEARNING IN STATISTIC 2 COURSE AND THEIR ACADEMIC ACHIEVEMENT Vanny Septia Efendi.
1 Psych 5500/6500 The t Test for a Single Group Mean (Part 4): Power Fall, 2008.
Usability Testing Chapter 6. Reliability Can you repeat the test?
Chapter 5 Comparing Two Means or Two Medians
Learning objectives By the end of the session all learners will have: Identified at least 2 motives specific to them Considered key evidence to support.
How can giving ELL students access to learning games on a computer help them learn in the classroom? By: Lisa Cruz.
Does training on self-regulated learning facilitate students' learning with hypermedia Presenter: Jenny Tseng Professor: Ming-Puu Chen Date: March 15,
Data Analysis Econ 176, Fall Populations When we run an experiment, we are always measuring an outcome, x. We say that an outcome belongs to some.
Identifying Programmer Ability Using Peer Evaluation: An Exploratory Study Jeffrey C. Carver, University of Alabama Lorin Hochstein, USC Information Sciences.
AMSc Research Methods Research approach IV: Experimental [1] Jane Reid
Lab 9: Two Group Comparisons. Today’s Activities - Evaluating and interpreting differences across groups – Effect sizes Gender differences examples Class.
Gender and Year of Study as a Predictor of Life Pressures Research Project Presentation March 30, 2000 Jennifer Drover Laura Peddle.
CHAPTER 15: Tests of Significance The Basics ESSENTIAL STATISTICS Second Edition David S. Moore, William I. Notz, and Michael A. Fligner Lecture Presentation.
APA Results Section Results.
Presenter: Han, Yi-Ti Adviser: Chen, Ming-Puu Date: March 02, 2009 Papastergiou, M.(2009). Digital Game-Based Learning in high school Computer Science.
Experimental Research Methods in Language Learning Chapter 5 Validity in Experimental Research.
Inference for Two Population Means Goal: Hypothesis Test or Confidence interval for the “average difference” between two populations There are two designs.
Introduction to Statistics for the Social Sciences SBS200, COMM200, GEOG200, PA200, POL200, or SOC200 Lecture Section 001, Spring 2015 Room 150 Harvill.
A health magazine recently reported a study in which researchers claimed that iron supplements increased memory and problem-solving abilities in a random.
CHAPTER 27: One-Way Analysis of Variance: Comparing Several Means
CHAPTER 27: One-Way Analysis of Variance: Comparing Several Means
Research in Psychology Chapter Two 8-10% of Exam AP Psychology.
CHAPTER 15: Tests of Significance The Basics ESSENTIAL STATISTICS Second Edition David S. Moore, William I. Notz, and Michael A. Fligner Lecture Presentation.
Sample paper in APA style Sample paper in APA style.
Does higher club payroll in Major League Soccer directly relate to success? In US professional sports the big market teams or the teams that have the most.
Module Example: Influence of Race and Gender on Income 1 Used in Social Problems class, 100-level course 20 students in class (all have laptops) Takes.
Module Example: Influence of Race and Gender on Income1
The effects of physical activity on third grade math scores
Welcome to Strategies for Teaching ACT Science Skills
Unit 5: Hypothesis Testing
Chapter 5 Comparing Two Means or Two Medians
Experimental Design-Chapter 8
Effects of Targeted Troubleshooting Activities on
The digital divide: the special case of gender
Experimental Psychology PSY 433
Erin Harris & Jerry Weinberg
Finding Answers through Data Collection
2 independent Groups Graziano & Raulin (1997).
Program for International Student Assessment (PISA) 2009 Results
THE RELATIONSHIP BETWEEN PRE-SERVICE TEACHERS’ PERCEPTIONS TOWARD ACTIVE LEARNING IN STATISTIC 2 COURSE AND THEIR ACADEMIC ACHIEVEMENT Vanny Septia Efendi.
Experimental Design: The Basic Building Blocks
Thinking critically with psychological science
Research in Psychology Chapter Two 8-10% of Exam
Embry-Riddle Aeronautical University, College of Aviation
Chapter Ten: Designing, Conducting, Analyzing, and Interpreting Experiments with Two Groups The Psychologist as Detective, 4e by Smith/Davis.
Presentation transcript:

Mere Presence and PowerPoint: Examining Social Facilitation and Software By: Will Osnato and Matt Worley

Robinson-Stavely & Cooper, 1990 Examined the social context effects of computing Used the simplest meaning of public context, or the mere presence of others

(Robinson-Stavely & Cooper, 1990) Princeton University men and women participated in a study to play with “Zork”, an adventure game. They were instructed to make the most progress that they possibly could in 20 minutes They worked in a room completely alone or in the presence of another person Always of the same sex Who was not playing Zork (a “mere presence” condition)

Features of “Zork”, the adventure game Male-oriented metaphors, such as -finding treasure - slaying dragons - participants in public condition made aware that other person was neither competing nor aware of their performance

Effects of the social context Results showed that females were just as adept as the males at Zork in the private condition However, in the public condition the females performed significantly worse and reported more anxiety than the males It seems that the social context facilitated the gender difference in this study

Performance scores on Zork

What about aspects of computing other than computer games? Computer application classes in high schools often teach software instruction in large, mixed-gender groups. Students work in open computer labs with many other students working around them This creates a possible situation for social facilitation to cause gender differences

How can we test performance at using office software? We constructed a task that required participants to put together a simple 6- slide PowerPoint presentation Participants used data provided by the experiment. No data search or computation was involved, in order to strictly assess performance at the presentation organization task

Sample Data: Baseball statistics We used baseball statistics to comprise the sample data that participants would use for the presentation Assuming that males are more comfortable and accustomed to baseball, this would create a task with male-oriented features, similar to the male oriented “Zork” game (Robinson-Stavely & Cooper, 1990) In addition, participants completed the experiment in public or private conditions, allowing us to evaluate if the social context would facilitate the gender effects on performance

Hypothesis Females completing a male-oriented PowerPoint task would be just as adept at males if they were alone. However, in the presence of other people, females’ performance would suffer and they would experience more anxiety

Independent Variables Half of the participants completed the task in private conditions Half of the participants completed the task in a mixed-gender group

Dependent Measures Time We assumed that participants would need more time if they felt pressured by the social context Self-reported anxiety, confidence, etc. Pre- and post-test questionnaires evaluated how anxious, comfortable, confident, and overwhelmed participants felt before and during the task

Methods Participants were asked to imagine themselves as a statistician for a sports news company Their task would be to organize a PowerPoint presentation involving the home run statistics for 3 players on a major league baseball team over the past 4 years. Stats for 4 teams would be presented, requiring 1 slide per team. In addition, participants would include a title slide and a final slide with a general analysis. Participants knew they were being timed. They were asked to complete the task as quickly as they could, while fulfilling all aspects of the task

Methods (cont.) Pre-test questionnaire Instructions- Participants would make 6 slides (Title Slide, 4 Team Slides, Final Slide) Team Slides would include the team name, a bar graph displaying the home run statistics, and text summarizing the general trends of the graph Final Slide required participants to make some analytical statement or prediction based on the information from the team slides Post-test questionnaire

Sample stat chart from instructions Participants took information from 4 charts such as this and converted it to the bar graph format.

Some examples of presentation slides

Homerun Production, New York Yankees Boston Red Sox Anaheim Angels St. Louis Cardinals

New York Yankees Jason Giambi has been the Yankees most consistent homerun hitter, averaging just over 40 homers per season. Jorge Posada slumped in 2001 and 2002, while having his best season in 4 years in Bernie Williams has hit steadily fewer homeruns over the last 4 seasons.

2004 Predictions Based on the past 4 seasons, the New York Yankees should expect around 75 HRs from their top three hitters. The Red Sox can expect their three top hitters to produce at least 80 HRs in Anaheim’s top hitters will break 70 HRs in The Cardinals’ top hitters will surpass 75 HRs in 2004.

Results: Females in private condition seemed to expect worse performance going in

This coincides with previous data showing that females tend to be less comfortable and more anxious when using computers. Females in public condition also expected to perform worse than males

Results: Time measures revealed that females were just as able as males

Females did not report more anxiety or less confidence in public condition

Against hypothesis We expected females in the public condition to feel more anxiety, less confidence, less ability, and more tense at the task. In contrast, data for females and males was similar in this domain. Any explanation why?

Females in public condition expected to perform better than those in private

It is possible that females in the public condition felt more comfortable with the task based on their own ability, rather than the experimental conditions. Females in the public condition also responded with low ratings of belief that others were aware of their progress,

Comparison of pre-test and post-test responses in private condition

Comparison of pre-test and post-rest responses in public condition

Implications from comparisons In both private and public conditions, females rated themselves as less anxious, more confident, less overwhelmed, and having more ability in the post-test questionnaire. Likely that females realized that they were as able as males. When thinking about the experiment, they realized that it wasn’t actually all that bad, and felt less anxious.

Females less confident and more anxious when making analytical prediction

Why are females significantly worse at this task? Likely due to male-oriented subject of baseball Females, having less experience with baseball statistics, felt much less confident when making predictions. Making analytical prediction based much more on experience than the rest of the presentation task.

Implications and Error Analysis

Not all hypotheses supported Results were not significant in the predicted direction for all measures. Evidence showed that females did have more worries about the task before-hand, but any deficits in performance were not correlated with the presence of other people. Females in the public condition actually self-reported as being less anxious than those in private after the experiment. We expected females to need more time in the public condition. They did not.

Why? Low number of participants Leads to high standard deviations, need to run more experiments Subject of baseball Could confound the male/female difference in or against the predicted direction. Also, this makes the results inapplicable to PowerPoint tasks that do not use male-oriented metaphors.

Other confounds Typing speed of participant Computer processing speed Subjects using a mouse vs a touchpad on a laptop

Time as a dependent measure Cognizance of speed Some participants may have forgotten that speed was important. Participants in the public condition were likely to be aware of others’ progress and subsequently work faster Interest and Creativity We assumed that females, less familiar with baseball, would take longer in public. In contrast, those familiar with baseball (males) could have been more interested in the presentation, gotten more creative, and made a more elaborate presentation, thus taking more time.

Interest and Creativity Likely exerted strong effects in subjective part of experiment where participants were required to summarize each graph. Here, there existed great variability in the amount of information that subjects included. The following 2 slides were from identical parts of the experiment, from 2 different subjects.

St. Louis Cardinals Albert Pujols seems to be the Cardinals’ best bet for the future of their home run hitting.

St Louis Cardinals The St. Louis Cardinal hitters fluctuated in their performance. Each player peaked at different years during this four year period (Martinez peaked in 2001, Edmonds in 2000 and Pujols in Martinez appears to be on a general downward trend after 2001, overall Edmonds has also experienced a dip in performance over the years but he did achieve 39 hits in 2003 which was comparable to 2000, like Edmonds, Pujols appears to be doing significantly better than *Pujols did not play in 2000

Future Research More objective measures Tasks that can be scored on content, rather than being based on time alone Time If included, there should be less variability in the complexity of responses. Also, participants should always be aware of need to work fast Non-biased subject matter To evaluate if effects are due to content of information, or to actual software itself Obviously, more participants

Conclusion Due to the subjective nature of the experiment, it is difficult to validate our hypothesis. Generally, our experiment supports the idea that females are more anxious going into a PowerPoint task. Such anxiety can be decreased by a task that is completed successfully and relatively quickly. Further research into gender differences and software is warranted, requiring more subjects and more objective methods