1. CMU Faculty Self-Perception Presented by: Group #3 Zeljka Bradaric Meng-Yang Chiang Belinda Kazlman John Rinderle

2. Agenda Background and Design Background and Design Expectations Expectations Questionnaire Questionnaire Survey Administration Survey Administration Data Analysis Data Analysis Conclusions Conclusions

3. Why we chose this topic? Social Psychology Phenomenon Social Psychology Phenomenon People tend to perceive themselves above average even though they may be below average People tend to perceive themselves above average even though they may be below average Curious to see if CMU Faculty follow this pattern of self-serving bias Curious to see if CMU Faculty follow this pattern of self-serving bias

4. Background and Design Target Population Target Population Carnegie Mellon Faculty Carnegie Mellon Faculty Sample Population Sample Population Difference between target and sample Difference between target and sample Frame Frame Email list provided by Ethan, weeded out to eliminate non-eligible emails Email list provided by Ethan, weeded out to eliminate non-eligible emails Stratified Random Sample Stratified Random Sample Proportional Allocation across departments Proportional Allocation across departments

5. Background and Design(cont.) Sample size Sample size Assume 50% response rate, MOE of 9% Assume 50% response rate, MOE of 9% 863 Faculty in original list (without Philosophy) 863 Faculty in original list (without Philosophy) Original sample of 200, then added 12 with philosophy department Original sample of 200, then added 12 with philosophy department Survey was online Survey was online Participants received email with link to take our survey Participants received email with link to take our survey

6. Expectations Faculty would be more willing to take survey to help out students Faculty would be more willing to take survey to help out students Would have higher response rate in H&SS and CFA than in CIT or SCS Would have higher response rate in H&SS and CFA than in CIT or SCS CIT and SCS to rate themselves higher than H&SS and CFA CIT and SCS to rate themselves higher than H&SS and CFA

7. Questionnaire First piloted on friends for understanding First piloted on friends for understanding Got feedback from Profs for formatting issues Got feedback from Profs for formatting issues

8. Survey Administration Survey was administered electronically between 4/19/2001. and 4/30/2001. Survey was administered electronically between 4/19/2001. and 4/30/2001. Three attempts at follow-up were made on 4/23/01, 4/26/01, and 4/29/01. Three attempts at follow-up were made on 4/23/01, 4/26/01, and 4/29/01. Problems Problems Left out two departments in list Left out two departments in list No technical issues No technical issues

13. Response Rates by Department HCII540.80 Modern Languages850.62 SDS530.60 Physics950.56 Architecture940.44 Mathematics940.44 MSE940.44 Chemistry730.43 Computer Science2190.43 Psychology730.43 Drama1140.37 Mechanical Engineering620.33 Biology720.29 EPP410.25 History820.25 ECE1430.21 CEE510.20 Chemical Engineering510.20 Philosophy1020.20 Statistics510.20 Art610.17 Design710.14 Robotics Institute1210.08 Music1410.07 English900.00

14. Departments where >2 responded HCII HCII Modern Languages Modern Languages SDS SDS Physics Physics Architecture Architecture Mathematics Mathematics MSE MSE Chemistry Chemistry Computer Science Computer Science Psychology Psychology Drama Drama ECE ECE

15. Teaching Ability Chemistry91.67% Drama86.25% Psychology78.33% Mathematics75.00% Computer Science73.44% Physics69.00% MSE68.75% Modern Languages63.00% Architecture57.50% SDS45.00% ECE43.33% HCII36.67%

16. Research Ability Physics68.00% Mathematics66.67% Chemistry65.00% ECE63.33% Drama57.66% Architecture57.50% HCII51.25% Computer Science48.75% MSE46.25% Psychology40.00% SDS31.67% Modern Languages26.66%

17. Creativity Drama85.00% Chemistry83.33% Mathematics79.25% ECE76.67% HCII71.25% Physics68.00% Computer Science67.22% Psychology65.00% Modern Languages62.00% MSE61.25% Architecture56.25% SDS40.00%

18. Rapport with students Drama88.75% Chemistry80.00% Psychology75.00% Physics70.00% Computer Science66.44% Modern Languages64.00% Mathematics62.50% SDS56.67% Architecture56.25% MSE56.25% ECE38.33% HCII36.67%

19. Prestige Chemistry80.00% Drama71.25% Physics68.00% ECE53.33% Mathematics53.00% Psychology46.56% Computer Science37.22% Modern Languages36.00% HCII36.00% Architecture33.75% MSE33.75% SDS28.33%

20. Quality of the department within CMU Computer Science87.11% ECE83.33% Psychology83.33% Drama72.50% SDS68.33% Chemistry63.33% Modern Languages63.00% Physics62.00% HCII60.00% MSE60.00% Mathematics55.00% Architecture52.50%

21. CMU faculty vs. other faculty Psychology91.00% SDS91.00% Drama90.00% Computer Science83.33% Modern Languages82.00% ECE80.00% Mathematics78.75% Chemistry75.00% Physics75.00% HCII72.50% Architecture68.75% MSE61.67%

22. Field of study among those present at CMU ECE83.33% Chemistry80.00% Psychology76.67% Computer Science74.89% Physics70.00% Mathematics67.50% MSE66.25% Architecture62.50% Drama55.00% SDS45.00% HCII37.50% Modern Languages32.00%

23. Field of study within the department Drama83.75% Chemistry83.33% Computer Science78.89% ECE73.33% Psychology73.33% Architecture66.67% HCII62.50% SDS53.33% Physics52.50% Modern Languages52.00% Mathematics51.25% MSE50.00%

24. Comments “I do not have time for surveys.” “In the School of Drama the uniqueness of one's teaching style is valued highly. Also we respect each other's privacy in the classroom. I couldn't judge, unfortunately for your survey's goal, my colleagues teaching quality and even I'd find it unthinkable to play with some percents there. There's no such kind of a measurement in the arts in my view.” “As I am no longer officially a faculty, having resigned in the Spring, you may take that as an indication that I did not feel that my worth was fully appreciated.” We also received one automatically generated response indicating that the recipient of our email was deceased.

25. Conclusions CMU Faculty DO exhibit self-serving bias CMU Faculty DO exhibit self-serving bias Non-response problems and questions Non-response problems and questions Faculty very worried about confidentiality Faculty very worried about confidentiality Topic more sensitive than originally thought Topic more sensitive than originally thought Expectations were wrong Expectations were wrong

26. Questions ?