1. Sylvia Hurtado Marcela Cuellar Cynthia Alvarez AAC&U Meeting October 22, 2010 Houston, TX

2. Purposes, goals, & Key Features of Project Developing the DLE Conceptual Framework A New Assessment: Diverse Learning Environments Survey DLE Survey Pilot Findings

4. Purpose: Assist educators in advancing the success of diverse students Goals: Develop a greater awareness about diversity, student learning, and student success Assess undergraduate skills for work and citizenship in a pluralistic democracy Increase retention rates and improve the assessment of retention Create the conditions for realizing the benefits of diversity in the learning process

5. Research: Diverse Learning Environments Survey Campus Case Studies of 7 Institutions National Retention Study (Clearinghouse) Practice: Institute for the Critical Analysis of Quantitative Data Diversity Research Institute

7. Habits of Mind/Skills for Lifelong Learning Competencies for a Multicultural World Achievement and Retention

8. Institutional Adaptation to Student Diversity Richardson & Skinner (1990) Campus Climate for Diversity Hurtado, Milem, Clayton-Pedersen & Allen (1998, 1999) Milem, Chang & Antonio (2005) Student/Institution Engagement Model Nora, Barlow & Crisp (2005) Dynamics of Multicultural Teaching & Learning Marchesani & Adams (1992) adaptation of Jackson (1988)

9. 9

11. Nationally available CIRP survey Integrated assessment of climate, diversity practice, and outcomes Inclusive of diverse social identities Modules targeting specific topics Longitudinal when linked with other student data (e.g. registrar data)

12. Core Survey Modules Classroom Climate Transition into the Major Intergroup Relations Community College Students Transfer Pathway Transition Experiences for Transfer Students at 4-year Institutions

14. DLE Pilot data from 14 institutions Academic Year 2009 -10 N = 5,010 68.3% Female 58.4% Students of Color 33.6% Age 25+ 39.7% Currently at 2-yr

15. Instrument Coded for Conceptual Themes in Literature Exploratory Factor Analysis (EFA) in SPSS Principal Axis Factoring Varimax Rotation Items removed if loading below.35 Confirmatory Factor Analysis (CFA) in EQS With Uncorrelated Errors (Factor Loadings 1 st Column) With Correlated Errors (Factor Loadings 2 nd Column) Factors Rescaled to 0 – 100 with a mean of 50

16. Harassment Discrimination & Bias Positive Cross-Racial Interactions Negative Cross-Racial Interactions Satisfaction with Diverse Perspectives on Campus Institutional Commitment to Diversity Student Financial Difficulty Academic Validation in the Classroom General Interpersonal Validation Sense of Belonging

17. ItemsFactor Loadings Witnessed discrimination.758/.750 Been mistaken as a member of a racial/ethnic group that is not your own.454/.444 Heard insensitive or disparaging remarks from students.685/.644 Heard insensitive or disparaging remarks from faculty.751/.677 Heard insensitive or disparaging remarks from staff.741/.664 Verbal comments.775/.792 Written comments (e.g. emails, texts, writing on walls, etc.).753/.762 Exclusion (e.g. from gatherings, events, etc.).716/.746 Offensive visual images or items.735/.733 Robust ML Model-Fit Results NFI =.698/.955; CFI =.700/.958; RMSEA =.138/.056 Please indicate how often at this institution you have: Please indicate how often you have experienced the following forms of bias/harassment/discrimination while at this institution:

18. ItemsFactor Loadings Instructors were able to determine my level of understanding of course material.753/.776 Instructors provided me with feedback that helped me judge my progress.818/.842 I feel like my contributions were valued in class.810/.811 Instructors encouraged me to meet with them after or outside of class.651/.582 Instructors encouraged me to ask questions and participate in discussions.717/.673 Instructors showed concern about my progress.611/.588 Robust ML Model-Fit Results NFI =.927/.986; CFI =.928/.986; RMSEA =.126/.062 Please indicate how often you have experienced the following in class at this institution:

19. Curriculum of Inclusion Co-Curricular Diversity Activities (Campus-Facilitated)

20. ItemsFactor Loadings Materials/readings on gender issues.715 Material/readings on issues of oppression as a system of power and dominance.775 Serving communities in need (e.g. service learning).578 Material/readings on race and ethnicity issues.824 Opportunities for intensive dialogue between students with different backgrounds and beliefs.635 Materials/readings on issues of privilege.705 ML Model-Fit Results NFI =.987; CFI =.988; RMSEA =.056 How many courses have you taken at this institution that included the following?

21. ItemsFactor Loadings Attended presentations, performances, and art exhibits on diversity.637/.649 Attended debates or panels about diversity issues.797/.810 Participated in ongoing campus-organized discussions on racial/ethnic issues (e.g. intergroup dialogue).854/.866 Participated in the Lesbian, Gay, Bisexual, and Transgender Center activities.762/.729 Participated in the Ethnic or Cultural Center activities.844/.848 Participated in the Womens/Mens Center activities.809/.782 Robust ML Model-Fit Results NFI =.964/.981; CFI =.965/.982; RMSEA =.079/.062 Since entering this institution have you: Since entering this institution, how often have you done the following?

22. Integration of Learning Pluralistic Orientation Social Action Engagement Civic Action

23. Items Factor Loadings Ability to see the world from someone else's perspective.621/.589 Tolerance of others with different beliefs.678/.752 Openness to having my own views challenged.697/.672 Ability to discuss and negotiate controversial issues.650/.728 Ability to work cooperatively with diverse people.628/.607 Robust ML Model-Fit Results NFI =.955/.990; CFI =.954/.991; RMSEA =.103/.052 Rate yourself on each of the following traits as compared with the average person your age. We want the most accurate estimate of how you see yourself.

24. Frequencies of Select Items & Factors Cross-tabulations of Factors by Racial/Ethnic Groups Multiple Regression on Select Factors Enrollment Mobility Frequencies & Cross-tabulations

25. Student Satisfaction with Climate General Interpersonal Validation Reporting Discrimination Harassment Based on Different Social Identities

26. Percentages

28. Scalen = 5,007 (%) Never 4,457 (89.0%) Seldom 266 (5.3%) Sometimes 160 (3.2%) Often 82 (1.8%) Very Often 42 (0.8%) Please indicate how often at this institution you have: Reported an incident of discrimination to a campus authority

29. Social Identity GroupNeverSeldom - Sometimes Often – Very Often Race/Ethnicity71.223.94.9 Gender72.123.74.2 Age73.422.24.4 Sexual Orientation86.011.02.9 Ability/Disability Status85.212.22.7 Citizenship Status87.010.03.0 Political Beliefs70.224.15.7

30. Discrimination & Bias Positive Cross Racial Interactions Negative Cross Racial Interactions

31. Racial /Ethnic GroupsLowMiddleHigh Asian27.329.143.6 African American40.625.334.1 Latina/o39.633.227.2 White36.035.328.7 Two or More24.735.140.2 χ ² = 126.244 p <.001

32. Racial /Ethnic GroupsLowMiddleHigh Asian23.639.437.0 African American36.723.739.5 Latina/o39.331.729.0 White36.334.129.6 Two or More26.832.241.0 χ ² = 106.723 p <.001

33. Racial /Ethnic GroupsLowMiddleHigh Asian22.526.551.0 African American34.330.435.3 Latina/o39.927.133.1 White47.727.924.4 Two or More39.228.332.5 χ ² = 209.258 p <.001

34. General Interpersonal Validation Academic Validation in the Classroom Pluralistic Orientation

35. Informal Visiting Office Hours Discrimination and Bias (-) High level of peer encouragement Campus – Facilitated Faculty Staff Academic Counselors (-) Curriculum of Inclusion Institutional Commitment to Diversity Co-curricular Diversity Activities

36. Informal Visiting Office Hours Discrimination and Bias (-) High level of peer encouragement Campus – Facilitated Faculty Curriculum of Inclusion Institutional Commitment to Diversity

37. Informal Positive Cross Racial Interactions Interest in helping to promote racial understanding Campus – Facilitated Institutional Commitment to Diversity Conversations Across Differences

38. Registration Opened Oct. 20, 2010 Standard CIRP Fees: $775 admin, $3/ returned survey PDF preview of core and modules online www.cirpsurveys.org Administration February 12 – June 30, 2011 Online only Contact www.heri.ucla.edu HERI: 310-825-1925

39. Conclusion Suggestions? Comments?