1. Student Satisfaction Report: Pacific Oaks College: Addendum: Instructional Sites Vs. Cohorts Office of Institutional Research TCS Education System September 19, 2014

2. Table of Contents Background3 Executive Summary5 Detailed Findings8 2

3. Background The Office of Institutional Research produced a report for Pacific Oaks College on results of its student satisfaction survey program. After presenting the report, Pacific Oaks expressed the need to have results for non-Pasadena ground locations broken out into cohorts and instructional sites. The purpose of this additional data analysis request was to determine if there were any statistically significant differences between cohorts and instructional sites for the 2013 and 2014 waves of the annual Pacific Oaks College student satisfaction survey. Data were analyzed using SPSS for Windows, Version 20.0. In this report the word “significantly” means that a statistical test was conducted to determine if the difference between cohorts and instructional sites is “real” or simply the result of random variation in the data. 3

4. Background 4 Survey YearCohort NameNumber of Survey Responses Instructional Site NameNumber of Survey Responses 2013 Bay Area Cohort13Sacramento Instructional Site5 Huntington Park Cohort5Salinas Instructional Site6 Los Angeles City College Cohort5Santa Cruz Instructional Site5 Los Angeles Mission Cohort4 Pierce College Cohort1 Plaza de la Raza Cohort3 Total31Total16 2014 Bay Area Cohort8Bay Area Instructional Site3 East Los Angeles College Cohort3Foothills Instructional Site12 HLPUSD Cohort5 Los Angeles City College Cohort9 Los Angeles Mission Cohort3 Options Head Start11 VOA – North Hollywood Cohort6 Westside Children’s Center4 Total49Total15

5. Executive Summary Overall, there are very few statistically significant differences between cohorts and instructional sites in terms of items on the annual Pacific Oaks student satisfaction survey. Among survey items in which there are statistically significant differences between respondents from cohorts and instructional sites, the cohort scores tend to be greater than those of instructional sites. OIR recommends that leadership of Pacific Oaks College work with students from the instructional sites to develop strategies to improve satisfaction among this group of students. The tables on the following two pages show the items, mean scores, and the direction of the significant difference on satisfaction survey items in which there are statistically significant differences between mean ratings of students from cohorts and students from instructional sites. 5

6. Executive Summary Survey Items Where the Cohort Mean is Significantly Greater than the Mean for Instructional SitesSurvey Year Please rate your level of agreement with the statement, "I made the right choice by enrolling at PO.“ 2014 Please rate your level of agreement with the statement, "I would recommend PO to friends / family …” 2014 Satisfaction with process of registering for courses 2014 Satisfaction with availability of elective courses 2014 Satisfaction with time it took Help Desk to resolve your issue 2014 Satisfaction with availability of the HelpDesk staff 2014 Agreement that at Pacific Oaks inclusive classroom and co-curricular environments promote mutual respect, reflection, critical thinking, and academic excellence 2014 Impact of experiences at Pacific Oaks in advancing student multicultural competence 2014 Impact of experiences at Pacific Oaks in advancing student professional practice skills. 2014 Impact of experiences at Pacific Oaks in preparing student to behave in a professional manner 2014 Importance of advancement in current employment to overall satisfaction with Pacific Oaks 2013 Importance of having face to face contact with Financial Aid Counselors to overall satisfaction with Pacific Oaks 2014 6

7. Executive Summary 7 Survey Items Where Instructional Site Mean is Significantly Greater than the Mean for CohortsSurvey Year Satisfaction with overall experience of the practicum process 2013 Impact of experiences at Pacific Oaks in advancing student multicultural competence 2013 Impact of experiences at Pacific Oaks in improving student ability to apply theory and scholarship to practice issues 2013 Impact of experiences at Pacific Oaks in advancing student multicultural competence 2013 Impact of experiences at Pacific Oaks in improving student ability to apply theory and scholarship to practice issues 2013

8. Measures of Satisfaction and Loyalty Measures of Satisfaction and Loyalty ¹ CohortsInstructional Sites 2013 (a) 2014 (b) 2013 (c) 2014 (d) Meann n n n How satisfied are you with your overall academic experience at PO? 4.32314.31454.25163.9314 Please rate your level of agreement with the statement, "I made the right choice by enrolling at PO.“ 4.41294.40 (d) 434.29143.75 (b) 12 Please rate your level of agreement with the statement, "I would recommend PO to friends / family …” 4.45294.40 (d) 434.14143.50 (b) 12 My overall experience at PO has met my expectations. 4.45294.30434.36143.9212 1 Items use five-point scales 8 2013: No statistically significant mean differences In the 2014 iteration of the Pacific Oaks student satisfaction survey, mean ratings of respondents from cohorts were significantly greater than those of respondents from instructional sites on the following items: Please rate your level of agreement with the statement, "I made the right choice by enrolling at PO.“ Please rate your level of agreement with the statement, "I would recommend PO to friends / family …”

9. Satisfaction with Instruction and Course Work In the PAST ACADEMIC YEAR, how satisfied have you been with the: ¹ CohortsInstructional Sites 2013 (a) 2014 (b) 2013 (c) 2014 (d) Meann n n n Quality of instruction provided by faculty 4.35314.31454.31163.9314 Consistency of instruction across faculty 3.93303.80444.06163.5714 Intellectual challenge of the course work 4.52314.36444.38164.0714 Quality of academic courses you've taken 4.48314.44454.31164.3813 Number of courses taught by my department's core faculty 3.61314.10414.25163.8513 1 Items use five-point scales 9 2013: No statistically significant mean differences 2014: No statistically significant mean differences

10. Satisfaction with Academic Support In the PAST ACADEMIC YEAR, how satisfied have you been with the: ¹ CohortsInstructional Sites 2013 (a) 2014 (b) 2013 (c) 2014 (d) Meann n n n Staff's response to concerns I've expressed 4.07304.10424.31163.5714 Support received from my Student Advisor 3.80304.02454.00143.3113 Support received from my Academic Advisor 3.87303.98454.31163.7114 Support received from the Financial Aid Office 4.16314.05394.19164.0812 1 Items use five-point scales 10 2013: No statistically significant mean differences 2014: No statistically significant mean differences

11. Satisfaction with Technology In the past academic year, how satisfied have you been with the : ¹ CohortsInstructional Sites 2013 (a) 2014 (b) 2013 (c) 2014 (d) Meann n n n Quality of the classroom facilities 4.03314.10403.69164.1414 Availability of technological resources 3.65313.87393.50164.2114 Effective use of technology in courses 3.94313.98403.75164.2114 1 Items use five-point scales 11 2013: No statistically significant mean differences 2014: No statistically significant mean differences

12. Satisfaction with Course Registration In the past academic year, how satisfied have you been with the : 1 CohortsInstructional Sites 2013 (a) 2014 (b) 2013 (c) 2014 (d) Meann n n n Process of registering for courses 3.81314.51 (d) 374.50163.77 (b) 13 Availability of courses to allow progress toward the completion of my degree 4.17304.67364.81164.2313 Availability of elective courses 3.19314.31 (d) 262.94162.40 (b) 5 1 Items use five-point scales 12 2013: No statistically significant mean differences In the 2014 iteration of the Pacific Oaks student satisfaction survey, mean ratings of respondents from cohorts were significantly greater than those of respondents from instructional sites on the following items: Satisfaction with process of registering for courses Satisfaction with availability of elective courses

13. Use of (School)HelpDesk Have you ever used the (school) HelpDesk (email or phone)?CohortsInstructional Sites 2013 (a) 2014 (b) 2013 (c) 2014 (d) %n%n%n%n Yes 48.4 %1546.7 %2175.0 %1235.7 %5 No 22.6 %728.9 %1312.5 %27.1 %1 No, I’ve never had a need. 29.0 %924.4 %1112.5 %257.1 %8 TOTAL 100.0 %31100.0 %45100.0 %16100.0 %14 13 2014: No statistically significant differences in response patterns, cohorts vs. instructional sites 2013: No statistically significant differences in response patterns, cohorts vs. instructional sites

14. Satisfaction with (School) HelpDesk In regards to your (school) HelpDesk experience, how satisfied have you been with the: 1 CohortsInstructional Sites 2013 (a) 2014 (b) 2013 (c) 2014 (d) Meann n n n Time it took to resolve your issue 4.00154.55 (d) 204.36113.40 (b) 5 Availability of the HelpDesk staff 4.07154.57 (d) 214.17123.40 (b) 5 1 Items use five-point scales 14 2013: No statistically significant mean differences In the 2014 iteration of the Pacific Oaks student satisfaction survey, mean ratings of respondents from cohorts were significantly greater than those of respondents from instructional sites on the following items: Satisfaction with time it took [for HelpDesk] to resolve your issue Satisfaction with Availability of the HelpDesk staff

15. Academic Advising In the PAST ACADEMIC YEAR, how satisfied have you been with the:CohortsInstructional Sites 2013 (a) 2014 (b) 2013 (c) 2014 (d) Meann n n n Accessibility to academic advising 3.58314.16433.81163.9111 Quality of New Student Orientation 3.90314.18403.19163.7713 Overall quality of academic advising 3.87314.02424.06163.6913 Overall experience of the practicum process 2.87 (c) 314.23304.06 (a) 164.008 Overall quality of my academic program 4.35314.26434.13163.9314 1 Items use five-point scales 15 2014: No statistically significant mean differences In the 2013 iteration of the Pacific Oaks student satisfaction survey, the mean rating of respondents from instructional sites was significantly greater than those of respondents from cohorts on the following item: Satisfaction with experience of the practicum process

16. Communication and Hours of Academic Support Departments In the past academic year, how satisfied have you been with communication and hours of operation from the following departments: CohortsInstructional Sites 2013 (a) 2014 (b) 2013 (c) 2014 (d) Meann n n n Admissions - Communication3.90293.98434.00143.9213 - Hours of Operation3.96253.88424.20104.0012 Registrar's Office - Communication3.97293.93433.87153.7713 - Hours of Operation3.96253.90414.18114.0012 Student Services (CARE) - Communication3.79283.79433.50143.6213 - Hours of Operation3.72253.81423.90103.5812 Financial Aid - Communication4.03294.02443.80154.0013 - Hours of Operation4.04253.98424.36113.7512 1 Items use five-point scales 16 2014: No statistically significant mean differences 2013: No statistically significant mean differences

17. Communication and Hours of Academic Support Departments In the past academic year, how satisfied have you been with communication and hours of operation from the following departments: CohortsInstructional Sites 2013 (a) 2014 (b) 2013 (c) 2014 (d) Meann n n n Business Office - Communication3.79283.70433.50143.7712 - Hours of Operation3.76253.76424.10103.7512 Information Technology - Communication3.72293.72433.50143.7212 - Hours of Operation3.76253.76423.80103.7612 Library - Communication3.50283.72433.13153.9212 - Hours of Operation3.63243.64423.73114.0812 1 Items use five-point scales 17 2013: No statistically significant mean differences 2014: No statistically significant mean differences

18. Library and Computer Lab Considering the past academic year, what is your level of agreement with the following statements: CohortsInstructional Sites 2013 (a) 2014 (b) 2013 (c) 2014 (d) Meann n n n Courses are available to fit my schedule. 4.59294.48444.50144.0812 Library resources and services are appropriate for my needs. 3.62293.91443.36143.5812 The library’s hours of operation fit my schedule. 3.36283.61443.29143.3312 The computer lab is appropriate for my needs. 3.39283.48443.08123.0812 The computer lab's hours of operation fit my schedule. 3.39283.44433.17123.0812 Areas for study are made available to me. 3.61283.65433.50123.2512 1 Items use five-point scales 18 2014: No statistically significant mean differences 2013: No statistically significant mean differences

19. Use of Smart Thinking Have you ever used Smart Thinking? CohortsInstructional Sites 2013 (a) 2014 (b) 2013 (c) 2014 (d) %n%n%n%n Yes 10.3 %311.4 %50.0 %0 0 No 31.0 %961.4 %2742.9 %666.7 %8 I don’t know what Smart Thinking is 58.6 %1727.3 %1257.1 %833.3 %4 TOTAL 100.0 %29100.0 %44100.0 %14100.0 %12 19 2014: No statistically significant differences in response patterns, cohorts vs. instructional sites 2013: No statistically significant differences in response patterns, cohorts vs. instructional sites

20. Use of ePortfolio / Canvas Have you used ePortfolio / Canvas at PO? CohortsInstructional Sites 2013 (a) 2014 (b) 2013 (c) 2014 (d) %n%n%n%n Yes 93.1 %2790.9 %4078.6 %11100.0 %12 No 6.9 %29.1 %421.4 %30.0 %0 TOTAL 100.0 %29100.0 %44100.0 %14100.0 %12 20 2014: No statistically significant differences in response patterns, cohorts vs. instructional sites 2013: No statistically significant differences in response patterns, cohorts vs. instructional sites

21. Satisfaction with eCollege / Canvas Considering your use of eCollege / Canvas within the past academic year, what is your level of agreement with the following statements: CohortsInstructional Sites 2013 (a) 2014 (b) 2013 (c) 2014 (d) Meann n n n eCollege / Canvas courses are easy to navigate and use 4.00273.75404.10103.6712 eCollege / Canvas courses are conducted effectively by PO instructors 3.96273.58403.50103.4212 1 Items use five-point scales 21 2014: No statistically significant mean differences 2013: No statistically significant mean differences

22. Personal Life and Course Work CohortsInstructional Sites 2013 (a) 2014 (b) 2013 (c) 2014 (d) Meann n n n If I have questions I know which staff members to contact. 3.93293.86433.50143.8312 PO provides proper channels of communication for students. 3.83293.83423.29143.6712 As a student at PO, I am able to maintain a healthy balance between my personal life and my course work / training. 4.07293.86434.07143.8312 1 Items use five-point scales 22 2014: No statistically significant mean differences 2013: No statistically significant mean differences

23. Student Safety Considering the past academic year, what is your level of agreement with the following statements: CohortsInstructional Sites 2013 (a) 2014 (b) 2013 (c) 2014 (d) Meann n n n I am aware of (campus) Advisory / emergency action plans. 2.62292.93432.62133.0012 I feel safe and secure on campus. 3.59293.77433.08134.0812 I feel the information I send and receive online is secure. 3.97294.10424.00143.8312 1 Items use five-point scales 23 2014: No statistically significant mean differences 2013: No statistically significant mean differences

24. Preparedness in Use of Intuit How prepared do you feel about the online student account system, Intuit? CohortsInstructional Sites 2013 (a) 2014 (b) 2013 (c) 2014 (d) Meann n n n 3.76293.86434.00143.9212 1 Items use five-point scales 24 2014: No statistically significant mean differences 2013: No statistically significant mean differences

25. Use of Career Services Have you used Career Services?CohortsInstructional Sites 2013 (a) 2014 (b) 2013 (c) 2014 (d) %n%n%n%n Yes 0.0 %04.7 %214.3 %20.0 %0 No 72.4 %2176.7 %3364.3 %966.7 %8 No, but I would like to 27.6 %818.6 %821.4 %333.3 %4 TOTAL 100.0 %29100.0 %43100.0 %14100.0 %12 25 2013: No statistically significant differences in response patterns, cohorts vs. instructional sites 2014: No statistically significant differences in response patterns, cohorts vs. instructional sites

26. Satisfaction with Career Services How satisfied are you with the following components of your Career Services experience: CohortsInstructional Sites 2013 (a) 2014 (b) 2013 (c) 2014 (d) Meann n n n Quality of Career Services NA03.5024.002NA0 Availability of Career Services NA03.5024.002NA0 1 Items use five-point scales 26

27. Promotion of Diversity Please rate your level of agreement with the following statements:CohortsInstructional Sites 2013 (a) 2014 (b) 2013 (c) 2014 (d) Meann n n n Faculty and staff create safe environments in which multiple voices and perspectives are shared and heard. 4.38294.19434.36143.6712 Course content is balanced and inclusive so that diverse perspectives are explored. 4.45294.40434.50143.9212 Developmental education is practiced by accommodating different learning styles, cognitive abilities, and sociocultural influences in the classroom. 4.45294.28434.64143.7512 Inclusive classroom and co-curricular environments promote mutual respect, reflection, critical thinking, and academic excellence. 4.52294.47 (d) 434.71143.67 (b) 12 I feel actively engaged in the learning process. 4.55294.51434.79144.0012 1 Items use five-point scales 27 2013: No statistically significant mean differences In the 2014 iteration of the Pacific Oaks student satisfaction survey, the mean rating of respondents from cohorts was significantly greater than those of respondents from instructional sites on the following item: Agreement that inclusive classroom and co-curricular environments promote mutual respect, reflection, critical thinking, and academic excellence.

28. Attainment of Professional Skills My experiences at PO have …CohortsInstructional Sites 2013 (a) 2014 (b) 2013 (c) 2014 (d) Meann n n n … advanced my multicultural competence. 4.21 (c) 294.44 (d) 434.86 (a) 143.92 (b) 12 … increased my awareness of writing as an important skill in my professional life. 4.41294.33434.86144.0812 … advanced my professional practice skills. 4.52294.44 (d) 434.71143.92 (b) 12 … prepared me to behave in a professional manner. 4.41294.42 (d) 434.64143.83 (b) 12 … improved my ability to apply theory and scholarship to practice issues. 4.36 (c) 284.38424.79 (a) 144.0812 1 Items use five-point scales 28 In the 2013 iteration of the Pacific Oaks student satisfaction survey, mean ratings of the impact of one’s experiences at PO of respondents from instructional sites were significantly greater than those of respondents from cohorts in the following areas: Advancing one’s multicultural competence Improving one’s ability to apply theory and scholarship to practice issues In the 2014 iteration of the Pacific Oaks student satisfaction survey, mean ratings of the impact of one’s experiences at PO of respondents from cohorts were significantly greater than those of respondents from instructional sites in the following areas: Advancing one’s multicultural competence Advancing one’s professional practice Preparing the respondent to behave in a professional manner

29. Importance of Attributes to Overall Satisfaction¹ CohortsInstructional Sites 2013 (a) 2014 (b) 2013 (c) 2014 (d) Meann n n n Access to academic support services such as those provided by C.A.R.E., the library, and individual faculty 5.42315.69495.81164.8015 Learning the most you can from every experience 6.52316.67496.69166.6015 The academic rigor of your degree program 6.32316.49496.44166.1315 The value that PO places on each individual student 6.55316.53496.63166.6015 Being at a college that shares your vision for society 6.45316.51496.69166.4715 Employment in a new career after graduation 5.84315.65495.63166.0715 Advancement in your current employment 6.65 (c) 316.18495.63 (a) 166.3315 Being able to take required courses in an online delivery mode 4.58314.57494.81164.8715 Having face to face contact with Financial Aid Counselors 5.32315.16 (d) 494.75163.80 (b) 15 Being able to take required courses at an instructional site/offsite cohort 6.77316.78496.63166.8715 ¹ Scale = 7-point importance scale 29 In the 2013 iteration of the Pacific Oaks student satisfaction survey, the mean rating of respondents from cohorts was significantly greater than that of respondents from instructional sites on the importance of advancement in one’s career as being important to student satisfaction. In the 2014 iteration of the Pacific Oaks student satisfaction survey, the mean rating of respondents from cohorts was significantly greater than that of respondents from instructional sites on the importance of having face to face contact with financial aid counselors as being important to student satisfaction.

30. Interest Levels – Student Activities Student ActivitiesCohortsInstructional Sites 2013 (a) 2014 (b) 2013 (c) 2014 (d) %n%n%n%n Not at all Interested 41.4 %1240.5 %1721.4 %350.0 %6 Somewhat Interested 41.4 %1240.5 %1750.0 %733.3 %4 Very Interested 17.2 %519.0 %828.6 %420.0 %2 Total 100.0 %29100.0 %42100.0 %14100.0 %12 30 2013: No statistically significant differences in response patterns, cohorts vs. instructional sites 2014: No statistically significant differences in response patterns, cohorts vs. instructional sites

31. Interest Levels – Copy Machines Copy MachinesCohortsInstructional Sites 2013 (a) 2014 (b) 2013 (c) 2014 (d) %n%n%n%n Not at all Interested 46.4 %1353.5 %2335.7 %558.3 %7 Somewhat Interested 35.7 %1025.6 %1121.4 %316.7 %2 Very Interested 17.9 %520.9 %942.9 %625.0 %3 Total 100.0 %28100.0 %43100.0 %14100.0 %12 31 2013: No statistically significant differences in response patterns, cohorts vs. instructional sites 2014: No statistically significant differences in response patterns, cohorts vs. instructional sites

32. Interest Levels – Writing Assistance Writing AssistanceCohortsInstructional Sites 2013 (a) 2014 (b) 2013 (c) 2014 (d) %n%n%n%n Not at all Interested 21.4 %6 935.7 %533.3 %4 Somewhat Interested 60.7 %1738.1 %1621.4 %341.7 %5 Very Interested 17.9 %540.5 %1742.9 %625.0 %3 Total 100.0 %28100.0 %42100.0 %14100.0 %12 Cohort respondents in 2013 are significantly more likely than instructional site respondents to be at least somewhat interested in writing assistance. 2014: There are no statistically significant differences in response pattern when comparing respondents from cohorts and instructional sites. 32

33. Interest Levels – Daytime Courses Daytime CoursesCohortsInstructional Sites 2013 (a) 2014 (b) 2013 (c) 2014 (d) %n%n%n%n Not at all Interested 58.6 %1754.8 %2350.0 %7100.0 %12 Somewhat Interested 31.0 %933.3 %1428.6 %40.0 %0 Very Interested 10.3 %311.9 %521.4 %30.0 %0 Total 100.0 %29100.0 %42100.0 %14100.0 %12 33 2013: No statistically significant differences in response patterns, cohorts vs. instructional sites 2014: Students at instructional sites are statistically significantly more likely to show no interest at all in daytime courses than students enrolled in cohorts.

34. Interest Levels – Career Assistance Career AssistanceCohortsInstructional Sites 2013 (a) 2014 (b) 2013 (c) 2014 (d) %n%n%n%n Not at all Interested 24.1 %722.0 %942.9 %625.0 %3 Somewhat Interested 37.9 %1134.1 %1421.4 %325.0 %3 Very Interested 37.6 %1143.9 %1835.7 %550.0 %6 Total 100.0 %29100.0 %41100.0 %14100.0 %12 34 2013: No statistically significant differences in response patterns, cohorts vs. instructional sites 2014: No statistically significant differences in response patterns, cohorts vs. instructional sites