1. The first choice for faster results. Integrating Periodic Review with an Expanded Student Success Agenda MSCHE 2011 Annual Conference Mary Frances Archey, VP for Learning and Student Development Kevin G. Smay, Executive Director of Strategic Planning 1

2. The first choice for faster results. The Community College of Allegheny County Serves Pittsburgh PA metro area – Four Campuses – Five Centers 33,000 annual unduplicated credit headcount 30,000 annual unduplicated non- credit headcount 5,000 students access CCAC via distance education 2,663 grads last year Among two year colleges: – Largest producer of nursing grads – Second largest producer of allied health professionals 2

3. The first choice for faster results. Challenges facing CCAC and Other Community Colleges Increasing numbers of under-prepared students Expanded governmental regulations Focus on accountability Shrinking financial resources 3

4. The first choice for faster results. Integrating Major College Functions Middle States Periodic Review Achieving the Dream Initiative Institutional Planning – Student Success Tactical Plan National Completion Agenda 4

5. The first choice for faster results. Recent Accreditation History 2005 Warned that accreditation may be in jeopardy – Standard 7: Assessment of Institutional Effectiveness – Standard 14: Assessment of Student Learning 2006 – 1 st Monitoring Report and Small Team Visit – CCAC admitted into Achieving the Dream 2007 2 nd Monitoring Report December 2009 PRR Process kick-off June 2011 PRR submitted to peers and MSCHE August 2011 reviewers’ report accepted as written 5

6. The first choice for faster results. Approach to Periodic Review 17 member team representing college locations and functions Several team members attended Middle States PRR workshop in Philadelphia Started early and followed program recommended in PRR Handbook Used a SharePoint Site to facilitate group work from multiple campuses – Established a “knowledge base” for future self study PRR occurred parallel to strategic plan update 6

7. The first choice for faster results. 7

8. Tips Start early Assemble a team that can help tell your PRR story Think positively Give yourself credit for the progress you have made Be relentless 8

9. The first choice for faster results. Periodic Review Objectives Source: Handbook for Periodic Review 2011 1.To assess the impact of significant major developments, changes, or challenges subsequent to the last evaluation 2.To assess the institution’s response to recommendations resulting from the previous evaluation 3.To review the institution’s enrollment trends, financial status, and enrollment and financial projections 4.To determine the current status of the implementation of plans for the assessment of institutional effectiveness and the assessment of student learning outcomes (accreditation standards 7 and 14) 5.To assess the extent to which linked institutional planning and budgeting processes are in place (standard 2) 9

10. The first choice for faster results. Focus of Periodic Review Institutional Assessment (Standard 7) Assessment of Student Learning (Standard 14) Planning, Resource Allocation, and Institutional Renewal (Standard 2) 10

11. The first choice for faster results. Achieving the Dream ATD is national nonprofit that is dedicated to helping more community college students, particularly low-income students and students of color, stay in school and earn a college certificate or degree. – Conceived in 2004 by Lumina Foundation – 160 community colleges and institutions – Helps 3.5 million community college students – CCAC admitted in 2006 11

12. The first choice for faster results. Achieving the Dream Leader Colleges CCAC achieved a Leader College status in 2011 Leader Colleges exemplify: – systematic improvement – use of data – broad-based participation – elimination of achievement gaps Motivate other colleges to advance Pilot, scale initiatives 12

13. The first choice for faster results. Alignment with Achieving the Dream (ATD) Middle State Standards:ATD Principles: Assessment of Institutional Effectiveness (Standard 7) Student centered, evidence based model for systematic institutional improvement Assessment of Student Learning (Standard 14) Outcomes based, student centered vision Planning, Resource Allocation, and Institutional Renewal (Standard 2) Budget decisions based on evidence of student success 13

14. The first choice for faster results. INSTITUTIONAL EFFECTIVENESS 14

15. The first choice for faster results. Standard Seven Key Elements Institutional Assessment Documented, organized assessment processes to evaluate the total range of programs and services Time-bound, resourced, comprehensive yet simple and practical Assessment results are shared, discussed and used for planning, resource allocation and improvement Written institutional plan based on assessment results Periodic evaluation of the assessment process itself 15

16. The first choice for faster results. ATD Parallels to Standard Seven Four Principles of Institutional Improvement 1.Systemic institutional improvement 2.Use of evidence to improve programs and services 3.Broad engagement 4.Committed leadership – Administrators, board members, and faculty and staff leaders demonstrate a willingness to make changes in policies, programs, and resource allocation to improve student success. ATD institutional plans based on a year-long self assessment process. 16

17. The first choice for faster results. CCAC’ Institutional Effectiveness Model 17

18. The first choice for faster results. Measurement of Institutional Effectiveness ACT Student Opinion Survey (2-Year College Form) – Supports assessment of student service units – Administered every two years – Compares institutional scores with prior year’s administration and national benchmarks Topics: – Background information – College Impressions – College Services – College Environment 18

19. The first choice for faster results. Investing in Data Needed for Assessment 19 2009 Sampling N = 450 2011 All Students N = 1,951 Web based Administration

20. The first choice for faster results. Section III: College Services Above Norm Computer services Cultural programs and activities Student health services Day care services College sponsored social activities Cafeteria/food services Library/learning resources center facilities and services College orientation program Parking facilities and services Below Norm Vocational guidance/career planning services Personal counseling services Credit by examination program Veterans services Student employment services Financial aid services Recreational and intramural programs and services College-sponsored tutorial services Academic advising/course planning services Job placement services Mean WorseMean Improving 20

21. 21 Quadrant Section III College Services 20092011NormYr to YrYr to norm Better and above norm Cultural programs and activities3.724.334.080.610.25 Student health services3.454.033.940.580.09 Day care services3.754.193.930.440.26 College sponsored social activities3.804.084.040.280.04 Cafeteria/food services3.553.733.620.180.11 Library/learning resources center facilities and services4.204.274.250.070.02 College orientation program3.893.953.940.060.01 Parking facilities and services3.643.673.510.030.16 Better but below norm Veterans services2.753.824.031.07-0.21 Student employment services3.623.83.980.18-0.18 Financial aid services3.894.044.050.15-0.01 Recreational and intramural programs and services3.904.024.040.12-0.02 College-sponsored tutorial services4.004.064.150.06-0.09 Academic advising/course planning services3.463.513.920.05-0.41 Job placement services3.523.563.780.04-0.22 Worse but above norm Resident hall programs and services4.104.083.7-0.020.38 Computer services4.274.23 -0.040.00 Worse and below norm Vocational guidance/career planning services3.603.593.99-0.01-0.40 Personal counseling services3.623.573.98-0.05-0.41 Credit by examination program3.943.813.96-0.13-0.15

22. The first choice for faster results. ASSESSMENT OF STUDENT LEARNING 22

23. The first choice for faster results. Standard Fourteen Key Elements Assessment of Student Learning Clearly articulated student learning outcomes Documented, organized and sustainable assessment processes Time-bound, resourced, comprehensive yet simple and practical. Collaboration between faculty and administration Evidence that students are achieving key institutional learning outcomes Assessment results are shared, discussed and used to improve teaching and learning Integration with institutional assessment 23

24. The first choice for faster results. Achieving the Dream Initiative Student centered vision ATD interested in disaggregated data to reveal and address achievement gaps Follows cohorts from start dates ATD Outcomes: – advance from remedial to credit-bearing courses; – enroll in and successfully complete gatekeeper courses; – enroll from one semester to the next; – earn degrees and/or certificates. 24

25. The first choice for faster results. Strategic Priority One: Ensure the success of learners through ongoing assessment of learning outcomes and overall institutional effectiveness. a)Improve learner success in developmental courses b)Increase learner retention and academic success c)Increase the number of learners who graduate d)Develop a culture of assessment and effectiveness Alignment: Student Success Tactical Plan 2010-15 Achieving the Dream

26. The first choice for faster results. CCAC Response Learning assessment processes and infrastructure put in place and implemented Student Success tactical plan 26

27. The first choice for faster results. Achieving the Dream – Direct Interventions – Supplemental Instruction – Learning Communities – Early Intervention – First Year Experience (SDS 102) – Math Enrichment 27

28. The first choice for faster results. Achieving the Dream – Policy Changes Began with a data-driven review of policies and procedures – “Identify existing values, assumptions, structures and systems at the college that nurture and impede student success” ATD Kick-off Institute manual, July 2006 D Policy Tiered Probation Reading First Elimination of the Graduation Application Fee 28

29. The first choice for faster results. Developmental Course Completion Trend Percent who complete developmental courses by second year. 29 Source: ATD Measures Report, September 2011

30. The first choice for faster results. Student Success Matrix: ATD Proxy Groups 30

31. The first choice for faster results. Student Success Matrix: Program Cohorts 31 * The first year for Pittsburgh Promise Fall 2008

32. The first choice for faster results. Student Success Matrix: Student Goal 32

33. The first choice for faster results. Student Success: Engagement and Retention The Community College Survey of Student Engagement (CCSSE) Focus - institutional practices and student behaviors that promote student engagement Benchmarks - 38 of the most important survey items are grouped into five conceptually related categories of high-quality educational practices 3 rd administration – able to measure changes over time 33

34. The first choice for faster results. Raw Benchmark Scores 2007-2011 34 CCSSE Benchmarks 2007 Raw Scores 2009 Raw Scores 2011 Raw Scores Change 2009-11 Active and Collaborative Learning 0.320.330.32-0.01 Support for Learners 0.370.380.400.02 Student-Faculty Interaction 0.35 0.380.03 Student Effort0.440.45 0.00 Academic Challenge 0.550.540.550.01

35. The first choice for faster results. 2011 Standardized Benchmark Scores The mean is always 50. Scores are relative to the overall performance of the institutions in the cohort. 2011 cohort = 699 institutions 35

36. The first choice for faster results. National Graduation Initiative Degree Completion Agenda * President Obama – Goal/Challenge given in 2010 to have the highest proportion of students in the world graduating from college by 2020 * The Gates Foundation - double the number of individuals who earn a postsecondary degree by 2025 * The Lumina Foundation - increasing the proportion of U.S. adults who earn college degrees to 60 % by 2025. 36

37. The first choice for faster results. National Graduation Initiative CCAC Scenario with Class of 2011 Update Assumes 7.3% growth in graduates per year Historical average = 2,119 graduates per year 2,663 Growth target was 161 and actual was 495 grads.

38. The first choice for faster results. Improved Graduate Survey Richer Data for Program Review Process 38

39. The first choice for faster results. Graduate Employment by Program Area 39 Full timePart timeUnemployed % Employed (full and part) Applied Arts Career Programs129484.0% Applied Service/Trades Career74101684.0% Behavioral & Social Sciences200100.0% Building Trade Apprenticeship80561.5% Business Career Programs20710810475.2% Computer/Information Tech47274761.2% Engineering/Science Career2471468.9% Health-Related Career Programs66124928476.2% Social Service Career Programs1981078079.2% Transfer/University Parallel34131518977.6%

40. The first choice for faster results. PLANNING AND RESOURCES 40

41. The first choice for faster results. Standard Two Key Elements Planning, Resource Allocation and Institutional Renewal Clearly stated goals drawn from assessment results that are linked to mission and resource allocation Clearly communicated and participative planning processes Assignment of responsibility and accountability A record of improvement efforts and results Assessment of planning and resource allocation processes 41

42. The first choice for faster results. ATD Parallels to Standard Seven Leader College Characteristics Systematic institutional improvement: – An established strategic planning process – Annual plans focus on student success – Regular review of programs and services – Linked budgeting, planning and assessment – Student success agenda integrated with accreditation activity 42

43. The first choice for faster results. Institutional Planning Five-year strategic plans Scorecard Annual operating plans Quarterly review process Tactical Plans – Student Success – Diversity and Inclusion – Workforce – Institutional Data Forum Institutional Data Forum “Student Success Matrix” reports to board of trustees 43

44. The first choice for faster results. Student Success Tactical Plan – Preparation Placement Testing Orientation – Engagement Academic Advising First Year Experience Course – Retention Early Intervention Financial Aid Student Activities – Completion Graduation Job Placement 44

45. The first choice for faster results. Discontinuation of Supplemental Instruction in Developmental Mathematics 45 09FA Cohort

46. The first choice for faster results. Institutional Planning Program Reviews – Academic – Student Development Conducted Annually and Every Five Years – Incorporates assessment activities 46

47. The first choice for faster results. Student Success Tactical Plan: 2010-2015 1.Improve learner success at CCAC in developmental education courses and the selection of appropriate courses. – Student Success Interventions – Developmental Studies – SDS 102 – Math Initiative – Reading and English support 47

48. The first choice for faster results. Student Success Tactical Plan: 2010-2015 2.Expand student involvement with in-class and college sponsored events – CSSE Benchmarks – Co-and Extra-curricular activities – Online Services – Library/Learning Centers 3.Increase student retention and academic progress as measured by credits completed and GPA earned – Early Intervention – Case Management/Student Success Coaches – Faculty Resource Program – Financial Assistance 48

49. The first choice for faster results. Student Success Tactical Plan: 2010-2015 4.Increase the number and rate of students meeting their stated goals at the College – Graduation – Transfer – Job Placement – Certification Examinations 5.Expand the college’s programs to increase student success through professional development and grant funded programs – Outreach – Professional Development – Foundation and Other Grants 49

50. The first choice for faster results. Student Success Tactical Plan--Resources Federal Grants—Selective – Biotech Workforce Collaborative National Science Foundation--$ 597,920 – Center of Excellence for Veterans Student Success US Dept of Education—Post Secondary Education-- $423,435 – Innovative Strategies—Mechatronics US Dept of Ed-Post Secondary Education-$748,896 – Perkins PA Dept of Education--$ 1,184,492 – RN Achievement Grant US Dept of Health and Human Services--$1,211,852 – TAACCCT US Dept of Labor-Employment and Training Adm--$ 2,629,935 (CCAC) 50

51. The first choice for faster results. Student Success Tactical Plan—Resources Foundation Grants--Selective – College Ready Centers Claude Worthington Benedum Foundation--$ 186,500 – Math Cafés RK Mellon Foundation--$ 240,000 – STEM Academy The Heinz Endowments-- $ 200,000 – Student Success Coaches—Pittsburgh Promise The Heinz Endowments--$ 186,223 – Student Success Coach—South Campus The Heinz Endowments--$ 50.000 – YAEP (Young Adult Empowerment Program) BNY Mellon--$ 125,000 51

52. The first choice for faster results. Thank You Mary Frances Archey, VP for Learning and Student Development marchey@ccac.edu Kevin G. Smay, Executive Director of Strategic Planning ksmay@ccac.edu 52