Assessment Leadership Day Continuous Program Improvement Planning, Analytics, and Decision Support (PADS) Planning and Assessment 1-17-2018

Agenda Role of Academic Quality in Vision for NYIT Middle States Expectation for Institutional Improvement Continuous Program Improvement (CPI) Framework Draft Academic CPI Template Draft Administrative CPI Template Proposed Process and Timeline

Role of Academic Quality Draft vision statement (Sep 2017): NYIT will become an engaged and supportive academic community devoted to ethical, highly impactful teaching and learning that is technology-rich, intellectually rigorous, and future-focused. Academic quality is critical to this vision.

Role of Academic Quality Strategy for achieving our vision presented by Hank Foley (Dec 2017): Be the 3rd best private institution of higher education in metropolitan New York by 2027

Role of Academic Quality Wall Street Journal and Times Higher Education Rankings: Rankings focused on student success and learning – based on a survey of 200,000 current students Sufficient resources? Students engaged and challenged? Good academic reputation? Student outcomes post-graduation? NYIT strengths: Diversity; Student Interaction/ Engagement NYIT’s most notable challenge: Reputation

Role of Academic Quality How do you change reputation in higher education? ACADEMIC QUALITY Is this the work of just the academic program? No… INSTITUTIONAL EFFORT

MSCHE Expectations – Institutional Improvement: Show institutional health and improvement Student achievement Financial standing Linkage between the two Report on major initiatives What’s the intended improvement? What can data tell you about impact on improvement? How is this linked to your resources? All of this done in the context of institutional mission.

Annual Institutional Updates The 8 Year New Process Annual Institutional Updates •Financial and Student Achievement data elements •Responses to recommendations (if needed) Opportunities/Input for Institutional Improvement Midpoint Review •Cumulative Peer Review of AIU data •Feedback from the Commission Self-Study Evaluation •Campus engagement in self-study process that culminates with an onsite team visit by peer evaluators

Rethinking assessment: “Student Achievement-” Academic Progress Mandatory Retention Rates IPEDS Graduation Rates Mean Time to Graduation Assessment of Learning Report – can exclude from review % Credits Completed/Attempted % Pell % Minority % Developmental % 1st Generation % Non-Traditional % Part-Time Self-Identified

Rethinking assessment: “Student Achievement-” Post-Institutional Mandatory Loan Default Rate Loan Repayment Rate Review – can exclude from review 1st time Pass Rates on Licensure Exams Graduate Survey Satisfaction Results Career Placement Rates “First Destination” Survey Placement Rates Transfer Rates Self-Identified

Rethinking assessment: Financial Health Indicators- Documents All Most Recent Audited Financials IPEDS Finance Data Title IV Compliance Audits Catalog/URL Most Recent USDE Composite Score If Applicable Bond Rating for New Debt issued Financial Audit from Parent Corporation

Continuous Program Improvement (CIP) Process: At the heart of NYIT’s new framework – using data of all kinds to: Demonstrate the health of the school/department Student achievement (e.g., persistence, student learning) Financial metrics (e.g., expenditures and revenues, enrollment) Achievement of mission and goals – aspirational, strategic goals Inform improvement initiatives Inform resource allocation decisions

Dean’s data set (internal) Student credit hours FTE faculty FTE staff Total revenue and expense, total margin Three year enrollment trend. DFW (drop-failure-withdrawal)rates Three-year trend data: retention rate, graduation rate, and mean time to graduation. School/college level graduation students survey (GSS) and NSSE Others (requested by deans)

Dean’s data set (outside-environment) Market data Benchmarking to peer programs Student/alumni/employer/client satisfaction data Others?

Academic CPI Template: Department Overview – history, points of pride, mission, etc. Department/Program Profile and Trend Analysis – Dean’s data set Department/Program Goal Achievement – evidence of meeting goals, curriculum review, scholarly productivity, faculty service Evidence of Student Learning and Achievement Evaluation of Student Satisfaction with Academic Programs

Academic CPI Template: Evaluation of Student Service Areas Impacting Student Life Cycle Improvement Initiatives Update on Past Improvement Initiatives Self-Reported Resource Allocation Analysis Department/Program Strengths and Concerns Future Department/Program Goals and Recommendations

Administrative CPI Template: Similar to Academic CIP with some additions: Staffing Structure Organizational Chart Key Performance Indicators

New Framework (CPI) Implementation Discussion: Timeline: a 4-year cycle with annual update to track its implementation? Responsibilities & collaborations: School/department/division own it, and PADS facilitates the multi-year planning and assessment with data, and data analysis. Tech platform to facilitate? Presentation to a review team (who should be) Initiate process Academic Year 2018-2019

School/department/division CPI presentations Students’ learning improvement with evidence. Students’ achievement improvement with evidence Teaching effectiveness improvement Scholarship productivity improvements Curriculum improvement with evidence of updated syllabi Alumni and current student recommendations of NYIT Other evidence of improvement (e.g., rankings)…