Based in business Balanced Scorecard – grounded in strategic initiatives Communicates priorities to constituents (internally & externally) Four perspectives o Financial/resource allocation o Customer/operational & program outcomes o Internal Business Process/key stats o Learning and Growth/learning outcomes
Steps to implementation ArticulateOperationalizeCreateShare
Steps to implementation Articulate OperationalizeCreateShare
Starting points Existing KPIs on your campus Mission and vision Strategic plan Learning outcomes frameworks (e.g., CAS, AAC&U) Numbers you are already using Questions you are already asking
Example performance indicators Graduation Rate GPAs Retention Rates Annual Giving Satisfaction Campus Climate Student Awareness Campus Safety Student Participation Class Size Outcome Measures Student Engagement Number of courses Credit Hour Production Contact Hour Housing Occupancy Rates Student Conduct Incidents Student: Faculty Ratio Programs Offered Service Hours
Direction of KPI developmentUniversityDivision Department Program
Institutional Dashboards Institutional Dashboard Examples: -Mean SAT score -Research Funding -4 or 6 year Graduation Rate -Doctorates Awarded -Undergraduate Enrollment -Graduate Enrollment -Alumni Giving -Financial Aid Awarded -Scholarships Awarded
Divisional Dashboards Provide information on the direction of the organization May not be directly actionable for departments Primarily shared “up” or “out” Examples: –Overall student satisfaction –Retention rates –Annual giving –Participation rates
Divisional Dashboard example Division of Enrollment Management and Student Development: -% overall student satisfaction rates (by semester) -% student engagement rates (by level of connectedness) -% student involvement rates (by semester) -Learning outcome domain rates (by type of learning environment) -% student development rates (by subject area)
Divisional Dashboard example Division of Academic Affairs: -Align with academic strategic plan -Use NSSE measures for student engagement as a structure for goals: –level of academic challenge –active and collaborative learning –student-faculty interaction –enriching educational experiences –supportive campus environment -Example: Buffalo State’s score for the “active and collaborative learning” NSSE benchmark area will rise from 49.7 to at least 55.4, or to a score that earns Buffalo State a place in the upper 50 percent of NSSE institutions.
Department Dashboard Focus on the aspects of the department that are critical Measured frequently and more actionable Measures are understood by staff members Have significant and positive impact on daily operations Examples: –Knowledge of policies/procedures –Perceptions –Outcome measures
Departmental dashboard example Parent Program: -# contact via email (by year) -# Parent Council Membership (by year and class) -% in-state vs. out-of-state residence -% satisfied with email contact -% satisfied with accessibility of Parent Liaison -% parents who considered themselves “involved”
Goals and targets In order to indicate progress or success, a goal or target is needed o External (e.g., determined by board of trustees) o Internal (e.g., director determined goals for department) o Objectively stated (e.g., retention goal of 89%) o Subjectively stated (e.g., learning outcome mean of 4)
Considerations Is the development of KPIs internally driven or externally required? Who will be USING the KPIs? With whom will you be SHARING the KPIs? Are others on your campus also developing KPIs? Is there an existing committee that can lead the KPI development process?
Keep it simple At core, the performance indicator is simple and informative. KEY is the important word
Steps to implementation Articulate Operationalize CreateShare
Data collection methods Keep in mind: KPIs are quantitative/numbers and can come from: Campus or student record systems Tracking Surveys Rubrics
Use terms consistently Create data audits and/or data dictionaries Define terms: –“Student” –Class year –Terms/time periods
Effect on the assessment process Incorporate KPI into planning or project proposals Develop a standard set of scales and question formats Consider response rate requirements for inclusion in KPIs Create a data dictionary
Steps to implementation ArticulateOperationalize Create Share
How Campus Labs Can Help Collect event attendance and participation numbers Track exposure to outcome to link to learning/growth based performance indicators Embed performance indicators within your planning and reporting process Show concrete metrics that track improvement towards your larger goals and outcomes Collect survey and rubric data for performance indicators Create a variety of performance indicators Work with your assessment consultant to identify best practices for your institution or division
Melissa Wright, M.A. Assistant Director Campus Labs Team firstname.lastname@example.org 716.270.0000 QUESTIONS?