Presentation on theme: "360 Degrees: Conducting a Comprehensive Evaluation of Your Integrated Planning Processes Bri Hays Jill Baker San Diego Mesa College RP Conference April."— Presentation transcript:
1360Degrees: Conducting a Comprehensive Evaluation of Your Integrated Planning ProcessesBri HaysJill BakerSan Diego Mesa CollegeRP ConferenceApril 11, 2014
2Introductions and Context What is one thing you would like to learn in today’s session?
3Session Learning Outcomes Describe 360-degree feedback approach and applications to integrated planningApply process evaluation principles to integrated planningDiscuss research methods appropriate to a comprehensive evaluation of integrated planning processesOutline an evaluation plan for college integrated planning processesIdentify strategies for facilitating the use of data for action planning and improvement
4360 Feedback Approach Applying the 360 approach to process evaluation Multi-source feedback provides a more comprehensive perspective of performanceFeedback from various stakeholders at differing levelsFoundations in the business world (HR) and I/O psychologyApplying the 360 approachto process evaluationEvaluandInformation Source 1Information Source 2Information Source 3Information Source 4Information Source 5
5The Impetus for Process Evaluation Is the process working as intended?How can we improve the process for the end-user?Could additional efficiencies be achieved?
7Integrated Planning Is… “…the linking of vision, priorities, people, and the physical institution in a flexible system of evaluation, decision-making and action. It shapes and guides the entire organization as it evolves over time and within its community.” –Society for College and University Planning
8Integrated Planning Process Evaluation: What You Need Process ModelList of Key StakeholdersOutline of Process GoalsList of Evaluation Research QuestionsProcess Timeline or Calendar
9Getting Started: What’s The Model Step 1Step 2Step 3Step 1Step 2Step 3Step 1Step 2Step 3Step 4Step 5
10Integrated Planning Components Program ReviewOutcome AssessmentResource Request ProcessMission and VisionInstitutional Plans (Ed Master Plan, Facilities Plan, Tech Plan, HR plan)Prioritization Process (Committees)Allocation ProcessFollow-Up/Evaluation
13Identifying Integrated Planning Process Goals What are the overarching goals of the college’s integrated planning process?Increase transparency in decision-makingClearly link data, planning, and resource allocationInform the strategic planning prioritiesWhat are the operational objectives of the integrated planning process?Increase efficiency of the integrated planning processEliminate redundanciesAlign planning and resource allocation calendars
14Outlining Process Evaluation Research Questions & Goals Was the process carried out as intended?How effective and efficient was the flow of information?Did the correct information make its way to the appropriate end point?Was the information used as intended?How do stakeholders perceive the process?Did the process/activities work as planned?Were resources allocated according to the plan?How can the process be improved?
15Framing the Evaluation What are the goals of the evaluation?What data are needed to address the evaluation goals?Who are the key stakeholders in the process?How do the results of the evaluation need to be reported out and to whom?How will the information gained from the evaluation be used?Program ReviewResource AllocationStrategic Planning
16Setting Evaluation Goals Set goals for the evaluation itself based on the goals/objectives of the process (or process redesign)
17A Mixed Methods Approach What methods will you utilize to assess the integrated planning process?Examples include:SurveysFocus GroupsCampus-wide forumsCommittee feedback or debriefing sessionsProgram review and resource request contentInstitutional effectiveness data/key performance indicators
18Process Goal/Objective Evaluation Activities Person(s) Responsible The Evaluation PlanThe evaluation plan should clearly illustrate the alignment of process goals/objectives, evaluation goals, evaluation activities, and the timeframe during which activities will take placeProcess Goal/ObjectiveEvaluation Plan GoalEvaluation ActivitiesTimelinePerson(s) ResponsibleImprove transparency of resource request prioritizationAssess stakeholder perceptions of transparencySurvey of faculty, staff, and studentsFocus group with department chairs and supervisorsFocus group with resource allocation committeesSpring 2013Campus Based Researcher; Dean of IE; Program Review CommitteeClarify connections between planning, data, and resource allocationAssess the program review utilization of data and links between unit and college goalsContent analysis of unit goal form dataTaskStream reports on goal mappingSummer 2013Dean of IE; Campus Based Researcher
20Conveying the Evaluation Results What deliverables are best suited to your college?How can the evaluation results be turned into action items?What structures and processes are in place at your college to ensure the results are reported out and action is taken?
22Closing the Loop Formative Evaluation Cycle Plan Implement Assess AnalyzeIdentify Action ItemsFormativeEvaluation Cycle
23From Data to ActionAnalyze all information collected and organize it by topic or componentProvide a conceptual framework for moving forward with specific recommendationsRecommendations, after being vetted, become goals for the next cycle……Which inform the following year’s evaluation plan
25Paving the Way for Continuous Quality Improvement Start with a baselineResults of the baseline study inform changes to the integrated planning process for the following yearGoals/objectives for the subsequent cycle are based on the results of the previous cycle’s evaluationDevelop a calendar of activities to meet new goals and objectives—list person(s) or group(s) responsibleTrack progress toward goals/objectivesAddress the limitations of the previous cycle’s evaluation
26Next StepsHow do you integrate results into the larger assessment of the college’s institutional effectiveness?What process does your college have for assessing the effectiveness of resource allocation?
27Thank You! Bri Hays Campus Based Researcher San Diego Mesa College Jill BakerDean of Institutional Effectiveness