SHELLY POTTS, PH.D. UNIVERSITY OFFICE OF EVALUATION AND EDUCATIONAL EFFECTIVENESS ARIZONA STATE UNIVERSITY Quality Assurance Mechanisms

What do we mean by quality? Comprehensive, institution-specific strategic plans with detailed goals, objectives, and metrics Organizational structures aligned with plan Curriculum consistent with international standards for engineering education Ongoing, measureable progress toward implementation of an institution’s strategic plan Collection, analysis, reporting, and usage of data to demonstrate progress Hiring top candidates & providing ongoing professional developmentProduction of quality graduates in high demand by employers

Why focus on quality assurance? Shift to data-driven planning and decision-making Focus on “collection and use” of data rather than merely on “collection and reporting” Institutions need timely, accurate, and accessible trend data presented in ways that facilitate discussions, and inform planning and decision-making

Strategic planning Robust QA Practices Transformational change

What can we do with institutional data? Gauge progress on Key Performance Indicators over time Make comparisons between units Demonstrate value-added by programs and services Direct and/or inform resource allocations Answer questions and report to constituents Produce accurate & accessible trend data to...

Campus QA Director Roles Facilitate critical examination of institutional systems, practices, challenges, and opportunities Support transformation of institutional QA systems and practices Acquire new knowledge and skills Share knowledge, skills, ideas, and resources with campus colleagues Develop expanded QA capacities modern data collection, analysis, and reporting processes aligned with KPIs data resources and analytical tools in support of the institution’s strategic plan Facilitate development of…

Expected Outcomes of VULII QA Institute Critical examination of current QA practices at VULII institutions Training for expanded QA roles and responsibilities Design and implementation of modern QA strategies and systems

3 Year Overview of VULII Quality Assurance Institute Year 3: Continue to expand staff capacity for new roles Implement QA strategies and systems Share strategies and best practices Year 2: Continue to expand staff capacity for planning and executing robust QA systems Design and begin to implement QA change plans Attend AIR conference Year 1: Expose to model systems, structures, roles, and functions Build staff capacity -- knowledge and skills Conduct needs assessment Prepare QA staff for new roles and responsibilities in research, evaluation, and planning. Design & implement modern strategies & systems

QA Knowledge & Skill Outcomes Roles, functions, and practices of IR and evaluation offices Methods and tools for collecting, analyzing, & reporting data Purpose and practice of student learning assessment (course, program, and institution levels) Course evaluations Use of data analytics Strategies for using data in planning and decision making, improvement initiatives Knowledge Use of statistical software to perform descriptive statistics and comparative analysis of course, program, and institution-level data Use of spreadsheet software to track data, perform calculations, and create tables/charts/graphs Use of database programs as information management tools Development of dashboards to display at-a-glance interactive views of KPIs for institutional planning, evaluation, and improvement Skills

VULII Quality Assurance Institute Timeline Selection of VULII Quality Assurance Directors QA workshop at ASU (January , 2013) Coaching, progress reports, video conferences 2 nd QA workshop in Vietnam (April, 2013) Coaching, progress reports, video conferences Campus Visits (May 27-June 7, 2013) Year 1 Assessment Conference in Vietnam (August 6-9, 2013)

QA Institute (January 2013) Overview of QA systems and structures at ASU Roles, functions, & deliverables of institutional research/evaluation units Methods, processes, tools, and timing of institutional data collection, management, analysis, and reporting Assessment of student learning (course, program, institution levels) Faculty & course evaluations Strategies for data sharing & usageData analyticsCampus needs assessments

Campus Quality Assurance Needs Assessment Current structures, systems, & strategies Data Collection & Processing Data Management & Storage Data Analysis & Reporting Data Needs Data Challenges

Questions?