Assessing the Assessment Process: Developing a rubric for reporting at Virginia Tech Ardian Daku, Pamplin College of Business; Ryan Cook, Counselor Education;

Slides:



Advertisements
Similar presentations
What is Assessment? The university, with the support and encouragement of President Hitt and the Vice President team, engages in the institutional effectiveness.
Advertisements

STUDENT LEARNING OBJECTIVES (SLOs) “Designing” © Pennsylvania Department of Education.
STUDENT LEARNING OBJECTIVES (SLOs) 1 Orientation Module.
Measuring Student Learning March 10, 2015 Cathy Sanders Director of Assessment.
CoA+A Student Learning Outcomes Assessment Dec. 11, 2014 E. Payne-Wiens.
Program Assessment: Writing Learning Outcomes Specify intended outcomes Measure whether students are meeting those outcomes Improve your program based.
Program Review: The Foundation for Institutional Planning and Improvement.
ELAC SLO RETREAT 2009 Veronica Jaramillo, Ph.D. Mona Panchal Anthony Cadavid ELAC SLO RETREAT 2009.
Department Plans for Assessment of Student Learning Teachers Talking February 16, 2011.
Program Review Steve Wilson Director of Academic Assessment.
Assessment Strategies Visual Tools EDUC 4454 P/J Methods.
HELPFUL TIPS FOR UNIT PLANNING Office of Institutional Effectiveness.
What should be the basis of
performance INDICATORs performance APPRAISAL RUBRIC
Develop Systematic processes Mission Performance Criteria Feedback for Quality Assurance Assessment: Collection, Analysis of Evidence Evaluation: Interpretation.
Dr. Timothy S. Brophy Director of Institutional Assessment University of Florida GRADUATE AND PROFESSIONAL PROGRAM ASSESSMENT PLANS.
Assessment Assessment Planning Assessment Improvements Assessment Data Dialogue & Reflection.
Reaffirmation of Accreditation: Institutional Effectiveness Southern Association of Colleges and Schools February 2008 Stephen F. Austin State University.
Maps, Rubrics and Templates A Primer on Their Uses for Assessment in Student Affairs.
Accrediting Commission for Community and Junior Colleges of the Western Association of Schools and Colleges.
2014 AmeriCorps External Reviewer Training
Writing Measurable Student Learning Outcomes
TaskStream Training Presented by the Committee on Learning Assessment 2015.
STUDENT LEARNING OBJECTIVES (SLOs) Orientation Module © Pennsylvania Department of Education.
PDHPE K-6 Using the syllabus for consistency of assessment © 2006 Curriculum K-12 Directorate, NSW Department of Education and Training.
Academic Assessment at UTB Steve Wilson Director of Academic Assessment.
Impact assessment framework
Preparing for ABET Accreditation: Meeting Criteria 2, 3 & 4 October 12, 2006 Melissa Canady Wargo, Director Office of Assessment.
1. Continue to distinguish and clarify between Student Learning Outcomes (SLOs) and Service Area Outcomes (SAOs) 2. Develop broad SLOs/SAOs in order to.
Mapping Student Learning Outcomes
Department Mission Statement and Program Learning Outcomes.
Undergraduate Academic Assessment Plans: What’s New for Timothy S. Brophy, Director of Institutional Assessment University of Florida Office of.
Program Review In Student Affairs Office of the Vice President Division of Student Affairs Virginia Tech
Comp 20 - Training & Instructional Design Unit 6 - Assessment This material was developed by Columbia University, funded by the Department of Health and.
March 26-28, 2013 SINGAPORE CDIO Asian Regional Meeting and Workshop on Engineering Education and Policies for Regional Leaders Programme Evaluation (CDIO.
Using the ACCJC Rubrics Dan Peck Cynthia Klawender-Lee.
The Basics of Student Learning Outcomes Assessment SACSCOC Summer Institute July 20, 2015 handout for this session is in the online program Timothy S.
From Inputs to Process to Outcomes: the Quality Management Program at the American University in Bulgaria Steven F. Sullivan Dean of Faculty.
Workshops to support the implementation of the new languages syllabuses in Years 7-10.
Fall 2015 Professional Development Days C. Cruz-Johnson & R. Gamez August 28, Walking with Integrity Towards Student Success.
Administrative and Educational Support Outcomes: Reporting Results, Taking Action, and Improving Services Lisa Garza Director, University Planning and.
A Basic Guide to Academic Assessment Presented by Darby Kaikkonen Director of Institutional Research.
By Monica Y. Peters, Ph.D. Coordinator of Institutional Effectiveness/QEP Office of Quality Enhancement.
VT University Libraries: Identifying, Teaching, and Assessing What Matters Most Office of Academic Assessment Ray Van Dyke,
Program Review Training 2015 Petr Lensky and Amanda Corcoran.
What Your Program Needs to Know about Learning Outcomes Assessment at UGA.
Assessing Student Learning Workshop for Department Chairs & Program Directors Workshop for Department Chairs & Program Directors January 9, 2007.
Grant Proposal Writing
Grant Proposal for [Project Name]
1 Learning Outcomes Assessment: An Overview of the Process at Texas State Beth Wuest Director, Academic Development and Assessment Lisa Garza Director,
What is Regional Accreditation? Regional Accreditation is a time-tested model of professional peer review that supports education excellence. Accreditation.
Developing Program Learning Outcomes To help in the quality of services.
SLOAC The Skyline Way1 Presented by: Skyline College SLOAC Committee.
CREATING A CULTURE OF EVIDENCE Student Affairs Assessment Council October 2013 Dr. Barbara Copenhaver-Bailey Assistant Vice President for Student Success.
JACKSON STATE UNIVERSITY ACADEMIC ASSESSMENT COMMITTEE WORKSHOP By: Dr. Shemeka McClung Director Ms. Arnitra Hunter Research Associate Institutional Research.
Conversation with the SLOA&C March 20, 2015 Professional Development Day SJCC Presenters: C. Cruz-Johnson, S. Datta, and R. Gamez Paving the Way for Student.
Kimberlee Pottberg.  Part 1: Why we use WEAVEonline  Part 2: How to enter components.
AQIP Categories Category One: Helping Students Learn focuses on the design, deployment, and effectiveness of teaching-learning processes (and on the processes.
AAC Assessment Glossary
Student Learning Objectives (SLOs)
Student Learning Outcomes (SLOs) Module #4: SLO Annual Report
Making the most of the assessment cycle and template
Program Review Training
Consider Your Audience
Developing a Student Learning Outcomes Assessment Plan and Report
Assessment Plan Tune-up
Presented by: Skyline College SLOAC Committee Fall 2007
Assessing Academic Programs at IPFW
Assessment Day Strategy
Center/Institute Name Director’s Name Proposal Team Members
Presentation transcript:

Assessing the Assessment Process: Developing a rubric for reporting at Virginia Tech Ardian Daku, Pamplin College of Business; Ryan Cook, Counselor Education; Steven Culver, Office of Assessment and Evaluation Introduction Given recent accreditation guidelines and state and federal mandates, it has become increasingly important that degree programs demonstrate that students are learning what we say they are learning. To that end, degree programs at Virginia Tech have developed student learning outcomes (what skills, knowledge, and abilities students possess when they graduate), measured and collected data on those outcomes, and have developed plans to adjust program or curricula to improve student learning. Purpose The purpose of our project was to synthesize more than 250 program level assessment processes by providing a snapshot of their completeness and quality. In order to synthesize the large amount of data in WEAVE, a repository for student learning outcomes used at Virginia Tech, reviewers developed two templates. Example of Template I  Template I assessed the inclusion of a mission statement, number of student learning and program outcomes, presence of outcomes data in the past year, presence of data over the past three years, number of action plans, and evidence of change made in the program based on measurement (direct and indirect) of student outcomes in the last three years.  Template II provided a deeper understanding of the data collected to SLOs. Program data that was in WEAVE was copied into Template II and data was organized by SLOs. For each SLO, the measures and findings over the past three years were reflected on the template. Missing data was denoted by blank space next to the corresponding term. This template denoted the importance of improvement and change as a result of findings.  Large amounts of data were presented in a concise manner that could easily be could be disseminated to over 250 programs  Templates provided directors a snapshot of completeness of data  A caveat: Though the templates provided a program overview related to assessment, specific details and outcomes could be oversimplified. MISSION STATEMENT: A concise statement outlining the purpose of the program, who it serves, in what ways, and with what results. STUDENT LEARNING OUTCOME: Specific statements that articulate the knowledge, skills, and abilities students should gain or improve through engagement in the degree program MEASURES: The variety of the methods used to evaluate each outcome and the criteria or indicators that describes whether the outcomes were achieved. Includes the target or benchmark that indicates success. FINDINGS: Brief summary of the results gathered from a given assessment measure and review of results in terms of targets set. Looking at what has been learned through data collected. Improvement PLAN: What actions will be taken to improve student learning or the assessment process based on the results Definition of Key Terms Example of Template II Description of Template I & II Benefits of Templates Results These templates served as a visual aid for programs about the completeness and level of quality of the student learning outcome and program outcome data. Using these templates, reviewers could easily identify programs who had successfully input data into WEAVE and those programs needing additional assistance. Furthermore, the templates aided review and discussion about program specific assessment.