22 May 2012. Session Overview Purposes: Provide an overview of the assessment plan for Foundational Studies Discuss Phase I of the assessment plan – assessing.

Slides:



Advertisements
Similar presentations
Outcomes Assessment. Many academic institutions measure the success of service- learning based on participation, number of hours, or estimated monies.
Advertisements

Daniel Peck January 28, SLOs versus Course Objectives Student Learning Outcomes for the classroom describe the knowledge, skills, abilities.
Guidelines and Methods for Assessing Student Learning Karen Bauer, Institutional Research & Planning, Undergraduate Studies; Gabriele Bauer, CTE.
The Role of Faculty During the Self-Study Process Ensuring Success at Cedar Crest LaMont Rouse Executive Director of Assessment, Accreditation & Compliance.
Assessment Rubrics Los Angeles City College Assessment Team.
CWU Writing Assessment. Why? To improve student learning.
Measuring Student Learning March 10, 2015 Cathy Sanders Director of Assessment.
SLO Process A process to document a measure of educator effectiveness based on student achievement of content standards.
Department Plans for Assessment of Student Learning Teachers Talking February 16, 2011.
Apples to Oranges to Elephants: Comparing the Incomparable.
2005 CELT Conference1 Strategies from the Assessment Trenches: A Self-Help Clinic presented by AURA.
1 KapCC Student Learning Outcomes Assessment Framework Faculty Senate SLO Committee Presented by Kristine Korey-Smith.
UNA’S QUALITY ENHANCEMENT PLAN RESEARCH LITERACY IMAGINE... INVESTIGATE... COMMUNICATE Building Success through Discovery.
NSE Assessment (Session 1): The Academic Plan Assignment for MEP
Program Assessment Workshop Kathleen Harring. What is Assessment? Assessment is the systematic gathering and analysis of information to inform and improve.
Assessment 101: Back-to-Basics An Introduction to Assessing Student Learning Outcomes.
May 8 th Assessment Day 2015 Agenda Introductions Assessment Overview Review General Education Outcomes. Overview of past assessment work. What.
Assessment of Ethics Jones College of Business MTSU July 29, 2015.
Writing Measurable Student Learning Outcomes
Direct vs Indirect Assessment of Student Learning: An Introduction Dr. Sheila Handy, Chair Business Management and Co-Chair University Assessment Committee.
Assessing Student Learning: What Kapi‘olani Community College is Doing Kristine Korey-Smith, Assessment Coordinator Louise Pagotto, Interim Vice Chancellor.
Assessment Leader Training General Education Student Learning Assessment GEO Training Series: 2 of 5 Spring 2012 February 13, 2012.
October 31, Dialog about SLOs, assessment, and existing practices at TC Identify course level SLO to assess this semester Align SLO with TC’s institutional.
Rubrics for Complex Papers/Projects Academic Assessment Workshop May 13-14, 2010 Bea Babbitt, Ph.D.
Assessment of Curriculum Outcomes Dale Whittaker Associate Dean and Director of Academic Programs Purdue University May 21, 2008.
Note: Because of slide animation, this ppt is intended to be viewed as a slide show.  While viewing the ppt, it may be helpful to obtain a sample Core.
Closing the Loop: The Assessment Process from Outcomes to Academic Excellence, Budgetary Competence and Community Engagement.
Building Your Assessment Plan Esther Isabelle Wilder Lehman College.
Closing the Loop: The Assessment Process from Outcomes to Academic Excellence, Budgetary Competence and Community Engagement January 2012.
Updating Curriculum to Support Learning Davidson County Community College May
Evaluation Team Progress Collaboration Grant 252.
Adriana Signorini, CRTE, SATAL Coordinator Greg Dachner, SSHA, SATAL Student Sharai Kirk, SSHA, SATAL Student How do we know our students are learning?
Winter  Provide information and examples of the SLO process to help faculty use assessment to improve teaching and learning  Provide tools and.
Evidence of Student Learning Fall Faculty Seminar Office of Institutional Research and Assessment August 15, 2012.
Full-Time Faculty In-Service: Program and Student Learning Outcomes Fall 2005.
Higher Learning Commission Annual Conference Chicago, IL ▪ April 8, 2013 Christine Keller VSA Executive Director Teri Lyn Hinds VSA Associate Director.
Everything You Need to Know for Spring 2010 S. Kashima.
Learning Outcomes Assessment Learning Outcomes Committee Co-Chairs - David Steer: Stephane Booth:
Susan DeMatteo June 13, 2013 Putting EOF on the Map! Mapping Strategies for Assessment Design.
Core Curriculum Proposal Workshop. Overview  Defining Assessment  Steps in Assessment  Time to Practice Developing an Assessment Plan  Q&A and Wrap.
Fall 2015 Professional Development Days C. Cruz-Johnson & R. Gamez August 28, Walking with Integrity Towards Student Success.
Abstract: The definition of effective teaching is fluid and dependent on the teaching environment and its community members (faculty, students and administrators).
Peralta Community Colleges: Environments of Effective Learning and Innovation. January
Strengthening Student Success Summit Strengthening Student Success Summit November 17, Student Services and Student Success Assessment, Dialogue.
Connecting Course Goals, Assignments, and Assessment Faculty Development for Student Success at Prince George’s Community College William Peirce
Competency Assessment Advisory Team (CAAT) QUANTITATIVE REASONING DEPARTMENT OF MATHEMATICS REP – ROB NICHOLS 1.
Integrating Teaching, Learning and Assessment: A Programmatic ePortfolio Process AAEEBL Conference, Boston, MA - July 28, 2011 Karen Stein, Faculty Director,
August 15th 2007 Assessment of Student Learning Outcomes by Kirby Hayes.
Introduction to Academic Assessment John Duffield Office of Academic Assessment Georgia State University September 2013.
What Your Program Needs to Know about Learning Outcomes Assessment at UGA.
1 Student Learning Outcomes and Assessment Norma Ambriz * February 14, 2008 Student Learning Outcomes and Assessment Norma Ambriz * February 14, 2008 A.
UK Office of Assessment. The LEARNING Initiative Dual Track Implementation Strategy Completion Dates Not actively engaged in program level assessment.
Student Learning Outcomes Reconsidered. Presentation Learning Outcomes - Bill Use a departmental process of creating student learning outcomes Define.
Assessing Student Assignments Student Learning Kathleen M. Morley, Ph.D. University Director of Assessment Office of Academic Affairs Long Island University,
Incorporating Program Assessment into Your Annual Program Review June 29, 2006.
Assessment Instruments and Rubrics Workshop Series Part 1: What is a rubric? What are the required elements? What are VALUE rubrics? February 24, 2016.
Student Learning Outcomes Assessment Montgomery College Fall 2011 Orientation.
If I hear, I forget. If I see, I remember. If I do, I understand. Rubrics.
Updates on AASCU & APLU Data Projects Christine M. Keller, PhD Executive Director, Voluntary System of Accountability APLU Associate Vice President, Academic.
CIAS Program Level Assessment Office of Educational Effectiveness Assessment September 6, 2016.
The Assessment Process: A Continuous Cycle
Direct vs Indirect Assessment of Student Learning: An Introduction
Consider Your Audience
LASC 2010 Program Review Orientation
Workshop 1 Self-Assessment Committee (SAC)
Assessment Day 2018 New Student Experience
Presented by: Skyline College SLOAC Committee Fall 2007
Assessment History Since 2013 the department has performed ongoing assessment of RWS 100 & 200 comprised of Internal, department-driven, self-assessment.
Student Learning Outcomes Assessment
Peralta Community Colleges: Environments of Effective Learning and Innovation. January 2012.
Presentation transcript:

22 May 2012

Session Overview Purposes: Provide an overview of the assessment plan for Foundational Studies Discuss Phase I of the assessment plan – assessing writing Introduce using rubrics to assess writing

The Compliance Thing Higher Learning Commission (HLC) of the North Central Association of Schools and Colleges (NCA) Required report on Assessment of Student Learning – Expectations: 1. “Assessment activities which reflect at least one year of data collection, analysis, and anticipated use of results for all academic programs at both the undergraduate and graduate level” – one completed assessment cycle 2. an update on assessment for the Foundational Studies program with at least one year of data Activities must be completed by May 2013 for reporting in Fall 2013

HLC Academy for Assessment of Student Learning Four-year Academy student learning project: Jan – Dec Focused on assessment of Foundational Studies learning outcomes 1, 2, 3, and 10 Learning Outcomes for Foundational Studies

Project Overview First phase (Jan 2012 – Dec 2013) focused on SLO 10 – written communication Second phase (Fall 2012 – Fall 2014) focused on SLO 10 – oral communication; data collection Spring 2014 Third phase (Fall 2013 – Fall 2015) focused on SLO 1 – information literacy/problem solving; data collection Spring 2015

Phase 1: Assessment of Writing: First-Year and UDIEs Assessment of writing in first-year program English 101 – diagnostic and end of semester – Fall 2012 English 105 and 107 – Spring 2013 rubrics under development by Susan Latta norming session in June 2012

Assessment of Writing in the UDIEs SLOs for the UDIEs Will develop a shared rubric for common criteria – each faculty or program can add additional outcomes/traits and performance criteria/scales specific to course or program objectives and outcomes Common outcomes/traits will be consistent with those for first-year writing Specific program or course outcomes added by instructors

Timeline for Fall 2012: Develop and Test Rubrics Aug – roundtables for rubric development Sept share rubrics for discussion and feedback/modify - training on applying rubrics/norming Sept - Oct roundtables for pilot test of evaluating student artifacts Oct evaluate inter-rater reliability Oct- Nov modify rubrics and conduct second pilot if necessary Dec load rubrics into Blackboard (if available)

Timeline for Spring 2013: Data Collection ETS Proficiency Profile: Fall 2012 – first-year students Feb – seniors NSSE/FSSE (indirect) – Spring 2013 April – May 2013 – course artifacts

Completing Phase I Cycle Summer data aggregated and analyzed Fall open fora to discuss evidence and consider implications Spring open fora to identify needed improvements to enhance student writing Implement changes in

Descriptive Rubrics Questions: 1. Is written communication among your program’s student learning outcomes? 2. Do you currently use descriptive rubrics to grade student writing in one or more courses? 3. Do you consider the rubric(s) you use to be an effective and efficient means of evaluating student work? 4. Is the aggregated data from the rubric(s) used as evidence in assessing student achievement of your program’s learning outcomes?

What is a rubric, anyway? A scoring/grading guide – aka “primary trait analysis scale” (Walvoord) 1. A matrix that explicitly states the criteria and standards for student work 2. Identifies outcomes and describes levels of performance within each of the traits 3. Makes clear the strengths and weaknesses in student work 4. A grading time-saver The rubric to be used should be shared with the students before they begin work so they will know the criteria on which they will be evaluated.

Developing Rubrics 1. Describe the characteristics of a. a superior paper b. an unexceptional but acceptable paper c. a borderline paper d. an unacceptable paper 2. Make a list of the SLOs or traits that will count in the evaluation. 3. For each trait, develop descriptive statements for each of the four (or five or six) points on the scale (performance criteria).

Examples of rubrics for evaluating writing Internet resources: ISU

Sources consulted Suskie, L. (2009). Assessing student learning: A common sense guide (Second ed.). Bolton, MA: Anker Publishing Company, Inc. Walvoord, B. E. (2004). Assessment clear and simple. San Francisco: Jossey-Bass. Walvoord, B. E., & Anderson, V. J. (1998). Effective grading: A tool for learning and assessment. San Francisco: Jossey-Bass.