Assessing Student Learning Presenters: Eric Babbitt & Sherrard Pearce

Workshop Purpose

Used with skill, assessment can Motivate the unmotivated Restore students’ desire to learn Encourage students to keep learning Create—not simply measure—increased achievement --Stiggins, Arter, Chappuis, & Chappuis, 2006

CLASSROOM ASSESSMENT GUIDING PRINCIPLES: Gather accurate information about student achievement Use assessment process and results to promote maximum student learning

Expected Benefits and Proven Results Assessment connected to learning Better instruction focused on standards Profound achievement gains for all students, with the largest gains for lowest achievers More self-managed learning by students

Assessment FOR Learning- Seven Strategies 1. Provide a clear and understandable vision of the learning target. 2. Use examples and models of strong and weak work 3. Offer regular descriptive feedback. 4. Teach students to self-assess and set goals. 5. Design lessons to focus on one aspect of quality at a time. 6. Teach students focused revision. 7. Engage students in self-reflection, and let them keep track of and share their learning. 1 minute

Training Goals Every Teacher Will: Know the 4 types of learning targets Understand each target type Be able to unpack an objective or standard with competence and confidence Begin to consider how this knowledge of learning targets applies to your lesson objectives, PDSA goals, classroom instructional strategies and CFAs.

Teacher / Participant Activities & Key Learning

Learning Targets for Today: Define Assessments of (summative) and for (formative) Learning Learn 7 Strategies for engaging students in Classroom Assessment for Learning

The Goal of Assessment for Learning… FOR TEACHERS TO KNOW: How students’ brains work. How they learn. How to maximize students’ enthusiasm for learning. 2 minutes

Identify the Type of Achievement Target Activity Instructions: Divide into equal groups. Read the objectives for the goal you receive. Classify each objective into the appropriate type of achievement target on the worksheet. Each group will read one of their objectives and their answer.

Now Put It In Kid-Friendly Language See side two of the Deconstructing Standards worksheet. I-SS requires that your essentials be posted and in student-friendly language. If you need to adjust your 2nd semester essentials based on CFA/PA Data, now is the time to do so.

Every Teacher Will: Know the 4 types of learning targets Understand each target type Be able to unpack an objective or standard with competence and confidence Begin to consider how this knowledge of learning targets applies to your lesson objectives, PDSA goals, classroom instructional strategies and CFAs. Be able to Match the Assessment Method to the Learning Target.

Carefully select and clarify learning targets Determine their relative importance Chose the best assessment method Carefully write questions or tasks and scoring guides, and critique them to ensure they adhere to standards of quality

The point is not that we adults don’t contribute immensely to student learning. We do. We are critical players in teaching, learning, and assessment. It’s just that we are second in rank order of importance as instructional decision makers. Stiggins, Arter, and Chappuis2

Choose student & teacher success! Register for our workshop and receive: Differentiated training based on your district or staff needs and prior learning/experience Materials to help move your teachers forward with their understanding Materials that get teachers to reflect and analyze their assessments Guaranteed student success!

Classroom Assessment: Moving Learning Forward for Teachers and Students Module 1 Key 1: Clear Assessment Purpose

Keynote Video Presentation Featuring Rick Stiggins

FORMATIVE ASSESSMENT: All those activities undertaken by teachers and by their students [that] provide information to be used as FEEDBACK to modify the teaching and learning activities in which they are engaged. --Black & Wiliam, 1998

Research consistently shows that regular, high-quality FORMATIVE ASSESSMENT increases student achievement.

CLASSROOM ASSESSMENT GUIDING PRINCIPLES: Gather accurate information about student achievement Use assessment process and results to promote maximum student learning

ACCURACY EFFECTIVE USE PURPOSE EFFECTIVE COMMUNICATION DESIGN STUDENT INVOLVEMENT TARGET

Key 1: Clear Assessment Purpose Always begin by asking What decisions? Who’s making them? What information will be helpful to them?

What’s the PURPOSE for assessment?

Two Purposes for Assessment SUMMATIVE Assessments OF Learning How much have students learned as of a particular point in time? FORMATIVE Assessments FOR Learning How can we use assessment information to help students learn more?

Assessment for learning Assessment for learning Balanced Assessment Formative Formal and informal processes teachers and students use to gather evidence to directly improve the learning of students assessed Summative Provides evidence achievement to certify student competence or program effectiveness Assessment for learning Use assessments to help students assess and adjust their own learning Assessment for learning Use classroom assessments to inform teacher’s decisions Formative uses of summative data Use of summative evidence to inform what comes next for individuals or groups of students

Key 1: Clear Assessment Purpose Always begin by asking What decisions? Who’s making them? What information will be helpful to them?

Key 2: Clear Learning Targets Know what kinds of targets are represented in curriculum Knowledge Reasoning Performance skill Product Master the targets ourselves Know which targets each assessment measures Make learning targets clear to students, too.

Clarifying Learning Targets Begin with state standards Order in learning progressions, if needed Deconstruct into clear learning targets leading to each standard Communicate the learning targets in advance in language students can understand

Products Skills Reasoning Knowledge

Key 3: Sound Assessment Design Select a proper method Select or create quality items, tasks, and rubrics Sample appropriately Prevent bias Design assessments so students can self-assess and set goals based on the results

Possible Assessment Methods Selected Response Multiple Choice True/False Matching Fill in Extended Written Response Performance Assessment Personal Communication Questions Conferences Interviews

Key 4: Effective Communication Provide students with timely, accurate descriptive feedback Involve students in tracking and communicating about their learning Use grading practices that accurately communicate about student learning Interpret and use standardized test results correctly

Effective Feedback… Describes features of work or performance Relates directly to learning targets and/or standards of quality Points out strengths and gives specific information about how to improve Occurs during the learning process Limits correctives to the amount of advice the student can act on

Key 5: Student Involvement Students are identified as important users of assessment information Students understand the learning targets and standards of quality Assessments are designed so that students can use the results to self-assess and set goals for further action Students keep track of and share their achievement Assessment FOR Learning!

5 Keys to Quality Classroom Assessment

Requirement for Success? Quality Assessment! All assessment arise from high-quality content standards All assessments produce accurate evidence All users use assessment to benefit student learning

Expected Benefits and Proven Results Assessment connected to learning Better instruction focused on standards Profound achievement gains for all students, with the largest gains for lowest achievers More self-managed learning by students

Classroom Assessment for Student Learning Module 1 Key 1:Clear Assessment Purpose Introduction 1 minute

Learning Targets for Today: Define Assessments of (summative) and for (formative) Learning Learn 7 Strategies for engaging students in Classroom Assessment for Learning Setting the objective for your professional development 2 minutes

Hear the experts…. Rick Stiggins on Assessment for/of Learning

What does it look like? Summative Assessments OF Learning Formative -How much have students have learned as of a particular point in time? Autopsy EOG Report Card Grade Project Grade End-Unit-Test Formative Assessments FOR Learning How can we use assessment information to help students learn more? Check-up CFAs PDSA Assessments L to J Predictive Assessments DRA

The Goal of Assessment for Learning… FOR TEACHERS TO KNOW: How students’ brains work. How they learn. How to maximize students’ enthusiasm for learning. 2 minutes

Three Questions that Define Students’ Information Needs Effective formative assessments answer these three questions : Where am I going? Where am I now? How can I close the gap?

JIGSAW FUN! At your table: Each person choose a different strategy Become an expert of your strategy Share your new knowledge of your strategy with your table

Assessment FOR Learning- Seven Strategies 1. Provide a clear and understandable vision of the learning target. 2. Use examples and models of strong and weak work 3. Offer regular descriptive feedback. 4. Teach students to self-assess and set goals. 5. Design lessons to focus on one aspect of quality at a time. 6. Teach students focused revision. 7. Engage students in self-reflection, and let them keep track of and share their learning. 1 minute

Where are you? Take a few minutes to consider “Where Am I Now?” Fill out the accompanying document & turn in to your Instructional Facilitator, please.

Classroom Assessment for Student Learning Module 2 Key 2: Clear Targets Introduction 1 minute

Today’s Training Goals Every Teacher Will: Know the 4 types of learning targets Understand each target type Be able to unpack an objective or standard with competence and confidence Begin to consider how this knowledge of learning targets applies to your lesson objectives, PDSA goals, classroom instructional strategies and CFAs.

We Need Clear Targets To: Know if the assessment adequately covers what we taught Correctly identify what students know and don’t know Have students self-assess or set goals for future study that are likely to help them learn more Keep track of student learning target by target or standard by standard Complete a standards-based report card (CASTLE Learning does this already!)

Kinds of Achievement Targets Knowledge – Master factual and procedural knowledge Reason – Use knowledge to reason and solve problems Performance – Demonstrate mastery of specific performance skills Product – Create quality products (See handout for verbs to go with each type of target)

Identify the Type of Achievement Target Activity Instructions: Divide into equal groups. Read the objectives for the goal you receive. Classify each objective into the appropriate type of achievement target on the worksheet. Each group will read one of their objectives and their answer.

Now Put It In Kid-Friendly Language See side two of the Deconstructing Standards worksheet. I-SS requires that your essentials be posted and in student-friendly language. If you need to adjust your 2nd semester essentials based on CFA/PA Data, now is the time to do so.

Round Robin Activity In your groups, take turns responding orally to the following question: How does the knowledge from today’s training help us develop more informative CFAs based on our lesson objectives and PDSA goals?

For the next CASL PD We’ll be matching the types of assessment methods with the type of learning target(s) students need to master.

Focus for Today Key 3: Sound Design (Target Method Match) CASL Training Focus for Today Key 3: Sound Design (Target Method Match)

Today’s Training Goals Review the 5 Keys to Quality Classroom Assessment Review the 4 Learning Targets Be able to Match the Assessment Method to the Learning Target

Key 3: Assess How? Sound Design Assessment methods matched to learning targets Well written tasks, items, and scoring guides Adequate sample Bias Avoided

Assessing Learning Targets Selected Response Extended Written Response Performance Assessment Personal Communication

Selected Response (Multiple choice, True/False, Matching, Fill in the blank, Labeling)

Extended Written Response Students create a written answer at least several sentences in length in response to a question or task Evaluated with a checklist or rubric

Performance Assessment Assessment based on observation and judgment Consists of tasks and scoring criteria

Personal Communication Conversations with students Questions and answers Conferences Interviews Oral examinations

Links Among Achievement Targets and Assessment Methods Table 4.1 (on table)

Target Method Match Activity A strong match between method and kind of learning target results in accurate information gathered as efficiently as possible A mismatch occurs when the assessment method is not capable of yielding accurate information about the learning target. Place a plus sign (+) in each assessment method column you believe is a strong match Share out.

Next Steps Assessment Cycle Development All assessment, regardless of method selected, go through the same five stages of development: planning, developing, critiquing, administering, and revising.

Stages in Assessment Development Plan: Assess why? Assess what? Assess how? How important? Develop: Determine the sample. Select, create, or modify test items or tasks and scoring mechanisms. Critique: Evaluate for Quality Administer: Administer the test or assessment. Revise: Evaluate test quality based on results and revise as needed.

That’s All Folks! Thank you for your participation and attention. Please plus/delta today’s training .

Classroom Assessment for Student Learning Module 4: Assessment Planning and Development

The Connection Between Clear Targets and Assessment Quality Assessments of learning must reflect what has actually been taught and what students have had an opportunity to learn. What happens when assessments of learning don’t do this? How might it impact instruction? How might it impact students? Today will equip us to plan for and develop high quality assessments.

What was being assessed on this test? What does the smiley face indicate? What does the “M” indicate? What were the learning targets? Does the “grade” reflect level of learning vs. requirements? (So that teachers can look closely at “Claire’s Test”, a handout is available a companion document to this PPT.) Slides 308 engage teachers in a close look at a classroom assessment and guide them through how it can be analyzed in order to answer several key questions about quality assessment for learning. “Claire’s Test” is a third grade assessment used to help teachers begin thinking about whether or not their assessments actually assess what students are expected to learn and have had an opportunity to learn. It also leads teachers to begin thinking about the marks or “grade” placed on student assessments and the degree to which those marks give students helpful information about their learning. (For example, the happy face on Claire’s test may simply tell Claire that the teacher is happy with her work, not what her strengths were on the test). Teachers discuss these and other points on the slides that follow. Remember that in the story of Claire’s test – a true story - when Claire’ mom saw this test and asked Claire about it, Claire was unable to tell her mom whether she did a good job or not, much less what the test assessed and what her own strengths or weaknesses were or what she needed to do to improve. When asked what she was tested on, she could only answer, “Math.” Copies of Claire’s Test documents are in the CASL Notebook, Tab 3, blue pages 43 – 46. We suggest making a hard copy of only the test on page 44.

Step 2: Organize the learning targets into a test plan Claire’s Math Page 33 # of points Item #s Learning Target 15 1, 5, 9, 11, 16 Number Sense: Place Value 1 2 Representation 5 4,12 Number Operations: Fractions, multiply by 2, subtract with borrowing 1 3 Problem Solving/Add with carry 7 7,10,14,15 Measurement: Identify correct units 3 13 Data Analysis & Probability: Tables, charts, & graphs 4 6,8 Algebra: number patters, number sentences

Now look back at Claire’s test & discuss: Whether the test actually assesses what the teacher taught How student results on this test might help inform the teacher’s lesson planning. Conditions under which this test should be graded and the grade placed in the grade book. Overall conclusions about Claire’s math test.

Analyze Your Own Assessment for Clear Targets Analyze the test item by item. (we already did this) Organize the learning targets into a test plan. (see slide 19) Question your test plan. Number of points = relative importance of targets? Number of points = amount of instructional time on each target? Any targets left out? How does assessment and instruction match content standards? Page 34

Analyze Your Own Assessment for Clear Targets Analyze the test item by item. Organize the learning targets into a test plan. Question your test plan. Adjust your test plan. Draw conclusions/adjust the test. How could Claire’s teacher complete 4 & 5 above in order to improve the assessment given to Claire’s class?

Keys to Quality Classroom Assessment Accurate Assessment Clear Purposes Why Assess? What’s the purpose? Who will use results? Clear Targets Assess What? What are the learning targets? Are they clear? Are they good? Good Design Assess How? What method? Sampled how? Avoid bias how? Effectively Used Sound Communication Communicate How? How manage information? How report? Student Involvement Students are users, too. Students need to understand learning targets, too. Students can participate in the assessment process, too. Students can track progress and communicate, too.

Overview of Stages in Assessment Development All assessments, regardless of method selected, go through the same five stages of development: Planning Developing Critiquing Administering Revising

Stage One - Planning Assess WHY? Determine the intended use of an assessment Identify the learning targets to be assessed (WHAT?) Select the proper assessment method (HOW?)

Stage Two - Developing Select or create test items or tasks Select or create scoring mechanisms (rubric, scantron, etc.)

Stage 2: Develop the Assessment Learning Targets Type of Target Assessment Method Percent Importance 1.03a – I can explain personal responses to lit. based on evidence from the text. Reasoning Extended Response 40 % Provide 2 excerpts from lit. text to support your opinion of the main character. 1.03b – I can examine my own personal views & make connections to a text. 40% Use evidence from the text to support your opinion of the way the main character solved the conflict

Learning Target Type of Target Assessment Method Percent Importance

Stage Three - Critiquing Evaluate to avoid bias or misrepresentation Evaluate for quality Reminder: March focus

Stage Four - Administering Simply administer the assessment to students Reminder: You’ll do this between March & April CASL sessions.

Stage Five - Revising Evaluate test quality based on results. Problems with questions? Problems with tasks? Problems with scoring? Reminder: April focus; will use the classroom assessment you created

Next steps: CASL Use test plan document to create a classroom assessment (not a CFA). Bring it to the next training on CASL.

Classroom Assessment for Student Learning Module 5: Assessment Critiquing

Before we begin… Make sure you have a copy of your assessment for today’s Professional Development

Keys to Quality Classroom Assessment Accurate Assessment Clear Purposes Why Assess? What’s the purpose? Who will use results? Clear Targets Assess What? What are the learning targets? Are they clear? Are they good? Good Design Assess How? What method? Sampled how? Avoid bias how? Effectively Used Sound Communication Communicate How? How manage information? How report? Student Involvement Students are users, too. Students need to understand learning targets, too. Students can participate in the assessment process, too. Students can track progress and communicate, too.

Overview of Stages in Assessment Development All assessments, regardless of method selected, go through the same five stages of development: Planning Developing Critiquing Administering Revising

Stage One - Planning Assess WHY? Determine the intended use of an assessment Identify the learning targets to be assessed Select the proper assessment method

Stage Two - Developing Select or create test items or tasks Select or create scoring mechanisms (rubric, scantron, etc.)

Stage Three - Critiquing Evaluate to avoid bias or misrepresentation

Critique Working Definition Going back over the assessment to see if you have completed or addressed all the necessary components of sound assessment design.

Bias Working Definition Anything in the assessment, or the conditions under which the assessment was given, including student barriers, that would lead to inaccurate measurements of student learning.

Basic Components of Sound Assessment Design – Selecting an Assessment Method Will the assessment method(s) chosen accurately reflect the learning target(s) to be assessed? In other words have you done your target-method match?

Basic Components of Sound Assessment Design - Sampling Do the learning targets represent what was taught? Does the relative importance of each learning target match its relative importance during instruction? Have you considered how much instruction time was spent on a target and represented that target accordingly on the assessment? Is the sample size large enough to inform the decisions intended to be made.

Basic Components of Sound Assessment Design – Item Quality Do the assessment items, exercises, scoring procedure, and scoring guides/rubrics adhere to standards of quality? (This is something we will look at much more in-depth next year. For now, look carefully at each test item and do your best to determine whether it is a quality test item.)

Basic Components of Sound Assessment Design – Avoiding Potential Sources of Bias and Distortion Is there anything in the assessment itself or in the conditions under which it is administered that could lead to inaccurate estimates of student learning? Will accommodations made for diverse student characteristics result in any distortions in the final judgment of student learning? Are instructions present, clear, and concise?

Stage Four - Administering Simply administer the assessment to students

Stage Five - Revising Problems with questions Problems with tasks Problems with scoring

Standard II b Standard III a, b Standard IV a, b, c, h CASL Content Connects to the Following NC Professional Teaching Standards: Standard II b Standard III a, b Standard IV a, b, c, h Standard V a, b, c

CASL Stages in Assessment Development Revise the Assessment

What have we done? Carefully selected and clarified learning targets, Determined their relative importance, Chosen the best assessment method, Carefully written questions or tasks and scoring guides, and critiqued them to ensure they adhere to standards of quality. We’re finished, right?

“What really counts happens after the assessments.” Thomas Guskey

What do you do with the Data? In your table groups, discuss your findings from the preliminary work on your assessment data.

Test Revision Beginning Questions: Did you get any feedback from your students? Were there questions or parts of the test that were a surprise or that were confusing to the students? Did they know the answer but could not find it? Did they finish the assessment? If not, why? Did they rush to finish at the end? Why? Did any student question their grade? Why Were students given the time to go back through and check their work?

Test Revision The BIG questions: Did this assessment really inform you of what students need to be able to know and do based on what you taught? Did your instruction fall short on the target(s) you taught? How will you adjust your instruction to ensure all students master the essential content taught?

The point is not that we adults don’t contribute immensely to student learning. We do. We are critical players in teaching, learning, and assessment. It’s just that we are second in rank order of importance as instructional decision makers. Stiggins, Arter, and Chappuis2

This is our feedback for your learning this year. Your Ticket OUT! Complete the survey “Where Am I Now?” This is our feedback for your learning this year. Thank You!