1. Classroom Assessment for Student Learning March 2009 Assessment Critiquing

2. Keys to Quality Classroom Assessment Clear Purposes Why Assess? What’s the purpose? Who will use results? Clear Targets Assess What? What are the learning targets? Are they clear? Are they good? Good Design Assess How? What method? Sampled how? Avoid bias how? Sound Communication Communicate How? How manage information? How report? Accurate Assessment Effectively Used Student Involvement Students are users, too. Students need to understand learning targets, too. Students can participate in the assessment process, too. Students can track progress and communicate, too.

3. Overview of Stages in Assessment Development All assessments, regardless of method selected, go through the same five stages of development: 1.Planning 2.Developing 3.Critiquing 4.Administering 5.Revising

4. Stage One - Planning Assess WHY? Determine the intended use of an assessment Identify the learning targets to be assessed Select the proper assessment method

5. Stage Two - Developing Select or create test items or tasks Select or create scoring mechanisms (rubric, scantron, etc.)

6. Stage Three - Critiquing Evaluate to avoid bias or misrepresentation

7. Critique Working Definition Going back over the assessment to see if you have completed or addressed all the necessary components of sound assessment design.

8. Bias Working Definition Anything in the assessment, or the conditions under which the assessment was given, including student barriers, that would lead to inaccurate measurements of student learning.

9. Basic Components of Sound Assessment Design Are the student learning targets measured by the assessment stated? Are the learning targets clear? Does the method used match the target being assessed? Does the number of items for each target give you the information that you need to determine student mastery of the target? Is the amount of instructional time spent on each target reflected in the assessment?

10. Question 1 Are the student learning targets measured by the assessment stated? Exemplar: Civics Baseline Assessment Notice how the MS, HS & Essential learning targets are given…..

11. Question 2 Are the learning targets clear? Exemplar: English I Predictive Assessment, Pg. 6 – A description of O’Henry’s passage - sets the tone; gives a hint to the reader of how the passage ends….. Does the grammar mistake change the meaning?

12. Question 3 Does the method used match the target being assessed? Exemplar: Pg. 10 of English I PA – Good measure of Knowledge & Reasoning Targets….. If standardized tests are always multiple choice, how can we “deepen” or “extend” the students’ knowledge in between these assessments?

13. Question 4 Does the number of items for each target give you the information that you need to determine student mastery of the target? Are any important targets you taught left out? If so, which ones?

14. Utilize Your “Planning To Assess” Document To Ensure The Proper Sampling, Representation and Balance “Planning Backwards”

15. Or, take a look at the key with the objectives connected to the answers or the test itself to see if there is a match. DASH reports also give you good information on this question as well!

16. Question 5 Is the amount of instructional time spent on each target reflected in the assessment? Reflection time – Table Talk: How do you balance the teaching and the assessing of “your favorite content” with your “less than favorite content?”

17. The Good, The Bad, The Ugly Look at your copies of the different assessments on your table Determine whether they fall into the category of “good; bad; or ugly” Share with your partner how you would change it or fix it…..

18. Biology and Geometry PA – Good models US History – p.3 #17 Algebra I Baseline – Question Formats Civics CFA – Good graphics, bad format VOCATS – Bad question samples (#’s 2,4) Math CFA - #6

19. Things To Think About If applicable, does your assessment model EOC format and questions? http://www.dpi.state.nc.us/docs/accountabi lity/testing/sample2003scsalg1goal1.pdf http://www.dpi.state.nc.us/docs/accountabi lity/testing/sample2003scsalg1goal1.pdf Are the test generator questions really that good? Does your assessment state the objectives or identify the learning targets being assessed?

20. Stage Four - Administering Simply administer the assessment to students This will happen between this session and our April CASL training session.

21. Stage Five - Revising Problems with questions Problems with tasks Problems with scoring This will happen during our last CASL training session in April.

22. CASL Content Connects to the Following NC Professional Teaching Standards: Standard II b Standard III a, b Standard IV a, b, c, h Standard V a, b, c

23. Standard II b - Teachers strive to understand how a student’s culture and background may influence his or her school performance. Knowing how to assess - Assessment should be sensitive to cultural bias/be careful of wording on assessment (possible example: writing prompt on American Patriotism - ESL students could not write to this prompt because they were not born in America and came when they were much older, so they could not write to the prompt because it would not be meaningful to them.) Assessment bias is the focus on our CASL session in March.

24. Standard III a –Teachers develop and apply strategies. Assessment development is a strategy teachers use to help students understand performance on requirements and is a strategy used to inform instruction. Standard III b – Teachers know there subject beyond what they are required to teach. Teachers know their content when they are able to design an assessment that accurately measures student achievement levels on identified content, reviews previously learned content, and previews content not yet taught.

25. Standard IV a – Teachers keep abreast of evolving research about student learning. They adapt resources to address to address the strengths and weaknesses of their students. CASL is research based best practice on how to improve assessment development, analysis, and providing feedback. With CASL, we are learning how to identify strengths and weaknesses in our own assessments, adapting our own resources to better inform ourselves and our students regarding their academic achievement.

26. Standard IV b – Teachers use a variety of data sources short and long term based on NCSCOS. Teachers engage students in the learning process. Teachers understand that instructional plans must be consistently monitored and modified to enhance learning. CASL helps teachers develop assessments that engage learners. If students are involved in the creation and development of assessments from the beginning, their performance on the assessment increases. CASL provides information on how monitoring timely and corrective feedback on assessment enhances student learning.

27. Standard IV c- Teachers choose the methods and techniques that are most effective in meaning as they strive to eliminate achievement gaps. This refers to identifying and communicating clear learning targets, types of targets, and target/method match Standard IV h – Teachers use a variety of methods to assess what each student has learned, 21st century knowledge, skills, performance, and dispositions and to use the assessment information to adjust their instructional practice. This is the basis of all CASL content.

28. Standard V a -Teachers think systematically and critically about student learning in their classroom and school: why learning happens and what can be done to improve achievement. CASL provides the research to support data analysis and classroom instructional practice at classroom and school level. Standard V b Teachers participate continued, high quality professional development that reflects global view of educational practices ….that meets the needs of students and their own personal growth. CASL helps to apply and implement knowledge gained from professional development that impacts student learning.

29. Standard V c – Teachers adapt their practice based on research and data to best meet the needs of their students. CASL equips teachers to use assessment results as information that drives instruction. Assessment results are the data that informs teaching and learning.

30. Critique Your Own Assessment Use the worksheet Answer the questions Review in your PLC’s Discuss in your PLC’s Use your new learning in your PLC’s

31. Your Ticket Out The Door Write-in any plus/delta/issue bin items on that page if so desired Drop off on your way out the door Thanks for everything! See You On April 21st!