1. Assessments for Gifted

2. What gets measured gets done.

3. Questions to Consider What are the goals of your unit? How can you measure growth before and after for each of the overarching goals? How do the unit goals contribute to the program goals over time?

4. Goals Improve student critical thinking (program goal) Provide advanced content and differentiated instruction (program goal) Improve inquiry-based skills in science (unit or program goal) Test of Critical Thinking (TCT) or curriculum- based pre-post measures Classroom observations, evaluation of curriculum aligned with advanced standards, stakeholder perceptions Performance-based pre/post assessment in science inquiry

5. Key Components of Assessments Used to promote learning Frequent and on-going Both performance-based and standardized Criteria for judgment are well-defined and used for instruction MATCHES INSTRUCTION

6. Key Definitions and Distinctions Achievement is what or how much a student has learned by some point in time. Learning is what or how much a student has learned over time. Perseverance is the amount of time a student was willing to spend in learning; ‘motivation’ or desire to learn.

7. Performance-based v. Traditional Assessment Tasks Performance-based Focus on thinking and problem solving within a domain Provide open-ended tasks that demand multiple resources Require student articulation of solution process Employ manipulative materials to promote solution finding Assessed by a graduated rubric that allows for divergence in responses Traditional Focus on content-specific skills Provide close-ended tasks that demand one correct response Require limited student response Employ paper and pencil means only to solve Assessed by an answer sheet on a convergent response

8. Example Assessments Performance-Based Writing Literary Analysis Science Experimentation and Inquiry Research Concept (Content) Concept (Systems) Traditional Test of Critical Thinking (TCT) Out of level assessments State Assessment

9. Performance-Based Example Should _______ be required reading for students in your grade?

10. Pre-Assessment Persuasive Writing Pre-Assessment Student A, Grade 3 Yes, because a lot of people will understand it and it was a good story. No, because some people might think I do not want to read this story.

11. Post-Assessment Persuasive Writing Post-Assessment Student A, Grade 3 Yes, I do think every kid in this grade should read The Miser. Because it might teach some kids to use what they have and not waste things. It would also tell kids to not attract other people. I would also tell children that you should think before you do something. This story will help children in the third grade.

12. Pre-Assessment Persuasive Writing Pre-Assessment Student B, Grade 3 Yes, I think the story The Wolf and the Lion should be required reading for all the students. Why? It’s a great story with a very interesting topic. They could also learn from the story. Also they could get lots of interesting questions. That’s why I think 3rd grade students should read The Wolf and the Lion.

13. Post-Assessment Persuasive Writing Post-Assessment Student B, Grade 3 Yes, I think all the students in 3rd grade should read this book. It’s such an excellent moral. One reason I think everyone in third grade should read The Miser is because it does teach a good lesson. It could help them learn that things they never use are worthless. Another reason I think all the students in third grade should read this story is they use great, funny words. It basicly is a funny story. One of the parts I likes was “He pulled his hair out (not really). It would make our writing better. Also, the students should read this because it’s similar to a true story. If you have a good, healthy body and you never use it, the muscles will be very weak, and you’ll miss out on a lot of things. As you see, it’s a good moral for all the students in third grade. They could learn great details for their own stories, and they can compare it with a true happening like this story. It’s a great story.

14. Rubric * Persuasive Writing Scoring Rubric Claim or Opinion: 0No clear position exists on the writer’s assertion, preference, or view, and context does not help to clarify it. 2Yes/no alone or writer’s position is poorly formulated, but reader is reasonably sure what the paper is about based on context. 4 meets expectations: A clear topic sentence exists, and the reader is reasonably sure what the paper is about based on the strength of the topic sentence alone. 6exceeds expectations: A very clear, concise position is given and position is elaborated with reference to reasons; multiple sentences are used to form the claim. Must include details that explain the context. Data or Supporting Points 0No reasons are offered that are relevant to the claim. 2One or two weak reasons are offered; the reasons are relevant to the claim. 4At least two strong reasons are offered that are relevant to the claim. 6meets expectations: At least three reasons are offered that are relevant to the claim. 8exceeds expectations: At least three reasons are offered that are also accurate, convincing, and distinct. Elaboration 0No elaboration is provided. 2An attempt is made to elaborate at least one reason. 4More than one reason is supported with relevant details. 6meets expectations: Each reason (3) is supported with relevant information that is clearly connected to the claim. 8exceeds expectations: The writer explains all reasons in a very effective, convincing, multi-paragraph structure. Conclusion 0No conclusion/closing sentence is provided. 2A conclusion/closing sentence is provided. 4meets expectations: A conclusion is provided that revisits the main ideas. 6exceeds expectations: A strong concluding paragraph is provided that revisits and summarizes main ideas.

15. What do you think? Use the rubric to evaluate this writing. Kids should say “no” to drugs for a lot of important reasons. First, drugs are dangerous to the person who takes the drug and to others. If you take drugs, you might get really sick or even die. Plus, you might hurt somebody else while you’re on drugs and not even know it. Another reason is that drugs are expensive. Once you start buying drugs and us up all your money, you might even start stealing to get money to buy more drugs. My last reason is that once you start taking drugs, you might not be able to stop even if you want to. These are all the good reasons why kids should say “No” to drugs. From Autobiographies (Wm. & Mary Unit)

16. Literary Analysis Higher level comprehension question Analyze a quote (inference) Link to an overarching concept Synthesis (create a new title)

17. Think of a fish bowl as a system. Add the parts of the system to the diagram below. Boundaries Elements InputsOutputs Interactions

18. Concept Map of Matter

19. Concept Map of Soil

20. Scoring a Concept Map Examples Propositions Hierarchies

23. Pre-Test How would you do a fair test of this question? Are earthworms attracted to light? Tell how you would test this question. Be as scientific as you can as you write about your test. Write down the steps you would take to find out if earthworms like light.

24. Pre-test Response First, I would put some earthworms in a container. There would be lights and some dirt. I would put several different earthworms in it. If more earthworms like the light than that would be right. If more didn’t like the light than that would be right. I would try this with about seven groups and decide if they like the light.

25. Post-Test How would you do a fair test of this question: Are bees attracted to diet cola? Tell how you would test this question. Be as scientific as you can as you write about your test. Write down the steps you would take to find out if bees like diet cola.

26. Post-Test Response Materials: Diet Cola, 3 large containers, 3 small containers, 6 bees. Hypothesis: If you give bees diet cola then they will be attracted to it. 1. Gather 6 bees, diet cola, 3 large containers, 3 small containers. 2. Put 2 bees in each large container. 3. Pour 5 ml of diet cola in each small container. 4. Set the small container of diet cola in each large container that has bees in it. 5. Watch and observe to see if the bees are attached to the diet cola. 6. You should record if the bees like diet cola on a chart like below. Bees If they are attracted to Diet Cola 1. 2. 3. 4. 5. 6.

27. Scientific Investigation Sample Item How would you study this question: Are plants attracted to sun? I predict that:__________________ Materials:_____________________ What steps would you take and in what order: What data do you want to collect and how should it be recorded? How do the data help you decide if your prediction is correct?

29. Time Assessment Tell in pictures and numbers what you know about telling time.

36. Task Development Criteria Emphasis on thinking and problem solving, not prior learning Off-level/advanced Open-ended Emphasis on articulation of thinking processes

37. Product Example Evaluation Use the following scale to rate each quality: 2=poor4=needs improvement 6=satisfactory 8=good 10=excellent 1. The issue and problem are clearly defined. 2 4 6 8 10 2. Sources are diverse.2 4 6 8 10 3. Literature sources are summarized.2 4 6 8 10 4. Interview or survey questions are included.2 4 6 8 10 5. Interviews and/or surveys are summarized. 2 4 6 8 10 6. Results are reported appropriately.2 4 6 8 10 7. Interpretation of data was appropriate.2 4 6 8 10 8. Implications were drawn from the data.2 4 6 8 10 9. Given the data, reasonable conclusions were stated.2 4 6 8 10 10. The project/paper/report was mechanically competent.2 4 6 8 10 Strengths of the project: Areas for improvement:

38. Portfolio Assessment – Key Components and Issues Portfolios are carefully selected pieces of student work NOT a folder of all the work a student does Promotes ownership in learning and goal setting Used for assessment and instruction Promotes metacognition Allows for close examination of work, pride, and view of progress over time Time Record-Keeping Lack of work going home Student organization Space

39. The Expectancy-Value Theory Students must value either what they are expected to achieve (the objectives) or the rewards attached to the achievement per se. Students must believe they can achieve what they are expected to achieve (expectancy of success) Students must see the connection between their efforts and their achievement.

40. The Expectancy-Value Theory (cont.) The strength of the effort-achievement connection decreases the longer students are in school. Over time, effort is replaced with ability (a lot or little), luck (good or bad), task difficulty (easy or difficult), or influence of other people (good teacher or poor teacher). Evidence of learned helplessness sets in. Anderson, 2003

41. Portfolio Considerations Portfolios can be used to Show progress over time Showcase achievement and pride Assess pre/post student learning Gain insight into student thinking Help students reflect on their own learning Help students reach goals or share interests Build communication between student and teacher about student work

42. Portfolio Stems I chose to include this ____ because… When I compare these two math journals, I notice that… Based on this paper/product, my biggest area for improvement is ____. I know this because… I still have the following questions about _____ based on my work… If I did this again, I would… Over the past two months my work shows the following improvements…. My next goal is to… I’ve improved! I used to…but, now I… Three things I want you to notice about this are… I changed this when I… I’m glad I learned how to do this because… I struggled with this because… Next time I work on this type of ______ I will… I am proud of this learning because…

43. Portfolio Inclusions Table of Contents Topic:_______ Examples:___________________ Pre and post learning examples Strong and weak examples Anecdotal evaluations of work (teacher and student) Personal interests, goals, and achievements

44. Standardized Assessments Key Issues Ceiling Effect and Regression to the Mean Scoring Efficiency Time to Administer Acceptance Level Compatibility with Standards and Teaching Consideration of Normed Population Comparison to National or State Norms Value-Added Growth over Time

45. Standardized Assessment Descriptive Advanced Placement Scores Contest Participation Dual Enrollment SAT and ACT Scores Talent Searches National Merit Scholars State Assessment Advanced Pass Rates Comparative Achievement Tests Between Years Value Added Approaches Over Time Contest Comparisons with Like Schools State Assessment Sub- group Comparisons or Pass/Fail for Served v. Not Served

46. State Assessment Data

49. Test of Critical Thinking ( Bracken, Bai, Fithian, Lamprecht, Little, Quek, 2003) Theoretical Orientation - Paul’s Model of Reasoning Test Development - 10 written scenarios - 45 multiple choice questions Technical Adequacy - Reliability (internal consistency, stability) - Validity (content, concurrent) Results

50. Sample Scenario and Items Nathan and Sean were in the same math class. Their teacher returned the tests she had graded. When they saw their grades, Nathan smiled, but Sean looked unhappy. The teacher said that many students had received low grades, and she hoped they would study more for the next test.

51. Based on this story, what is MOST LIKELY to be true? A. Nathan received a better grade on the test than Sean did. This answer is INCORRECT. Nathan seemed happier with his grade than Sean did, but we do not know who actually received a higher grade. If Nathan usually receives C’s, he might have received a B and been very happy. If Sean usually receives A’s, he might be unhappy with an A-minus. B. Nathan usually receives better grades than Sean in math. This answer is INCORRECT. We cannot tell from the story what grades these two students usually receive. C. Sean had expected to do better on the test than he did. This answer is INCORRECT. We know Sean seems to be unhappy about his grade, but we do not know if he expected a better grade. Even if Sean expected to do badly on the test, he might still have been unhappy with a low grade. D. Sean did not do as well on the test as he would have liked. This is the CORRECT answer. Sean looked unhappy when he saw his test grade, so we can conclude that he most likely did not do as well as he would have liked. Sample Scenario and Items (cont.)

52. The Test of Critical Thinking (TCT): Technical Adequacy Total Scale Internal Consistency Reliability: r =.89 Concurrent Validity with Verbal Correlates: - ITBS Reading:r =.61 - ITBS Language: r =.55 - CogAT Verbal: r =.59 Nonverbal Correlates: - UNIT Abbreviated Scale: r =. 29 - CogAT Nonverbal: r =.45

53. Assessing Classroom Practice: Instrument Construction (COS-R) Categories are consonant with research on effective teaching practices, teacher reform literature, and teaching high-ability learners Curriculum Planning and Delivery Accommodations for Individual Differences Problem Solving Critical Thinking Strategies Creative Thinking Strategies Research Strategies Student Scale Indicators for Observation

54. First observation:.87 Second observation:.89 Sub Scale reliabilities:.68-.93 The COS-R scale reliability :.93 Content validity:.98 Technical Adequacy of COS-R

55. Intent of COS-R Core subject areas Learning Tool and Debriefing of Curriculum Effectiveness and Teacher Strategies Measures Growth (Pre-Post) Sample Indicators for LA/SS & Science/Math Developmentally Pre-K to 12

56. Regular (N=68) Gifted Classrooms (N=228)

57. Assessing Classroom Practice: Discussion Teachers of the Gifted: Strong in general teaching strategies (e.g. lesson planning and clarity in directions) but fewer differentiation practices employed than desired Little emphasis placed on accelerative practices Problem-solving behaviors were not routinely observed “Compare/contrast” activities most prevalent critical thinking approach employed Little emphasis placed on metacognition or extension

58. Evaluation has moved from being primarily a reservoir of methods for evaluation to now also becoming and being a reservoir for knowledge about generic patterns of program effectiveness. -- Patton