1. Rubrics

2. What is a Rubric? A rubric is a set of guidelines for scoring performance against criteria. Performance is described along a scale of quality Performance is described along a scale of quality Descriptors are provided for each level of performance Descriptors are provided for each level of performance Descriptors provide general traits and concrete indicators to make each level clear (and scoring reliable) Descriptors provide general traits and concrete indicators to make each level clear (and scoring reliable) Holistic or analytic (multiple rubrics corresponding to each dimension of performance; such as precision of calculations or understanding the scientific method) Holistic or analytic (multiple rubrics corresponding to each dimension of performance; such as precision of calculations or understanding the scientific method) May be longitudinal and measure progress over time toward mastery of an educational objective May be longitudinal and measure progress over time toward mastery of an educational objective

3. Rubric Construction 1. Draft and define possible criteria to be used in scoring work 2. Decide whether there will be a holistic or various analytic-trait rubrics for each criterion 3. Begin by trying to build a 3- or 4-point rubric 4. Always build your rubrics from the top, starting from a description of truly exemplary performance 5. Edit rubric(s) based upon feedback: adjust scale (5-8) and distinguish between indicators and criteria.

4. Characteristics of a Rubric Validity: based on full range or performances or products, and based on apt, not arbitrary, easy-to-score criteria. Validity: based on full range or performances or products, and based on apt, not arbitrary, easy-to-score criteria. Reliability: yields consistent scores across judges, and yields stable scores for individual performances. Reliability: yields consistent scores across judges, and yields stable scores for individual performances.

5. Characteristics Criteria Types Impact: informative, engaging, persuasive Impact: informative, engaging, persuasive Work quality: organized, well crafted, mechanically correct Work quality: organized, well crafted, mechanically correct Methods: efficient, thoughtful, thorough Methods: efficient, thoughtful, thorough Validity of content: apt, accurate, focused Validity of content: apt, accurate, focused Sophistication of knowledge employed: insightful, expert Sophistication of knowledge employed: insightful, expert

6. Characteristics Useful are based on observable features of performance at all levels are based on observable features of performance at all levels based on credible samples of performance for each level scored, with special attention to deriving the top score from authentic exemplars based on credible samples of performance for each level scored, with special attention to deriving the top score from authentic exemplars are calibrated to a 5- to 8-point scale are calibrated to a 5- to 8-point scale describe equidistant levels of performance describe equidistant levels of performance are clear and specific about the ‘cut point’ are clear and specific about the ‘cut point’

7. Characteristics Coherent: must focus on the same criteria throughout. Coherent: must focus on the same criteria throughout. Authentic: properly balance the impact of the work with an assessment of content and process. Authentic: properly balance the impact of the work with an assessment of content and process.

8. What do you think? You have already been introduced to rubrics in this program; how are they? You have already been introduced to rubrics in this program; how are they? Are the current rubrics developed well? Why or shy not? Are the current rubrics developed well? Why or shy not? Do the rubrics follow the guidelines given? Do the rubrics follow the guidelines given?