Erica Schurter and Molly Mead Department of Information Access.

Slides:



Advertisements
Similar presentations
The Research Consumer Evaluates Measurement Reliability and Validity
Advertisements

Designing Scoring Rubrics. What is a Rubric? Guidelines by which a product is judged Guidelines by which a product is judged Explain the standards for.
Systematic Assessment of Student Achievement February 5, 2007.
Iowa’s Application of Rubrics to Evaluate Screening and Progress Tools John L. Hosp, PhD University of Iowa.
Assessment 2.0: The Next Frontier Dr. Nathan Lindsay Assistant Vice Provost for Assessment October 28, 2011.
Chapter 8 Criteria and Validity PERSIAN GROUP. ارزیابی امتحان آزمون ارزیابی امتحان آزمون ارزیابی امتحان آزمون ارزیابی امتحان آزمون ارزیابی امتحان آزمون.
Using Rubrics for Assessment: A Primer Marcel S. Kerr Summer 2007 
Course (Re)design and the Chico Rubric Andrea Saltzman Martin Jim Julius SDSU Course Design Institute May 27, 2009.
Susan Malone Mercer University.  “The unit has taken effective steps to eliminate bias in assessments and is working to establish the fairness, accuracy,
Curriculum Assessment
Making Your Assessments More Meaningful Flex Day 2015.
The mere imparting of information is not education. Above all things, the effort must result in helping a person think and do for himself/herself. Carter.
Authentic Assessment Abdelmoneim A. Hassan. Welcome Authentic Assessment Qatar University Workshop.
RELIABILITY & VALIDITY
NCATE Institutional Orientation Session on PROGRAM REVIEW Moving Away from Input- based Programs Toward Performance-based Programs Emerson J. Elliott,
Dr. Robert Mayes University of Wyoming Science and Mathematics Teaching Center
Using statistics in small-scale language education research Jean Turner © Taylor & Francis 2014.
Rubrics as Instructional Tools: Effective Design & Use in the Classroom Kathleen Landy, Ed.D. ANNY Conference Mercy College April 29, 2015.
VALIDITY. Validity is an important characteristic of a scientific instrument. The term validity denotes the scientific utility of a measuring instrument,
Office of Institutional Research, Planning and Assessment January 24, 2011 UNDERSTANDING THE DIAGNOSTIC GUIDE.
Authentic Assessment Principles & Methods
Instrument Validity & Reliability. Why do we use instruments? Reliance upon our senses for empirical evidence Senses are unreliable Senses are imprecise.
Assessment for Optimal Learning Tace Crouse Faculty Center for Teaching and Learning University of Central Florida.
Classroom Assessments Checklists, Rating Scales, and Rubrics
1 An Introduction to Language Testing Fundamentals of Language Testing Fundamentals of Language Testing Dr Abbas Mousavi American Public University.
Classroom Assessment A Practical Guide for Educators by Craig A. Mertler Chapter 7 Portfolio Assessments.
Student assessment Assessment tools AH Mehrparvar,MD Occupational Medicine department Yazd University of Medical Sciences.
1 What are the roles of learning targets and success criteria in my classroom? – I can specify plans for engaging my students with learning targets.
APRIL 16, 2013 A review of Chapters CHAPTER FOURTEEN The Role of Assessment VOCABULARY.
Reliability vs. Validity.  Reliability  the consistency of your measurement, or the degree to which an instrument measures the same way each time it.
Student assessment Assessment tools AH Mehrparvar,MD Occupational Medicine department Yazd University of Medical Sciences.
University Teaching Symposium January 9,  Individual Development and Educational Assessment  Kansas State University  A diagnostic to.
Performance-Based Assessment HPHE 3150 Dr. Ayers.
Formative and Summative Evaluation. Formative Evaluation The goal of formative assessment is to Monitor student learning Provide ongoing feedback Improve.
Presented By Dr / Said Said Elshama  Distinguish between validity and reliability.  Describe different evidences of validity.  Describe methods of.
Assessment Design. Four Professional Learning Modules 1.Unpacking the AC achievement standards 2.Validity and reliability of assessments 3. Confirming.
PLC Team Leader Meeting
Understanding by Design, UbD - based on work by McTighe and Wiggins.
An Assessment For Learning. A rubric is a scoring tool that lists the criteria for a piece of work, or “what counts” and clearly defines gradations of.
Alternative Assessment Chapter 8 David Goh. Factors Increasing Awareness and Development of Alternative Assessment Educational reform movement Goals 2000,
WHAT IS A RUBRIC?.  A CRITERION BASED SCORING GUIDE.  The criteria are qualities that must be met for student work to measure up to a standard.
ASSESSMENT TOOLS DEVELOPMENT: RUBRICS Marcia Torgrude
Why So Much Attention on Rubric Quality? CAEP Standard 5, Component 5.2: The provider’s quality assurance system relies on relevant, verifiable, representative,
Identifying Assessments
Reliability and Validity Themes in Psychology. Reliability Reliability of measurement instrument: the extent to which it gives consistent measurements.
UbD - Stage 2 Assessment Evidence. Our Big Idea Making Best Practices, Common Practice *create a variety of assessments, to be used throughout the lesson,
Scoring Rubrics: Validity and Reliability Barbara M. Moskal Colorado School of Mines.
Foundations of American Education: Perspectives on Education in a Changing World, 15e © 2011 Pearson Education, Inc. All rights reserved. Chapter 11 Standards,
Rubrics, and Validity, and Reliability: Oh My! Pre Conference Session The Committee on Preparation and Professional Accountability AACTE Annual Meeting.
Part II – Chapters 6 and beyond…. Reliability, Validity, & Grading.
Assessment Literacy and the Common Core Shifts. Why Be Assessment Literate? ED Test and Measurement 101 was a long time ago Assure students are being.
Student Growth Goals Work Session. Goals for the day 1.Develop questions to ask teachers to determine if the SGG meets the criteria established in the.
If I hear, I forget. If I see, I remember. If I do, I understand. Rubrics.
Designing Quality Assessment and Rubrics
Classroom Assessments Checklists, Rating Scales, and Rubrics
Evaluation Of and For Learning
Designing Rubrics with the Three Categories of Knowledge
Lecture 5 Validity and Reliability
Information Literacy Standards for Freshmen Seminars
Classroom Assessments Checklists, Rating Scales, and Rubrics
Outline the steps خطوات in the selection اختيار process عملية
Principles of Assessment & Criteria of good assessment
Module 9: Category III: Monitoring Student Progress
Designing and Using Rubrics
Jesus Jr. Camposeco ECE 682 Dr. David L. Brown
Matthew McCullagh Linking the Principles of Assessment to the QA Criteria.
jot down your thoughts re:
jot down your thoughts re:
Presentation transcript:

Erica Schurter and Molly Mead Department of Information Access

What is a rubric? CriteriaExceedsMeetsDoes Not Meet Sources and Evidence Demonstrates skillful use of high-quality, credible, relevant sources to develop ideas that are appropriate for the discipline and genre of the writing. Demonstrates consistent use of credible, relevant sources to support ideas that are appropriate for the discipline and genre of the writing. Demonstrates an attempt to use sources to support ideas in writing.

How can rubrics be used?  Scoring rubrics  Instructional rubrics Clarify learning goals Guide feedback on student progress Judge final products in terms of the degree to which goals were met

How to build a rubric  Given your broad course goals, what determines the extent of student understanding?  What criterion counts as EVIDENCE of student learning?  What specific characteristics in student responses, products or performances should be examined as evidence of student learning?

Rubric Reliability and Validity Validity  The key is in your course goals and objectives  Create measureable objectives  Develop criteria for each objective  Validity always comes first! Reliability  Inter-rater  Intra-rater  A reliable instrument does not mean that it is valid

More rubric help  AACU Rubrics  Rubistar