USEFULNESS IN ASSESSMENT Prepared by Vera Novikova and Tatyana Shkuratova.

Slides:

Advertisements

Similar presentations

Assessment FOR Learning in theory

Advertisements

Assessment types and activities

Quality Control in Evaluation and Assessment

School Based Assessment and Reporting Unit Curriculum Directorate

Wynne Harlen. What do you mean by assessment? Is there assessment when: 1. A teacher asks pupils questions to find out what ideas they have about a topic.

1 Functions of Assessment Why do we assess students? Discuss in your group and suggest the three most important reasons.

Updated 11/16/06©1996 & forthcoming, Bachman & Palmer & OUPPage 1 The Place of Intended Impact in Assessment Use Arguments * Lyle F. Bachman Department.

Assessment: Reliability, Validity, and Absence of bias

Language Testing Introduction. Aims of the Course The primary purpose of this course is to enable students to become competent in the design, development,

Teaching and Testing Pertemuan 13

Basic Issues in Language Assessment 袁韻璧輔仁大學英文系. Contents Introduction: relationship between teaching & testing Introduction: relationship between teaching.

Principles of High Quality Assessment

TOPIC 3 BASIC PRINCIPLES OF ASSSESSMENT

Developed by Marian Hargreaves for NEAS 2013

Creating Effective Classroom Tests by Christine Coombe and Nancy Hubley 1.

Questions to check whether or not the test is well designed: 1. How do you know if a test is effective? 2. Can it be given within appropriate administrative.

ASSESSMENT IN EDUCATION ASSESSMENT IN EDUCATION. Reliability  Test-re-test, equivalent forms, internal consistency.  Test-re-test, equivalent forms,

LANGUAGE TESTING AND ASSESSMENT ASSESSMENT LITERACY Prepared by Marina Gvozdeva, Natalya Milyavskaya, Tatiana Sadovskaya, Violetta Yurkevich Based on material.

Principles of Language Assessment Ratnawati Graduate Program University State of Semarang.

Shawna Williams BC TEAL Annual Conference May 24, 2014.

Performance-Based Assessment June 16, 17, 18, 2008 Workshop.

6 th semester Course Instructor: Kia Karavas.  What is educational evaluation? Why, what and how can we evaluate? How do we evaluate student learning?

Chap. 3 Designing Classroom Language Tests

Authentic Assessment Principles & Methods

Overall Teacher Judgements

Marion Webb January  By the end of the session, participants will be able to:  Discuss the role of assessment for learning  Describe key assessment.

Classroom Assessment and Grading

ASSESSMENT IN EDUCATION ASSESSMENT IN EDUCATION. Copyright Keith Morrison, 2004 PERFORMANCE ASSESSMENT... Concerns direct reality rather than disconnected.

Quality in language assessment – guidelines and standards Waldek Martyniuk ECML Graz, Austria.

Enabling learning and assessment Unit 3 – Week 1.

ASSESSMENT 19 September 2015Laila N. Boisselle 1.

June 09 Testing: Back to Basics. Abdellatif Zoubair Abdellatif

Classroom Assessments Checklists, Rating Scales, and Rubrics

Classroom Assessment A Practical Guide for Educators by Craig A

EDU 385 Education Assessment in the Classroom

Unit 1 – Preparation for Assessment LO 1.1&1.2&1.3.

Principles in language testing What is a good test?

Chap. 2 Principles of Language Assessment

Stages 1 and 2 Wednesday, August 4th, Stage 1: Step 5 National and State Standards.

Week 5 Lecture 4. Lecture’s objectives  Understand the principles of language assessment.  Use language assessment principles to evaluate existing tests.

Performance-Based Assessment HPHE 3150 Dr. Ayers.

Aligning the South African National Curriculum Electrical Technology Jenny Rault-Smith Director: Curriculum Development, WCED

DESIGNING CLASSROOM TESTS TSL3112 LANGUAGE ASSESSMENT PISMP TESL SEMESTER 6 IPGKDRI.

How Much Do We know about Our Textbook? Zhang Lu.

Assessment Design. Four Professional Learning Modules 1.Unpacking the AC achievement standards 2.Validity and reliability of assessments 3. Confirming.

Validity Validity is an overall evaluation that supports the intended interpretations, use, in consequences of the obtained scores. (McMillan 17)

McGraw-Hill/Irwin © 2012 The McGraw-Hill Companies, Inc. All rights reserved. Obtaining Valid and Reliable Classroom Evidence Chapter 4:

1 Scoring Provincial Large-Scale Assessments María Elena Oliveri, University of British Columbia Britta Gundersen-Bryden, British Columbia Ministry of.

MAVILLE ALASTRE-DIZON Philippine Normal University

Evaluation, Testing and Assessment June 9, Curriculum Evaluation Necessary to determine – How the program works – How successfully it works – Whether.

Language Assessment. Evaluation: The broadest term; looking at all factors that influence the learning process (syllabus, materials, learner achievements,

Monitoring and Assessment Presented by: Wedad Al –Blwi Supervised by: Prof. Antar Abdellah.

 Teaching: Chapter 14. Assessments provide feedback about students’ learning as it is occurring and evaluates students’ learning after instruction has.

Evaluation and Assessment Evaluation is a broad term which involves the systematic way of gathering reliable and relevant information for the purpose.

Assessment for Learning Centre for Academic Practice Enhancement, Middlesex University.

Language Assessment.

Standards-Based Assessment Linking up with Authentic Assessment

Classroom Assessment A Practical Guide for Educators by Craig A

Implementing and reviewing additional admissions assessments

Consistency of Teacher Judgement

Washback and Alternative Assessment

Designing Assessment Things to be considered:

Assessment A.E.T. Week 10 Cate Clegg.

Assessment PTLLS Week 9 Cate Clegg.

evaluating a test Test Usefulness (Bachman and Palmer, 1996)

Assessment Methods.

BASIC PRINCIPLES OF ASSESSMENT

Why do we assess?.

Presentation transcript:

USEFULNESS IN ASSESSMENT Prepared by Vera Novikova and Tatyana Shkuratova

Usefulness Assessments are used to: help people take decisions about test takers; encourage learning; give fair access to opportunities. If we have evidence that an assessment does these things, we can be confident that it is useful.

‘Usefulness, consisting of several qualities is an overriding consideration for quality control throughout the process of designing, developing, and using a particular [assessment]’. (Bachman & Palmer, 2010) Usefulness

Usefulness: 4 essential qualities ( Green 2013) Impact Validity Reliability Practicality

Reliability + Construct validity + Authenticity + Interactiveness + Impact + Practicality = Usefulness (Bachman and Palmer 2010) Usefulness

Three principles to rationalize usefulness 1.Overall usefulness of the assessment more important than any single quality. 2.Judgement that an assessment is useful must take account of combined effect of qualities on the usefulness of the test. 3.Usefulness depends on the situation as different balance of qualities will be important to tests used for different purposes: usefulness must be determined for each assessment situation. (Bachman and Palmer 2010)

Practicality Resources sufficient to support assessment? Time, money, space, equipment etc. Good classroom assessment should be "teacher friendly” - developed, administered, and marked within available time with available resources. Classroom assessments are only useful if feedback is provided and is timely and well understood by the students (Coombe, Folse and Hubley, 2007).

Reliability: stability: results would be the same if the assessment was given at another time; consistency: different parts of an assessment give similar results; rater reliability: results are similar when different people score the assessment.

Validity: extent to which assessment provides users with the information needed for sensible decisions; assessment must therefore actually assess what it is intended to assess - language ability - not ability to do Maths, memorise answers, guess or cheat etc.; in other words, in educational settings, assess what you teach and how you teach it!

Impact: ways in which use of an assessment affects society, educational systems, individuals (Bachman and Palmer, 2010); in classroom: test washback and effects of feedback on learning.

Usefulness: 4 essential qualities (Green 2013) Impact Validity Reliability Practicality

OTHER QUALITIES OF USEFUL ASSESSMENTS

Authenticity: extent to which assessments reflect realistic language use situations; language learners are motivated to perform when they are faced with tasks that reflect real-world situations and contexts (Coombe, Folse and Hubley, 2007).

Interactiveness: extent and type of involvement of test taker’s individual characteristics in accomplishing a test task (Coombe, Folse and Hubley, 2007); do test takers use and process language in realistic ways when performing assessment tasks?

15 Absence of bias: all test takers with similar level of ability in the skills being assessed should achieve similar results; no advantage for one group over another (e.g. boys over girls, urban children over rural children) because of factors other than what is being assessed. [e.g. if all locations described in the passages in a reading test are in Kaliningrad, that might advantage learners from Kaliningrad over those from Vladivostok]

Transparency Availability of clear, accurate information to students. Information should include: outcomes to be evaluated; formats used; weighting of items and sections; time allowed to complete the test; grading criteria. (Coombe, Folse and Hubley, 2007)

Security: Security is part of practicality, reliability, validity and impact for all tests. Security needs resources. Results obtained through any form of cheating are unreliable, invalid and likely to have a negative impact on society. If a teacher invests time and energy in developing good tests that accurately reflect the course outcomes, then it is desirable to be able to recycle the test materials: this means keeping them protected. (Coombe, Folse and Hubley, 2007)