Presented by: Mohsen Saberi and Sadiq Omarmeli  Language testing has improved parallel to advances in technology.  Two basic questions in testing;

Slides:



Advertisements
Similar presentations
Standardized Tests: What Are They? Why Use Them?
Advertisements

Types of Tests. Why do we need tests? Why do we need tests?
Chapter Fifteen Understanding and Using Standardized Tests.
Grading. Why do we grade? To communicate To tell students how they are doing To tell parents how students are doing To make students uneasy To wield power.
TESTING ORAL PRODUCTION Presented by: Negin Maddah.
III Choosing the Right Method Chapter 10 Assessing Via Tests p235 Paper & Pencil Work Sample Situational Judgment (SJT) Computer Adaptive chapter 10 Assessing.
Chapter 4 Validity.
VALIDITY.
LANGUAGE TESTING: Approaches & Techniques
Language Testing Introduction. Aims of the Course The primary purpose of this course is to enable students to become competent in the design, development,
STANDARDIZED TESTING MEASUREMENT AND EVALUATION  All teaching involves evaluation. We compare information to criteria and ten make judgments.  Measurement.
Lesson Two Kinds of Test and Testing. Contents Proficiency Test Achievement Test Diagnostic Test Placement Test Three Contrasting Paris of Test Concepts.
Testing 09. Problems and Directions Past experience with language help us come to the conclusion that we should keep a balance between linguistic and.
Topic: Assessment and Evaluation
Uses of Language Tests.
Lesson Three Kinds of Test and Testing. Yun-Pi Yuan 2 Contents Kinds of Tests: Based on Purposes  Classroom use Classroom use  External examination.
Linguistics and Language Teaching Lecture 9. Approaches to Language Teaching In order to improve the efficiency of language teaching, many approaches.
Standardized Test Scores Common Representations for Parents and Students.
WEEK 1 – TOPIC 1 OVERVIEW OF ASSESSMENT: CONTEXT, ISSUES AND TRENDS 1.
Assessment in Language Teaching: part 2 Today’s # 24.
Questions to check whether or not the test is well designed: 1. How do you know if a test is effective? 2. Can it be given within appropriate administrative.
Communicative Language Teaching
Formative and Summative Assessment
Chapter 1 Assessment in Elementary and Secondary Classrooms
Lecture 8 Assessing Listening Chapter Six Pages: Brown, 2004.
But What Does It All Mean? Key Concepts for Getting the Most Out of Your Assessments Emily Moiduddin.
Chapter 14 Understanding and Using Standardized Tests Viewing recommendations for Windows: Use the Arial TrueType font and set your screen area to at least.
Creating Assessments with English Language Learners in Mind In this module we will examine: Who are English Language Learners (ELL) and how are they identified?
Chap. I Testing, Assessing, and Teaching
Language Assessment 4 Listening Comprehension Testing Language Assessment Lecture 4 Listening Comprehension Testing Instructor Tung-hsien He, Ph.D. 何東憲老師.
Aptitude Tests - LAB  Paul Pimpleur developed Language Aptitude Battery in 1960s with 6 subtests Grade-Point Average in academic areas other than foreign.
Analyzing Reliability and Validity in Outcomes Assessment (Part 1) Robert W. Lingard and Deborah K. van Alphen California State University, Northridge.
PLAN AND ORGANISE ASSESSMENT. By the end of this session, you will have an understanding of what is assessment, competency based assessment, assessment.
Chapter 3 Understanding Test Scores Robert J. Drummond and Karyn Dayle Jones Assessment Procedures for Counselors and Helping Professionals, 6 th edition.
Winda Needs analysis Goals and objectives Testing Curriculum design.
Validity & Practicality
The second part of Second Language Assessment 김자연 정샘 위지영.
EDU 385 Education Assessment in the Classroom
Teaching Today: An Introduction to Education 8th edition
Lesson Three Kinds of Test and Testing. Contents Kinds of Tests: Based on Purposes  Classroom use Classroom use  External examination Kinds of Testing:
Chap. 2 Principles of Language Assessment
Classroom Evaluation & Grading Chapter 15. Intelligence and Achievement Intelligence and achievement are not the same Intelligence and achievement are.
Assessment – basic concepts LETRAS – Pre-service education Diagnostic and Final Assessments Formative X Summative Assessment.
Chapter 7 Measuring of data Reliability of measuring instruments The reliability* of instrument is the consistency with which it measures the target attribute.
Nurhayati, M.Pd Indraprasta University Jakarta.  Validity : Does it measure what it is supposed to measure?  Reliability: How the representative is.
Tests can be categorised according to the types of information they provide. This categorisation will prove useful both in deciding whether an existing.
Assessment My favorite topic (after grammar, of course)
Chapter 3 Selection of Assessment Tools. Council of Exceptional Children’s Professional Standards All special educators should possess a common core of.
By: Nurhayati M.Pd. Indraprasta University Jakarta Testing, Assessing, and Teaching.
COURSE AND SYLLABUS DESIGN
Principles of Instructional Design Assessment Recap Checkpoint Questions Prerequisite Skill Analysis.
Communicative Language assessment Ministry of Education Seminars & Workshops Jahanbakhsh Nikoopour
Language Assessment: Principles & Classroom Practices
Chapter 1 Assessment in Elementary and Secondary Classrooms
Standards-Based Assessment Linking up with Authentic Assessment
Assessment of Learning 1
Classroom Assessment A Practical Guide for Educators by Craig A
Concept of Test Validity
Learning About Language Assessment. Albany: Heinle & Heinle
III Choosing the Right Method Chapter 10 Assessing Via Tests
Communicative Language Teaching
Analyzing Reliability and Validity in Outcomes Assessment Part 1
III Choosing the Right Method Chapter 10 Assessing Via Tests
Understanding and Using Standardized Tests
TESTING AND EVALUATION IN EDUCATION GA 3113 lecture 1
Assessment in Language Learning
Analyzing Reliability and Validity in Outcomes Assessment
TESTING, ASSESSING, AND TEACHING
EDUC 2130 Quiz #10 W. Huitt.
Relationship between Standardized and Classroom-based Assessment
Presentation transcript:

Presented by: Mohsen Saberi and Sadiq Omarmeli

 Language testing has improved parallel to advances in technology.  Two basic questions in testing;  Can language be broken into skills and components?  Are all skills attained separately at different rates or they are attained together at the same rate?

 There are four principal coexisting but competing trends in language testing.  Prior to the study of language as a science language testing was characterized by the lack of a well-established theory=grammar translation method.

 A- Attempts to assess language abilities through different subtests that sample distinctive elements from each skill, aspects of the skill, and a component of the skill.  Structural linguistices+behavoral psychology =discrete point approach.

 1-Short multiple tests which could be easily verified for reliability.  2-Each item samples a particular element through the use of one skill.  3-Items are not dependent one another, chancing one item does not change the testee’s performance on the other items of the test. = TOEFL

 1-DP tests are the ideal form of tests for diagnostic purposes.  They furnish results which are radially quantifiable

 1-They are difficult to construct.  2-It is difficult to determine which point to test and which not to.  3- They cannot portray the subject’s ability to use language in real life situations.  4-Contrastive analysis has been criticized as being short-sighted.

 DP approach will continue to be the major tradition in test construction for years to come.

 Involves the testing of language in context and thus primarily concerned with meaning and the total communicative effect of discourse.  Cloze, dictation, composition writing, and oral interview.  Some believe that DP and IA form the two extremes of one continuum.

 1-Time consuming (composition writing)  2- The reliability and validity of dictation and close tests is in question. They do not meet the criterion of predicting or assessing a unified and integrated underling linguistic competence.  Language tests should assess the efficiency of the expectancy grammar of the learner.

 The psychologically real grammar a learner internalizes when he learns a language.  The measuring instrument developed to tap this efficiency has been called pragmatics.  Question answering dictation, narration, noise test, translation, composition writing, oral interview and paraphrase recognition are examples of pragmatic testing.

 Expectancy grammar resembles the type of grammar required by language users in the execution of a speech act.  It has been claimed that pragmatic tests attempt to assess the ability to recognize relationships holding between linguistics elements and extra linguistic context in which elements are appropriately used.

 A pragmatic test should fulfill two criteria:  1-It should invoke and challenge the subject’s developing grammatical system.  2-The test should involve linguistic sequences that relate to extra linguistic context in meaningful ways.  Not all the integrative tests fulfill both of the above criteria.

 1-Communicative competence is so global that typical pragmatic tests cannot adequately measure it.  2-The close procedure is regarded as a test of language usage.  3-Dictation is also criticized because it does not give any convincing proof of the examinee’s skill to actually use the language.

 Both communicative approach and integrative approach emphasize the importance of the meaning of utterances, rather than their form and structure.However,communicative tests are concerned primarily with how language is used in communication.

 Perhaps the most important criterion for communicative test is that they should be based on precise and detailed specification of the needs of learners for whom they are constructed.

 The attempt to measure different language skills in communicative test is based on a view of language referred to as divisibility hypothesis.

 Finally,communicative testing has introduced the concept of qualitative modes of assessment in preference to quantitative ones.  What are the benefits of qualitative evaluation? Each students’ performance is evaluated according to his or her degree of success in performing the language task and it is not compared with other students

 1.Norm-referenced  It gives meaning to raw scores by permitting the comparison of test performance of examinees with those of other representative subjects on a local, regional or national basis  These tests are designed to yield maximum discrimination among testees and spread their scores along a normal probability curve.

 When a great number of testees miss an item it is eliminated from the test.This approach is useful in aptitude testing where the purpose is to make differential predictions  Norm referenced test yields a rank order of candidates based on distribution of scores.

 2.Criterion-referenced interpretation:  It refers to what testees can do with what he knows, not on how he compares with others.it does not matter in principle whether all candidates are successful, or non of the candidates is successful.

 Characteristically, criterion-referenced tests are designed before the instruction is designed. A criterion is set in advance and those who do not meet the criterion are required to repeat the course.  Selection tests and proficiency tests fall into the realm of criterion-referenced testing.