1. Gazİ unIVERSITY M.A. PROGRAM IN ELT TESTING AND ASSESSMENT IN ELT «ValIdIty» PREPARED BY FEVZI BALIDEDE , ANKARA

2. WHAT IS A TEST?
A test is a method of measuring a person's ability, knowledge, or performance in a given domain.
A test:
provides accurate measures,
has a beneficial effect on teaching,
is economical in terms of time and money.

3. Testing and assessment
Why is testing and assessment so important?
Testing and assessment are part of modern life.
educational progress
quality of school system
job
promotion
entrance to institutions
FUNDEMANTAL BUT CONTROVERSIAL

4. Testing and assessment
Classroom tests (Which one is the best?)
Decision-making (grades, remedial classes)
Two important characteristics:
VALIDITY vs. RELIABILITY

5. Validity vs. reliability
Neither Valid
nor Reliable
Fairly Valid but
not very Reliable
Reliable but not Valid
Valid & Reliable

6. Defining validity
Validity is the central concept in testing and assessment.
A test is said to be valid to the extent that it measures what it is supposed to measure.
Any given test then may be valid for some purposes, but not for others.
Validity may be determined in a variety of ways (empirical or non-empirical).

7. Defining validity Validity is a relative concept. Messic states:
"Validity is a matter of degree,
not all or none."
Brown says:
"There is no final, absolute measure of validity."

8. TYPES OF VALIDITY Content validity Face validity Construct validity
Criterion-referenced validity
Consequential validity

9. CONTENT validity Hughes says:
"A test is said to have content validity if its content constitutes a representative sample of the language skills, structures, etc."
A comparison of test specification and test content is the basis for judgments as to content validity.
Judgments should be made by experts in the field.

10. CONTENT validity TEST SPECIFICATIONS
Test specifications are an official statement of what the test tests and how it tests it. It is a description of the test, written beforehand, which includes such information as what the purpose of the test is, what will be covered by the test, how it will be tested, etc. Test specifications are written before the test, and then the test is written based on them. After the test is finished, the specifications should be consulted to see whether they match the test that was written, preferably by someone not directly connected with the writing of the test. Test specifications can help the teacher clarify whether the test covers what it is intended to cover in the way it is supposed to cover it.

11. CONTENT validity TEST SPECIFICATIONS
1. What is the purpose of the test?
2. What sort of learner will be taking the test?
3. How many sections should the test have, and how long should they be?
4. What text types should be used in the test?
5. What language skills should be tested?
6. What language elements should be tested?
7. What test methods are used?
8. What criteria will be used for assessment?

12. CONTENT validity Why is it so important?
more likely it is to be an accurate measure of what it is supposed to measure
backwash effect (positive vs. negative)

13. CONTENT VALIDITY what is easy to test? vs. what is important to test?
Content validation should be carried out while a test is being developed.
Testing performance directly is important for content validity.

14. CONTENT VALIDITY Time and budget constraints of language teachers
Careful consideration about purpose, content, objectives, examinee etc.

15. «measure what you are supposed to measure, nothing else.»
CONTENT VALIDITY
To achieve content validity:
plan the course content (What has been taught till the test?),
sample the content in the most suitable way.
«measure what you are supposed to measure, nothing else.»

16. THANK YOU BUT THAT’S NOT ALL!