Presentation on theme: "English Language Proficiency Tests, One Dimension or Many?: Yoonsun Lee Director of Assessment and Psychometrics Office of Superintendent of Public Instruction."— Presentation transcript:
English Language Proficiency Tests, One Dimension or Many?: Yoonsun Lee Director of Assessment and Psychometrics Office of Superintendent of Public Instruction
ELPT Requirements Under NCLB States are required to: - Implement ELD standards - Implement ELP tests that assess skills in listening, speaking, reading, and writing with an added comprehension measure - Administer ELP tests annually in grades K- 12 - Align ELP tests with academic content standards - Meet AMAO Title III objectives
More on Title III Measurement Demands AMAO I requires setting target growth rates in English language proficiency status across years AMAO II requires setting targets for attaining full English language proficiency across years States attracted to ELP tests that implement vertical scales
Construct Validity Issue Does it make sense to hypothesize that English language proficiency test is unidimensional? Or, is it multidimensional with four different domains (reading, writing, speaking, and listening)?
Washington Language Proficiency Test-II (WLPT-II) Developed in 2006 Used Stanford English Language Proficiency Test (SELP) and added augmented items developed by Washington teachers Four grade spans (K-2, 3-5, 6-8, & 9-12) Four subtests (Reading, Writing, Listening & Speaking)
Results (Primary level) ModeldfGFICFIRMSEA 1 (single with no corr) 16896.21890.670.751.33 2 (single with corr) 2445.41420.950.970.05 3 (four factor) 5472.141830.880.920.07 4 (second order) 6192.91850.870.910.08
Results (Primary: K-2) - was examined to compare models. Model 2 (Single Factor with errors correlated within subtest) produced a good fit to the data.
Results (Elementary, Middle, & High School) - Same result was found in Elementary, Middle, & High School) - Model 2 showed the best fit to the data (over 0.95 GFI and CFI and below 0.05 RMSEA) - No significant evidence to threaten construct validity with adding augmented items to the existing language test