Vincent Briseno EDTC 6343
In a technology-enhanced environment, the MTT demonstrates knowledge of: Instructional design Development Assessment Competency 007
Demonstrates knowledge of fundamental assessment- related issues, such as those related to bias, reliability and validity. Competency 007: E
Bias: prejudice in favor of or against one thing, person, or group compared with another, usually in a way considered to be unfair. Bias
Assessment bias: present whenever one or more items on a test offend or unfairly penalize students because of personal characteristics including but not limited to: Race Gender Socioeconomic status Religion Does the test over/under estimate a groups true ability? Assessment Related Bias
Reliability: consistency of a measure Reliability
Assessment reliability: assesses the degree to which test scores are consistent from one test administration to the next The tests reliability is determined by three factors Reliability of student performance Reliability of scoring Reliability between different forms of the same test Assessment Reliability Center for applied linguistics. (2009). Module 3: Reliability. Retrieved October 7, 2012, from:
Validity: the state or quality of being valid Valid: producing the desired result Validity
Assessment validity: the extent to which a test accurately measures the intended purpose The validity of a test can be separated into three major categories Content validity Criterion-related validity Construct validity Assessment Validity Duquesne University. Test construction: Introduction and overview. Retrieved October 7, 2012, from:
Reliability vs Validity Image: © Nevit Dilmen found at Wikimedia commons Image: © Nevit Dilmen
Vincent Briseno EDTC 6343
If performance on a given test results in low performance for only English language learners, then this may be a case of Assessment bias Assessment reliability Assessment validity
That was the wrong answer
Congratulations
Which of the following is the best definition for test reliability? A test that provides a fresh perspective when given multiple times to the same group of students. A test that can be scored differently depending on the test administrator. A test that provides consistent scores regardless of date, time, or test administrator.
That was the wrong answer
Congratulations
A test can be reliable without being valid. True False
That was the wrong answer
Congratulations
Which statement best describes test validity? A test is valid if it accurately measures the intended objective. A test is valid if a specific subset of students score low regardless of ability A test is valid if a change in the order of test questions results in significantly different scores.
That was the wrong answer
Congratulations
A middle school math test that accurately predicts the grade of 8th grade students in Algebra I is an example of A bias test A reliable test A valid test
That was the wrong answer
Congratulations
A classroom scale used in health class that always measures a students weight to be 25 pounds over the actual weight is A bias assessment A reliable assessment A valid assessment
That was the wrong answer
Congratulations
According to Competency 007: E, the MTT will demonstrate Knowledge of fundamental assessment-related issues Knowledge of the benefits and limitations of technology Knowledge of effective methods for incorporating technology into various instructional strategies
That was the wrong answer
Congratulations
Which of the following is not an assessment related issue? Bias Number of answer choices Validity Reliability
That was the wrong answer
Congratulations
One way an MTT could assess the reliability of a test would be to Give the test to the same group of students on consecutive days. Allow multiple teachers to grade the same tests. Rearrange the test questions and ask students to take the test again All of the above None of the above
That was the wrong answer
Congratulations
Powerpoint template provided by Wendy Russell tm
Reliability vs Validity Video