1. Item Analysis and Question Reuse Rationale #11 Week 14

2. We instructors want you to learn
So we try new approaches …
But how do we know if they are working?
Testing can help.

3. Reuse of questions Take a question that was used in a previous class.
Compare
score in the current class,
score in previous class
Quasi-experimental
I have reused a couple of questions on this semester’s tests, and may reuse one or two more.

4. Other advantages of reuse
Control difficulty through item analysis
Fix glitches in wording
But, what about “cheating”?
Especially on open-web test!

5. A balancing act Do students need a copy of the answers?
“Formative” vs. “summative”

6. A balancing act Do students need a copy of the answers?
“Formative” vs. “summative”
Advantage of sharing answers
Disad. of sharing answers

7. A balancing act Do students need a copy of the answers?
“Formative” vs. “summative”
Advantage of sharing answers
Disad. of sharing answers
Students learn from them

8. A balancing act Do students need a copy of the answers?
“Formative” vs. “summative”
Advantage of sharing answers
Disad. of sharing answers
Students learn from them
Harder to reuse fairly

9. A balancing act Do students need a copy of the answers?
“Formative” vs. “summative”
Advantage of sharing answers
Disad. of sharing answers
Students learn from them
Harder to reuse fairly
Promotes transparency

10. A balancing act Do students need a copy of the answers?
“Formative” vs. “summative”
Advantage of sharing answers
Disad. of sharing answers
Students learn from them
Harder to reuse fairly
Promotes transparency
May require construction of new questions, always a risk

11. A balancing act Do students need a copy of the answers?
“Formative” vs. “summative”
Advantage of sharing answers
Disad. of sharing answers
Students learn from them
Harder to reuse fairly
Promotes transparency
May require construction of new questions, always a risk
Can’t measure impact of new teaching strategies