1. Part 3 of a Good Test Question Writing Workshop

2. Objectives
At the end of this presentation the faculty member will be able to:
Understand and apply test question analysis data provided from LXR software
Evaluate questions using data from LXR
Develop a plan to ‘recycle’ questions using the LXR database

3. Ways a computer can help test question writing
Grammatical
Spelling
Analysis
With software
Spot checks
Database creation
LXR test
Others exist

4. Ways a computer can help kill question writing
Dependency
Corruption
Lack of understanding

5. Let’s look at an LXR test report

6. Now let us look at the question

7. Active learning time!!!!!
From the item statistics report sheet provided to you, pick two questions that you feel would warrant ‘closer’ review.

8. Discussion of problem questions
After looking at the stats, let us look at the questions to identify if the issues from the statistics reports are ‘real.’

9. Summary Stats are nice My method But not always clear
Combine the stats with the question for best results
Especially if you have multiple adminstrations
My method
Review stats first
Identify potential issues
Then look at the question with a biased eye

10. Test stats over a time period for question Chap 11 11

11. Summary of database of questions
Great for tracking progression of exam questions
Keeps track of administrations
Allows for creation of exams that
May be easy
May be hard

12. Questions?