1. 12011 Translating MC  Performance Items Taxonomy of Item Types Wallace Judd, Ph.D. Wallace@WallaceJudd.com

2. 22011 Translating MC  Performance Items Taxonomy of Item Types What is a taxonomy? Examples of taxonomies: – Bloom’s Taxonomy of Learning Objectives – Kirkpatrick’s Four Levels of Evaluation

3. 32011 Translating MC  Performance Items Why Is a Taxonomy Useful? Expands item continuum Clarifies an item’s goal Establishes testing conditions Clarifies appropriate scoring Because it …

4. 42011 Translating MC  Performance Items Bloom’s Taxonomy: Created by a committee of colleges

5. 52011 Translating MC  Performance Items Taxonomy: Memorization Examples: Word processing:Margin, Gutter, Font Programming:Syntax; Elements Chemistry:Elements; formulas History:Dates; Names, Places Card Games:Cards, Rules, Values Articulating given verbalizations with acceptable fidelity.

6. 62011 Translating MC  Performance Items Taxonomy: Concepts Examples: Discrimination:Edible - inedible; Heavy - light; Attribute set:Chair; Airplane; Mountain Process:P.O. approvals Structure:Bridge; Auto Transmission; Programming:Cache, Cell reference, text model Mental structures that guide action.

7. 72011 Translating MC  Performance Items Taxonomy: Concepts The Man In the Crosswalk Word processing Linked table database model Cell reference spreadsheet model

8. 82011 Translating MC  Performance Items Taxonomy: How Do You Operationalize A Concept? When would it matter? If they didn’t get it … ? What would you see if they did … ? How can you apply the concept? How do you debug …?

9. 92011 Translating MC  Performance Items Knowledge Goal  Operationalized Concept Draw primary components of the R27 Router Show the data flow between components Define the function of each component.

10. 10 2011 Translating MC  Performance Items Taxonomy: Reference Infrequent Not time critical Sequence critical Complex list of instructions

11. 112011 Translating MC  Performance Items Examples: Word processing:Mail merge; ToC Bookkeeping:Quarterly books Auto mechanic:Repairing brakes Pilot:IFR landing Spreadsheet:Function Syntax Programming:APIs; Protocols Use external resources directed at the problem. Taxonomy: Reference

12. 122011 Translating MC  Performance Items Taxonomy: Reference Recognize need for additional info Access appropriate reference Translate task  reference terms Apply reference info Verify solution

13. 132011 Translating MC  Performance Items Taxonomy: Competence Examples: Word processing:Set headers, footers Spreadsheet:Use Net Present Value Mechanic:Rebuild a carburetor Landscaper:Install sprinkler system Definition: Figuring it out given the context.

14. 142011 Translating MC  Performance Items Taxonomy: Kinesthetic Examples: Word proc:Cut, paste, set attributes Spreadsheet:Select, sum, cell reference Mechanic:Tighten, loosen bolt Pilot:Landing; emergency procedures Programmer:Initialize vars; close blocks Muscle memory. An overlearned skill.

15. 15 Translating MC  Performance Items Taxonomy: Problem-Solving Examples: Word proc:Resolve confused tabs Spreadsheet:Fix a formula Mechanic:Troubeshoot electrical system Pilot:Reconcile instrument readings Programmer:Debugging Applying diverse strategies to a problem intractable to pre-defined procedures.

16. 162011 Translating MC  Performance Items Taxonomy: Writing Test Items ClassificationTest Conditions MemorizationObserve articulation. ConceptsConcept guides behavior. ReferenceSpecify resources available. CompetenceSequence contexts; allow mistakes. KinestheticBehavior meets speed criteria. Problem-SolvingOpen-ended problem situation.

17. 172011 Translating MC  Performance Items Taxonomy of Item Types Wallace Judd, Ph.D. Wallace@WallaceJudd.com