1. Chapter 5 Tests 1

2. Importance of tests An opportunity for clever designers to engage leaners Creating test questions precisely defines and clarifies learning objectives Could be more effective than many expensive 3D games that don’t have any learning objective 2

3. Formal and informal tests Formal tests Informal practice activities 3

4. Good reasons for testing 4 1.Let students know how much progress they have made 2.Tell learners what is important and motivate them to learn those. 3.Let learners apply what they learn 4.Evaluate what parts of your e-learning work and which ones don’t 5.Make sure students have mastered the requirements to pass 6.Diagnose learners’ misconceptions and allow them to skip if necessary (Adaptive Teaching)

5. 3 steps in designing a test 1- Think about (what can those who meet the objective do that those who don’t meet the objective cannot do) 2- Test activity (how learners prove they meet the objective) 3- Resources (media, technology, and other tools) 5

6. When to use True/False Is a statement right or wrong? Will a procedure work or not? Is a procedure safe or unsafe? Does an example comply with standards? Should you approve or reject a proposal? Which of two alternatives should I pick? 6

7. When to use pick-one questions Ratings or scales ( strongly agree…) Recognizing a member of a specific category Recognizing the main cause of a problem Picking superlatives ( which one is faster?) Selecting the best course of action 7

8. Alternative forms for pick-one questions 8

9. 1- Use selection lists (drop-down menu) 9

10. 2- Click-in-pictures 10 Find Noble Gas group in the periodic table

11. Hints on click-in-pictures Explain what learners are supposed to select Make targets visually distinct Make targets large enough Show the scene the way it would appear in the real world (control panel) 11

12. Examples of click-in-pictures What button would you press to trigger an emergency shutdown? Who in this picture is not wearing required safety gear? What country is home to our company’s largest factory? Click on the flag of the province where Mandarin Chinese is the official language. 12

13. 3- Select along a scale for value judgment 13

14. When to use Pick-multiple questions Picking items that meet a criterion Deciding when a rule applies Making a quick series of yes-no decisions Picking examples and non-examples of items 14

15. Chances of Guessing 15

16. When to use fill-in-the-blanks questions? Technical or business terms Part numbers Abbreviations Commands and statements in a programming languages Vocabulary in a foreign language 16

17. Matching List 17

18. Sequence-type questions 18

19. 19

20. Composition questions It is the same as “original work” but this one is for assessment or testing Writing essay Drawing and designing Writing a song Media development 20

21. When to use composition questions 21

22. What type of question to choose? 22

23. Writing effective questions 23

24. Follow standard format 24

25. Phrase questions precisely and clearly The difference between a clear and unclear question may be just a single word or punctuation. Use the simplest language possible. 25

26. Phrase questions as questions 26 Don’t ask which if you can ask “what”??????

27. Put background info before the question 27

28. Ask just one question at a time 28

29. Emphasize important words What item is not an example of learning style? Particularly important are words such as: – Not – Only – Just – One – First – last 29

30. Ask in the mode of application What does it mean? 30

31. 31

32. Match the type of test question to the way in which knowledge and skills will be applied later. 32

33. Base questions on a scenario To make testing more engaging and more predictive of real world. 33

34. Avoid common mistakes 34

35. Prevent obsolescence 35

36. Avoid “all of the above” and “none of the above” 36

37. Do not repeat phrases from the text Paraphrase rather than repeating exact phrases from the course materials. Savvy learners (cheaters) can just Google the phrase to find the answer. 37

38. Do not repeat a phrases in each choice which of the following is the best brief description of this novelist’s writing? A.a flowery approach to characterization B.a psychiatric approach to characterization C.an inner-feeling approach to characterization D.an overt-action approach to characterization 38 which of the following is the best brief description of this novelist’s approach to characterization A.flowery B.psychiatric C.inner-feeling D.overt-action

39. How to cheat on an online test? 39

40. How to cheat on an online test? 40

41. How to cheat on an online test? 41

42. Specify patterns (question templates) 42

43. Make answering meaningful Some tests encourage learners to guess rather than think about the answer. 43

44. Make all choices plausible The distractors should be plausible so that students who don’t know the correct answer will tend to select them. DI= 25% 44

45. Keep all answers about the same length and precision 45

46. Make all choices grammatically equivalent the judiciary committee’s impeachment deliberations resulted in a resolution in favor of A.no impeachment B.the majority voted for three articles C.a sharp division between the two parties D.one article cited obstruction of justice. 46

47. Make choices parallel Phrase all answers at the same level of abstraction, generality, precision, and degree of common usage. 47

48. Put choices in a meaningful order 48

49. Don’t give away the answer 49

50. Ask enough questions 50

51. Make sure one question does not answer another 51

52. Sequence test questions effectively Ask several questions about one scenario Ramp up difficulty Keep the number of questions low Enable skipping/returning questions 52

53. Vary the form of questions and answers Mix different types of questions (matching, multiple choice,…) arrange similar types together (all matching questions together) Each question measures a different misconceptions (what, when, why…) Vary the rom of questions (pick the right one,wrong one, the best one, the one that does not apply) Vary the order of correct answers but don’t vary the order of choices if you use the same choices in several question 53

54. Give Significant feedback 54

55. Report test scores simply 55

56. Helpful feedback Sometimes a simple correct/incorrect feedback and a score is enough However, if your goal is teaching not measurement then you may add additional feedback For correct answers you may challenge the learners to think about how thy got the right answer Or you may teach additional info as the feedback to a correct answer 56

57. Advance Your Testing Use technology to give hints before the correct answer Use test banks Randomize questions (prevent cheating, looks new each time) Randomize choices (each time the same question is presented) Automatically generate questions 57

58. Monitor results (item analysis) 58

59. Consider alternatives to formal tests Use more than formal graded tests Help learners build portfolios Have learners collect tokens Adapt testing to social learning Adapt testing to mobile learning 59

60. Use more than formal graded tests 60