1. I nternational D atabase for E nhanced A ssessments & L earning HK Ng, C. Hazlett, J Ware, S. Yip

2. I D E A L Additionally, some basic medical science teachers have difficulty assessing their students’ reasoning abilities within a clinically relevant context R-type selected response items (also referred to as Extended Matching Questions [EMQ]) are particularly suitable for measuring medical students’ scientific & clinical reasoning abilities However, some teachers find that composing an R-type item is difficult and/or time-consuming Background

3. I D E A L The R-type item writing wizard is designed to assist basic & clinical science teachers composing well designed R-Type items more easily & quickly Objective & Purpose

4. I nternational D atabase for E nhanced A ssessments & L earning Using the Wizard to Create an R-type Item

6. I D E A L Select or Compose an Appropriate Lead-In Question

7. I D E A L Next, compose a relevant, appropriate scientific or clinical scenario Two yr-old boy is brought to clinic complaining of generalized rash & fever for 1 day. Rash initially appeared on face & trunk then spread to limbs. Intensity of rash in axilla & groin region has recently increased. Skin feels like sand-paper & there is also circumoral pallor. Throat is congested & examination is otherwise uneventful.

8. I D E A L Vignette can be composed within the wizard or copied & pasted from Word Pad or another source except MS Word

9. I D E A L Specify the Option Which is the Correct Answer

10. I D E A L Compose Relevant Feedback for Students Feedback can be provided to the students after the assessment for formative purposes

11. I nternational D atabase for E nhanced A ssessments & L earning If another clinical scenario is relevant for the same option set, compose a 2 nd vignette

12. I D E A L Example of a 2 nd Scenario Applicable for the Same Option Set Six yr-old girl, who has had cold & fever for 3 days, is sent home from school because she is feeling so poorly. Later in the same day she develops a maculopapular rash on her face & trunk. She does not want to get out of bed, preferring the bedroom curtains to be closed. On examination, there is grayish spot on the mucous membrane of her mouth.

13. I D E A L Click button ‘Add Scenario’

14. I D E A L 2nd Scenario is Added Sequential position of this scenario is indicated

15. I D E A L By default the feedback from the previous (first) scenario is included

16. I nternational D atabase for E nhanced A ssessments & L earning Several vignettes can be generated under the same option set

17. I D E A L Example of a 3rd Scenario One yr-old boy is admitted to the A&E department due to high fever & generalized rash. His mother claims that the boy was still playful a few hours ago & his condition has deteriorated very quickly. On examination, the rash is non-blanching, irregular in size, with a necrotic centre.

18. I nternational D atabase for E nhanced A ssessments & L earning Transferring the R-Type Item(s) to MS Word

19. I D E A L If one has finished entering all scenarios for a particular set of options, but wishes to also generate other R-type items, click the button ‘Export and Continue’ Using this protocol, the exported item will be displayed in MS Word only after all the other R-type items have been created

20. I D E A L When one has finished generating all R-type items click button “Export and Exit” Using this protocol, the wizard will close & a MS Word document will appear (see next slide)

21. Example of an R-type Item Displayed in MS Word After item(s) is (are) displayed in MS Word, go to Word’s menu bar - click View - select Print Layout

22. I D E A L If no appropriate option set is presently available in the Wizard, add a new option set for use now & for the future how to achieve this is explained in the following slides The Wizard can Increase in its Capability

23. I D E A L Click the Tab ‘Input/Edit Option Set(s)’

24. I D E A L Select an existing Discipline Select an existing Topic Select an existing Theme

25. I D E A L Compose (or copy & paste) your new options one by one within ‘Add Option’ text box & click the button ‘Add’ The options will be added to above option set text box

26. I D E A L An Example of a New Option Set for the Theme of ‘Chest Pain’ Asthma Costochondritis (Tietze Syndrome) Conversion Disorder Esophagitis Foreign Body Myocarditis Muscle strain Pericarditis Pneumonia Pneumothorax Precordial Catch Syndrome Supraventricular Tachycardia

27. I D E A L Generating the New Option Set Click ‘Create New Option Set’ button & the new option set is added to the wizard & its total number of option sets is appropriately increased (e.g., 271)

28. I nternational D atabase for E nhanced A ssessments & L earning Wizard also enables one to add additional sets of Disciplines / Topics / Themes

29. I D E A L Type in a new discipline in relevant text box & click button ‘Add Discipline/Panel’

30. I D E A L Similarly type in a new topic & theme in relevant text box & click the button ‘Add Topic/Theme’

31. I nternational D atabase for E nhanced A ssessments & L earning Saving the changes made to Discipline / Topic / Theme

32. I D E A L Click button ‘Save Changes Permanently’

33. I nternational D atabase for E nhanced A ssessments & L earning R-type Intranet Wizard

34. I D E A L The R-type Wizard Intranet Version has all the same features as the PC Version. and in addition, items created with the Intranet Wizard can be saved to the IDEAL non-restricted item bank if this item bank is being kept on the same server as the wizard

35. I D E A L To enter the item into the non-restricted IDEAL bank, click button ‘Save Item and Continue Edit’