1. Copyright © 1995-2007 Questionmark Corporation and/or Questionmark Computing Limited, known collectively as Questionmark. All rights reserved. Questionmark is a registered trademark of Questionmark Computing Limited. All other trademarks are acknowledged. Perception Assessment Management System AFPA June 7 th -8 th, 2007

2. Copyright © 1995-2007 Questionmark Corporation and/or Questionmark Computing Limited, known collectively as Questionmark. All rights reserved. Questionmark is a registered trademark of Questionmark Computing Limited. All other trademarks are acknowledged. Slide 2 Contents: Day 1  Structuring Assessments: Blocks  Changing Look and Feel: Templates  Publishing Assessments

3. Copyright © 1995-2007 Questionmark Corporation and/or Questionmark Computing Limited, known collectively as Questionmark. All rights reserved. Questionmark is a registered trademark of Questionmark Computing Limited. All other trademarks are acknowledged. Slide 3 Contents: Day 2  System Administration  Results Manager  Enterprise Reporter

4. Copyright © 1995-2007 Questionmark Corporation and/or Questionmark Computing Limited, known collectively as Questionmark. All rights reserved. Questionmark is a registered trademark of Questionmark Computing Limited. All other trademarks are acknowledged. Perception Assessment Management System Structuring Assessments: Blocks

5. Copyright © 1995-2007 Questionmark Corporation and/or Questionmark Computing Limited, known collectively as Questionmark. All rights reserved. Questionmark is a registered trademark of Questionmark Computing Limited. All other trademarks are acknowledged. Slide 5 The Anatomy of an Assessment

6. Copyright © 1995-2007 Questionmark Corporation and/or Questionmark Computing Limited, known collectively as Questionmark. All rights reserved. Questionmark is a registered trademark of Questionmark Computing Limited. All other trademarks are acknowledged. Slide 6 Assessment Editor  Edit default control parameters  Add additional question blocks  Add jump blocks Enable adaptive or multi-stage testing  Add reported topic outcomes  Add/edit assessment outcomes

7. Copyright © 1995-2007 Questionmark Corporation and/or Questionmark Computing Limited, known collectively as Questionmark. All rights reserved. Questionmark is a registered trademark of Questionmark Computing Limited. All other trademarks are acknowledged. Perception Assessment Management System Changing Look and Feel: Templates

8. Copyright © 1995-2007 Questionmark Corporation and/or Questionmark Computing Limited, known collectively as Questionmark. All rights reserved. Questionmark is a registered trademark of Questionmark Computing Limited. All other trademarks are acknowledged. Slide 8 Assessment Delivery  “Items” (questions, choices, feedback, etc.) are stored within the question database (table)  Perception merges “items” with html using custom “templates” or “style sheets” and “format” files at the time assessment is taken questionsassessments templateformat files Repository Inet Participant f Delivering Assessments

9. Copyright © 1995-2007 Questionmark Corporation and/or Questionmark Computing Limited, known collectively as Questionmark. All rights reserved. Questionmark is a registered trademark of Questionmark Computing Limited. All other trademarks are acknowledged. Slide 9 Assessment Delivery  Order files are applied to final output Format Files  Contains all default settings Template File  Contains just the items you wish to change from the defaults Style Sheet  Works with the template, adding styles to the code contained in the template Questions  Contains html used in questions Format Files TemplateStyle Sheet Assessment Questions

10. Copyright © 1995-2007 Questionmark Corporation and/or Questionmark Computing Limited, known collectively as Questionmark. All rights reserved. Questionmark is a registered trademark of Questionmark Computing Limited. All other trademarks are acknowledged. Slide 10 Assessment Delivery  The exact HTML produced is defined by: Perception software settings.format and htmlcore.format local.format and local_login.format containing any global customization Templates (with or without references to Style sheets), selected using Assessment Manager, to modify the defaults for a particular assessment

11. Copyright © 1995-2007 Questionmark Corporation and/or Questionmark Computing Limited, known collectively as Questionmark. All rights reserved. Questionmark is a registered trademark of Questionmark Computing Limited. All other trademarks are acknowledged. Slide 11 HTML Produced by Perception Assessment Name assessment content’s “look and feel” is defined by merging items with html from format files, session templates, and style sheet

12. Copyright © 1995-2007 Questionmark Corporation and/or Questionmark Computing Limited, known collectively as Questionmark. All rights reserved. Questionmark is a registered trademark of Questionmark Computing Limited. All other trademarks are acknowledged. Slide 12 Final HTML Produced Assessment Name the question choice

13. Copyright © 1995-2007 Questionmark Corporation and/or Questionmark Computing Limited, known collectively as Questionmark. All rights reserved. Questionmark is a registered trademark of Questionmark Computing Limited. All other trademarks are acknowledged. Slide 13 What are Format Files?  Control how the QML code of the questions is converted to a page of HTML  ASCII text files with the extension.format  Stored in \perception4\authoring\format folder on the Perception authoring PCs, and the \perception4\server\format folder on the Perception Server PC  settings.format is the most important; use for reference purposes only  Settings in files local.format or local_login.format overwrite the settings in the main format files

14. Copyright © 1995-2007 Questionmark Corporation and/or Questionmark Computing Limited, known collectively as Questionmark. All rights reserved. Questionmark is a registered trademark of Questionmark Computing Limited. All other trademarks are acknowledged. Slide 14 What are Templates?  Enable Perception authors to change how the questions appear to participants  Are ASCII text files with the extension.template  A template file can contain no settings, or any number of settings  Stored in the \[repository]\templates folder within each repository  A number of template files are supplied with Perception as examples  You can use the Template Editor in Authoring Manager or a text editor to alter template settings

15. Copyright © 1995-2007 Questionmark Corporation and/or Questionmark Computing Limited, known collectively as Questionmark. All rights reserved. Questionmark is a registered trademark of Questionmark Computing Limited. All other trademarks are acknowledged. Slide 15 Template Editor

16. Copyright © 1995-2007 Questionmark Corporation and/or Questionmark Computing Limited, known collectively as Questionmark. All rights reserved. Questionmark is a registered trademark of Questionmark Computing Limited. All other trademarks are acknowledged. Slide 16 Template changes  All format file settings can continue to be used for templates using CSS with the exception of the following: All START_xxx and END_xxx definitions in settings.format All definitions in the [FEEDBACK], [STYLE], [CHOICE] and [OPTION] sections All button definitions :  SUBMIT, RESET, CONTINUE, QUIT, HOME_BUTTON, BRANCH_BUTTON, PIP_HOME_BUTTON SEPARATOR OPEN_DOCUMENT_HEADER CLOSE_DOCUMENT_HEADER OPEN_FEEDBACK_HEADER CLOSE_FEEDBACK_HEADER OPEN_END_HEADER CLOSE_END_HEADER BLOCK_SCORE RUNNING_SCORE FINAL_SCORE ANSWERED_DEF NOTANSWERED Template definitions to be used with CSS should not include any font tags – font face, size and color are to be controlled by the cascading style sheet.

17. Copyright © 1995-2007 Questionmark Corporation and/or Questionmark Computing Limited, known collectively as Questionmark. All rights reserved. Questionmark is a registered trademark of Questionmark Computing Limited. All other trademarks are acknowledged. Slide 17 What are Style Sheets?  Define rules that control the styling of HTML elements  Allow you to control the rendering — e.g. fonts, colors, leading, margins, typefaces, and other aspects of style — of a Web document without compromising its structure  Separate the style of a page from the code, or HTML, makes it easier to apply corporate standards to a web page

18. Copyright © 1995-2007 Questionmark Corporation and/or Questionmark Computing Limited, known collectively as Questionmark. All rights reserved. Questionmark is a registered trademark of Questionmark Computing Limited. All other trademarks are acknowledged. Slide 18 Using Style Sheets  Style sheet support is turned on using the variable USE_STYLESHEET=1  Style sheet used is defined by the setting STYLESHEET=MyStyle.css  Question by Question (QxQ) delivery does not currently support CSS  QxQ templates should include USE_QXQ=1 or USE_STYLESHEET=0 to disable the use of Style sheets

19. Copyright © 1995-2007 Questionmark Corporation and/or Questionmark Computing Limited, known collectively as Questionmark. All rights reserved. Questionmark is a registered trademark of Questionmark Computing Limited. All other trademarks are acknowledged. Perception Assessment Management System Publishing Assessments

20. Copyright © 1995-2007 Questionmark Corporation and/or Questionmark Computing Limited, known collectively as Questionmark. All rights reserved. Questionmark is a registered trademark of Questionmark Computing Limited. All other trademarks are acknowledged. Perception Assessment Management System Authoring Manager Security and Workflow Management

21. Copyright © 1995-2007 Questionmark Corporation and/or Questionmark Computing Limited, known collectively as Questionmark. All rights reserved. Questionmark is a registered trademark of Questionmark Computing Limited. All other trademarks are acknowledged. Slide 21 Managing Administrators Manage Administrator in Enterprise Manager Manage Administrator in Windows Authoring Manager

22. Copyright © 1995-2007 Questionmark Corporation and/or Questionmark Computing Limited, known collectively as Questionmark. All rights reserved. Questionmark is a registered trademark of Questionmark Computing Limited. All other trademarks are acknowledged. Slide 22 Personal Settings

23. Copyright © 1995-2007 Questionmark Corporation and/or Questionmark Computing Limited, known collectively as Questionmark. All rights reserved. Questionmark is a registered trademark of Questionmark Computing Limited. All other trademarks are acknowledged. Slide 23 Roles and Groups Roles are for Workflow

24. Copyright © 1995-2007 Questionmark Corporation and/or Questionmark Computing Limited, known collectively as Questionmark. All rights reserved. Questionmark is a registered trademark of Questionmark Computing Limited. All other trademarks are acknowledged. Slide 24 Authoring Rights

25. Copyright © 1995-2007 Questionmark Corporation and/or Questionmark Computing Limited, known collectively as Questionmark. All rights reserved. Questionmark is a registered trademark of Questionmark Computing Limited. All other trademarks are acknowledged. Slide 25 Controlling Access to Topic and Assessment Folders Topic and assessment folder rights menu

26. Copyright © 1995-2007 Questionmark Corporation and/or Questionmark Computing Limited, known collectively as Questionmark. All rights reserved. Questionmark is a registered trademark of Questionmark Computing Limited. All other trademarks are acknowledged. Slide 26 Topic Rights per Administrator

27. Copyright © 1995-2007 Questionmark Corporation and/or Questionmark Computing Limited, known collectively as Questionmark. All rights reserved. Questionmark is a registered trademark of Questionmark Computing Limited. All other trademarks are acknowledged. Slide 27 Assigning Administrators from the Navigation Pane

28. Copyright © 1995-2007 Questionmark Corporation and/or Questionmark Computing Limited, known collectively as Questionmark. All rights reserved. Questionmark is a registered trademark of Questionmark Computing Limited. All other trademarks are acknowledged. Slide 28 Topic Rights Set in Browser-based Authoring

29. Copyright © 1995-2007 Questionmark Corporation and/or Questionmark Computing Limited, known collectively as Questionmark. All rights reserved. Questionmark is a registered trademark of Questionmark Computing Limited. All other trademarks are acknowledged. Slide 29 Assessment Folder Rights per Administrator

30. Copyright © 1995-2007 Questionmark Corporation and/or Questionmark Computing Limited, known collectively as Questionmark. All rights reserved. Questionmark is a registered trademark of Questionmark Computing Limited. All other trademarks are acknowledged. Slide 30 Assessment Folder Rights Set in Browser- based Authoring

31. Copyright © 1995-2007 Questionmark Corporation and/or Questionmark Computing Limited, known collectively as Questionmark. All rights reserved. Questionmark is a registered trademark of Questionmark Computing Limited. All other trademarks are acknowledged. Slide 31 Topic and Folder Rights  No Access - the selected administrators cannot do anything with the selected root topics and any subtopics below them, and they will not appear to these administrators in the Authoring Manager window.  View/Use - the selected administrators can only view, tryout or copy the selected root topics and any subtopics below them  Edit/Use - the selected administrators can do everything with the selected root topics and any subtopics below them, except: Delete the root topic Delete a subtopic below the root topic Delete a question below the root topic Delete an item resource associated with the root topic or a subtopic below it Delete item content associated with the root topic or a subtopic below it Delete a topic outcome associated with the root topic or a subtopic below it Cut any of the above  Full Access - the selected administrators can do everything with the selected root topics and any subtopics below them

32. Copyright © 1995-2007 Questionmark Corporation and/or Questionmark Computing Limited, known collectively as Questionmark. All rights reserved. Questionmark is a registered trademark of Questionmark Computing Limited. All other trademarks are acknowledged. Slide 32 Administration Rights

33. Copyright © 1995-2007 Questionmark Corporation and/or Questionmark Computing Limited, known collectively as Questionmark. All rights reserved. Questionmark is a registered trademark of Questionmark Computing Limited. All other trademarks are acknowledged. Slide 33 Reporting Rights

34. Copyright © 1995-2007 Questionmark Corporation and/or Questionmark Computing Limited, known collectively as Questionmark. All rights reserved. Questionmark is a registered trademark of Questionmark Computing Limited. All other trademarks are acknowledged. Slide 34 Results/Monitoring Rights

35. Copyright © 1995-2007 Questionmark Corporation and/or Questionmark Computing Limited, known collectively as Questionmark. All rights reserved. Questionmark is a registered trademark of Questionmark Computing Limited. All other trademarks are acknowledged. Perception Assessment Management System Enterprise Manager Overview

36. Copyright © 1995-2007 Questionmark Corporation and/or Questionmark Computing Limited, known collectively as Questionmark. All rights reserved. Questionmark is a registered trademark of Questionmark Computing Limited. All other trademarks are acknowledged. Slide 36 Enterprise Manager Main Menu

37. Copyright © 1995-2007 Questionmark Corporation and/or Questionmark Computing Limited, known collectively as Questionmark. All rights reserved. Questionmark is a registered trademark of Questionmark Computing Limited. All other trademarks are acknowledged. Slide 37 Enterprise Manager Main Menu  Enterprise Manager Main Menu Menu options will vary on the basis of administrator privileges

38. Copyright © 1995-2007 Questionmark Corporation and/or Questionmark Computing Limited, known collectively as Questionmark. All rights reserved. Questionmark is a registered trademark of Questionmark Computing Limited. All other trademarks are acknowledged. Perception Assessment Management System System Administration

39. Copyright © 1995-2007 Questionmark Corporation and/or Questionmark Computing Limited, known collectively as Questionmark. All rights reserved. Questionmark is a registered trademark of Questionmark Computing Limited. All other trademarks are acknowledged. Slide 39 System Administration Main Menu

40. Copyright © 1995-2007 Questionmark Corporation and/or Questionmark Computing Limited, known collectively as Questionmark. All rights reserved. Questionmark is a registered trademark of Questionmark Computing Limited. All other trademarks are acknowledged. Slide 40 Creating Participants  Create a single participant  Create multiple participants  Import participant list

41. Copyright © 1995-2007 Questionmark Corporation and/or Questionmark Computing Limited, known collectively as Questionmark. All rights reserved. Questionmark is a registered trademark of Questionmark Computing Limited. All other trademarks are acknowledged. Slide 41 Create Single Participant

42. Copyright © 1995-2007 Questionmark Corporation and/or Questionmark Computing Limited, known collectively as Questionmark. All rights reserved. Questionmark is a registered trademark of Questionmark Computing Limited. All other trademarks are acknowledged. Slide 42 Sample Participant

43. Copyright © 1995-2007 Questionmark Corporation and/or Questionmark Computing Limited, known collectively as Questionmark. All rights reserved. Questionmark is a registered trademark of Questionmark Computing Limited. All other trademarks are acknowledged. Slide 43 Create Multiple Participants Assign multiple, new participants to a single group Generate Participant IDs automatically

44. Copyright © 1995-2007 Questionmark Corporation and/or Questionmark Computing Limited, known collectively as Questionmark. All rights reserved. Questionmark is a registered trademark of Questionmark Computing Limited. All other trademarks are acknowledged. Slide 44 Import Participants Import large numbers of participants from properly formatted data file and add them to a group single handedly.

45. Copyright © 1995-2007 Questionmark Corporation and/or Questionmark Computing Limited, known collectively as Questionmark. All rights reserved. Questionmark is a registered trademark of Questionmark Computing Limited. All other trademarks are acknowledged. Slide 45 Manage Participants

46. Copyright © 1995-2007 Questionmark Corporation and/or Questionmark Computing Limited, known collectively as Questionmark. All rights reserved. Questionmark is a registered trademark of Questionmark Computing Limited. All other trademarks are acknowledged. Slide 46 Manage Groups  Groups of participants Can be used to reflect your organization’s structure  E.g. geographic regions or functions (i.e. sales, marketing, finance, HR, R&D, Administration)  Schedule groups to take an assessment  Report on groups collectively Compare performance of one group to another

47. Copyright © 1995-2007 Questionmark Corporation and/or Questionmark Computing Limited, known collectively as Questionmark. All rights reserved. Questionmark is a registered trademark of Questionmark Computing Limited. All other trademarks are acknowledged. Slide 47 Edit Groups Create unlimited numbers of subgroups to reflect your organizational structure

48. Copyright © 1995-2007 Questionmark Corporation and/or Questionmark Computing Limited, known collectively as Questionmark. All rights reserved. Questionmark is a registered trademark of Questionmark Computing Limited. All other trademarks are acknowledged. Slide 48 Schedules  Schedule individual participants to take an assessment  Schedule groups to take an assessment  Schedule options Limit attempts Override time limit in hours Limit number of days between retakes Access period Require monitoring

49. Copyright © 1995-2007 Questionmark Corporation and/or Questionmark Computing Limited, known collectively as Questionmark. All rights reserved. Questionmark is a registered trademark of Questionmark Computing Limited. All other trademarks are acknowledged. Slide 49 Schedule Individuals

50. Copyright © 1995-2007 Questionmark Corporation and/or Questionmark Computing Limited, known collectively as Questionmark. All rights reserved. Questionmark is a registered trademark of Questionmark Computing Limited. All other trademarks are acknowledged. Slide 50 Schedule Individual – Step 2 Select the Schedule of Choice Web Delivery Certified Test Center

51. Copyright © 1995-2007 Questionmark Corporation and/or Questionmark Computing Limited, known collectively as Questionmark. All rights reserved. Questionmark is a registered trademark of Questionmark Computing Limited. All other trademarks are acknowledged. Slide 51 Add Assessment Add an Assessment to Individual Participants

52. Copyright © 1995-2007 Questionmark Corporation and/or Questionmark Computing Limited, known collectively as Questionmark. All rights reserved. Questionmark is a registered trademark of Questionmark Computing Limited. All other trademarks are acknowledged. Slide 52 Select Assessment

53. Copyright © 1995-2007 Questionmark Corporation and/or Questionmark Computing Limited, known collectively as Questionmark. All rights reserved. Questionmark is a registered trademark of Questionmark Computing Limited. All other trademarks are acknowledged. Slide 53 Schedule Assessment  Set Schedule Properties Name the schedule Limit the number of attempts a participant can take the assessment Override the time limit in minutes Limit the number of days between retakes OR Set the precise access period for the specified assessments  Indicate whether the schedule requires monitoring or not

54. Copyright © 1995-2007 Questionmark Corporation and/or Questionmark Computing Limited, known collectively as Questionmark. All rights reserved. Questionmark is a registered trademark of Questionmark Computing Limited. All other trademarks are acknowledged. Slide 54 Review Schedule  Review participants assigned to the schedule  Indicate whether to announce the schedule via email

55. Copyright © 1995-2007 Questionmark Corporation and/or Questionmark Computing Limited, known collectively as Questionmark. All rights reserved. Questionmark is a registered trademark of Questionmark Computing Limited. All other trademarks are acknowledged. Slide 55 Test Centers  Schedule individuals or groups to take assessments at a certified test center  Create new test centers

56. Copyright © 1995-2007 Questionmark Corporation and/or Questionmark Computing Limited, known collectively as Questionmark. All rights reserved. Questionmark is a registered trademark of Questionmark Computing Limited. All other trademarks are acknowledged. Slide 56 Schedule Test Center

57. Copyright © 1995-2007 Questionmark Corporation and/or Questionmark Computing Limited, known collectively as Questionmark. All rights reserved. Questionmark is a registered trademark of Questionmark Computing Limited. All other trademarks are acknowledged. Slide 57 Create Test Center Schedule

58. Copyright © 1995-2007 Questionmark Corporation and/or Questionmark Computing Limited, known collectively as Questionmark. All rights reserved. Questionmark is a registered trademark of Questionmark Computing Limited. All other trademarks are acknowledged. Slide 58 Add Assessment to Group

59. Copyright © 1995-2007 Questionmark Corporation and/or Questionmark Computing Limited, known collectively as Questionmark. All rights reserved. Questionmark is a registered trademark of Questionmark Computing Limited. All other trademarks are acknowledged. Slide 59 Schedule Details

60. Copyright © 1995-2007 Questionmark Corporation and/or Questionmark Computing Limited, known collectively as Questionmark. All rights reserved. Questionmark is a registered trademark of Questionmark Computing Limited. All other trademarks are acknowledged. Slide 60 Review Groups

61. Copyright © 1995-2007 Questionmark Corporation and/or Questionmark Computing Limited, known collectively as Questionmark. All rights reserved. Questionmark is a registered trademark of Questionmark Computing Limited. All other trademarks are acknowledged. Slide 61 Manage Schedules

62. Copyright © 1995-2007 Questionmark Corporation and/or Questionmark Computing Limited, known collectively as Questionmark. All rights reserved. Questionmark is a registered trademark of Questionmark Computing Limited. All other trademarks are acknowledged. Slide 62 Creating Administrators  The Root Manager can setup administrative users with different levels of permission and access to: Questions and Assessments Reports Participants and Groups other related content and features  The Administrator permissions that can be set in Enterprise Manager mirror those that can be set in Windows-based Authoring Manager

63. Copyright © 1995-2007 Questionmark Corporation and/or Questionmark Computing Limited, known collectively as Questionmark. All rights reserved. Questionmark is a registered trademark of Questionmark Computing Limited. All other trademarks are acknowledged. Slide 63 Creating Administrators – Personal & Group Permissions

64. Copyright © 1995-2007 Questionmark Corporation and/or Questionmark Computing Limited, known collectively as Questionmark. All rights reserved. Questionmark is a registered trademark of Questionmark Computing Limited. All other trademarks are acknowledged. Slide 64 Creating Administrators – Authoring Permissions

65. Copyright © 1995-2007 Questionmark Corporation and/or Questionmark Computing Limited, known collectively as Questionmark. All rights reserved. Questionmark is a registered trademark of Questionmark Computing Limited. All other trademarks are acknowledged. Slide 65 Authoring Rights in Enterprise Manager and in Authoring Manager Authoring Rights in Windows-based Authoring Manager

66. Copyright © 1995-2007 Questionmark Corporation and/or Questionmark Computing Limited, known collectively as Questionmark. All rights reserved. Questionmark is a registered trademark of Questionmark Computing Limited. All other trademarks are acknowledged. Slide 66 Creating Administrators – Administration Permissions

67. Copyright © 1995-2007 Questionmark Corporation and/or Questionmark Computing Limited, known collectively as Questionmark. All rights reserved. Questionmark is a registered trademark of Questionmark Computing Limited. All other trademarks are acknowledged. Slide 67 Creating Administrators – Reporting Permissions

68. Copyright © 1995-2007 Questionmark Corporation and/or Questionmark Computing Limited, known collectively as Questionmark. All rights reserved. Questionmark is a registered trademark of Questionmark Computing Limited. All other trademarks are acknowledged. Slide 68 Creating Administrators – Results Permissions

69. Copyright © 1995-2007 Questionmark Corporation and/or Questionmark Computing Limited, known collectively as Questionmark. All rights reserved. Questionmark is a registered trademark of Questionmark Computing Limited. All other trademarks are acknowledged. Slide 69 Creating Administrators – Monitoring Permissions

70. Copyright © 1995-2007 Questionmark Corporation and/or Questionmark Computing Limited, known collectively as Questionmark. All rights reserved. Questionmark is a registered trademark of Questionmark Computing Limited. All other trademarks are acknowledged. Slide 70 Managing Administrators Manage Administrator in Enterprise Manager Manage Administrator in Windows Authoring Manager

71. Copyright © 1995-2007 Questionmark Corporation and/or Questionmark Computing Limited, known collectively as Questionmark. All rights reserved. Questionmark is a registered trademark of Questionmark Computing Limited. All other trademarks are acknowledged. Slide 71 E-mail Broadcast  Email Broadcast Send e-mails to individual or groups  Send an announcement when scheduling participants or groups for an assessment  Send a reminder based on schedules and remaining attempts Select session variables to include in message  E.g. unique username and password

72. Copyright © 1995-2007 Questionmark Corporation and/or Questionmark Computing Limited, known collectively as Questionmark. All rights reserved. Questionmark is a registered trademark of Questionmark Computing Limited. All other trademarks are acknowledged. Slide 72 Email Broadcast

73. Copyright © 1995-2007 Questionmark Corporation and/or Questionmark Computing Limited, known collectively as Questionmark. All rights reserved. Questionmark is a registered trademark of Questionmark Computing Limited. All other trademarks are acknowledged. Slide 73 Server Management  Maintenance and configuration tools used exclusively by the Root Manager (a.k.a. the System Administrator)

74. Copyright © 1995-2007 Questionmark Corporation and/or Questionmark Computing Limited, known collectively as Questionmark. All rights reserved. Questionmark is a registered trademark of Questionmark Computing Limited. All other trademarks are acknowledged. Perception Assessment Management System Results Manager

75. Copyright © 1995-2007 Questionmark Corporation and/or Questionmark Computing Limited, known collectively as Questionmark. All rights reserved. Questionmark is a registered trademark of Questionmark Computing Limited. All other trademarks are acknowledged. Slide 75 Results Manager  Tools for managing results data  Access to each tool is selectively assigned to administrators

76. Copyright © 1995-2007 Questionmark Corporation and/or Questionmark Computing Limited, known collectively as Questionmark. All rights reserved. Questionmark is a registered trademark of Questionmark Computing Limited. All other trademarks are acknowledged. Slide 76 Delete Results Results Remover

77. Copyright © 1995-2007 Questionmark Corporation and/or Questionmark Computing Limited, known collectively as Questionmark. All rights reserved. Questionmark is a registered trademark of Questionmark Computing Limited. All other trademarks are acknowledged. Slide 77 Delete Selected Results  Sometimes the results of an assessment are invalid and need to be deleted so as not to skew the aggregate results

78. Copyright © 1995-2007 Questionmark Corporation and/or Questionmark Computing Limited, known collectively as Questionmark. All rights reserved. Questionmark is a registered trademark of Questionmark Computing Limited. All other trademarks are acknowledged. Slide 78 Score Editor  Score Editor Sometimes it’s necessary to manually adjust the score for a question  The correct answer may have been mis-keyed  There may be more than one correct answer  The question may have been ambiguous  The question may have been unfair

79. Copyright © 1995-2007 Questionmark Corporation and/or Questionmark Computing Limited, known collectively as Questionmark. All rights reserved. Questionmark is a registered trademark of Questionmark Computing Limited. All other trademarks are acknowledged. Slide 79 Score Editor

80. Copyright © 1995-2007 Questionmark Corporation and/or Questionmark Computing Limited, known collectively as Questionmark. All rights reserved. Questionmark is a registered trademark of Questionmark Computing Limited. All other trademarks are acknowledged. Slide 80  Scoring Tool Evaluate Essay and Spoken Response questions according to a rubric E-mail performance-specific feedback to participants

81. Copyright © 1995-2007 Questionmark Corporation and/or Questionmark Computing Limited, known collectively as Questionmark. All rights reserved. Questionmark is a registered trademark of Questionmark Computing Limited. All other trademarks are acknowledged. Slide 81

82. Copyright © 1995-2007 Questionmark Corporation and/or Questionmark Computing Limited, known collectively as Questionmark. All rights reserved. Questionmark is a registered trademark of Questionmark Computing Limited. All other trademarks are acknowledged. Slide 82 Results Importer  Results Importer Allows you to use Perception’s Enterprise Reporter with assessments that are not delivered by Perception Enter results manually or import from a properly formatted data file Associated results with an existing Perception assessment Or create a new assessment to associate the results with

83. Copyright © 1995-2007 Questionmark Corporation and/or Questionmark Computing Limited, known collectively as Questionmark. All rights reserved. Questionmark is a registered trademark of Questionmark Computing Limited. All other trademarks are acknowledged. Perception Assessment Management System Enterprise Reporter Overview

84. Copyright © 1995-2007 Questionmark Corporation and/or Questionmark Computing Limited, known collectively as Questionmark. All rights reserved. Questionmark is a registered trademark of Questionmark Computing Limited. All other trademarks are acknowledged. Slide 84 Reporting  Evaluate progress and identify trends  Understand assessment performance over time  Share results with key stakeholders  Eleven standard reports Reports can be customized / Design your own report Filter data by group, participant, date, score band, status, and special fields Administrator access to specific reports can be controlled by security settings Open and well-documented database can be used with 3rd-party tools

85. Copyright © 1995-2007 Questionmark Corporation and/or Questionmark Computing Limited, known collectively as Questionmark. All rights reserved. Questionmark is a registered trademark of Questionmark Computing Limited. All other trademarks are acknowledged. Slide 85 Reporting Process 1. Identify the assessment(s) or the participant on which to run the report 2. Edit report template to display necessary information 3. Set filters on data set a. Group b. Dates c. Status d. Special Fields 4. Generate report 5. Distribute results a. Electronic b. Hard-copy c. URL

86. Copyright © 1995-2007 Questionmark Corporation and/or Questionmark Computing Limited, known collectively as Questionmark. All rights reserved. Questionmark is a registered trademark of Questionmark Computing Limited. All other trademarks are acknowledged. Slide 86 Finding an Assessment Simple Search Advanced Search

87. Copyright © 1995-2007 Questionmark Corporation and/or Questionmark Computing Limited, known collectively as Questionmark. All rights reserved. Questionmark is a registered trademark of Questionmark Computing Limited. All other trademarks are acknowledged. Slide 87 Finding a Participant Simple Search Advanced Search

88. Copyright © 1995-2007 Questionmark Corporation and/or Questionmark Computing Limited, known collectively as Questionmark. All rights reserved. Questionmark is a registered trademark of Questionmark Computing Limited. All other trademarks are acknowledged. Slide 88 Assessment Overview Report  Generate for a single assessment or a selected group of assessments  Graphical representation of Assessment score distributions (histogram) Topic store distributions Score band distributions  Calculates standard deviation for assessment scores and topic scores

89. Copyright © 1995-2007 Questionmark Corporation and/or Questionmark Computing Limited, known collectively as Questionmark. All rights reserved. Questionmark is a registered trademark of Questionmark Computing Limited. All other trademarks are acknowledged. Slide 89 Assessment Overview Report

90. Copyright © 1995-2007 Questionmark Corporation and/or Questionmark Computing Limited, known collectively as Questionmark. All rights reserved. Questionmark is a registered trademark of Questionmark Computing Limited. All other trademarks are acknowledged. Slide 90 Export to ASCII  Export results for a single assessment or a selected group of assessments to an ASCII text file  Files can then be imported into other tools E.g. SPSS  Includes Question detail Topic analysis  Specify file parameters Include column headings Field delimiters Percentage format Date format

91. Copyright © 1995-2007 Questionmark Corporation and/or Questionmark Computing Limited, known collectively as Questionmark. All rights reserved. Questionmark is a registered trademark of Questionmark Computing Limited. All other trademarks are acknowledged. Slide 91 Export to ASCII Export data for a single assessment or multiple assessments Use advanced search capabilities to identify the assessments for reporting

92. Copyright © 1995-2007 Questionmark Corporation and/or Questionmark Computing Limited, known collectively as Questionmark. All rights reserved. Questionmark is a registered trademark of Questionmark Computing Limited. All other trademarks are acknowledged. Slide 92 Export for Excel  Export data on a single assessment to an MS Excel spreadsheet Includes results data and question data  Enables further analysis and manipulation of results  Enables more control over format and layout of data

93. Copyright © 1995-2007 Questionmark Corporation and/or Questionmark Computing Limited, known collectively as Questionmark. All rights reserved. Questionmark is a registered trademark of Questionmark Computing Limited. All other trademarks are acknowledged. Slide 93 Export for Excel

94. Copyright © 1995-2007 Questionmark Corporation and/or Questionmark Computing Limited, known collectively as Questionmark. All rights reserved. Questionmark is a registered trademark of Questionmark Computing Limited. All other trademarks are acknowledged. Slide 94 Coaching Report  Provides a detailed view of how an individual participant performs on a single assessment  Includes detailed information on individual questions Type of question Outcomes chosen/Possible outcomes Answers given Actual score/Maximum score Feedback presented and much more  Includes topic analysis  Excellent tool for feedback and remediation  Can be linked to from the Grade Book and Transcript reports

95. Copyright © 1995-2007 Questionmark Corporation and/or Questionmark Computing Limited, known collectively as Questionmark. All rights reserved. Questionmark is a registered trademark of Questionmark Computing Limited. All other trademarks are acknowledged. Slide 95 Coaching Report

96. Copyright © 1995-2007 Questionmark Corporation and/or Questionmark Computing Limited, known collectively as Questionmark. All rights reserved. Questionmark is a registered trademark of Questionmark Computing Limited. All other trademarks are acknowledged. Slide 96 Coaching Report – Topic Analysis

97. Copyright © 1995-2007 Questionmark Corporation and/or Questionmark Computing Limited, known collectively as Questionmark. All rights reserved. Questionmark is a registered trademark of Questionmark Computing Limited. All other trademarks are acknowledged. Slide 97 Score List Report  Generate a list of scores for different participants for a single assessment  Include link to Coaching report for details on an individual’s performance

98. Copyright © 1995-2007 Questionmark Corporation and/or Questionmark Computing Limited, known collectively as Questionmark. All rights reserved. Questionmark is a registered trademark of Questionmark Computing Limited. All other trademarks are acknowledged. Slide 98 Score List Report

99. Copyright © 1995-2007 Questionmark Corporation and/or Questionmark Computing Limited, known collectively as Questionmark. All rights reserved. Questionmark is a registered trademark of Questionmark Computing Limited. All other trademarks are acknowledged. Slide 99 Grade Book Report  Generate a list of participants with their associated assessment results for more than one assessment  Define a list of assessments to include in report This list can include all assessments used in a given course, for example.  Assign weights to assessments Useful for calculating cumulative scores where the scores of certain assessments comprise a greater percentage of the cumulative score than those for other assessments  Include link to Coaching report for details on an individual’s performance

100. Copyright © 1995-2007 Questionmark Corporation and/or Questionmark Computing Limited, known collectively as Questionmark. All rights reserved. Questionmark is a registered trademark of Questionmark Computing Limited. All other trademarks are acknowledged. Slide 100 Grade Book Report

101. Copyright © 1995-2007 Questionmark Corporation and/or Questionmark Computing Limited, known collectively as Questionmark. All rights reserved. Questionmark is a registered trademark of Questionmark Computing Limited. All other trademarks are acknowledged. Slide 101 Transcript Report  Generate a list of all assessments and their associated results taken by an single participant  Include link to Coaching report for details on a single assessment

102. Copyright © 1995-2007 Questionmark Corporation and/or Questionmark Computing Limited, known collectively as Questionmark. All rights reserved. Questionmark is a registered trademark of Questionmark Computing Limited. All other trademarks are acknowledged. Slide 102 Transcript Report

103. Copyright © 1995-2007 Questionmark Corporation and/or Questionmark Computing Limited, known collectively as Questionmark. All rights reserved. Questionmark is a registered trademark of Questionmark Computing Limited. All other trademarks are acknowledged. Slide 103 Gap Report  Used to compare two sets of results Compare the performance of two groups Compare pre-course test results to post-course test results  Displays differences graphically  Displays assessment score histogram and topic score histogram for each group

104. Copyright © 1995-2007 Questionmark Corporation and/or Questionmark Computing Limited, known collectively as Questionmark. All rights reserved. Questionmark is a registered trademark of Questionmark Computing Limited. All other trademarks are acknowledged. Slide 104 Gap Report

105. Copyright © 1995-2007 Questionmark Corporation and/or Questionmark Computing Limited, known collectively as Questionmark. All rights reserved. Questionmark is a registered trademark of Questionmark Computing Limited. All other trademarks are acknowledged. Slide 105 Survey Report  Ideal for reporting on reaction assessments E.g. Course evaluations, Level 1 evaluations  Graphically displays frequency of responses  Calculates mean score for each question

106. Copyright © 1995-2007 Questionmark Corporation and/or Questionmark Computing Limited, known collectively as Questionmark. All rights reserved. Questionmark is a registered trademark of Questionmark Computing Limited. All other trademarks are acknowledged. Slide 106 Survey Report

107. Copyright © 1995-2007 Questionmark Corporation and/or Questionmark Computing Limited, known collectively as Questionmark. All rights reserved. Questionmark is a registered trademark of Questionmark Computing Limited. All other trademarks are acknowledged. Slide 107 Question Statistics  Derive useful statistics on individual questions  Analyze questions by assessment or by individual topic  Use information to improve quality of your measurements

108. Copyright © 1995-2007 Questionmark Corporation and/or Questionmark Computing Limited, known collectively as Questionmark. All rights reserved. Questionmark is a registered trademark of Questionmark Computing Limited. All other trademarks are acknowledged. Slide 108 Question Statistics

109. Copyright © 1995-2007 Questionmark Corporation and/or Questionmark Computing Limited, known collectively as Questionmark. All rights reserved. Questionmark is a registered trademark of Questionmark Computing Limited. All other trademarks are acknowledged. Slide 109 Item Analysis Report  Provides detailed psychometric statistics on individual question P Value (difficulty) Item/Outcome discrimination Item/Outcome correlation  Facilitates quality assurance measures for soundness, fairness, and validity Identify items that are too easy or too hard Identify items that do not discriminate well between high performers and low performers Identify items that do may not be valid as their correlation between a correct answer and a good score on the assessment is weak

110. Copyright © 1995-2007 Questionmark Corporation and/or Questionmark Computing Limited, known collectively as Questionmark. All rights reserved. Questionmark is a registered trademark of Questionmark Computing Limited. All other trademarks are acknowledged. Slide 110 Item Analysis Report

111. Copyright © 1995-2007 Questionmark Corporation and/or Questionmark Computing Limited, known collectively as Questionmark. All rights reserved. Questionmark is a registered trademark of Questionmark Computing Limited. All other trademarks are acknowledged. Slide 111 Item Analysis Report

112. Copyright © 1995-2007 Questionmark Corporation and/or Questionmark Computing Limited, known collectively as Questionmark. All rights reserved. Questionmark is a registered trademark of Questionmark Computing Limited. All other trademarks are acknowledged. Slide 112 Reporting Security  Specify which reports an administrator can run  Specify if administrator can run reports on results for all groups or just those to of which he or she is a member