1. Marc Brierley SAMigo Lead Designer Stanford University (aka Tests & Quizzes ) A ssessment M anager I G O

2. Agenda Feature Overview –Focus on pedagogical flexibility using assessment types Short Demo Futures Q&A

3. What are SAMigo’s features: Assessment Authoring Assessment Publishing Assessment-Taking Management Assessment Grading Question Pools Management Assessment-Type Management

4. Why “Assessments”? More than just test and quizzes For Example: –Problem Sets –Formative Assessments –Surveys The name “Tests and Quizzes” is a compromise

5. Organize & Publish Assessments Core (pending) Assessments for a course –Starting page for assessment authoring –Can be ex/imported in QTI XML format –When ready, published via Settings Published Assessments for student assessment-taking –When students respond, scores link appears –Can change release, due, retract dates

7. Question Types Multiple Choice (single and multiple correct) Multiple Choice Survey True/False Matching Essay/Short Answer Fill in the Blank File Upload Audio Recording

9. Rich-Text & Attachments At all levels of assessment authoring: – assessment/part headers –questions –selections –feedback

10. Pedagogical Flexibility Online test Self-study questions Homework, problem-sets Paper, code, or project submission Language drills Quick knowledge probes Surveys Others???

11. Assessment Types Create assessment “types” for different disciplines, different uses Hide complexity by selecting what which settings are visible to the instructor. Pre-set defaults by making setting choices for the type (e.g., Self-study always has immediate feedback)

12. Assessment Creation Workflow

18. Online Test Unique tests for each student –Randomized order of questions –Randomized draw from question pools Timed test-taking during access window –Auto-submit at end of timed period One submission only per student Higher Security –IP Addresses restricted –Secondary Password (proctored) No late submissions accepted Scores transferred to gradebook

20. Self-Study Questions Immediate feedback Random access to Questions –Table of contents –Marked for review list No record of score in gradebook No due date; always available to student Unlimited submissions allowed

22. Homework/Problem Sets Published with multiple release and due dates for different sections Multiple methods for handling late submissions Students can save work during assignment period. Auto-grading with methods for diagnosing learning problems Quick-reviews of student aggregate performance by instructors viewing histograms, statistics. Pools for organizing questions for reuse

23. Essay and Project Submission Use file upload question type for submitting any type of document Grader can download assignment; upload marked-up file to return to student Grades are recorded in gradebook

24. Question Pools Organize questions into multiple subpools Author Questions from within Pool Mgr. Randomly draw from pools for an assessment

27. Demo

57. 2.4 Highlights email students from 'Scores' screens give individual students permission to re- take an assessment imported from other Sakai Sites via Site Info import/export of assessments with attachments Importing of assessments to Question Pools

58. 2.4 Highlights (contributions) Importing of assessments to Question Pools. (Lisa Wilson, UC Davis) Importing simple text formatted assessments using Word-2-QTI converter. (James Renfro, UC Davis, based on code from Claremont McKenna College) i18n Internationalization/localization support implemented. (Diego del Blanco Orobitg, Universidad Politécnica de Valencia)

59. 2.5 Roadmap and beyond 2.5 –ability to edit a published assessment –performance enhancements based on recent load testing recommendations

60. Questions?

61. Contacts Marc Brierley, Stanford University Lead Designer marc.brierley@stanford.edu Lydia Li, Stanford University Project Manager lydial@stanford.edu Homepage: http://confluence.sakaiproject.org/confluence/display/SAM