2. Engaging Students in the Assessment Process The Conference 2006 Thomson Course Technology's 11th Anniversary Event San Francisco, CA March 30, 3:45 PM – 5:00 PM

3. 2 Who Are We? Montgomery County Community College, Blue Bell, PA  Patricia Rahmlow Assistant Professor, Computer Science prahmlow@mc3.edu prahmlow@mc3.edu  Marie Hartlein Associate Professor, Computer Science mhartlein@mc3.edu mhartlein@mc3.edu  Linda Moulton Professor Mathematics and Computer Science lmoulton@mc3.edu lmoulton@mc3.edu http://faculty.mc3.edu/prahmlow/Presentations/index.html

4. 3 Agenda  Online Assessment Overview  Demonstrations  Textbook Web Sites  Blackboard  SAM  Course Grader  Assessment Integrity  Technical Issues

5. 4 Why Assess Students Online?  Space and time independent

6. 5 Why Assess Students Online?  Immediate feedback

7. 6 Why Assess Students Online?  Learning aide

8. 7 Uses of Online Assessment  Evaluation of student learning  Pre-test  Post-test

9. 8 Uses of Online Assessment  Evaluation of student learning  Assessment of knowledge  Exams  Make-up tests

10. 9 Uses of Online Assessment  Evaluation of student learning  Assessment of knowledge  Self-evaluation  Repetitive testing  Feedback

11. 10 Uses of Online Assessment  Evaluation of student learning  Assessment of knowledge  Self-evaluation  Distance learning assessment  Keeps students as “distance” learners  More convenient for student

12. 11 Online Assessment Tools  Course delivery software  Blackboard  WebCT  Publisher course delivery sites

13. 12 Online Assessment Tools  Course delivery software  Simulated software application testing  SAM  Train IT  SimNet  SNAP

14. 13 Online Assessment Tools  Course delivery software  Simulated software application testing  Free / low-cost quiz sites http://getonline.wichita.edu/transitions/asses s.asp#assessmenttools

15. 14 Online Assessment Tools  Course delivery software  Simulated software application testing  Free / low-cost quiz sites  Textbook web sites  Computer Science Concepts http://csilluminated.jbpub.com/  Information Literacy Concepts http://wps.prenhall.com/bp_evans_techinaction_2/0,10009,1799886-,00.html  Active Help Desk http://media.pearsoncmg.com/ph/bp/bp_evans_tiahelpdeskcd_2/chapter0 3/index.html  Accounting Textbook http://wps.prenhall.com/bp_slater_collacctg_9/0,8786,1172076-,00.html

16. 15 Tool Selection  Cost  Ease of use  Student  Access  Software  Professor  Set-up  Grading (SCORM)  Purpose  Graded assessment  Self-assessment

17. 16 Online Assessment Modes  Time constraints  None  Timed – warning mode  Timed – shut down mode

18. 17 Online Assessment Modes  Time constraints  Number of attempts  One  Multiple  Unlimited  Student specific

19. 18 Online Assessment Modes  Time constraints  Number of attempts  Restricted access  Site password  Assessment password **********

20. 19 Online Assessment Modes  Time constraints  Number of attempts  Restricted access  Survey  Anonymous  Course evaluation ?

21. 20 Blackboard Demonstration  What we will demonstrate

22. 21 Knowledge Based Questions  True/False  Multiple Choice  Matching  Multiple Answer  Ordering  Fill in the Blank  Essay  Calculated Numeric  Calculated Formula  File Response  Hot Spot  Fill in Multiple Blanks  Jumbled Sentence  Opinion Scale/Likert  Short Answer  Either/Or  Quiz Bowl

23. 22 SAM – Why Selected  Remediation tied to textbook  Richer reports  All actions taken by students are recorded  Include a screen shot  Easy installation for student (flash based)  Crash recovery  Adaptive, customized training  Addresses multiple learning styles – observe practice, apply

24. 23 SAM  What we will demonstrate  Also – what types of knowledge based questions are in SAM

25. 24 SAM  Student quotes

26. 25 Performance Based Questions  Open / close files  Search internet  Send email  Format documents  Develop formulas  Query a database

27. 26 Course Grader  What we will demonstrate

28. 27 Assessment Integrity  Timed  Allow use of textbook  Insufficient time to look up all answers

29. 28 Assessment Integrity  Timed  Question pool  Large pool of questions  No two quizzes identical

30. 29 Assessment Integrity  Timed  Question pool  Randomize questions  Facilitates face-to-face use  Less likely to memorize answers

31. 30 Assessment Integrity  Timed  Question pool  Randomize questions  Frequent assessments  Less likely someone else will take assessment

32. 31 Assessment Integrity  Timed  Question pool  Randomize questions  Frequent assessments  Don’t reveal answers  Send answers after exam time ends  Send only correct / incorrect indicator  Time release results

33. 32 Assessment Integrity  Timed  Question pool  Randomize questions  Frequent assessments  Don’t reveal correct answers  Proctored

34. 33 Assessment Integrity  Timed  Question pool  Randomize questions  Frequent assessments  Don’t reveal correct answers  Proctored  Other forms of assessment  “Portfolio” of student ability  Discussions  Homework / Projects

35. 34 Technical Issues  ISP Disconnect  “Passive” assessments  Keep under 30 minutes  Reset quizzes  Question pools  “Active” assessments  Count first recorded response  Pop-up Blockers  Special Software

36. 35 Summary Slide

37. 36 Demonstrations  SAM  http://sam2003.course.com http://sam2003.course.com  Blackboard  https://my.mc3.edu/ https://my.mc3.edu/  Textbook web sites  Computer Science Concepts http://csilluminated.jbpub.com/  Information Literacy Concepts http://wps.prenhall.com/bp_evans_techinaction_2/0,10009,17998 86-,00.html  Active Help Desk http://media.pearsoncmg.com/ph/bp/bp_evans_tiahelpdeskcd_2/c hapter03/index.html  Accounting Textbook http://wps.prenhall.com/bp_slater_collacctg_9/0,8786,1172076-,00.html