1. Assessing Robust SLOs Using Technology Jerry Rudmann and Pat Arlington Coastline Community College Strengthening Student Success Conference ~ October 2006

2. Agenda and Goal Robust SLOs Technology Uses Expected Outcome: Be able to select and use technology to promote and measure achievement of robust student learning outcomes Technology Tools Expected Outcome: Be able to select and use technology to promote and measure achievement of robust student learning outcomes Robust SLOs Technology Uses Expected Outcome: Be able to select and use technology to promote and measure achievement of robust student learning outcomes Technology Tools Expected Outcome: Be able to select and use technology to promote and measure achievement of robust student learning outcomes

3. Robust SLOs Developed through faculty dialog Behavioral/measurable Real-world Higher-level Conditions Performance Criteria Global, over-arching Scored with rubric Developed through faculty dialog Behavioral/measurable Real-world Higher-level Conditions Performance Criteria Global, over-arching Scored with rubric

4. Technology Uses Collaboration Faculty Students Practice Group and Individual Work Self Evaluation Peer Evaluation Authentic Assessment Collaboration Faculty Students Practice Group and Individual Work Self Evaluation Peer Evaluation Authentic Assessment

5. Technology Tools CCC Confer Discussion Forums Online and Scannable Tests and Surveys Online Rubric Builders Turnitin Calibrated Peer Review Classroom Responders ePortfolios CCC Confer Discussion Forums Online and Scannable Tests and Surveys Online Rubric Builders Turnitin Calibrated Peer Review Classroom Responders ePortfolios

6. Discussion Forums Tools Integrated discussion forum in CMS or standalone (e.g., WebBoard by O’Reilly) Uses Practice/enrichment Small-group project-based learning To assess understanding – score with rubric Tools Integrated discussion forum in CMS or standalone (e.g., WebBoard by O’Reilly) Uses Practice/enrichment Small-group project-based learning To assess understanding – score with rubric

7. Online Discussion Rubric Sample

8. CCC Confer Small-group work in project-based learning Assessment of DL students Foreign language classes Speech/oral communication Information literacy Score using discussion or presentation rubric Small-group work in project-based learning Assessment of DL students Foreign language classes Speech/oral communication Information literacy Score using discussion or presentation rubric

9. CCCConfer Screen Shot

10. Scoring an Online Presentation Rubric for Online Presentation Characteristic/ Standard/ Primary Trait Poor 1 Fair 2 Satisfactory 3 Excellent 4 Score TOTAL0

11. Online and Scannable Surveys and Tests Surveys Pre and post surveys of student self evaluation of progress Faculty and business community or advisory groups related to expected learning outcomes Student satisfaction (indirect outcomes) Quizzes/Tests Practice and graded Surveys Pre and post surveys of student self evaluation of progress Faculty and business community or advisory groups related to expected learning outcomes Student satisfaction (indirect outcomes) Quizzes/Tests Practice and graded Cross Match

12. Online Rubric Builders Rubrics to guide and measure learning Tools Rubistar Landmark Rubric Builder Coastline Rubric Builder Rubrics to guide and measure learning Tools Rubistar Landmark Rubric Builder Coastline Rubric Builder

13. RubistarRubistar Rubistar Art History Rubric

14. Rubric Builder Screen Shot

15. Coastline Rubric Builder

16. TurnitinTurnitin Plagiarism Grading (GradeMark)GradeMark Peer Review GradeBook Plagiarism Grading (GradeMark)GradeMark Peer Review GradeBook Peer Review Skip to CPR

17. Turnitin Peer Review Screen Shot Return to TurnitinReturn to Turnitin ~ Next SlideNext Slide

18. Calibrated Peer Review Web-based program that enables frequent writing assignments with minimal impact on instructor time Uses peer review Promotes deeper learning Web-based program that enables frequent writing assignments with minimal impact on instructor time Uses peer review Promotes deeper learning Arlene Russell Co-developer of CPR Videos 1 2 3123 PPTPPT ~ Psych AssignmentPsych Assignment Interpreting ResultsInterpreting Results ~ SkipSkip

19. Psych Assignment: CPR Source Material Learning Goals PPTPPT ~ Psych Assignment ~ Interpreting Results ~ Return to CPR OverviewPsych AssignmentInterpreting ResultsReturn to CPR Overview

20. Psych Assignment: CPR Source Material PPTPPT ~ Psych Assignment ~ Interpreting Results ~ Return to CPR OverviewPsych AssignmentInterpreting ResultsReturn to CPR Overview

21. Psych Assignment: CPR Guiding Questions PPTPPT ~ Psych Assignment ~ Interpreting Results ~ Return to CPR OverviewPsych AssignmentInterpreting ResultsReturn to CPR Overview

22. Psych Assignment: CPR Text Entry PPTPPT ~ Psych Assignment ~ Interpreting Results ~ Return to CPR OverviewPsych AssignmentInterpreting ResultsReturn to CPR Overview

23. Classroom Responders Engage students Monitor student understanding Quickly and easily collect and store assessment data Use publisher item banks or create your own Engage students Monitor student understanding Quickly and easily collect and store assessment data Use publisher item banks or create your own

24. Renaissance Classroom Response System PBS Demo

25. ePortfoliosePortfolios Advantages Document artifacts of learning Support diverse learning styles Authentic assessment Course, program, or degree-level tracking Job skill documentation Proprietary or Open Source ePortfolio and Open Source Portfolio Advantages Document artifacts of learning Support diverse learning styles Authentic assessment Course, program, or degree-level tracking Job skill documentation Proprietary or Open Source ePortfolio and Open Source Portfolio

26. ePortfolio.org Assessment Module Lock Assignments after submission Random selection of assignments by learning objective Anonymity of the student who produced the assignment and the instructor Access to the work and the scoring rubrics Reports to aggregate scores; generate frequencies/means Ability to download raw data which can be analyzed in another format

27. Open Source Portfolio Aligned with Sakai Admins or Faculty can structure and review work Learning matrix documents levels of work Aligned with Sakai Admins or Faculty can structure and review work Learning matrix documents levels of work

28. ResourcesResources CCC Confer: http://www.cccconfer.org http://www.cccconfer.org eListen: http://www.elisten.com http://www.elisten.com Class Climate: http://www.scantron.com http://www.scantron.com Remark Survey Software: http://www.principiaproducts.com/web/index.htmlhttp://www.principiaproducts.com/web/index.html Hot Potatoes : http://hotpot.uvic.ca/http://hotpot.uvic.ca/ Online Rubric Builders Rubistar: http://rubistar.4teachers.org http://rubistar.4teachers.org Landmark Rubric Builder: http://landmark- project.com/classweb/tools/rubric_builder.php http://landmark- project.com/classweb/tools/rubric_builder.php Coastline Rubric Builder: http://rubrics.coastline.edu http://rubrics.coastline.edu Turnitin.com: http://www.turnitin.com http://www.turnitin.com Calibrated Peer Review: http://cpr.molsci.ucla.edu/ http://cpr.molsci.ucla.edu/ Renaissance Classroom Responders: http://www.renlearn.com/renresponder/ http://www.renlearn.com/renresponder/ ePortfolios: ePortfolio.org: http://eportfolio.org http://eportfolio.org Open Source Portfolio: http://www.osportfolio.org/ http://www.osportfolio.org/ For others, see EduTools ePortfolio product comparison: http://eportfolio.edutools.info/item_list.jsp?pj=16 http://eportfolio.edutools.info/item_list.jsp?pj=16 CCC Confer: http://www.cccconfer.org http://www.cccconfer.org eListen: http://www.elisten.com http://www.elisten.com Class Climate: http://www.scantron.com http://www.scantron.com Remark Survey Software: http://www.principiaproducts.com/web/index.htmlhttp://www.principiaproducts.com/web/index.html Hot Potatoes : http://hotpot.uvic.ca/http://hotpot.uvic.ca/ Online Rubric Builders Rubistar: http://rubistar.4teachers.org http://rubistar.4teachers.org Landmark Rubric Builder: http://landmark- project.com/classweb/tools/rubric_builder.php http://landmark- project.com/classweb/tools/rubric_builder.php Coastline Rubric Builder: http://rubrics.coastline.edu http://rubrics.coastline.edu Turnitin.com: http://www.turnitin.com http://www.turnitin.com Calibrated Peer Review: http://cpr.molsci.ucla.edu/ http://cpr.molsci.ucla.edu/ Renaissance Classroom Responders: http://www.renlearn.com/renresponder/ http://www.renlearn.com/renresponder/ ePortfolios: ePortfolio.org: http://eportfolio.org http://eportfolio.org Open Source Portfolio: http://www.osportfolio.org/ http://www.osportfolio.org/ For others, see EduTools ePortfolio product comparison: http://eportfolio.edutools.info/item_list.jsp?pj=16 http://eportfolio.edutools.info/item_list.jsp?pj=16

29. Contact Info Dr. Jerry Rudmann, Supervisor of Research Coastline Community College jrudmann@coastline.edu jrudmann@coastline.edu Pat Arlington, Instructor/Coordinator, Instructional Research Coastline Community College parlington@coastline.edu parlington@coastline.edu Dr. Jerry Rudmann, Supervisor of Research Coastline Community College jrudmann@coastline.edu jrudmann@coastline.edu Pat Arlington, Instructor/Coordinator, Instructional Research Coastline Community College parlington@coastline.edu parlington@coastline.edu