Presentation is loading. Please wait.

Presentation is loading. Please wait.

JENNIFER FREEMAN Online Course Design EVALUATION AND REVISION Online Course Design.

Similar presentations


Presentation on theme: "JENNIFER FREEMAN Online Course Design EVALUATION AND REVISION Online Course Design."— Presentation transcript:

1 JENNIFER FREEMAN Online Course Design EVALUATION AND REVISION Online Course Design

2 Understand the difference between assessment and evaluation Define formative, summative and confirmative evaluation and understand the importance of each Explore theories and methods of evaluation Create a course evaluation and revision plan Session Goals

3 Evaluation: measuring the quality and effectiveness of learning materials and activities Assessment: measuring students learning and achievement of goals and objectives Evaluation vs. Assessment

4 Objectives and alignment Quality of instructional materials, resources, strategies Tools and technology Testing instruments Evaluation chart What Do We Evaluate?

5 Why? Uncover problems early on; fix broken stuff Discover potential usability/accessibility issues Examine effectiveness and improve functionality Dynamic nature of online learning Formative Evaluation of Instructional Materials

6 What? When? An ongoing process, usually done both during development and while being taught Asks the question, How are we doing? Formative Evaluation of Instructional Materials

7 Who will use this evaluation information? How? What should be evaluated? Formative Evaluation

8 Do learning activities and assessments align with the learning objectives? Do learning materials meet quality standards? Are the technology tools appropriate and working properly? Formative Evaluation: Questions to Ask

9 Course development rubrics Checklists Focus group feedback –consistency and repeatability Help desk error logs Students Faculty notes Formative Evaluation: Gathering data

10

11

12

13 Checkpoint #1 – syllabus, outline and first lesson Checkpoint #2 – half of the course, viewed on multiple platforms Checkpoint #3 – Entire course proofread/edited Checkpoint #4 – Entire course tech reviewed Checkpoint #5 – Final check (previous errors) Student survey after first three lessons Instructor survey after first three lessons Examination of help desk error logs Sample Formative Evaluation and Revision Plan During development Course is Live

14 1.Analysis of problems found 2.Assign each issue a priority score 3.Establish a threshold 4.Prioritized list of change requests 5.Assign corrections 6.Make note of unaddressed issues Sample Formative Evaluation and Revision Plan

15 Why? –Examine effectiveness –Improve functionality –Discover causes for failures –Constant maintenance and improvements What? When? –Usually done after the completion of each semester –Asks the question, How did we do? Summative Evaluation

16 Who will use this evaluation information? How? What should be evaluated? Summative Evaluation

17 Student success –grades –learning activities, assignments and assessments –time Instructor and student satisfaction –learning materials –motivation –tools Are program/department needs being met –accreditations, prerequisites for other courses, competencies –Is the course scalable? Summative Evaluation: Questions to Ask

18 Student grades Student surveys Instructor satisfaction surveys Learner self-assessments Pretest/posttest comparisons Assessment item analysis Focus group feedback Help desk error logs Discussion forum and chat archives Summative Evaluation: Gathering data

19

20

21 Analyze surveys; identify themes or trends Analyze assessment results Analyze help desk logs Examine course archives Compile list of issues Research solutions Assign priority ratings Assign tasks and establish deadlines Sample Summative Evaluation and Revision Plan

22 Why? long-term effectiveness large-scale issues What? When? after the completion of each semester How are we doing now? Confirmative Evaluation

23 Who will use the evaluation information? How? What is being evaluated? Confirmative Evaluation

24 program/department needs trends in student satisfaction scalability/sustainability tools and technology Confirmative Evaluation: Questions to Ask

25 Program student surveys Departmental administrative opinions Faculty peer review of learning materials Employer surveys Retention data Help desk logs LMS effectiveness study / survey Confirmative Evaluation: Gathering data

26 cost server space adequate maintenance needs being met vendor/software standards reliability security customization course structure and presentation Common LMS Evaluation Criteria

27 tracking assessment collaboration tools productivity tools documentation and training vendor reputation and position Common LMS Evaluation Criteria

28

29

30 is it accessible? is it scaleable? is it sustainable? Evaluation Activity

31 Jennifer Freeman


Download ppt "JENNIFER FREEMAN Online Course Design EVALUATION AND REVISION Online Course Design."

Similar presentations


Ads by Google