1. 1 Assessment and Evaluation for Online Courses Associate Professor Dr. Annabel Bhamani Kajornboon (kannabel@chula.ac.th) CULI’s 6 th Intl Conference: Facing ELT Challenges Nov. 27- 29, 2006

2. 2 Focus Assessment Evaluation

3. 3 Introduction Computers a part of education T technology & pedagogical problems T concern attend seminars, conferences etc. “In keeping with a learner-centered approach, evaluation and assessment should be part of the learning-teaching process, embedded in class activities and in the interactions between learners and teachers” (Harasim et al. 1996:167).

4. 4 Terminology E-learning and online – interchangeably Assessment– -the act of judging or assessing a person, situation or event -learning outcomes assessment provides what ss know and can do at specific points designed to improve learning

5. 5 Evaluation (1) Assess effectiveness of an ongoing program in achieving its objective(s) Relies on standards of project design to distinguish a program’s effect from those of other forces Aims at program improvement through a modification of current operation

6. 6 Evaluation (2) Collect infor. (assessments) to make informed decisions about continued instruction, programs, or activities. Evaluation can assess both the process and outcomes. Judging the quality, value or worth of a program or student performance using established criteria, using gathering data.

7. 7 Evaluation (3) Process of determining the adequacy, value, outcomes and impact of instruction & learning, Assessment at a point in time of the value, worth of impact of a project or program, Can be conducted at various points in a project.

8. 8 Technolog y E-learning course TeacherStudents Chart 1: Linkage of e-learning courses to assessment and evaluation Assessment & Evaluation s

9. 9 Action-Reflection Cycle Planning Reflecting Acting Observing

10. 10 Websites Assessments Quiz Test Papers Let's look at examples of websites assessment

11. 11 Examples of Websites Assessments Example A: About English as a 2nd Language Prepositions of Place – in/at/on- There are 15 questions. Ss click the mouse to answer the question. Ss are given 10 seconds to answer each question with only one correct answer. Feedback is provided at the end of the quiz.

12. 12 Example A: About English as a 2nd Language Prepositions of Place – in/at/on

13. 13 Example A: About English as a 2nd Language Prepositions of Place – in/at/on (2) Last line from previous example: More prepositions quizzes Example B: About English as a 2nd Language Prepositions of Place – in/at/on- Feedback is given for correct answer

14. 14 Example B: About English Language Prepositions of Place – in/at/on-

15. 15 Example C: About English as a 2nd Language Prepositions of Place – in/at/on- If ss do not click an answer the following appears

16. 16 If students click the incorrect answer the following appears look at Example D: About English as a 2nd Language Prepositions of Place – in/at/on-

17. 17 Example D: Prepositions of Place That answer was not correct.

18. 18 Example E: Lang. Prep. of Place (1) When students complete the quiz, the score will appear and other quizzes are offered. Let’s look at the score and what else is offered.

19. 19 Example E: Lang. Prep. of Place (2)

20. 20 Other form of assessments Electronic portfolios Computer-based work checklist Peer review Sheets Close texts Learning logs Multimedia projects

21. 21 Example G: Example of Portfolio Scoring Rubric

22. 22 E-portfolio It is a collection of students’ work that shows students’ efforts, progress, and achievements in more or more areas or the curriculum.

23. 23 Example H: E-portfolio

24. 24 Example I: E-portfolio

25. 25 What to include in an e- portfolio? Collection can include: Ss participation in selection content Criteria for selection Criteria for judging merits Evidence of ss self-reflection A collection of ss best work or efforts, ss choose samples to meet assignment. Show growth & development.

26. 26 What is necessary to create e-portfolio? Equipment Software Training Play Plan An assessment tool depending on knowledge level of T, time T have & can invest

27. 27 Example J: Example of an e-portfolio

28. 28 E-Portfolio An e-portfolio is an organized, purposeful collection of students’ work that displays knowledge, understanding, skills, accomplishments, interest and achievement over a period. Time and planning is essential.

29. 29 Example l: Sarah’s work

30. 30 Example M: T’s feedback (1)

31. 31 Evaluation (1) The evaluation can be conducted via qualitative methods which are often used. They tell the program’s story by capturing and communicating the participants’ stories. The action-reflection cycle can be used.

32. 32 Evaluation (2) It would be assessing the program. Systematic collection of information about the activities characteristics, and outcomes of programs to make judgments about the program, improve program effectiveness and/or inform decisions about future programs.

33. 33 An Example of Evaluation (Research) (1) Ajarns teaching oral com. courses were interviewed to find out the predicaments they were facing. What were some of the problems they had encountered teaching, The interviews were analyzed. The data was presented in a matrix form to find a common thread.

34. 34 An Example of Evaluation (Research) (2) Kajornboon (2005) investigated issues that teachers face in teaching oral com. in the Thai context and examined existing teaching method in oral communication that teachers found effective and productive. The study aimed to provide a practical guideline or checklist to assist ajarns in teaching oral communication in order to improve students’ language development.

35. 35 Conclusion Web assessment & evaluation can take many dimensions. T set their goal and know what they want to measure, such as the course, students, or program. T choose to do assessment or evaluation that is best for their students and course.

36. 36 Q & A Comments Questions Thank you Email: kannabel@chula.ac.thkannabel@chula.ac.th annabelbk@yahoo Subj.: assessment/evaluation