1. Mirjana Ivanović, Zoran Budimac Aleksandra Klašnja-Milićević, Boban Vesin, University of Novi Sad, Faculty of Sciences Novi Sad, Serbia Possibilities to Improve Web-based Assessment in Programming Courses

2. AGENDA  Introduction  Educational systems and TEL for improving students assessment  Personalization as a way of improving students’ testing and assessments  Integrated learning system for better assessment  Pedagogical Agents as instruments for increasing assessment quality  Conclusion

3. Introduction  E-learning - fastest growing form of education in the last decade  Diversity of requirements for commercial learning environments – no a single monolithic system  Multifunctional systems are needed -content production -mechanisms for students’ communication and collaboration -high quality student modeling  Department of Mathematics and Informatics -Moodle -Integrated in-house tools  MILE - on-line courses, testing, automated feedback

4. AGENDA  Introduction  Educational systems and TEL for improving students assessment  Personalization as a way of improving students’ testing and assessments  Integrated learning system for better assessment  Pedagogical Agents as instruments for increasing assessment quality  Conclusion

5. Educational systems and TEL for improving students assessment  Support for several programming courses – extensive practical tasks  Various aspects of Technology Enhanced Learning are utilized: -Learning Management Systems and Tutoring Systems LMS Moodle, MILE – learning, testing acquired knowledge, assessments programming practical tasks

6. Educational systems and TEL for improving students assessment -Programming Environments and Assessment Tools BlueJ, Eclipse, Jeliot Svetovid – prevent cheating, make easier assessment of students’ practical solutions -Communication and Cooperation Moodle Chat sessions, discussion forums, instant messages, e-mail Wikis for team work on SE projects

7. AGENDA  Introduction  Educational systems and TEL for improving students assessment  Personalization as a way of improving students’ testing and assessments  Integrated learning system for better assessment  Pedagogical Agents as instruments for increasing assessment quality  Conclusion

8. Personalization as a way of improving students’ testing and assessments  Internet research and survey methodology -promising area -offers powerful advantages over traditional modes of survey, questionnaire and assessment.  Testing of learner’s knowledge - demanding functionality of the e-learning systems  Our motivation: support of assignments of students’ programming solutions

9. Personalization as a way of improving students’ testing and assessments  MILE – general architecture -Multifunctional integrated learning environment -Learning styles recognition and content recommendation ( Felder-Silverman Learning Styles Model ) -Tests with numerous multiple-choice questions, code completion tasks  First practically used/tested version -Increasing assessment and testing functionalities for Java programming course -More accurate learner modelling

10. AGENDA  Introduction  Educational systems and TEL for improving students assessment  Personalization as a way of improving students’ testing and assessments  Integrated learning system for better assessment  Pedagogical Agents as instruments for increasing assessment quality  Conclusion

11. Integrated learning system for better assessment  The goal is to improve assessment of the learners in computer labs or over a network/internet  Testovid system - instructor has great flexibility in specifying how and what is to be tested (in programs)  Integrated version of MILE with Testovid brings new functionalities -do on-line programming -self-assessment programming tasks during course and final assessment of gained programming skills -submission of programs/solutions and receiving automated feedback and errors report -final exams via Internet or in computer laboratory

12. Integrated learning system for better assessment  Integration of the Assessment module in MILE

13. AGENDA  Introduction  Educational systems and TEL for improving students assessment  Personalization as a way of improving students’ testing and assessments  Integrated learning system for better assessment  Pedagogical Agents as instruments for increasing assessment quality  Conclusion

14. Pedagogical Agents as instruments for increasing assessment quality  Instruments for increasing learning and assessment quality, motivation  Web-based educational systems employ different recommendations and scaffolding techniques -pedagogical agents (Provoking and Zestful) -guide interactively learners through the learning process  Hints for solutions are prepared according to role of agents -Zestful agent - includes useful hints to guide student -Provoking agent - includes somehow wrong /misleading hints to confuse student, make them more concentrated

15. Pedagogical Agents as instruments for increasing assessment quality  MILE system with two kinds of agents (Provoking and Zestful )

16. Pedagogical Agents as instruments for increasing assessment quality

17. AGENDA  Introduction  Educational systems and TEL for improving students assessment  Personalization as a way of improving students’ testing and assessments  Integrated learning system for better assessment  Pedagogical Agents as instruments for increasing assessment quality  Conclusion

18. Conclusion  Faculty of Sciences, Department of Mathematics and Informatics  Different web-based tools for: -e-learning -e-testing -e-assessment  LMS Moodle has been using predominantly for testing students’ theoretical knowledge combining in questionnaires different types of questions.  For practical students’ program solutions: -TEL tools and facilities -MILE - Multifunctional integrated learning environment

19. Mirjana Ivanović, Zoran Budimac Aleksandra Klašnja-Milićević, Boban Vesin, University of Novi Sad, Faculty of Sciences Novi Sad, Serbia Possibilities to Improve Web-based Assessment in Programming Courses