Mirjana Ivanović, Zoran Budimac Aleksandra Klašnja-Milićević, Boban Vesin, University of Novi Sad, Faculty of Sciences Novi Sad, Serbia Possibilities to Improve Web-based Assessment in Programming Courses

AGENDA  Introduction  Educational systems and TEL for improving students assessment  Personalization as a way of improving students’ testing and assessments  Integrated learning system for better assessment  Pedagogical Agents as instruments for increasing assessment quality  Conclusion

Introduction  E-learning - fastest growing form of education in the last decade  Diversity of requirements for commercial learning environments – no a single monolithic system  Multifunctional systems are needed -content production -mechanisms for students’ communication and collaboration -high quality student modeling  Department of Mathematics and Informatics -Moodle -Integrated in-house tools  MILE - on-line courses, testing, automated feedback

AGENDA  Introduction  Educational systems and TEL for improving students assessment  Personalization as a way of improving students’ testing and assessments  Integrated learning system for better assessment  Pedagogical Agents as instruments for increasing assessment quality  Conclusion

Educational systems and TEL for improving students assessment  Support for several programming courses – extensive practical tasks  Various aspects of Technology Enhanced Learning are utilized: -Learning Management Systems and Tutoring Systems LMS Moodle, MILE – learning, testing acquired knowledge, assessments programming practical tasks

Educational systems and TEL for improving students assessment -Programming Environments and Assessment Tools BlueJ, Eclipse, Jeliot Svetovid – prevent cheating, make easier assessment of students’ practical solutions -Communication and Cooperation Moodle Chat sessions, discussion forums, instant messages, Wikis for team work on SE projects

AGENDA  Introduction  Educational systems and TEL for improving students assessment  Personalization as a way of improving students’ testing and assessments  Integrated learning system for better assessment  Pedagogical Agents as instruments for increasing assessment quality  Conclusion

Personalization as a way of improving students’ testing and assessments  Internet research and survey methodology -promising area -offers powerful advantages over traditional modes of survey, questionnaire and assessment.  Testing of learner’s knowledge - demanding functionality of the e-learning systems  Our motivation: support of assignments of students’ programming solutions

Personalization as a way of improving students’ testing and assessments  MILE – general architecture -Multifunctional integrated learning environment -Learning styles recognition and content recommendation ( Felder-Silverman Learning Styles Model ) -Tests with numerous multiple-choice questions, code completion tasks  First practically used/tested version -Increasing assessment and testing functionalities for Java programming course -More accurate learner modelling

AGENDA  Introduction  Educational systems and TEL for improving students assessment  Personalization as a way of improving students’ testing and assessments  Integrated learning system for better assessment  Pedagogical Agents as instruments for increasing assessment quality  Conclusion

Integrated learning system for better assessment  The goal is to improve assessment of the learners in computer labs or over a network/internet  Testovid system - instructor has great flexibility in specifying how and what is to be tested (in programs)  Integrated version of MILE with Testovid brings new functionalities -do on-line programming -self-assessment programming tasks during course and final assessment of gained programming skills -submission of programs/solutions and receiving automated feedback and errors report -final exams via Internet or in computer laboratory

Integrated learning system for better assessment  Integration of the Assessment module in MILE

AGENDA  Introduction  Educational systems and TEL for improving students assessment  Personalization as a way of improving students’ testing and assessments  Integrated learning system for better assessment  Pedagogical Agents as instruments for increasing assessment quality  Conclusion

Pedagogical Agents as instruments for increasing assessment quality  Instruments for increasing learning and assessment quality, motivation  Web-based educational systems employ different recommendations and scaffolding techniques -pedagogical agents (Provoking and Zestful) -guide interactively learners through the learning process  Hints for solutions are prepared according to role of agents -Zestful agent - includes useful hints to guide student -Provoking agent - includes somehow wrong /misleading hints to confuse student, make them more concentrated

Pedagogical Agents as instruments for increasing assessment quality  MILE system with two kinds of agents (Provoking and Zestful )

Pedagogical Agents as instruments for increasing assessment quality

AGENDA  Introduction  Educational systems and TEL for improving students assessment  Personalization as a way of improving students’ testing and assessments  Integrated learning system for better assessment  Pedagogical Agents as instruments for increasing assessment quality  Conclusion

Conclusion  Faculty of Sciences, Department of Mathematics and Informatics  Different web-based tools for: -e-learning -e-testing -e-assessment  LMS Moodle has been using predominantly for testing students’ theoretical knowledge combining in questionnaires different types of questions.  For practical students’ program solutions: -TEL tools and facilities -MILE - Multifunctional integrated learning environment

Mirjana Ivanović, Zoran Budimac Aleksandra Klašnja-Milićević, Boban Vesin, University of Novi Sad, Faculty of Sciences Novi Sad, Serbia Possibilities to Improve Web-based Assessment in Programming Courses