Dimensions and parameters for the evaluation of e-learning Dr. Bernhard Ertl

Why evaluation? To ensure the quality of the learning environment To ensure acceptance of the learning environment To learn about learners´ needs To prove the value and benefits of the environment to financers and participants

Results of an Evaluation Increased knowledge of learning processes Knowledge of the effectiveness of the learning environment  Target-group-specific improvements

Evaluation Forms Formative Evaluation –Takes place during the course Summative Evaluation –Takes place at the end of the course

Formative evaluation Analysis of the learning process: –Discovering problems –Optimisation of the learning environment

Summative Evaluation Analysis of the outcomes: –Knowledge gain –Acceptance

Evaluators Learners Teachers Experts –Internal –External

Dimensions of evaluation Cognitive dimension – do the learners have the necessary strategies to work in the learning environment? Epistemological dimension – the structure and implementation of the content Social dimension –available facilitation, tutoring and sociability Technical dimension – usability and technical support offered

Cognitive Dimension Learning prerequisites -Does the learning environment allow learners to activate existing knowledge? -Do the learners have required prior knowledge? Learning strategies -Which strategies are encouraged in the environment? -Are the learners supported in their use of strategies?

Epistemological Dimension Appropriateness of content -Who is the target group? -Is the content up-to-date? Didactical design -Based on a particular education theory? -Which concrete learning goals? Acceptance -Would participants recommend the course? -Did it meet their expectations?

Social Dimension Facilitation -To what extent do the users receive support in collaborative learning? -Do tutors and pupils have set roles and tasks? Sociability -Are the face-to-face and online elements well integrated? -Is there a positive social environment within the groups?

Technical Dimension Usability -Are the tools appropriate and adequate? -Usability and design of the environment? Support -Is the technical support offered to the users adequate?

Evaluation Model during Implementation Planning phaseImplementation Aims Appropriateness Didactical Design Learning prerequisites Learning strategies Appropriateness Didactical Design Learning prerequisites Learning results Fulfillment of aims Acceptance formative summative Pilot Learning processes Learning strategies Sociability Technical Support Learning prerequisites

Evaluation during productive Use Learners in learning environment formative: summative: learning process outcomes acceptance Analysis of test results Addition of necessary changes

Summary Evaluation is key to any e-learning project Evaluation may take place continuously throughout a project A number of parameters must be considered in order to evaluate a learning environment as a whole

Thank you for your attention