Learning Technology Evaluation Framework (LTEF) A Diagrammatic Overview

Traditional Learning (what was) 1.Instructor-centered 2.Text-based media 3.Individual work 4.Content delivery 5.Recall and memory 6.Exam-based assessment Networked Learning (what is now) 1.Learner-centered 2.Multimedia 3.Collaborative work 4.Information exchange 5.Application and reflective thinking 6.Project based assessment What will be the future? How to Evaluate the future? Learning Technology Evaluation Framework [LTEF]

LTEF WHY? HOW?  Lack of availability of a widely recognised framework  The need to avoid the many bias inherent in most frameworks  The need to position L & T at the top of a hierarchy of evaluation criteria consistent with the stated vision  Identify the principles and models on which the framework is to be established  Lack of availability of a widely recognised framework  The need to avoid the many bias inherent in most frameworks  The need to position L & T at the top of a hierarchy of evaluation criteria consistent with the stated vision  Identify the principles and models on which the framework is to be established The Evaluation is conducted over the entire life-cycle of the technologies, delineated across three stages… STAGE 1 An initial vendor assessment: to determine the suitability, stability and viability of the prospective vendors/open-source solutions STAGE 2 A pre-pilot evaluation score-sheet: to determine the suitability of technology for full pilot evaluation testing in Stage 3 STAGE 3 An on-going full-pilot evaluation: to determine suitability for inclusion in the online platform

LTEF Stage One: Vendor Assessment (1 to 2 days) (determine suitability of vendor and/or open source solution) Stage Two: Pre-Pilot Scoresheet (2 to 4 weeks depending on scale of solution) (determine suitability of technology for Stage Three evaluation) Stage Three: Full Pilot Evaluation (for length of pilot) (determine suitability for the online platform)

Stage Three (LTEF) Evaluation Criteria – L & T Three Sub-Layers of L & T evaluation Sub-layer 1 (also Stage 3): (educational value and usefulness of selected application) Sub-layer 2: Evaluation of learning effectiveness of technologies Sub-layer 3: Evaluation of learning environments that use technologies (course design)

USABILITY Generic Application Specific USEFULNESS EDUCATIONAL VALUE TECHNOLOGY EFFECTIVENESS

LEARNING EFFECTIVENESS TECHNOLOGY EFFECTIVENESS (eLEARNING) TECHNOLOGY EFFECTIVENESS (eLEARNING) LEARNING PROCESS EFFECTIVENESS TEACHING PROCESS EFFECTIVENESS (COURSE DESIGN) TEACHING PROCESS EFFECTIVENESS (COURSE DESIGN)

+ TECHNOLOGY EFFECTIVENESS (eLearning) TECHNOLOGY EFFECTIVENESS (eLearning) USABILITY USEFULNESS EDUCATIONAL VALUE EDUCATIONAL VALUE TEACHING PROCESS EFFECTIVENESS (course design) TEACHING PROCESS EFFECTIVENESS (course design) LEARNING PROCESS EFFECTIVENESS LEARNING PROCESS EFFECTIVENESS LEARNING EFFECTIVENESS LEARNING EFFECTIVENESS