1. EQO Workshop – University of Piraeus, 26 November 2004 SEEQUEL S ustainable E nvironment for E valuation of QU ality in E-L earning Dr Nikitas Kastis Lambrakis Research Foundation – MENON Network

2. EQO Workshop – University of Piraeus, 26 November 2004 Objectives To define a Conceptual Framework for Analysis, corresponding to a holistic approach to Quality in e- learning, to serve as a basis for a productive long-term dialogue and consensus building between the stakeholders in Europe. To establish the European eLearning Quality Forum, with representation from all relevant bodies, organizations and authorities in Europe, as a sustainable forum for dialogue, consensus building and policy support in the field To develop a set of eLearning Quality Tools

3. EQO Workshop – University of Piraeus, 26 November 2004 Partnership MENON Network EEIG (Coordinator): Scienter, Lambrakis Research Foundation, FIM - New Learning, HUT Dipoli eLearning Industry Group (eLIG): Accenture, Sanoma WSOY, SAP, SUN Microsystems CEDEFOP (European Centre for Vocational Education & Training) EIfeL (European Institute for e-Learning) EDEN (European Distance & E-Learning Network) EUROPACE ESIB – European Students Association University of Reading & University of Edinburgh

4. EQO Workshop – University of Piraeus, 26 November 2004 1. Mapping of approaches to quality Stakeholders typology Industry providing e-Learning Industry as users (HR departments, etc.) Government (EU / national / regional) K12 (providers, learners, parents and proxies, teachers) Higher education (providers, learners, teachers) Initial VET (providers, learners, teachers) Informal learning (providers, learners, trainers?) Continuous Professional Development (providers, learners, trainers)

5. EQO Workshop – University of Piraeus, 26 November 2004 S R V Perception Stakeholder Object LE LSLPLC Quality of Learning experience 2. Conceptual Framework

6. EQO Workshop – University of Piraeus, 26 November 2004 Value features The World of InspirationSingularity, difference, innovation, originality, irrationality, imaginary, spirituality, unconscious, chance The Domestic WorldConfidence, responsibility, merit, respectability, convention, dignity, tradition, hierarchy, rank; parents, children, generation; rules and confidence, principles; harmony; the "natural"; the duty The World of OpinionImage, reputation, fame, success, honour, acknowledgement, visibility, audience, credibility, identification Visions of the World (adapted from Boltanski and Thévenot) 1/2

7. EQO Workshop – University of Piraeus, 26 November 2004 Value features The Civic WorldThe general will, the common interest, generosity, self-abnegation, sacrifice, pride, the group, collective action, collective entities (ideas, values, symbols and institutions). The Merchant WorldWealth, money, luxury; business, fair deals, good deals, bargain; interest, attentions to others; contract; competition, rivalry, opportunism, freedom, The Industrial WorldProgress, future, functionality, efficiency, optimality, performance, productivity, professionality, reliability, far-sightedness, system Visions of the World (adapted from Boltanski and Thévenot) 2/2

8. EQO Workshop – University of Piraeus, 26 November 2004 Learning experience Learning Sources Teachers CV/ Qualification Learn. Materials Reference Materials Components Core learning processes Guidance/Re cruitment/TN A/ Planning Design (Guidance Principle) Delivery (T&L) Evaluation Learning context Institutional setting Centralised/ Decentralised curriculum Culture (nat., org.,prof., gen.) Learn. Environm. Legislation Financial Values system

9. EQO Workshop – University of Piraeus, 26 November 2004 Learning Sources Teachers CV/Qualification Learn. Materials Reference Materials Components Example of area specific criteria Pedagogical Quality Content updating potential/reliability Technical Quality Portability (techn.) Integration potential (context/org) Adaptability (context/indiv.) Aestethics Quality – Attractiveness - Empathy IPR conformance Learning experience

10. EQO Workshop – University of Piraeus, 26 November 2004 Core Learning Process Guide - Recruitment Design (Guidance principle) Delivery (T&L) Evaluation Example of area specific criteria Tracking progress Interaction Learning Motivation Open endedness Collaboration Production of change Effectiveness (Pedag.) Efficiency (Econ.) Learning experience

11. EQO Workshop – University of Piraeus, 26 November 2004 L. context Institutional setting Centralised/ decentralised curriculum Culture (nat., org., prof., gen.) Equipment and connectivity Learn. Environm. Legislation Financial rules Values system Examples of area specific criteria Supportiveness (climate + service) Open-mindedness Tolerance to mistakes Valorisation of learning results Encouraging implementation Learning experience

12. EQO Workshop – University of Piraeus, 26 November 2004 SEEQUEL on the web

13. EQO Workshop – University of Piraeus, 26 November 2004 3. European Quality Forum

14. EQO Workshop – University of Piraeus, 26 November 2004 European Quality Forum 1.What can you find there? Desk research results Desk research results More than 800 registered users More than 800 registered users Analysis of different approaches, methods, criteria Analysis of different approaches, methods, criteria Ongoing documentation Ongoing documentation SEEQUEL consortium discussion SEEQUEL consortium discussion Workshops: presentation, discussion, findings Workshops: presentation, discussion, findings Documents: revision of initial analysis, integrating the Communities views Documents: revision of initial analysis, integrating the Communities views

15. EQO Workshop – University of Piraeus, 26 November 2004 Identifies needs for Quality Tools Checks availability at international level Proposes new Tools or improvements/adaptations Gives mandate to Working Groups for progress Evaluate progress and results 4. SEEQUEL Quality Lab The Quality Lab uses Forum s input to produce Tools

16. EQO Workshop – University of Piraeus, 26 November 2004 Goals of the Quality Laboratory a)facilitate long-term discussion, exchange of ideas, experiences, good practice and knowledge consolidation ­ as a policy support mechanism at the European level b)provide a highly reliable and value-added environment offering a consistent approach for the testing and certification of Quality Assurance Frameworks, addressing the practical requirements for the effective development of learning technologies and learning services It is an experts environment to validate quality assurance schemes for e-learning content and practice and to disseminate good practice to both the industry and the Education and Training users.

17. EQO Workshop – University of Piraeus, 26 November 2004 The CF-Forum-Laboratory Link Position / identity (stakeholder s identity) Consider objects and weight criteria Choose approach to quality Implement Report / share Compare Improve your approach

18. EQO Workshop – University of Piraeus, 26 November 2004 5. The SEEQUEL Working Groups WP1 Review of supply/industr y approach to quality WP4 eLearning Quality Forum WP4 eLearning Quality Forum WP2 Review of demand/E&T approach to quality WP6 Tools development for industry WP7 Tools development for E&T Community WP9 – Project Management and Evaluation WP8 Forum Web support and dissemination WG2 WG4 WG5 WG … WG1WG3 WP3 Development of conceptual framework WP5 ELearning Quality Laboratory

19. EQO Workshop – University of Piraeus, 26 November 2004 5. The SEEQUEL Working Groups WG 1 Coordination of the Quality Lab WG 2 Core Quality Framework WG 3 User guide WG 4 Informal learning WG 5 Industry WG 6 Self positioning path - accompanying the user through the process WG 7 External Coordination

20. EQO Workshop – University of Piraeus, 26 November 2004 6. The SEEQUEL Tools Core Quality Framework & eLearning Quality Guide for the User (Learner) (e-)Learner s Bill of Rights Reaching eLearning Quality in Informal Learning Quality Analysis Tool (for the industry)

21. EQO Workshop – University of Piraeus, 26 November 2004 What is next?

22. EQO Workshop – University of Piraeus, 26 November 2004 Contacts-Information- Contribution to the discussion Contacts-Information- Contribution to the discussion www.education-observatories.net/seequel www.education-observatories.net/seequel fabio.nascimbeni@menon.org