1. University of Duisburg-Essen Information Systems for Production and Operations Research Dr. Jan M. Pawlowski 2004-11-25 E-Learning Quality E-Learning Quality and the International Standardization Perspective Piraeus, 2004-11-25 Dr. Jan M. Pawlowski

2. University of Duisburg-Essen Information Systems for Production and Operations Research Dr. Jan M. Pawlowski 2004-11-25, Slide 1.2 E-Learning Quality Contents Part 1: Quality Research and Standardization: State of the Art Perspectives of Quality Quality Approaches in Europe European Quality Observatory Quality Standardization Part 2: Adaptation of Quality Approaches The Quality Decision Cycle ISO 19796-1 Adaptation / Profiles

3. University of Duisburg-Essen Information Systems for Production and Operations Research Dr. Jan M. Pawlowski 2004-11-25, Slide 1.3 E-Learning Quality University of Duisburg-Essen: Where we are…

4. University of Duisburg-Essen Information Systems for Production and Operations Research Dr. Jan M. Pawlowski 2004-11-25, Slide 1.4 E-Learning Quality Individual Quality Through Standardisation?! Return on Investment Learner Satisfaction Strategic Impact Productivity Personality Development Process Optimization Customer Satisfaction Organizations Success Market Share Media Quality Method Mix Individualization/ Personalization InteroperabilityErgonomics Learning Culture Availability Flexibility Accessibility Individual Quality Profile

5. University of Duisburg-Essen Information Systems for Production and Operations Research Dr. Jan M. Pawlowski 2004-11-25, Slide 1.5 E-Learning Quality Diversity of Quality Approaches & Standards LOM SCORM SGML, XML, RDF, XHTML Author Guide ISO 9241 Accessibility Guidelines DIN Criteria ASTD Criteria Organizations Criteria Implement Learning Scenario Design Learning Scenario Evaluate Learning Scenario …… ISO 9000 EFQM EFQM QAA … … Management Approaches ECTS QoL Bench- marks European DE Guide- lines Media Association Certificate Auto Industry Standard … …

6. University of Duisburg-Essen Information Systems for Production and Operations Research Dr. Jan M. Pawlowski 2004-11-25, Slide 1.6 E-Learning Quality Quality Research Classification Context Branch Sector Culture … Objectives: Learning performance, cost-benefit, financial objectives, motivation, … Dimension: Processes Products Competencies Perspective Learner Provider Author Administrator … Methodology: QM, QA Evaluation Benchmarking … Metrics; Indicators Criteria Which quality approach will suit my organization? Individual Quality National, regional, local requirements Organizational requirements Context Quality Objectives & Goals Quality Instruments … Support by Standards

7. University of Duisburg-Essen Information Systems for Production and Operations Research Dr. Jan M. Pawlowski 2004-11-25, Slide 1.7 E-Learning Quality Quality Standardization CEN/ISSS European Quality Observatory State of the Art : Collection & Analysis of Quality Approaches Conceptual Model DIN State of the Art : Extended Process Model PAS 1032-1 Harmonized QM Model ISO State of the Art: Description Scheme Process Model FCD 19796-1 New Items: ISO 19796-1 Profiles Learning Ressource Transparency Conceptual Model

8. University of Duisburg-Essen Information Systems for Production and Operations Research Dr. Jan M. Pawlowski 2004-11-25, Slide 1.8 E-Learning Quality The Quality Decision Cycle: A Framework for Diversity Analysis of Quality Needs Analysis & Comparison of Approaches Decision Support Adaption/ Implementation Recommend- ations

9. University of Duisburg-Essen Information Systems for Production and Operations Research Dr. Jan M. Pawlowski 2004-11-25, Slide 1.9 E-Learning Quality Decision Cycle: Tools and Models EQO RFDQ/RQC Analysis of Quality Needs Analysis & Comparison of Quality Approaches Decision Support / Harmonisation Adaptation / Implementation Quality Management Approaches Specific Standards / Criteria Quality Assurance Approaches Common Criteria Common Process Approach Vocabulary Input Use as Analysis Model Consensus Common Process ApproachCommon Criteria Country Profiles Sector Profiles … Country Profiles Sector Profiles … Specific Profiles ISO/IEC JTC1 SC36 WG5 EQO ISO 19796-1: RFDQ

10. University of Duisburg-Essen Information Systems for Production and Operations Research Dr. Jan M. Pawlowski 2004-11-25, Slide 1.10 E-Learning Quality ISO/IEC 19796-1 To provide a framework for interoperable description of quality approaches To provide a framework for harmonization Abstract framework (Reference Framework for the Description of Quality Approaches) Description Scheme Process Model Profiles National instantiations Specific objectives Reference Quality Criteria Use as Guideline Quality Development Tools Questionnaire

11. University of Duisburg-Essen Information Systems for Production and Operations Research Dr. Jan M. Pawlowski 2004-11-25, Slide 1.11 E-Learning Quality Description Scheme: RFDQ

12. University of Duisburg-Essen Information Systems for Production and Operations Research Dr. Jan M. Pawlowski 2004-11-25, Slide 1.12 E-Learning Quality Reference Framework for the Description of Quality Approaches: ISO/IEC 19796 NA Needs Analysis FA Framework Analysis CD Conception / Design DP Development/ Production IM Implementation LP Learning Process / Realization EO Evaluation/ Optimization

13. University of Duisburg-Essen Information Systems for Production and Operations Research Dr. Jan M. Pawlowski 2004-11-25, Slide 1.13 E-Learning Quality Reference Framework for the Description of Quality Approaches: ISO/IEC 19796

14. University of Duisburg-Essen Information Systems for Production and Operations Research Dr. Jan M. Pawlowski 2004-11-25, Slide 1.14 E-Learning Quality Reference Quality Criteria

15. University of Duisburg-Essen Information Systems for Production and Operations Research Dr. Jan M. Pawlowski 2004-11-25, Slide 1.15 E-Learning Quality Reference Quality Criteria

16. University of Duisburg-Essen Information Systems for Production and Operations Research Dr. Jan M. Pawlowski 2004-11-25, Slide 1.16 E-Learning Quality Individual Quality Based on Standards (1) Analysis of Quality Needs Context (EQO Conceptual Model & Vocabulary) Requirements Actors (ISO/IEC 19796-1) Objectives (ISO/IEC 19796-1) Processes (ISO/IEC 19796-1) Comparison & Recommendation EQO Tools Adaptation Using EQO & ISO 19796-1

17. University of Duisburg-Essen Information Systems for Production and Operations Research Dr. Jan M. Pawlowski 2004-11-25, Slide 1.17 E-Learning Quality Individual Quality: Adaptation Involve relevant actors Identify relevant processes Specify quality objectives EQO Vocabulary CEO/ Official Quality manager Consultant Evaluator Learner Teacher developers (software developer, content broker, authors etc.) Policy Maker Researcher

18. University of Duisburg-Essen Information Systems for Production and Operations Research Dr. Jan M. Pawlowski 2004-11-25, Slide 1.18 E-Learning Quality Individual Quality: Adaptation Define Criteria and Standards CONSENSUS Define Methods EQO Vocabulary Benchmarking Evaluation Management approaches Quality Criteria Standards Certification Accreditation process Quality Policy Reference Quality Criteria ISO 9241 General Conditions Technical Aspects Data storage and Data processing Functionalities Theoretical Aspects Encoding of Information Special modes of presentation

19. University of Duisburg-Essen Information Systems for Production and Operations Research Dr. Jan M. Pawlowski 2004-11-25, Slide 1.19 E-Learning Quality Conclusion Standards support the full decision cycle Standards are the basis for further harmonization Tools are available for description, search, and recommendations Individual Quality adaptation needs to be supported Quality as a selection and adaptation process Long-term performance evaluation

20. University of Duisburg-Essen Information Systems for Production and Operations Research Dr. Jan M. Pawlowski 2004-11-25, Slide 1.20 E-Learning Quality Next Steps To provide a complete harmonized quality model Providing Objectives Methods Specific Criteria Metrics Including worldwide experts Start of ISO/IEC 19796-xxxx Input from Germany / CEN/ISSS Good Practice: ISO/IEC 19796-1 in Europe Learning Resource Transparency Harmonized German Quality Model ? Develop working draft on a workplan towards a harmonized quality model ? Involving European experts ? WG Meeting in January/February in Essen, Germany

21. University of Duisburg-Essen Information Systems for Production and Operations Research Dr. Jan M. Pawlowski 2004-11-25, Slide 1.21 E-Learning Quality Contact http://wip.wi-inf.uni-essen.de jan.pawlowski@icb.uni-essen.de ++49 (0) 201 1834061

22. University of Duisburg-Essen Information Systems for Production and Operations Research Dr. Jan M. Pawlowski 2004-11-25, Slide 1.22 E-Learning Quality References: Standards DIN Workshop Quality and Standardization Process-Model, Description Model http://www.beuth.de/sc/pas1032-1 CEN/ISSS Workshop Learning Technologies European Process Description Model http://www.cenorm.be/isss/cwa_download_area/cwa14644.pdf ISO/IEC JTC1 SC36 Generic Description Model http://jtc1sc36.org/