1. The Future of Standards Robby Robson, Eduworks Corporation Chair, IEEE Learning Technology Standards Committee The slides in this work are each separately licensed under a Creative Commons Attribution- NoDerivs 2.5 LicenseCreative Commons Attribution- NoDerivs 2.5 License

2. This slide is licensed under a Creative Commons Attribution-NoDerivs 2.5 License. Some rights reserved.Creative Commons Attribution-NoDerivs 2.5 License 30-06- 2005 The Future of Standards: EDMedia 20052 Outline Standards Learning Technology Standards Technology Changes Standards Changes Directions in Standards Discussion WARNING: THE SURGEON GENERAL HAS DETERMINED THAT STANDARDS HUMOR IS AN OXYMORON

3. This slide is licensed under a Creative Commons Attribution-NoDerivs 2.5 License. Some rights reserved.Creative Commons Attribution-NoDerivs 2.5 License 30-06- 2005 The Future of Standards: EDMedia 20053 Interoperability Standards Help systems talk to each other Help systems interpret data Help systems exchange information Help people exchange information Really its all about plumbing …

4. This slide is licensed under a Creative Commons Attribution-NoDerivs 2.5 License. Some rights reserved.Creative Commons Attribution-NoDerivs 2.5 License 30-06- 2005 The Future of Standards: EDMedia 20054 Standards are the infrastructure that works behind the scenes WOW! Look at those pipes COOL! That one’s made by ACME! Are Pipes-R-Us and We-Do-Pipes the same company? YUK! there’s a leak! But I wanted pipes for my house! Uh oh! These pipes don’t quite fit together! PVC? HDPE? LDPE? ERW?

5. This slide is licensed under a Creative Commons Attribution-NoDerivs 2.5 License. Some rights reserved.Creative Commons Attribution-NoDerivs 2.5 License 30-06- 2005 The Future of Standards: EDMedia 20055 Why bother with standards? RESEARCH Design new systems / create new reality Solve problems New technologies Vision New technologies Vision CONSUMER PROTECTION Prevent lock-in Increase quality through choice Commoditization Transparency Commoditization Transparency BUILD MARKETS Lower production costs Modularize the supply chain Shared suppliers Shared effort Shared suppliers Shared effort Market moves from underserved to overserved* * Clayton M Christensen & Michael E Raynor, (2003). The Innovator’s Solution: Creating and Sustaining Successful Growth, Harvard Business School Press, Cambridge, Mass.

6. This slide is licensed under a Creative Commons Attribution-NoDerivs 2.5 License. Some rights reserved.Creative Commons Attribution-NoDerivs 2.5 License 30-06- 2005 The Future of Standards: EDMedia 20056 Who is in the game, and why Academics and Researchers –Focused on their own disciplines and needs –Culture of innovation driven by attribution What really turns them on*: Inventing the future and getting recognized for it. RESEARCH Design new systems / create new reality Solve problems CONSUMER PROTECTION Prevent lock-in Insure against supplier failures BUILD MARKETS Lower production costs Modularize the supply chain *The opinions expressed here are opinions.

7. This slide is licensed under a Creative Commons Attribution-NoDerivs 2.5 License. Some rights reserved.Creative Commons Attribution-NoDerivs 2.5 License 30-06- 2005 The Future of Standards: EDMedia 20057 Who is in the game, and why Government Agencies Corporate / Academic consumers –Consumers with specific needs –Responsible for purchasing decisions What really turns them on*: Software that works and saving money. RESEARCH Design new systems / create new reality Solve problems CONSUMER PROTECTION Prevent lock-in Insure against supplier failures BUILD MARKETS Lower production costs Modularize the supply chain *The opinions expressed here are opinions.

8. This slide is licensed under a Creative Commons Attribution-NoDerivs 2.5 License. Some rights reserved.Creative Commons Attribution-NoDerivs 2.5 License 30-06- 2005 The Future of Standards: EDMedia 20058 Who is in the game, and why Technology Vendors (Commercial and not) –Market driven –Competitive What really turns them on*: Growth (of markets, revenue, profits and footprint) RESEARCH Design new systems / create new reality Solve problems CONSUMER PROTECTION Prevent lock-in Insure against supplier failures BUILD MARKETS Lower production costs Modularize the supply chain *The opinions expressed here are opinions.

9. This slide is licensed under a Creative Commons Attribution-NoDerivs 2.5 License. Some rights reserved.Creative Commons Attribution-NoDerivs 2.5 License 30-06- 2005 The Future of Standards: EDMedia 20059 So what has happened in learning technology?

10. This slide is licensed under a Creative Commons Attribution-NoDerivs 2.5 License. Some rights reserved.Creative Commons Attribution-NoDerivs 2.5 License 30-06- 2005 The Future of Standards: EDMedia 200510 Lots of organizations formed DLF (1995) SIF ARIADNE AICC (1988) ADL IMS IEEE LTSC JTC1 SC36 EdNA (1994) ALIC OKI OASIS CEN/ISSS WS-LT W3C (1994) ebXML EICA CanCore Dublin Core (1995) SISO (1994) MERLOT HR-XML CONSOR- TIUM 199619971998199920002001 But few since 2001

11. This slide is licensed under a Creative Commons Attribution-NoDerivs 2.5 License. Some rights reserved.Creative Commons Attribution-NoDerivs 2.5 License 30-06- 2005 The Future of Standards: EDMedia 200511 Goals and drivers evolved Standardized learning infrastructureGOAL: Standardized learning infrastructure Characterized by –Many activities –Little implementation –Proliferation of organizations Learning content interoperabilityGOAL: Learning content interoperability Characterized by –Public stewardship –Focus on “learning management systems” –Adoption & Implementation 1996199719981999200020012002200320042005 Research Driven Consumer Driven

12. This slide is licensed under a Creative Commons Attribution-NoDerivs 2.5 License. Some rights reserved.Creative Commons Attribution-NoDerivs 2.5 License 30-06- 2005 The Future of Standards: EDMedia 200512 In formal standards bodies working theories were replaced IEEE LTSC Web Site, October 12, 1999

13. This slide is licensed under a Creative Commons Attribution-NoDerivs 2.5 License. Some rights reserved.Creative Commons Attribution-NoDerivs 2.5 License 30-06- 2005 The Future of Standards: EDMedia 200513 With Accredited Standards IEEE Approved Learning Technology Standards (as of June, 2005) IEEE LTSC IEEE LTSC Web Site, October 22, 2003

14. This slide is licensed under a Creative Commons Attribution-NoDerivs 2.5 License. Some rights reserved.Creative Commons Attribution-NoDerivs 2.5 License 30-06- 2005 The Future of Standards: EDMedia 200514 While in specification consortia IMS Global Learning Consortium Web Site, 24 February, 2000

15. This slide is licensed under a Creative Commons Attribution-NoDerivs 2.5 License. Some rights reserved.Creative Commons Attribution-NoDerivs 2.5 License 30-06- 2005 The Future of Standards: EDMedia 200515 Specs were released and horizons broadened IMS Global Learning Consortium Web Site, 29 July, 2003

16. This slide is licensed under a Creative Commons Attribution-NoDerivs 2.5 License. Some rights reserved.Creative Commons Attribution-NoDerivs 2.5 License 30-06- 2005 The Future of Standards: EDMedia 200516 By 2004 We had a good Portfolio of Interoperability Standards* Separated content from delivery –Based on early research work –Driven by consumers to avoid lock-in –Driven by vendors to support their supply chain Specialized to the learning community –Driven by training departments –Driven by educational institutions –Driven by smallish vendors *Standard in the sense of adopted by industry

17. This slide is licensed under a Creative Commons Attribution-NoDerivs 2.5 License. Some rights reserved.Creative Commons Attribution-NoDerivs 2.5 License 30-06- 2005 The Future of Standards: EDMedia 200517 Metadata PurposeStandards Search / Discovery / Cataloging / Processing Learning Object Metadata* Dublin Core Metadata (DC-ED) * Part of SCORM 2004

18. This slide is licensed under a Creative Commons Attribution-NoDerivs 2.5 License. Some rights reserved.Creative Commons Attribution-NoDerivs 2.5 License 30-06- 2005 The Future of Standards: EDMedia 200518 Learning Content Formats PurposeStandards Organize & Transport Learning Content & “Learning Objects” IMS Content Packaging* AICC Course Structure Format Store & Exchange Online Quiz Questions IMS Question & Test Interoperability * Part of SCORM 2004

19. This slide is licensed under a Creative Commons Attribution-NoDerivs 2.5 License. Some rights reserved.Creative Commons Attribution-NoDerivs 2.5 License 30-06- 2005 The Future of Standards: EDMedia 200519 Data Exchange PurposeStandards Communicate data between content & delivery platform HTTP AICC Communication Protocol IEEE Runtime Communication (JavaScript API)* Define and Encode data to be exchanged AICC CMI Data Model (adopted by IEEE)* Exchange Enrollment Data IMS Enterprise * Part of SCORM 2004

20. This slide is licensed under a Creative Commons Attribution-NoDerivs 2.5 License. Some rights reserved.Creative Commons Attribution-NoDerivs 2.5 License 30-06- 2005 The Future of Standards: EDMedia 200520 Learner Records PurposeStandards Exchange Learner Information IMS Learner Information Package Record status of learning objectives AICC CMI Data Model (adopted by IEEE)* Parts of IMS Simple Sequencing* * Part of SCORM 2004

21. This slide is licensed under a Creative Commons Attribution-NoDerivs 2.5 License. Some rights reserved.Creative Commons Attribution-NoDerivs 2.5 License 30-06- 2005 The Future of Standards: EDMedia 200521 Managing Learning PurposeExample Telling a Management System what to deliver next AICC CMI specifications IMS Simple Sequencing* Higher level organization of Learning Activities IMS Learning Design * Part of SCORM 2004

22. This slide is licensed under a Creative Commons Attribution-NoDerivs 2.5 License. Some rights reserved.Creative Commons Attribution-NoDerivs 2.5 License 30-06- 2005 The Future of Standards: EDMedia 200522 Adoption (Compiled in 2004) Sources: Various Brandon-Hall Reports (Excepting Last Column) 1997/8 LMS 2000 LMS2001 LCMS 2003 LMS 2003 LCMS 2004 Authoring Tools Current Course Management Systems Number of Systems275629 234323 AICC Support41%52%83% 87%65%26% Certified**7% 13%9%* Compliant**76% 74%56%* Support Planned*23%* 4%0%* No AICC Exists / Planned59%25%17% 9%35%74% SCORM Support*17%83% 87%72%43% 1.2 *** 83%63%39% Other*** 4%9%4% Support Planned*2%7% 13%5%* No SCORM Exists / Planned100%80%10% 0%23%52% IMS Metadata*34%* **43% IMS Metadata Planned*25%* *** IMS Content Packaging*** **61% IMS QTI*** **22% IMS (not specified)*** **9%

23. This slide is licensed under a Creative Commons Attribution-NoDerivs 2.5 License. Some rights reserved.Creative Commons Attribution-NoDerivs 2.5 License 30-06- 2005 The Future of Standards: EDMedia 200523 But the world of learning systems is changing in some significant ways …

24. This slide is licensed under a Creative Commons Attribution-NoDerivs 2.5 License. Some rights reserved.Creative Commons Attribution-NoDerivs 2.5 License 30-06- 2005 The Future of Standards: EDMedia 200524 The Topology is Changing Client / Server is being replaced by (massively) distributed (increasingly heterogeneous) networks –Institutions are federating Repositories Learning Technologies Identities Games / Simulations are an influencer

25. This slide is licensed under a Creative Commons Attribution-NoDerivs 2.5 License. Some rights reserved.Creative Commons Attribution-NoDerivs 2.5 License 30-06- 2005 The Future of Standards: EDMedia 200525 Architectures Are Changing Services from other domains Componentization challenges product categories New barriers to entry Standards re-thought Service User Service Provider Service Registry Describe: WSDL Access: SOAP Publish: UDDI Find: UDDI

26. This slide is licensed under a Creative Commons Attribution-NoDerivs 2.5 License. Some rights reserved.Creative Commons Attribution-NoDerivs 2.5 License 30-06- 2005 The Future of Standards: EDMedia 200526 The Context is Changing Learning Management Human Capital Development Learning Content Management Enterprise Content Management Training Transformation E-Knowledge Transformation Supply Chains Customer Relations Globalization Enterprise Learning Technology Enterprise Architecture Workflow Learning Learning is becoming an ubiquitous embedded application

27. This slide is licensed under a Creative Commons Attribution-NoDerivs 2.5 License. Some rights reserved.Creative Commons Attribution-NoDerivs 2.5 License 30-06- 2005 The Future of Standards: EDMedia 200527 The Technology is Working! And so is the research …

28. This slide is licensed under a Creative Commons Attribution-NoDerivs 2.5 License. Some rights reserved.Creative Commons Attribution-NoDerivs 2.5 License 30-06- 2005 The Future of Standards: EDMedia 200528

29. This slide is licensed under a Creative Commons Attribution-NoDerivs 2.5 License. Some rights reserved.Creative Commons Attribution-NoDerivs 2.5 License 30-06- 2005 The Future of Standards: EDMedia 200529 Metadata Structured Metadata Abstract Models Descriptive Metadata Contextual Metadata Cataloguing Meta-search / Federation MetadataOntologies Semantic Web Query Standards Automated Generation Ontology Languages Why isn’t the answer? What was the question? What is life like in a metadata-rich world?

30. This slide is licensed under a Creative Commons Attribution-NoDerivs 2.5 License. Some rights reserved.Creative Commons Attribution-NoDerivs 2.5 License 30-06- 2005 The Future of Standards: EDMedia 200530 LEARNING CONTENT FORMATS Darwin Informatio n Typing Architectur e OpenOffice S1000D: International specification for technical publications utilizing a common source database Metadata Encoding and Transmission Standard MPEG-21 Digital Item Description Language Content Packaging

31. This slide is licensed under a Creative Commons Attribution-NoDerivs 2.5 License. Some rights reserved.Creative Commons Attribution-NoDerivs 2.5 License 30-06- 2005 The Future of Standards: EDMedia 200531 The Copernican Content Revolution MPEG-21 Digital Item Descriptio n Language Multimedia Content Content Packaging Learning Content Metadata Encoding & Transmission Standard Digital Libraries S1000D: Tech Pubs / Common Source Data Base Tech Pubs & Documentation Darwin Information Typing Architecture Help Screens (EPSS) E-Content E-Business E-Knowledge E-Learners Open Office “Office” Documents

32. This slide is licensed under a Creative Commons Attribution-NoDerivs 2.5 License. Some rights reserved.Creative Commons Attribution-NoDerivs 2.5 License 30-06- 2005 The Future of Standards: EDMedia 200532 Future of Content Formats Learning content as structured content (no more “Black Box SCOs”) –Presentation –Assets –Behaviors –Addressable Locations Interoperability among content standards –Reference model for Resource Aggregations (IEEE LTSC project) XML

33. This slide is licensed under a Creative Commons Attribution-NoDerivs 2.5 License. Some rights reserved.Creative Commons Attribution-NoDerivs 2.5 License 30-06- 2005 The Future of Standards: EDMedia 200533 Data Exchange Web Services Middleware Distributed Control Diagram Courtesy IcodeonIcodeon Business Process Execution Language

34. This slide is licensed under a Creative Commons Attribution-NoDerivs 2.5 License. Some rights reserved.Creative Commons Attribution-NoDerivs 2.5 License 30-06- 2005 The Future of Standards: EDMedia 200534 API Adapter SCORM API Delivery Service Tracking Service Sequencing Service Content Management Service Learner Profiles Service Testing/ Assessment Service Course Administration Service Local Content Repository Remote Content Repositories SCORM Content Packages Browser (Presentation) Generalized Learning Management System Model Selection Launch SCORM Tracking Data SCORM Content (SCOs & Assets) From P. Dodds, A Hoberny & W. Blackmon: Next Generation SCORM

35. This slide is licensed under a Creative Commons Attribution-NoDerivs 2.5 License. Some rights reserved.Creative Commons Attribution-NoDerivs 2.5 License 30-06- 2005 The Future of Standards: EDMedia 200535 JISC / DEST E-Learning Framework (http://www.elframework.org/)http://www.elframework.org/

36. This slide is licensed under a Creative Commons Attribution-NoDerivs 2.5 License. Some rights reserved.Creative Commons Attribution-NoDerivs 2.5 License 30-06- 2005 The Future of Standards: EDMedia 200536 Learner Records Competencies Relationships Among Competencies Definitions of Competencies & Objectives People Learner Information Evidence of Competency Learning Experiences Another Copernican Revolution KISS: Keep It Separated, Stupid

37. This slide is licensed under a Creative Commons Attribution-NoDerivs 2.5 License. Some rights reserved.Creative Commons Attribution-NoDerivs 2.5 License 30-06- 2005 The Future of Standards: EDMedia 200537 Managing Learning Managing Learning is a No-brainer … Because distributed, service oriented Architectures have no brain * IMHO So the focus will be the emergent patterns among heterogeneous applications (Not on learner management)*

38. This slide is licensed under a Creative Commons Attribution-NoDerivs 2.5 License. Some rights reserved.Creative Commons Attribution-NoDerivs 2.5 License 30-06- 2005 The Future of Standards: EDMedia 200538 Different Standards for Different Architectures

39. This slide is licensed under a Creative Commons Attribution-NoDerivs 2.5 License. Some rights reserved.Creative Commons Attribution-NoDerivs 2.5 License 30-06- 2005 The Future of Standards: EDMedia 200539 Different Standards for Different Architectures Type of System Top Issues Enabling Standards Monolithic (e.g. Plato)Programmed Learning Data reporting Standardized language Standard reports

40. This slide is licensed under a Creative Commons Attribution-NoDerivs 2.5 License. Some rights reserved.Creative Commons Attribution-NoDerivs 2.5 License 30-06- 2005 The Future of Standards: EDMedia 200540 Different Standards for Different Architectures Type of System Top Issues Enabling Standards Monolithic (e.g. Plato)Programmed Learning Data reporting Standardized language Standard reports Client / Server (e.g. institutional LMS) Data exchange Separation of content & platform Comm. Protocols Data models

41. This slide is licensed under a Creative Commons Attribution-NoDerivs 2.5 License. Some rights reserved.Creative Commons Attribution-NoDerivs 2.5 License 30-06- 2005 The Future of Standards: EDMedia 200541 Different Standards for Different Architectures Type of System Top Issues Enabling Standards Monolithic (e.g. Plato)Programmed Learning Data reporting Standardized language Standard reports Client / Server (e.g. institutional LMS) Data exchange Separation of content & platform Comm. Protocols Data models Distributed Homogeneous (e.g. Enterprise clusters) Information Management Data Exchange ID / Registries Services / Metadata Data models / protocols

42. This slide is licensed under a Creative Commons Attribution-NoDerivs 2.5 License. Some rights reserved.Creative Commons Attribution-NoDerivs 2.5 License 30-06- 2005 The Future of Standards: EDMedia 200542 Different Standards for Different Architectures Type of System Top Issues Enabling Standards Monolithic (e.g. Plato)Programmed Learning Data reporting Standardized language Standard reports Client / Server (e.g. institutional LMS) Data exchange Separation of content & platform Comm. Protocols Data models Distributed Homogeneous (e.g. Enterprise clusters) Information Management Data Exchange ID / Registries Services / Metadata Data models / protocols Distributed Heterogeneous (“Advanced Distributed Learning”) Services Behaviors Unified User Experience Intellectual property Behavior models Workflow Resolution architectures Learning design Rights / Access control

43. This slide is licensed under a Creative Commons Attribution-NoDerivs 2.5 License. Some rights reserved.Creative Commons Attribution-NoDerivs 2.5 License 30-06- 2005 The Future of Standards: EDMedia 200543 Which leaves us producing Standards that are Learning profiles of core e-knowledge and e-business standards Small Strategic Semantic Behavioral Service - oriented Universal Adaptable to Regions and Communities Compatible with current learning technology standards

44. This slide is licensed under a Creative Commons Attribution-NoDerivs 2.5 License. Some rights reserved.Creative Commons Attribution-NoDerivs 2.5 License 30-06- 2005 The Future of Standards: EDMedia 200544 And there is a lot of activity … Cross-community activity Research maturing into prototypes Prototypes maturing into products Products maturing into research Application of external standards to learning Lots of new ideas and real examples

45. This slide is licensed under a Creative Commons Attribution-NoDerivs 2.5 License. Some rights reserved.Creative Commons Attribution-NoDerivs 2.5 License 30-06- 2005 The Future of Standards: EDMedia 200545 But Don’t Forget GOOD ENOUGH FOR EVERYONE > GREAT FOR ME Standards are dedicated to the proposition:

46. This slide is licensed under a Creative Commons Attribution-NoDerivs 2.5 License. Some rights reserved.Creative Commons Attribution-NoDerivs 2.5 License 30-06- 2005 The Future of Standards: EDMedia 200546 THE END -- DISCUSSION AWAKE? NO DREAM PRE- OCCUPIED? YES THINK DEEP THOUGHTS NO YES QUESTIONS? ASK QUESTIONS YES NO INTER- ESTED? PARTICIPATE! YES NO LEAVE HAPPY robby@computer.org YES