Instructional Improvement System (IIS) (a.k.a. Learning Management System – LMS) Needs Analysis Discussion, Planning Meeting, and Focus Group Session This presentation was prepared by an independent consulting firm for the Bill & Melinda Gates Foundation. While the data and analysis contained in this document were used to inform the foundation, it is not a representation of the current grant-making strategy. For more information on the foundation’s strategy, please visit:

Slide 2 Prepared for Bill & Melinda Gates Foundation Instructional Improvement System (IIS) Project For nearly two decades, CELT has helped align leadership, learning, and technology in support of improved student learning by working collaboratively with educational organizations to support and transform teaching, learning, and administrative processes.

Slide 3 What is the purpose of today’s meeting? To gather end-user input for developing a conceptual model, functional requirements, and performance specifications for an Instructional Improvement System (IIS) (a.k.a. Learning Management System)…  as defined in the Race to the Top (RTTT) application process and proposal submissions;  based on IIS/LMS activities currently underway in learning organizations at all levels;  and, includes the results of statewide field-based assessment activities and state-level legislation.

Slide 4 Who are the meeting participants? Superintendents of Schools Chief Academic Officers Directors of Research and Assessment Staff Development Coordinators Chief Information Officers Library, Media, Instructional Resource Specialists School Principals  elementary  middle  high school Education Association/Consortium Leaders

Slide 5 Who are the CELT facilitators? Florida Meetings John Phillipo Laurie Keating Harold Ellis Lisa Connelly Ohio Meetings Don Ginder Cyndi Dunlap John Bowles Christine Ginder

Slide 6 What is today’s agenda? 8:30 – 9:00Registration and Continental Breakfast 9:00 – 9: 15Welcome and Introductions 9: 15 – 9:25Project Background and Rationale 9: 25 – 10:00IIS (LMS) Vision/Overview 10:00 – 10:40Breakout Session Part I 10:40 – 10:50Break 10:50 – 11:15Breakout Session Part II 11:15 – 11:45Reporting Back and Discussion 11:45 – 12:00Concluding Comments and Next Steps

Slide 7 Who is CELT? CELT’s Mission To help learning organizations attain their vision, mission, and goals by integrating high- quality programs, services, and technology with the organization's people and processes in a timely, efficient, and cost-effective way.

Slide 8

Slide 9 What is the project background? The IIS/LMS Project is funded by the Bill & Melinda Gates Foundation CELT serves as the research and development partner along with the state, regional, local education agencies and charter schools The participating states are Florida and Ohio

Slide 10 What are the project phases and timeline? Identify research, best practices, Jul/Aug 2010 and field-based needs assessment Develop IIS/LMS conceptualSep/Oct 2010 model, key components, functional requirements Conduct IIS/LMS Fall InstituteOct/Nov 2010 Draft vignettes on effective use Dec/Jan of an IIS/LMS application

Slide 11 What is the rationale for the project? As educators, we need to:  apply technology to our core mission  reverse the trend of “pulling” data from the classroom without adequate feedback loops and data analysis tools for students, teachers, and parents  recognize that successful IIS/LMS implementation is more of an organizational and industry problem than a technology project

Slide 12 What is the universally accepted core mission of education? Develop the most contemporary standards, curricula, and assessments Coach/facilitate learners through a myriad of developmental instructional activities Identify appropriate instructional strategies and resources with just-in-time staff development Monitor/assess student progress based upon a pre-determined set of learner needs and performance rubrics.

Slide 13 Current and Desired Data Flow Presently, there is a need to create seamless, continuous, and transparent feedback loops at all levels Without feedback loops, data will continue to remain inaccurate and unreliable.

Slide 14 Current and Desired Data Flow Presently, there is a need to create seamless, continuous, and transparent feedback loops at all levels Without feedback loops, data will continue to remain inaccurate and unreliable.

Slide 15 Why hasn’t technology helped transform education? Every major business or industry in the world, with the exception of education, has from the onset applied information technology to its CORE mission Education/Learning (???) Medical/Health (MEDLAR) Airline/Travel (SABRE, Expedia, etc.) Finance/Banks (ATM System)

Slide 16

Slide 17 IIS/LMS Conceptual Model Curriculum/ Instruction (What?) Staff Development (By Whom?) Assessment Strategies (How Well?) Learners (Who?) (With?) Instructional Resources

Slide 18 Why hasn’t technology helped transform education? Every major business or industry in the world, with the exception of education, has from the onset applied information technology to its CORE mission Education/Learning (???) Medical/Health (MEDLAR) Airline/Travel (SABRE, Expedia, etc.) Finance/Banks (ATM System)

Slide 19 Curriculum / Instruction (What?) Common core standards State frameworks Curriculum guides Courses of study Content objectives Process skills Technology competencies Instructional practices

Slide 20 Instructional Resources (With what?) Software Internet, web Manipulatives Multi-media resources Textbooks Lesson plans Field trips Guest speakers

Slide 21 Assessment Strategies (How well?) State – high stakes District - benchmark School - interim Classroom – formative/authentic/performance  Journal  Quiz  Interview  Essay  Project  Test  Portfolio  Other Home/Student – self-assessment and correlation

Slide 22 Staff Development (By whom?) Staff proficiencies  Skills  Knowledge  Behavioral attributes Staff profiles Staff development programs Job portfolios Individual staff development plans Supervision and evaluation strategies

Slide 23 Learners (Who?) Students  Learning profile  Growth pattern  Academic progress Community members  Teachers  Parents  Senior citizens  Business/industry leaders

Slide 24 What is the IIS/LMS integration strategy? Network Communications Infrastructure and Help Desk

Slide 25 Desired Outcomes of an IIS/LMS 1.Accurate and timely information about student achievement in support of decision making at all levels 2.Parents and community members participating more fully in the learning process 3.Students assuming an active role and accepting responsibility for their educational experience 4.Staff empowered to work cooperatively to increase student achievement, enhance productivity, and improve accountability continued…

Slide 26 Desired Outcomes of an LMS (continued) 5.Student achievement linked with staff development programs 6.Standards correlated to instructional practices, assessment strategies, and staff development programs 7.Gaps identified in instructional programs for adequacy of instructional resources, assessment items, and staff proficiencies 8.Ability to determine cost/benefit of instructional programs and learning resources

Slide 27

Slide 28 What are the questions that need to be answered? 1.What are the key components of a comprehensive IIS/LMS? 2.What is the required functionality? 3.Who are the major users of a web-based IIS/LMS and what is the impact upon them? 4.What are the unique needs of the various users? 5.What are the systems (data) integration requirements with LEA (SIS, FMS, DSS) applications and state-level reporting systems? continued…

Slide 29 What are the questions? (continued) 6.What is the impact of an easy-to-use and role- based IIS/LMS on:  curriculum?  assessment?  staff development?  student profile and achievement?  learning resources? 7.What are the barriers to successful implementation of an integrated LMS?  funding?  process improvements?  time?

Slide 30

Slide 31

Slide 32 “You can always trust Americans to do the right thing after they have tried to do everything else.”  Sir Winston Churchill We Must Systemically Change the Way We Manage Change

Slide 33 The Critical Success Factors: Funding Leadership Partnership Planning Technology and Education

Slide 34 Critical Mass* of 21st Century Resources Time Money Staff Technology * Amount of the innovation required to provide a substantial/measurable change in productivity and/or learning.

Slide 35 How can you contact CELT? Center for Educational Leadership and Technology (CELT) 65 West Boston Post Road, Suite 200 Marlborough, Massachusetts Website: Website: Ohio Project Lead: Mr. Don Ginder Office: (508) ex Fax: (508) Florida Project Lead: Dr. John R. Phillipo Office: (508) ex Fax: (508)