Re-imagining the Learning Ecosystem Time for New Approaches, Cultures, Tools & Metrics Sheila Jagannathan World Bank Group Washington DC

“.....Thus, to understand how countries grow and develop, it is essential to know how they learn and become more productive and what government can do to promote learning.”  Joseph E Stiglitz

1 2 3 Agenda Global Shifts in Capacity Development Achieving Reach and Impact Through E-learning Emerging Trends in Learning Ecosystems

1 2 3 Agenda Global Shifts in Capacity Development Achieving Reach and Impact Through E-learning Emerging Trends in Learning Ecosystems

Is there a tectonic shift in learning today? Question? Is there a tectonic shift in learning today? A. Yes… B. No…

M O C YES - More Change in the Last 5 Years than in the 100 Years Learning today Not sitting in classroom, listening to lectures Available at our finger tips, just-in-time and just enough Create an action learning cycle of learning and immediate applying with feedback loops M O C assive pen nline ourse

Education Knowledge News Visible in our daily lives… THEN… NOW… Golden Age of Education (Codecademy / Coursera / Khan Academy…) Interactive / Online / Accessible by Anyone Anywhere Anytime (Classrooms / Lectures / Reading Materials) . Source: Kleiner Perkins Caufield Byers

India is changing too…More Governance and Less Government

Capacity Challenges Are Multiplying Strengthen participative planning Connect and learn from innovative platforms Build cutting edge knowledge & skills Citizen centric Raise awareness & accountability Best practices

Innovative Approaches Leverage Global Shift Challenge - Requires innovative approaches Building capacity to effectively deliver on these new ideas, requires a different type of learning: multi-sectoral, self-directed, collaborative, dialog and discussion with peers, real-time, action learning – learning labs, citizen centric learning, co-creating solutions, learning from global best practices, learning from failure. The good news is that…. The way we consume knowledge and learning is changing… Mix of formal and informal Facilitated and self-directed Video based and mobile Collaborative, interactive, networked….. New Solution Sets to Build Competencies New pedagogy New Technologies New Delivery Methods New ways to measure results… Innovative Approaches For new competencies

1 2 3 Agenda Global Shifts in Capacity Development Achieving Reach and Impact Through E-learning Emerging Trends in Learning Ecosystems My presentation today will be in three parts First, I will talk about the significant shifts in global capacity development Next, explore elearning and the opportunities it provides to scale up and accelerate impact Third, share with you emerging trends in learning ecosystems that is relevant to this Conference.

Digital collaboration A Common Language for e-Learning The use of electronic technologies to deliver, facilitate, & enhance both formal & informal learning at any time, any place & at any pace. Computer, Internet & their applications including CD-ROM, E-mail, Web sites, & multimedia, social media… Massive Open Online courses Facilitated courses Self paced modules Multimedia Tutorials Interactive Simulations Digital collaboration Podcasts E-books CD-ROM/ DVD E-discussions Blogs, wikis, CoPs.. Games Webinars Virtual classrooms

E-learning Experiences – Brazil, Mexico and China Why E-learning? Why E-learning? Why E-learning? Large populations of slum dwellers need better services $80 billion allocation available from Federal Govt to implement national housing policy. Planners and City officials need training on the ‘how to’ aspects of upgrading 3 tier structure - feedback loop to policy makers at municipal, state and Federal Why: Massive unmet demand from individuals & institutions in public & private sector, civil society in a rapidly changing economy Comprehensive pedagogical Model that focuses on application. Quality education and training that transcends time and space barriers Participants welcomed from all walks of life Establish learning communities encouraged to share knowledge and innovate Build capacity for accountable institutions Large scale urbanization has led to growth in demand for urban planners Urban Planning Society of China interested in building a National E- learning Hub Responding to concerns at the NDRC (Planning Commission) level about unplanned urbanization Continuing education needs of planners Results Results Results 10 week, facilitated fully on-line course (Week1 Orient; 9 weeks core themes) Blends theory and “how-to” Goes beyond public officials to also include civil society and private contractors 1st piloted in 1 region (NE); then scaled up 10,000 participants trained. Certificates issued at end of course Drop out rates reduced from first to second offering (17.7% to 10.99) 18,500 graduated students since 1989 1.14 million continuing education 1.5 million practitioners interacting through CoPs 24 countries have benefited 100,000 participants in this program and other e-courses organized by Chinese Academy of Governance Creative Knowledge sharing and delivery participants increase from 610 in 2001 to 3800 in 2011 Partnerships established for sharing data, research through papers and virtual workshops Gateway to Chinese Planning community

E-learning Experiences - India Why E-learning? Why E-learning? Scale up disaster education in India 10 courses customized from LLI global modules; delivered as facilitated e-learning. Feedback to assignments and project work provided by virtual experts. Need to scale and disseminate urban land use planning skills to large groups of mid-career planning professionals, urban practitioners, policymakers and city managers from various city and state government departments Goals: Working with NIUA to ensure that participants have a functional and integrated understanding of the dynamics of urban land use in India; and demonstrate how to effectively utilize policies and planning instruments available. Global WBG Modules are being customized to Indian context: Understanding How Land Use Planning Contributes to Sustainable Urban Development Institutions, Policies and Tools for Effective Land Use Planning How to Integrate Land Use Planning and Infrastructure How to Manage Growth in Peri-Urban Areas How to Promote Local Economic Development Results Over 5,000 peole trained nationally (certified) Training of trainers, cadre of facilitated and community has emerged.

Mostly free and accessible to ALL MOOC Characteristics Support Access, Cost and Quality Global & Distributed Rich diversity of ideas from many regions, cultures and perspectives Massive 10,000-150,000 Open Mostly free and accessible to ALL M O C assive Participatory Conversational and collaborative opportunities Flexible Learners can select level of participation – a la carte pen nline ourse Life-long learning Ongoing CoPs, support & feedback Learning Analytics Track how learners learn

Benefits of E-learning Cost-efficiency, Reusability & scalability, Consistent Quality, Bridging of distances Cost-efficiency/Scalability Low cost delivery (travel, no time out) Flexible & convenience Quality Improved learning Apply while you learn Consistent quality of engagement Reuse/Customization Customized to local languages, stakeholders Customization and replication Networking & Learning communities Continuous learning Just-in-time Expanded participant reach

Mindset & low acceptability Lack of favorable policies Limitations for E-learning: Some Surprises! High Pedagogical Limitations: 30-40% drop-outs; multimedia, facilitation, relevance and making it required Time limitations: Participants availability on a continued basis over, e.g. 2-4 weeks Mindset & low acceptability Quality Content Poor connectivity Lack of favorable policies Financial limitations: High initial investment (time & money)  focus on scale and shelf life Infrastructure limitations: Low bandwidth, off-line, blending Audience limitations: not everywhere a “culture” of online interaction. Support &training Low

1 2 3 Agenda Global Shifts in Capacity Development Achieving Reach and Impact Through E-learning Emerging Trends in Learning Ecosystems

#1 – Understand the Mid-Career Learner GoI’s national training strategy, as we are seeing in several other countries is re-imagining the mid career learner. There is a recognition that competencies in knowledge, skills and behaviors have to be constantly enhanced to meet various challengies. At the same time officials are overwhelmed with responsibilities and crises in their work, The mid career learner needs untetethered, collaborative and just in time inputs we will be elaborating in this presentation.

Learning for Development – Beyond “Transfer of Knowledge” #2 – Reimagining Learning for Development Learning for Development – Beyond “Transfer of Knowledge” LEARNING IS ABOUT LEARNING IS NOT ABOUT Building applied problem-solving skills Multi-sectoral (everything is linked to everything else) Results focused (evidence-based solutions translated into practical, accessible learning) Evaluating what worked and did not worked Helping us unlearn and let go what is not on the critical path South-South knowledge exchange allows crucial exchange of tacit knowledge Networking & and participating in e- community GLOCAL – Local + Global Pls put what is learning not about to the left. F2F alone. It’s multi-channel and connected, using technology to achieve scale while promoting interactivity and collaboration Not one off, but CONTINUOUS

Create a ‘Lean’ Learning Environment #3 – Focus on Results – A Systematic Design Approach Group and organize methods in a series of events Assemble the events to a program Really would prefer a b etter visuals that shows the agile model Pick the appropriate delivery modes Select the tools that best facilitate the identified methods Determine what level of evaluation is appropriate Compare actual with desired outcomes Assemble program Monitor and evaluate the program Select tools Choose the appropriate methods to reach the objectives Identify Learning Methods Create a ‘Lean’ Learning Environment Define Outcomes & Objectives Identify the audience Set the learning objectives 21

#4 – Rebalance Informal with Formal Learning Learning Technology is used to support both formal and informal learning modalities Encourage learning without walls – rise of social learning. The trend we are seeing in high impact learning organizations is that only 10% of learning occurs through formal settings, the rest – 90 happens through informal and spontaneous, just in time and on the job learning. As we will discuss next, E-learning including the emerging learning technologies make this possible. Formal programs, including eLearning, are being combined with social learning, experiential learning, and ongoing support and reinforcement to support a continuous learning environment For example, if someone has a co mpetency gap in skills on how to m anage a large office, a formal learning in the ATI can be complemented by informamtl learning in the probationalry periods and in today’s world by using accessing webinars, podcasts, e-courses ettc. ------------------------------ Source: Next Learning Unwrapped, Nick van Dam (2011) 22

#5 – Move from One-Off to Continuous Learning E-Learning as one component of the continuous learning environment . Source: Bersin by Deloitte, 2013 23

Collaborative writing Problem-based learning #6 – Immersive Learning Produces can be Designed for Best Results Learning Pyramid Average Retention Rate 7 Teach others/Immediate Use 90% 6 Practice by Doing 75% Active 5 Discussion Group 50% 4 Demonstration 30% 3 Audio-Visual 20% Passive 2 Reading 10% Active learning produces 70-80% retention rates 1 Lecture 5% Source: National Training Laboratories, Bethel, Maine Best practices Storytelling Conceptual map Wild glossary Collaborative writing Discussions Role play Learning contracts Listening teams Case-based learning Keeping journals Simulation Group work Game-based learning Problem-based learning Brainstorming Discussion forum Follow up Interview Tests

Example: Engaging Health Professionals through Game Infused E-Learning Interactive tools ensure a collaborative, impact-focused, educational experience that allows for tailored learning for students/ participants Blend of an 8 week facilitated e-learning course with a 3D Immersive Game around the theme of Results Based Financing (RBF) Share experiences via the community dashboard as part of knowledge building Participants learn in an engaging matter about RBF Collaborate with others Apply concepts to a learning scenario Audience: Health and Financial policy makers at the national and district level

# 7 – Social Learning Matters Example: Strengthening Local Government Capacity in South-East Europe City-to-city dialogue series Municipal finance (e.g. revenue improvement, expenditure mgmt, public asset mgmt, performance measurement) Urban planning & land management Urban service delivery Hands-on capacity building Direct link with challenges on the ground LGs to engage in self- assessments F2F E-learning Global curriculum: e-Institute Regional Partner: CEU Local Partners: NALAS + NLGA *for marketing, dissemination, translation E-Institute Learning Labs Dialogues I am sure each and every one of you have benefitted from peernteraction in a f2f sitau tion. Now we do similar things thru a blend of elearning and f2f in innovative ways. This slide shares an examples of how citis in SE Europe have been able to improve their urban planning thru a combo of f2f and eleanring , with city to city dialogies thru VC and or web-based software and social media , learning lab to analyze to develop solutions to stickly problems ------------------------- Besides there is a move towards learning without walls- using social media tools Use asy toolse-discussions , reflective type of learning e-discussions, cop, podcasts, ted talks, curated learning blog, wiki, face book, yammer etc. Sch tools permit real time interactions google hangout on air, Skype vc, audio, webinar/webcast, messging, chat To: Engage Advise Share Learn Brainstorm Peer Review Decide Social Learning is extremely effective when included as part of a structured learning program, such as eLearning. For example, a formal course can be followed with a learner discussion forum ---- amplify learning

#8 – Enhancing Facilitation by Virtual Experts Facilitation by virtual experts improves learning effectiveness Learner Content Server Self-paced Community Thematic Facilitated Learner Peer Facilitator Content Process Technical Blended Courses

#9 – The Future of Learning is Mobile Mobile learning provides learners with anytime/anywhere access to learning and continuous support (18% mobile users among 3.6 global users) Popular delivery mode but under used But use creatively – not about dumping as is Responsive design Allows for customization via location-specific tools for tracking and collaboration Allows learners to create apps to share knowledge Recording Information Games/Simulations Assessment Reading Images Mobile learning through Audio Apps Polling Collaboration Searching Context/Location Support and Coordination Source: Nick van Dam, Next Learning, Unwrapped 2011

#10 – Leveraging Learning Analytics to Continually Improve Performance Learning analytics can be customized to student needs, allowing students to get a better, faster picture of their performance Unlike a classroom setting every student in a course using learning analytics answers every question, ensuring they interact with all course material Learning analytics allows for online peer grading and self-grading because educators can monitor correlations between current vs. past performance and teacher vs. peer/self-grading Learning analytics can help educators identify students who are initially slow but surge ahead later, proceeding from the appearance of struggling to gifted in a couple of weeks Learning analytics can identify common wrong answers and create custom responses crafted to help address the specifics of each particular wrong answer

#11 – The Cloud Provides a Common Learning Platform for Training Institutions Presentations Finance Training Contacts Email Database Spreadsheets Forums Calendar Videos Collaboration Quiz Storage Readings Desktop Assignments Notebook Cloud enhanced goi l earning to reah all over india. # 11 - The cloud enhances the ability to reach all corners of the India More learning organizations moving to the and t this will require training insitutions to fundamentally rethink how they deliver applications and services to learners? Share content and experience ffor goi . Is your training organization ready? Why consider cloud computing – what are the ADVANTAGEs : Lower costs [hardware, software, maintenance] Reliable data storage Unlimited storage space Easier group collaboration Universal file access from anywhere anytime Improve computer performance Infrastructure can be scaled as business requirements evolve. Relevance for GOI each AITY does not haave to maintain a separate learing paltfrom and in stead can benefit by sharing an all india cloud platform. Smartphone Tablet

#12 – Metrics Holds the Key to a Continual Improvement Process CAPTURE DATA TO IMPROVE, ROI, BENCH MARK AGAINST INDUSTRY NORMS Satisfaction Learning Adoption Utility Efficiency Alignment Attainment Did you reach the desired audience? Did they complete or comply as desired? Who did not comply and why? How well do the programs solve the workforce's particular problems? How well did it align to the specific job related problems and issues? Would learners recommend this program to their peers? How efficient and cost-effective was it? How did it compare to other similar programs or competitive programs? How well did it use the learner's time? How well were program business priorities defined? How well did business units buy in on the value of this program relative to other investments? How well did you meet specifically defined client (business user or customer) objectives? These may be revenue, time to market, compliance, time to complete, etc., Activity Individual Performance Organizational Performance

Take Aways Approach technology pragmatically. Extend the classroom. Extend the discussion. Extend ways to measure success Increase the scale & impact.

Welcome Your Questions Career long learning Welcome Your Questions