1. Re-imagining the Learning Ecosystem
Time for New Approaches, Cultures,
Tools & Metrics
Sheila Jagannathan
World Bank Group
Washington DC

2. “.....Thus, to understand how countries grow and develop, it is essential to know how they learn and become more productive and what government can do to promote learning.” 
Joseph E Stiglitz

3. 1 2 3 Agenda Global Shifts in Capacity Development
Achieving Reach and Impact Through
E-learning
Emerging Trends in Learning Ecosystems

4. 1 2 3 Agenda Global Shifts in Capacity Development
Achieving Reach and Impact Through
E-learning
Emerging Trends in Learning Ecosystems

5. Is there a tectonic shift in learning today?
Question?
Is there a tectonic shift in learning today?
A. Yes…
B. No…

6. M O C YES - More Change in the Last 5 Years than in the 100 Years
Learning today
Not sitting in classroom, listening to lectures
Available at our finger tips, just-in-time and just enough
Create an action learning cycle of learning and immediate applying with feedback loops M O C
assive
pen
nline
ourse

7. Education Knowledge News Visible in our daily lives… THEN… NOW…
Golden Age of Education
(Codecademy / Coursera / Khan Academy…)
Interactive / Online / Accessible by
Anyone Anywhere Anytime
(Classrooms / Lectures / Reading Materials) .
Source: Kleiner Perkins Caufield Byers

8. India is changing too…More Governance and Less Government

9. Capacity Challenges Are Multiplying
Strengthen participative planning
Connect and learn from innovative platforms
Build cutting edge knowledge & skills
Citizen centric
Raise awareness & accountability
Best practices

10. Innovative Approaches
Leverage Global Shift
Challenge - Requires innovative approaches Building capacity to effectively deliver on these new ideas, requires a different type of learning: multi-sectoral, self-directed, collaborative, dialog and discussion with peers, real-time, action learning – learning labs, citizen centric learning, co-creating solutions, learning from global best practices, learning from failure.
The good news is that….
The way we consume knowledge and learning is changing…
Mix of formal and informal
Facilitated and self-directed
Video based and mobile
Collaborative, interactive, networked…..
New Solution Sets to Build Competencies
New pedagogy
New Technologies
New Delivery Methods
New ways to measure results…
Innovative Approaches
For new competencies

11. 1 2 3 Agenda Global Shifts in Capacity Development
Achieving Reach and Impact Through
E-learning
Emerging Trends in Learning Ecosystems
My presentation today will be in three parts
First, I will talk about the significant shifts in global capacity development
Next, explore elearning and the opportunities it provides to scale up and accelerate impact Third, share with you emerging trends in learning ecosystems that is relevant to this Conference.

12. Digital collaboration
A Common Language for e-Learning
The use of electronic technologies to deliver, facilitate, & enhance both formal & informal learning at any time, any place & at any pace.
Computer, Internet & their applications including CD-ROM,
, Web sites, & multimedia,
social media…
Massive
Open
Online
courses
Facilitated
courses
Self paced
modules
Multimedia
Tutorials
Interactive
Simulations
Digital collaboration
Podcasts
E-books
CD-ROM/
DVD
E-discussions
Blogs, wikis, CoPs..
Games
Webinars
Virtual classrooms

13. E-learning Experiences – Brazil, Mexico and China
Why E-learning?
Why E-learning?
Why E-learning?
Large populations of slum dwellers need
better services
$80 billion allocation available from
Federal Govt to implement national
housing policy.
Planners and City officials need training
on the ‘how to’ aspects of upgrading
3 tier structure - feedback loop to policy
makers at municipal, state and Federal
Why: Massive unmet demand from individuals & institutions in public & private sector, civil society in a rapidly changing economy
Comprehensive pedagogical Model that focuses on application.
Quality education and training that transcends time and space barriers
Participants welcomed from all walks of life
Establish learning communities encouraged to share knowledge and innovate
Build capacity for accountable institutions
Large scale urbanization has led to
growth in demand for urban planners
Urban Planning Society of China
interested in building a National E-
learning Hub
Responding to concerns at the NDRC
(Planning Commission) level about
unplanned urbanization
Continuing education needs of planners
Results
Results
Results
10 week, facilitated fully on-line course (Week1 Orient; 9 weeks core themes)
Blends theory and “how-to”
Goes beyond public officials to also include civil society and private contractors
1st piloted in 1 region (NE); then scaled up 10,000 participants trained.
Certificates issued at end of course
Drop out rates reduced from first to
second offering (17.7% to 10.99)
18,500 graduated students since 1989
1.14 million continuing education
1.5 million practitioners interacting
through CoPs
24 countries have benefited
100,000 participants in this program and
other e-courses organized by Chinese
Academy of Governance
Creative Knowledge sharing and delivery
participants increase from 610 in 2001 to
3800 in 2011
Partnerships established for sharing data,
research through papers and virtual
workshops
Gateway to Chinese Planning community

14. E-learning Experiences - India
Why E-learning?
Why E-learning?
Scale up disaster education in India
10 courses customized from LLI global modules;
delivered as facilitated e-learning.
Feedback to assignments and project work
provided by virtual experts.
Need to scale and disseminate urban land use planning skills to large groups of mid-career planning professionals, urban practitioners, policymakers and city managers from various city and state government departments
Goals: Working with NIUA to ensure that participants have a functional and integrated understanding of the dynamics of urban land use in India; and demonstrate how to effectively utilize policies and planning instruments available.
Global WBG Modules are being customized to Indian context:
Understanding How Land Use Planning Contributes to Sustainable Urban Development
Institutions, Policies and Tools for Effective Land Use Planning
How to Integrate Land Use Planning and Infrastructure
How to Manage Growth in Peri-Urban Areas
How to Promote Local Economic Development
Results
Over 5,000 peole trained nationally (certified)
Training of trainers, cadre of facilitated and
community has emerged.

15. Mostly free and accessible to ALL
MOOC Characteristics Support Access, Cost and Quality
Global & Distributed
Rich diversity of
ideas from many
regions, cultures
and perspectives
Massive
10, ,000
Open
Mostly free and accessible to ALL M O C
assive
Participatory
Conversational and
collaborative
opportunities
Flexible
Learners can select
level of
participation
– a la carte
pen
nline
ourse
Life-long learning
Ongoing CoPs,
support
& feedback
Learning Analytics
Track how
learners learn

16. Benefits of E-learning
Cost-efficiency, Reusability & scalability, Consistent Quality, Bridging of distances
Cost-efficiency/Scalability
Low cost delivery (travel, no time out)
Flexible & convenience
Quality
Improved learning
Apply while you learn
Consistent quality of engagement
Reuse/Customization
Customized to local languages, stakeholders
Customization and replication
Networking & Learning communities
Continuous learning
Just-in-time
Expanded participant reach

17. Mindset & low acceptability Lack of favorable policies
Limitations for E-learning: Some Surprises!
High
Pedagogical Limitations: % drop-outs; multimedia, facilitation, relevance and making it required
Time limitations: Participants availability on a continued basis over, e.g. 2-4 weeks
Mindset & low acceptability
Quality Content
Poor connectivity
Lack of favorable policies
Financial limitations: High initial investment (time & money)  focus on scale and shelf life
Infrastructure limitations: Low bandwidth, off-line, blending
Audience limitations: not
everywhere a “culture” of online
interaction. Support &training
Low

18. 1 2 3 Agenda Global Shifts in Capacity Development
Achieving Reach and Impact Through
E-learning
Emerging Trends in Learning Ecosystems

19. #1 – Understand the Mid-Career Learner
GoI’s national training strategy, as we are seeing in several other countries is re-imagining the mid career learner. There is a recognition that competencies in knowledge, skills and behaviors have to be constantly enhanced to meet various challengies. At the same time officials are overwhelmed with responsibilities and crises in their work, The mid career learner needs untetethered, collaborative and just in time inputs we will be elaborating in this presentation.

20. Learning for Development – Beyond “Transfer of Knowledge”
#2 – Reimagining Learning for Development
Learning for Development – Beyond “Transfer of Knowledge”
LEARNING IS ABOUT
LEARNING IS NOT ABOUT
Building applied problem-solving
skills
Multi-sectoral (everything is linked to everything else)
Results focused (evidence-based solutions translated into practical, accessible learning)
Evaluating what worked and did not worked
Helping us unlearn and let go what is not on the critical path
South-South knowledge exchange allows crucial exchange of tacit knowledge
Networking & and participating in e- community
GLOCAL – Local + Global
Pls put what is learning not about to the left.
F2F alone. It’s multi-channel and connected, using technology to achieve scale while promoting interactivity and collaboration
Not one off, but CONTINUOUS

21. Create a ‘Lean’ Learning Environment
#3 – Focus on Results – A Systematic Design Approach
Group and organize methods in a series of events
Assemble the events to a program
Really would prefer a b etter visuals that shows the agile model
Pick the appropriate delivery modes
Select the tools that best facilitate the identified methods
Determine what level of evaluation is appropriate
Compare actual with desired outcomes
Assemble program
Monitor and
evaluate the
program
Select tools
Choose the appropriate methods to reach the objectives
Identify
Learning
Methods
Create a ‘Lean’ Learning Environment
Define
Outcomes &
Objectives
Identify the audience
Set the learning objectives 21

22. #4 – Rebalance Informal with Formal Learning
Learning Technology is used to support both formal and informal learning modalities
Encourage learning without walls – rise of social learning.
The trend we are seeing in high impact learning organizations is that only 10% of learning occurs through formal settings, the rest – 90 happens through informal and spontaneous, just in time and on the job learning.
As we will discuss next, E-learning including the emerging learning technologies make this possible.
Formal programs, including eLearning, are being combined with social learning, experiential learning, and ongoing support and reinforcement to support a continuous learning environment
For example, if someone has a co mpetency gap in skills on how to m anage a large office, a formal learning in the ATI can be complemented by informamtl learning in the probationalry periods and in today’s world by using accessing webinars, podcasts, e-courses ettc.
Source: Next Learning Unwrapped, Nick van Dam (2011) 22

23. #5 – Move from One-Off to Continuous Learning
E-Learning as one component of the continuous learning environment .
Source: Bersin by Deloitte, 2013 23

24. Collaborative writing Problem-based learning
#6 – Immersive Learning Produces can be Designed for Best Results
Learning Pyramid
Average
Retention Rate 7
Teach others/Immediate Use
90% 6
Practice by Doing
75%
Active 5
Discussion Group
50% 4
Demonstration
30% 3
Audio-Visual
20%
Passive 2
Reading
10%
Active learning produces 70-80% retention rates 1
Lecture 5%
Source: National Training Laboratories, Bethel, Maine
Best practices
Storytelling
Conceptual map
Wild glossary
Collaborative writing
Discussions
Role play
Learning contracts
Listening teams
Case-based learning
Keeping journals
Simulation
Group work
Game-based learning
Problem-based learning
Brainstorming
Discussion forum
Follow up
Interview
Tests

25. Example: Engaging Health Professionals through Game Infused E-Learning
Interactive tools ensure a collaborative, impact-focused, educational experience that allows for tailored learning for students/ participants
Blend of an 8 week facilitated e-learning course with a 3D
Immersive Game around the theme of
Results Based Financing (RBF)
Share experiences via the community dashboard as part of knowledge building
Participants learn
in an engaging
matter about RBF
Collaborate with others
Apply concepts to a learning scenario
Audience: Health and Financial policy makers at the national and district level

26. # 7 – Social Learning Matters
Example: Strengthening Local Government Capacity in South-East Europe
City-to-city dialogue series
Municipal finance (e.g. revenue improvement, expenditure
mgmt, public asset mgmt, performance measurement)
Urban planning & land management
Urban service delivery
Hands-on capacity building
Direct link with challenges on the
ground
LGs to engage in self-
assessments
F2F
E-learning
Global curriculum: e-Institute
Regional Partner: CEU
Local Partners: NALAS + NLGA
*for marketing, dissemination,
translation
E-Institute
Learning Labs
Dialogues
I am sure each and every one of you have benefitted from peernteraction in a f2f sitau tion. Now we do similar things thru a blend of elearning and f2f in innovative ways.
This slide shares an examples of how citis in SE Europe have been able to improve their urban planning thru a combo of f2f and eleanring , with city to city dialogies thru VC and or web-based software and social media , learning lab to analyze to develop solutions to stickly problems
Besides there is a move towards learning without walls- using social media tools
Use asy toolse-discussions , reflective type of learning e-discussions, cop, podcasts, ted talks, curated learning blog, wiki, face book, yammer etc.
Sch tools permit real time interactions google hangout on air, Skype vc, audio, webinar/webcast, messging, chat To:
Engage Advise Share Learn Brainstorm Peer Review Decide
Social Learning is extremely effective when included as part of a structured learning program, such as eLearning. For example, a formal course can be followed with a learner discussion forum ---- amplify learning

27. #8 – Enhancing Facilitation by Virtual Experts
Facilitation by virtual experts improves learning effectiveness
Learner
Content
Server
Self-paced
Community
Thematic
Facilitated
Learner
Peer
Facilitator
Content
Process
Technical
Blended Courses

28. #9 – The Future of Learning is Mobile
Mobile learning provides learners with anytime/anywhere access to learning and continuous support (18% mobile users among 3.6 global users)
Popular delivery mode but under used
But use creatively – not about dumping as is
Responsive design
Allows for customization via location-specific tools for tracking and collaboration
Allows learners to create apps to share knowledge
Recording Information
Games/Simulations
Assessment
Reading
Images
Mobile
learning
through
Audio
Apps
Polling
Collaboration
Searching
Context/Location
Support and Coordination
Source: Nick van Dam, Next Learning, Unwrapped 2011

29. #10 – Leveraging Learning Analytics to Continually Improve Performance
Learning analytics can be customized to student needs, allowing students to get a better, faster picture of their performance
Unlike a classroom setting every student in a course using learning analytics answers every question, ensuring they interact with all course material
Learning analytics allows for online peer grading and self-grading because educators can monitor correlations between current vs. past performance and teacher vs. peer/self-grading
Learning analytics can help educators identify students who are initially slow but surge ahead later, proceeding from the appearance of struggling to gifted in a couple of weeks
Learning analytics can identify common wrong answers and create custom responses crafted to help address the specifics of each particular wrong answer

30. #11 – The Cloud Provides a Common Learning Platform for Training Institutions
Presentations
Finance
Training
Contacts
Database
Spreadsheets
Forums
Calendar
Videos
Collaboration
Quiz
Storage
Readings
Desktop
Assignments
Notebook
Cloud enhanced goi l earning to reah all over india.
# 11 - The cloud enhances the ability to reach all corners of the India
More learning organizations moving to the and t this will require training insitutions to fundamentally rethink how they deliver applications and services to learners?
Share content and experience ffor goi
. Is your training organization ready?
Why consider cloud computing – what are the ADVANTAGEs :
Lower costs [hardware, software, maintenance]
Reliable data storage
Unlimited storage space
Easier group collaboration
Universal file access from anywhere anytime
Improve computer performance
Infrastructure can be scaled as business requirements evolve.
Relevance for GOI each AITY does not haave to maintain a separate learing paltfrom and in stead can benefit by sharing an all india cloud platform.
Smartphone
Tablet

31. #12 – Metrics Holds the Key to a Continual Improvement Process
CAPTURE DATA TO IMPROVE, ROI, BENCH MARK AGAINST INDUSTRY NORMS
Satisfaction
Learning
Adoption
Utility
Efficiency
Alignment
Attainment
Did you reach the desired audience?
Did they complete or comply as desired?
Who did not comply and why?
How well do the programs solve the workforce's particular problems?
How well did it align to the specific job related problems and issues?
Would learners recommend this program to their peers?
How efficient and cost-effective was it?
How did it compare to other similar programs or competitive programs?
How well did it use the learner's time?
How well were program business priorities defined?
How well did business units buy in on the value of this program relative to other investments?
How well did you meet specifically defined client (business user or customer) objectives?
These may be revenue, time to market, compliance, time to complete, etc.,
Activity
Individual Performance
Organizational Performance

32. Take Aways Approach technology pragmatically. Extend the classroom.
Extend the discussion.
Extend ways to measure success
Increase the scale & impact.

33. Welcome Your Questions
Career long learning
Welcome Your Questions