1. Learning Metrics Task Force Overview and Results of First In-Person Meeting October 2012

2. Project Overview

3. Contents Learning Metrics Task Force Overview: o Purpose and Objectives o Structure and Roles o Process and Timeline New York City Meeting Results: o Meeting Objectives o Consultation Process, Participants, and Results o Revised Framework o Key Decisions o Topics of Discussion o Next Steps

4. Why focus on learning? Despite commitments and progress in improving access to education at the global level (i.e., EFA Goals and MDG 2), learning levels are still low. It’s estimated that 171 million people could be lifted out of poverty if all students in low- income countries left school with just basic reading skills. (Education First, UNSG, 2012)

5. Why now? A confluence of global policy events has created a unique window of opportunity for the education sector to raise the profile of international education goals and ensure that learning becomes a central component of the global development agenda. EFA MDGs Education First To do this, the global education community must work collectively to define global ambition on improving learning and practical actions to deliver and measure progress.

6. What do we aim to accomplish? The overarching goal of the Learning Metrics Task Force is to catalyze a shift in the global conversation on education from a focus on access to access plus learning. To achieve this goal the task force will develop recommendations to help countries and international organizations measure and improve learning outcomes for children and youth.

7. Why shift the focus from just access to access plus learning? At least 250 million primary school age children around the world are not able to read, write or count well, even for those who have spent at least four years in school. (EFA GMR 2012) We must get better at measuring outcomes in addition to inputs. So in addition to enrollment and completion data, we must also measure and improve learning.

8. Core Questions To achieve its objectives, the Learning Metrics Task Force will address three main questions over the course of its deliberations: 1.What learning is important from early childhood through post-primary? 2.How should learning be measured? 3.How can national, regional, and global organizations work together to implement these measures to improve learning opportunities and outcomes for children and youth?

9. Project Structure and Roles Task Force: Led by three Co-Chairs and representing UN agencies, civil society, bilateral donors, government, and private organizations High-level representatives who can serve as decision-makers and strong advocates for the project recommendations Working Groups: Technical experts who work collaboratively to develop recommendations for consideration by the task force Based on the three guiding questions of the task force, the working groups will cover three topics in succession: standards/competencies, measures and methods, implementation Consultation Process: Engages a broad spectrum of education actors both online and in person Takes into account adaptability and applicability to specific contexts and collects input and feedback on working group recommendations

10. The Consultation Process Any effort to develop a shared vision for global learning goals and targets must be open, inclusive, and transparent. The task force seeks input from a wide variety of stakeholders through a global consultation process to be conducted both online and in person. The objectives of the consultation process are to: Engage a diverse group of actors at the political and technical levels to achieve maximum efficacy and impact. Compile feedback and input on appropriate competencies for measuring learning in various contexts to inform the final recommendations presented to the task force.

11. Project Process and Deliverables

12. Project Timeline JULAUGSEPOCTNOVDECJANFEBMARAPRMAYJUN = TASK FORCE MEETINGS JULAUGSEPOCT 20122013 LAUNCH STANDARDS WORKING GROUP MEASURES WORKING GROUP IMPLEMENTATION WORKING GROUP = CONSULTATION PERIODS New York City Sept. 27-28, 2012 Dubai, UAE Feb. 20-21, 2013 Bellagio, Italy July 16-18, 2013 Call July 2012 Montreal TBD

13. NYC Meeting Results

14. Meeting Overview Date: 27-28 September 2012 Location: New York City Host: UNESCO Keynote: Dr. Qian Tang, Assistant Director-General for Education, UNESCO Attendees: 3 Task Force Co-Chairs 25 Task Force Member Representatives 2 Working Group Chairs 9 Secretariat Representatives 5 Observers

15. Meeting Objectives Review the results of the consultation process Discuss and make final decisions on the recommendations of the Standards Working Group Discuss a plan of action and identify additional opportunities for informing the post-2015 agenda Discuss a plan of action for engaging national-level stakeholders Evaluate the LMTF process to date and identify improvements if necessary

16. Consultation Process A preliminary draft of competencies was distributed for public consultation from 2 August through 3 September 2012 The purpose was to spark discussion and elicit feedback from a broad spectrum of education stakeholders The draft was available in Arabic, French, English, and Spanish A “consultation toolkit” with guidance on facilitation and sample discussion questions was also distributed

17. Consultation Participants During the consultation period, more than 400 individuals from 57 countries participated in online or in-person consultations.

18. Consultation Results Several broad themes emerged from the consultation feedback: Alignment Specificity Number of competencies Level at which standards are set How to measure/implement Based on this feedback, the Standards Working Group significantly revised its proposed framework for presentation to the task force.

19. Revised Framework* Note: This draft framework is intended for the purposes of the Learning Metrics Task Force to identify domains for measurable learning outcomes. It is not intended at this time to be used as a framework for policymaking, curriculum or instruction. Recommended domains and sub-domains in the areas of early childhood, primary, and post-primary are listed in the meeting summary document.

20. Key Decisions Over the 2-day meeting, the task force came to the following decisions: Seven learning domains (see previous slide) will be submitted to the Measures and Methods Working Group for recommendations on measurement. Sub-domains within each of the seven domains (see meeting summary document) will be offered to the Measures and Methods Working Group as guidance for areas of measurement. Not all of the seven domains are feasible for a potential global learning goal; accordingly, the task force recommends exploring a hybrid approach to measuring learning at the global and national levels. The Measures and Methods Working Group is charged with proposing options for a hybrid approach.

21. Key Decisions (continued) The recommendations of the task force will encompass comprehensive basic education, from early childhood to lower secondary (ISCED 2). The recommendations will seek to encompass children who are in school and those who are out of school, but the task force acknowledges that measuring learning of children in school may be more feasible.

22. Topics of Discussion How comprehensive should the framework be? Should the task force recommend global or national metrics? Will the task force make recommendations for all children or only those who are in school? Should learning be measured by age cohort or grade level? How far into the education lifespan will the task force’s recommendations extend? Will the task force make recommendations for how assessments can be used to improve learning? What is the timeline for proposed learning goals? While the task force broadly accepted the working group’s revised framework, attendees engaged in lively discussion and debate on specific domains and sub-domains, as well as larger questions about the project vision and scope. The following questions were major topics of discussion over the 2-day meeting. (See the full meeting summary document for details on each.)

23. Overall Consensus The proposed competencies framework (Slide 16) represents the task force’s vision for what every child everywhere should learn and be able to do, whether at the classroom, system, or global level, by the time they complete post-primary education. All seven domains should remain the aspiration for every child throughout the education lifespan. While we anticipate that global assessment capability will improve, we do not yet have perfect measures in all of these areas at the global level. The task for the Measures and Methods working group is to: Determine what subset of domains can be measured globally within our current capacity; and Identify options for a hybrid approach to measuring learning at the global and national levels.

24. Next Steps Based on the meeting outcomes, the task force will develop a final report with recommendations on what learning is important globally, to be released in December 2012. Participants for the Measures and Methods Working Group will be announced in November 2012. The working group will then begin developing a proposal for how to measure learning based on the framework approved by the task force. Task force members will activate networks and constituencies to conduct public consultations on the proposal of the Measures and Methods Working Group. The next consultation period is scheduled for December 2012 – January 2013. Task force members will also plan to hold regional consultations before the next in-person meeting, scheduled for 20-21 February 2013.

25. Next Steps (continued) Post-2015 Agenda: The task force will map out post-2015 discussions and develop a strategy for linking the work of the task force to the global education agenda. National-Level Engagement: The task force will develop guiding questions to go into the guidance that UNESCO provides for the in- country EFA review process. The task force will develop a comprehensive communications and consultation plan and accompanying communications tools to: Generate greater awareness and build understanding about the project. Increase participation in the project process and consultations. Position task force recommendations to inform the post-2015 development policy discourse. Build a supportive environment for and develop interest among national and regional actors to implement task force recommendations.

26. Learn more and get involved… For updates on the Learning Metrics Task Force and information about working groups and consultations, please visit http://www.brookings.edu/learningmetrics http:// To receive email updates on the Learning Metrics Task Force, please send your name, organization, and email address to: learningmetrics@brookings.edu learningmetrics@brookings.edu