1. WestEd.org DATA LITERACY – DISCURSIVE CONSTRUCT AND CAPACITY-BUILDING CHALLENGE Ellen B. Mandinach Edith S. Gummer Jeremy M. Friedman WestEd 26 th Annual Management Information Systems (MIS) Conference February 15, 2013

2. WestEd.org Three Projects: The Foundation for our Thinking Spencer Foundation Convening Gates Foundation Data Literacy Conference Dell Foundation Schools of Education Project 2

3. WestEd.org Take Home Messages from the Spencer Convening Lack of clarity in the terminology Developmental continuum for educators’ acquisition of data literacy skills and knowledge is unknown Process to elevate the importance to schools of education to have them help build human capacity is complex How best to integrate data literacy into higher education – stand-alone or cross program? Recognition of the systemic nature of the issue Courses or integrated suites of courses? 3

4. WestEd.org Take Home Messages from the Gates Conference on Data Literacy There is a language issue – data literacy means different things to different people Data literacy may involve different knowledge and skills for different stakeholders It is difficult to determine the necessary skills along an educator’s developmental continuum Texts that address data literacy are variable and potentially superficial Data literacy professional development does not go far enough There is perhaps 95% agreement in what data literacy means; the remaining 5% remains elusive Is that good enough? 4

5. WestEd.org The Dell Project: Objective To understand how many and what kinds of courses and experiences are being offered in schools of education that help prepare educators to use data. 5

6. WestEd.org The Dell Project: Components Survey Syllabus Review Case Studies Licensure and Certification Requirements Review 6

7. WestEd.org The Dell Project: The Survey Original Objective – Examine what schools of education are doing to enhance educators’ data literacy Revised Objective – Examine what schools of education are doing to enhance teachers’ data literacy 7

8. WestEd.org The Dell Project: Syllabus Review Purpose – The drill down to see what courses address (compare to text review) Rubric – Constructing a rubric to analyze the syllabi Indicators – Under development What topics covered? What texts and readings? What skills and knowledge? What practices introduced? 8

9. WestEd.org The Dell Project: Case Studies Purpose – Conduct an in-depth examination of exemplar programs to identify curricula patterns, practica experiences, professorial capacity, vision What we are looking for Potential sites » Western Oregon University » Alverno College » Teach For America Suggestions? 9

10. WestEd.org The Dell Project: Licensure Requirements Purpose – To examine existing licensure and certification requirements for data literacy skills Methods Collaborators – The Data Quality Campaign, NASDTEC 10

11. WestEd.org The Dell Project: Outreach Purpose – To discuss the leverage points with diverse data holders to effect change Our plans for outreach and dissemination Collaborator – Data Quality Campaign 11

12. WestEd.org The Dell Project: The Survey – Implications for the Change in Focus Use of data for instructional purposes moves to the front of the focus – Formative assessment Leaves us with a continuing problem of how to distinguish assessment literacy from data literacy Makes seeing the difference between assessment courses and courses that prepare teachers to use other data problematic Decrease attention to other sources of data Missing an essential group that may be more the focus of higher education than teachers (i.e., preparation of administrators) 12

13. WestEd.org The Dell Project: Methodological Challenges Development Have we captured the essential elements of the courses? Do they align to the differing perspectives of the data literacy construct? Sharing our instrument How might we engage you in validation as a process ? Sharing our instrument How do we determine and reach the appropriate recipient(s) for the survey? How do we maximize the response rate? 13

14. WestEd.org Validation of Survey – Expert/Public Review Two questions Are we asking the right questions? Are we asking the questions right? Purpose for asking for your review Beginning of validation process Concerns about missing important constructs Willingness to share instrument 14

15. WestEd.org Process for the Review Prepared sections of the survey Purpose of the survey – is it clear? Individual sections – Are the instructions well described? Is the wording clear and understandable – jargon is used with reservations Mark up your sections with comments 15

16. WestEd.org Levels of Discussion With your neighbor General discussion Please return all copies – with your feedback and your email address if you want a copy of the finished survey. 16

17. WestEd.org The Dell Project: What Happens Next Objective – Using the findings from the survey, case studies and policy analysis to provide the impetus for schools of education to include data literacy in their curricula Identifying the levers of change Working with diverse stakeholders to focus and strengthen that change process 17

18. WestEd.org The Dell Project: What Happens Next What is the difference between elephants mating and establishing the importance of data literacy? Photo by Ellen Mandinach and Eli Gruber 18