1. Demonstration of Narrative Analysis Software (NVivo 7.0) Lori Kurth and Fumiyo Tao Abt Associates Inc.

2. Overview Quantitative and qualitative analysis of first year MSP reports Types of qualitative data Method of qualitative analysis Coding categories Software demo Developing models from analyses Questions and comments

3. Quantitative and Qualitative Analyses Quantitative analyses for numerical Project Profile data Qualitative analyses of narrative data in Project Profiles and Project Narratives Preliminary quantitative analyses and some qualitative analyses from Project Profile data presented tomorrow

4. Types of Qualitative Data Attributes –Definable characteristics of a project (e.g., content area or grade span) Larger categories –Specific themes of PD activities and evaluation (e.g., details of summer institutes or matched comparison evaluation design)

5. Method of Qualitative Analysis NVivo 7.0 software –Flexible coding of narrative data within specific categories –Analyze data within and between categories

6. Coding Categories *See Coding Tree handout (end of slides) 1 Description of Project 2 Characteristics of Professional Development 3 Project Evaluation

7. Software Demo

15. Developing Models from Analyses Materials and assessments  PD models

16. Questions and Comments

17. DRAFT Coding Tree - ED MSP APR Narrative Data 1 Description of Project 1-1 Goals 1-1-1 Goals – Addl info 1-2 Abstract 1-3 Partners and their Roles/Providers 1-3-1 Partners and their Roles/Providers – Addl info 1-4 1-4 Other Information on Project (Including Budget, Schedule, Antic Outcomes, Dissem Plans, Innovative Activ, Lessons Learned, Future Plans, etc) 1-5 Appendices 1-6 Great Quotes on Project 2 Characteristics of Professional Development 2-1 Types of PD Activities and Structure 2-1-1 Summer Institutes 2-1-2 On-line Course Work 2-1-3 Distance Learning Networks 2-1-4 On-site Professional Learning Experience 2-1-5 Study Groups 2-1-6 Types of PD Activities and Structure – Addl info 2-2 Content 2-2-1 Math Content Only 2-2-2 Science Content Only 2-2-3 Math and Science 2-2-4 Other 2-2-5 Content – Addl info 2-3 Resource Development (including curric materials, use for states not implementing a PD program) 2-4 Needs of Districts/Participants (including basic info on participants and recruitment and retention issues) 2-4-1 Needs of Districts/Participants – addl info,including names, #s, etc. 2-5 Purposes of PD Activities 2-5-1 Train teacher leaders/mentors/coaches 2-5-2 Increase teacher content knowledge 2-5-3 Purpose of PD Activities – Addl Info 2-6 Other PD Information 2-7 Great Quotes on PD

18. DRAFT Coding Tree (continued) ED MSP APR Narrative Data 3 Project Evaluation 3-1 Evaluation Design and Analysis Methods 3-1-1 Evaluation Design and Analysis Methods – Addl info 3-2 Student Assessments 3-2-1 Math State Assessment 3-2-2 Science State Assessment 3-2-3 Other Assessment 3-2-4 Student Assessments – Addl info 3-3 Teacher Assessments 3-3-1 Tchr Content Knowledge Assessment 3-3-2 Classroom Observation Protocol 3-3-3 Other 3-3-4 Teacher Assessments – Addl info 3-4 Student Findings 3-4-1 Student Findings - Addl info 3-5 Teacher Findings 3-5-1 Teacher Findings - Addl info 3-6 School-Level Findings 3-6-1 School-Level Findings - Addl info 3-7 Other Evaluation Information 3-8 Great Quotes on Evaluations