Demonstration of Narrative Analysis Software (NVivo 7.0) Lori Kurth and Fumiyo Tao Abt Associates Inc.

Overview Quantitative and qualitative analysis of first year MSP reports Types of qualitative data Method of qualitative analysis Coding categories Software demo Developing models from analyses Questions and comments

Quantitative and Qualitative Analyses Quantitative analyses for numerical Project Profile data Qualitative analyses of narrative data in Project Profiles and Project Narratives Preliminary quantitative analyses and some qualitative analyses from Project Profile data presented tomorrow

Types of Qualitative Data Attributes –Definable characteristics of a project (e.g., content area or grade span) Larger categories –Specific themes of PD activities and evaluation (e.g., details of summer institutes or matched comparison evaluation design)

Method of Qualitative Analysis NVivo 7.0 software –Flexible coding of narrative data within specific categories –Analyze data within and between categories

Coding Categories *See Coding Tree handout (end of slides) 1 Description of Project 2 Characteristics of Professional Development 3 Project Evaluation

Software Demo

Developing Models from Analyses Materials and assessments  PD models

Questions and Comments

DRAFT Coding Tree - ED MSP APR Narrative Data 1 Description of Project 1-1 Goals Goals – Addl info 1-2 Abstract 1-3 Partners and their Roles/Providers Partners and their Roles/Providers – Addl info Other Information on Project (Including Budget, Schedule, Antic Outcomes, Dissem Plans, Innovative Activ, Lessons Learned, Future Plans, etc) 1-5 Appendices 1-6 Great Quotes on Project 2 Characteristics of Professional Development 2-1 Types of PD Activities and Structure Summer Institutes On-line Course Work Distance Learning Networks On-site Professional Learning Experience Study Groups Types of PD Activities and Structure – Addl info 2-2 Content Math Content Only Science Content Only Math and Science Other Content – Addl info 2-3 Resource Development (including curric materials, use for states not implementing a PD program) 2-4 Needs of Districts/Participants (including basic info on participants and recruitment and retention issues) Needs of Districts/Participants – addl info,including names, #s, etc. 2-5 Purposes of PD Activities Train teacher leaders/mentors/coaches Increase teacher content knowledge Purpose of PD Activities – Addl Info 2-6 Other PD Information 2-7 Great Quotes on PD

DRAFT Coding Tree (continued) ED MSP APR Narrative Data 3 Project Evaluation 3-1 Evaluation Design and Analysis Methods Evaluation Design and Analysis Methods – Addl info 3-2 Student Assessments Math State Assessment Science State Assessment Other Assessment Student Assessments – Addl info 3-3 Teacher Assessments Tchr Content Knowledge Assessment Classroom Observation Protocol Other Teacher Assessments – Addl info 3-4 Student Findings Student Findings - Addl info 3-5 Teacher Findings Teacher Findings - Addl info 3-6 School-Level Findings School-Level Findings - Addl info 3-7 Other Evaluation Information 3-8 Great Quotes on Evaluations