1. VSS Pre-Conference on Research & Evaluation, 11/14/2009 Evolving Evaluation of a State Virtual School Tom Clark, PhD TA Consulting

2. Consulting 2008-09 Evaluation Team John Watson & Jennifer Ryan Evergreen Consulting Cathy Cavanaugh Drs. Cavanaugh/UF Meredith DiPietro UNC-Charlotte Tom Clark TA Consulting

3. Consulting MoVIP in 2008-09 Year 2 MoVIP Management Approach DESE oversight Separate instructional management vendors, K-5 & 6-12 in Y1/Y2 Bocavox SIS used across K-12 Year 2 Enrollments 15,810 enrollments in semester classes 8,478 - Fall 2008 7,332 – Spring 2009

4. Consulting MoVIP in 2008-09 F-TP-TTOTAL K-5:372399771 6-12:31217842096 TOTAL68421832867 Unique Finally Enrolled Students

5. Consulting National SVS Enrollments, 2008-2009 Source: Keep Pace with Online Learning (in press)

6. Consulting MoVIP Evaluation Plan 1. Are Courses and Teaching High Quality? 2. Are Equal Access and Enhanced Options Being Provided? 3. Are Infrastructure and Support Services Effective? 4. Is Student and Program Success Being Ensured?

7. Consulting Course & Teaching Quality Survey ItemParents 6-12 Facili- tators MoVIP offers high quality courses Spring 2009 Fall 2008 Spring 2008 91% 90% 97% 100%

8. Consulting Course & Teaching Quality Survey ItemK-5 Students 6-12 Students Courses Challenging Spring 2009 Spring 2008 85% 86% 83% 88% Courses too Difficult Spring 2009 Spring 2008 13% 12% 34% 47%

9. Consulting Course & Teaching Quality Survey Item6-12 Students Facili- tators A Good Teacher Spring 2009 Spring 2008 94% 91% 89% 94% Teacher Responds Spring 2009 Spring 2008 84% 82% 84% 78% Teacher Helps Spring 2009 Spring 2008 88% 78% 88% 85%

10. Consulting Equal Access and Options 40+ presentations statewide by MoVIP Director in Y2 Outreach to rural districts in Y2 School of Choice designation in Y2 High-enrolling urban districts (KC, STL) Minority and low income students Elementary division more diverse Good FRL representation in secondary 236 classes available; 89% increase

11. Consulting Meeting Curricular Needs Survey Item6-12 Facilitators MoVIP Benefits Students Spring 2009 Spring 2008 94% 93% MoVIP Benefits District Spring 2009 Spring 2008 91% 88%

12. Consulting Technology & Support Survey Item 6-12 Stu- dents 6-12 Parents 6-12 Facili- tators Computer prob- lems don’t keep students from learning Spring 2009 Spring 2008 66% 62% 76%65% 60%

13. Consulting Student & Program Success Completion rates improving Higher completions by grade level, other factors State End of Course Tests English II –higher than state average Algebra I – NSD Biology –lower State MAP Tests Statistical comparisons yielded some promising results NCLB subgroup means often higher than state

14. Consulting Student & Program Success Grade/ Subject WhiteIEPFRLAll Students 4 th Gr. CA NSD Sign. Higher NSD 4 th Gr. Math NSD Sign. Higher NSD NSD

15. Consulting Student & Program Success The wide range of data available allowed analysis of success factors. Some early results: Time spent in the LMS influenced learning outcomes positively in 11 out of 15 high enrollment courses Lack of economic disadvantage Influenced outcomes in 5 courses Full-time status Influenced learning in 5 courses

16. Consulting Recommendations Continue to review internal policies Address legislative policy issues that may limit ability to meet mission Build a positive school culture Build a leading PD system Share course review process

17. Consulting Recommendations Improve rapport with facilitators Work with home study families Address special education concerns Address common tech problems Monitor key learning indicators

18. Consulting Thank You! Tom Clark, PhD TA Consulting taconsulting@yahoo.com Mobile: (217)585-1539 On behalf of TA Consulting and Associates