1. 1 Academic Support Grantee Data Training Academic Support Grantee Data Training Department of Education Hoagland-Pincus Center (UMass) Shrewsbury, MA January 13, 2005

2. 2 FY04 School Year Programs Highlights (all fund codes) 248 districts, high schools, community colleges, and partnering organizations served 8,653 students in the classes of 2003-2006. Participating students each received an average of 27.3 hours of MCAS remediation service. 4,234 of the students served earned their competency determination (CD) after participation in the program. 24% more students participating in AS programs earned their CD compared to those not participating in AS programs (60% compared to 36%).

3. 3

4. 4 FY04 School Year Programs - Highlights (all fund codes) 58% of programs took place during the school day, 37% during extended time (before or after-school/evening), 5% during the weekend. 70% of programs focused on mathematics; 30% on English language arts. 18% of students served were from vocational schools. 50% of participating students received individual (1 teacher:1 student) or smallest group instruction (1:2-5), 45% received small group instruction (1:6-10), and 5% received an “other” type of instructional model.

5. 5

6. 6

7. 7

8. 8

9. 9

10. 10 Included in reports for legislature and Board of Ed. Viewed as a reflection of program effectiveness Influences TA provided to grantees Considered when determining funding amts. for grant programs and individual grants Cost per pupil #’s served Completion rates Gains made on MCAS tests Dosage effect (effect of increased participation hrs.) How Department Uses Academic Support Data?

11. 11 What Type of Data is Collected/Selected? SASID Student Name, Grade, School Fund Code (School Year / Summer) Allocation Grants 632/625 – Districts/Approved SPED Schools Competitive Grants 596/597 – Work and Learning Programs 598/593 – Community Colleges/Partners 619/592 – Districts/Partners

12. 12 What Type of Data is Collected/Selected? Project Info. (e.g. ELA3D – HS English during day) Content AreaGrade Levels Schedule Type MTH - Math3 - HSD – During ELA – English Lang. Arts 8 - VocationalE - Extended 9 – SPED Placement T - Weekend 0 – 9 th /10 th S – Summer Vacation

13. 13 What Type of Data is Collected/Selected? Instructional Model (Teacher:Student) 1:1 (Individual) 1:2-5 (Smallest Group) 1:6-10 (Small Group) Other (*Note: Must explain in narrative evaluation) Hours of Service per Student Pre/Post MCAS Scores (*Note: Entered by Department)

14. 14 What Type of Data is Collected/Selected? Student Status – Completed Program: Participated in at least 75% of possible hours of service – Withdrew: Participated in fewer than 75% of possible hours of service – Enrolled, but did not attend : Initially enrolled; zero hours of service – Participated until receipt of 220+ score: Attended program until s/he learned (during the program) that s/he passed the most recent MCAS test; hours of service > zero – Transferred out of school/district: Student was enrolled and may have attended, but s/he did not complete program due to transferring out of the school/district.

15. 15 How to Use Data? Inform narrative evaluations and future proposals Improve your program Do we need to increase outreach efforts? Is Day vs. Extended better for attendance and outcomes? Are more service hours correlated to greater MCAS gains? Was there more success with ELA vs. MTH – why? What was the most important factor for MCAS score gains? Build support for your program ( e.g. present data to school board or to other potential funders)

16. 16 How to Improve Data Collection? Appoint central person to plan collection and input data into security portal. Make sure central person has access to security portal and is aware of deadlines. Have central person share with program instructors the data that needs to be collected, their role in the collection process, and why it is collected.

17. 17 How to Improve Data Collection? Suggestions: Maintain data in an excel spreadsheet before inputting into the security portal. (http://www.doe.mass.edu/as/data/as_template.xls) Start entering data into security portal at least two weeks before due date to account for issues that may arise and so that it can be used to inform your narrative. (http://www4.doemass.org)

18. 18 When are the Data Submission Due Dates? Session Times: Data Due Dates Fall (Sept. to mid-Nov).: 1/31/05 * Winter (Late-Nov. to early-Mar.): 4/30/05 Spring (Feb/Mar. to May/June): 7/31/05 ** Summer (July to August): 9/30/05 ** * Mid-year narrative evaluation & data reports due for fund code 598. ** Narrative evaluations due for all fund codes (& for FC598/593 data report).

19. 19

20. 20

21. 21

22. 22

23. 23

24. 24

25. 25

26. 26

27. 27

28. 28

29. 29 Questions? Contact Allison Ward, Academic Support Data Specialist Tel: 781-338-3232 Email: ACsupport@doe.mass.edu Website: http://www.doe.mass.edu/as/data