1. Utilizing Student Academic Behavior Data to Improve Student Success Kira J. Holt Principal Consultant, ACT ©2012 by ACT, Inc. All rights reserved.

2. Workshop Agenda IntroductionCollege and Career Readiness ChallengeWhy Measure Academic Behaviors?What is ENGAGE and What Does It Measure?Administering ENGAGEENGAGE ReportsENGAGE ResourcesSummary and Conclusion

3. ACT’s M I S S I O N Helping people achieve education and workplace success ACT’s V A L U E S Excellence Diversity Leadership Empowerment Learning Sustainability

4. Workshop Agenda IntroductionCollege and Career Readiness ChallengeWhy Measure Academic Behaviors?What is ENGAGE and What Does It Measure?Administering ENGAGEENGAGE ReportsENGAGE ResourcesSummary and Conclusion

5. The College and Career Readiness Challenge On the one hand, as reported in Ready for College and Ready for Work: Same or Different (2006), college and career readiness skills have converged. On the other hand, in 2012 only 25% of graduating seniors who completed the ACT met all four of ACT’s College and Career Readiness Benchmarks.

7. ACT’s College Readiness Benchmarks The ACT Benchmark Score indicated a 50% chance of obtaining a “B” or a 75% chance of obtaining a “C” in corresponding credit-bearing college courses. College Readiness Benchmark Score Test College CourseEXPLORE (8/9)PLAN The ACT English English Comp.13/141518 Math Algebra17 /181922 Reading Social Sciences15/161721 Science Biology20/202124

8. MEASURING STUDENT PROGRESS TOWARD READINESS IMPROVING COURSE RIGOR SUPPORTING SOLUTIONS PLANNING SCHOOL IMPROVEMENT EXPLORE 8th and 9th grade curriculum-based educational and career planning program PLAN 10th grade curriculum-based educational and career planning program The ACT 11th and 12th grade curriculum- based assessment for learning outcomes ENGAGE Middle and high school assessment that measures all factors of academic success QualityCore Research-driven solutions for strengthening curriculum CoreWork Diagnostics Online service to diagnose and improve content and practice areas Core Practice Audit Framework for evaluating current practices ACT’s College and Career Readiness System

9. Workshop Agenda IntroductionCollege and Career Readiness ChallengeWhy Measure Academic Behaviors?What is ENGAGE and What Does It Measure?Administering ENGAGEENGAGE ReportsENGAGE ResourcesSummary and Conclusion

10. Why Measure Academic Behaviors? Identify at-risk students early Diagnose student strengths and needs Identify appropriate interventions Assess the effectiveness of interventions

11. What the Research Says… “current research across disciplines shows that non- academic aspects of school are also significant contributors to both school and student success.” (Page 2)

12. “While assessments of academic achievement provide early indication of risk, academic behaviors are also important for persistence and success.” (Page 1) What the Research Says…

13. “As a leading indicator, aggregate academic behavior assessment results help educators know that their programs are on the path to success long before improvements in lagging indicators, such as academic readiness or graduation rates, can be documented.” Enhancing College and Career Readiness and Success: The Role of Academic Behaviors, p.12

14. Research Summary Student Academic Success School Connectedness Student Academic Achievement Student Academic Behaviors

15. Workshop Agenda IntroductionCollege and Career Readiness ChallengeWhy Measure Academic Behaviors?What is ENGAGE and What Does It Measure?Administering ENGAGEENGAGE ReportsENGAGE ResourcesSummary and Conclusion

16. What is ENGAGE? measures behaviors and non-cognitive attributes related to academic success and persistence helps educators evaluate students’ self- reported psychosocial attributes, determine their levels of academic risk, and identify interventions to help them succeed

17. What Does ENGAGE Measure ? DomainENGAGE Grades 6-9ENGAGE Grades 10-12 Motivation (Getting work done)  Academic Discipline  Commitment to School  Optimism  Academic Discipline  General Determination  Goal Striving  Commitment to College  Communication Skills  Study Skills Social Engagement (Getting along)  Family Attitude toward Education  Family Involvement  Relationships w/ School Personnel  School Safety Climate  Social Activity  Social Connection Self-Regulation (Keeping your cool)  Managing Feelings  Thinking Before Acting  Orderly Conduct  Academic Self-Confidence  Steadiness

18. What Does ENGAGE Measure? Motivation Definition: personal characteristics that help students succeed academically by focusing and maintaining energies on goal-directed activities Grades 6-9 Examples: Academic Discipline, Commitment to School, and Optimism Grades 10-12 Examples: Academic Discipline, Commitment to College, Study Skills, Etc.

19. What Does Engage Measure? Social Engagement Definition: includes interpersonal factors that influence students’ successful integration into their environment Grades 6-9 Examples: Family Attitudes toward Education, Family Involvement, Relationships with School Personnel, and School Safety Climate Grades 10-12 Examples: Social Activity and Social Connection

20. What Does ENGAGE MEASURE? SELF REGULATION Definition: includes cognitive and affective processes used to monitor, regulate, and control behavior related to learning Grades 6-9 Examples: Managing Feelings, Orderly Conduct, Thinking Before Acting Grades 10-12 Examples: Academic Self-Confidence and Steadiness

21. Percentage of students accurately identified as having a 9 th -grade GPA < 2.0 Selection MethodHit Rate Random24% EXPLORE Composite only69% ENGAGE Grades 6-9 only80% EXPLORE & ENGAGE83% ©2012 by ACT, Inc. All rights reserved.

22. Percentages of Students Accurately Identified for Dropping Out Selection MethodHit Rate Random17% EXPLORE Composite only37% ENGAGE Grades 6-9 Grad. Index only 42% EXPLORE & ENGAGE Grad. Index52% ©2012 by ACT, Inc. All rights reserved.

23. What the Research Says about ENGAGE ©2012 by ACT, Inc. All rights reserved.

24. Workshop Agenda IntroductionCollege and Career Readiness ChallengeWhy Measure Academic Behaviors?What is ENGAGE and What Does It Measure?Administering ENGAGEENGAGE ReportsENGAGE ResourcesSummary and Conclusion

25. Create Local Items: Reserve the computer lab and ensue the Internet Explorer is 8 or above. Chrome, Firefox, and Safari are viable alternatives. Make sure spam filters do not block e-mails from engage@engage.act.org. engage@engage.act.org Administer ENGAGE which takes approximately 30 minutes, but it is an untimed inventory. Complete the inventory in one sitting: students may take a break if necessary. Administering ENGAGE ENGAGE Login Page

26. Workshop Agenda IntroductionCollege and Career Readiness ChallengeWhy Measure Academic Behaviors?What is ENGAGE and What Does It Measure?Administering ENGAGEENGAGE ReportsENGAGE ResourcesSummary and Conclusion

27. Two Reports for Each Student Student Report Advisor Report An Aggregate School Report A School Roster Report Utilizing ENGAGE Results: Report Types

28. Utilizing ENGAGE Results: Accessing Reports ENGAGE Login Page

29. Profile of scores Success Indices (only on Advisor & Roster Reports) Interpretive feedback, sorted from strengths to needs Sample ENGAGE Advisor Report ©2012 by ACT, Inc. All rights reserved.

32. What do my scores mean? What actions should I consider? A message for parents

33. Utilizing ENGAGE Results: The Big Picture

34. Utilizing ENGAGE Results: The Roster Report Student IDLast NameGrade LevelPrior grades Academic Success Index Percentile Graduation Index Percentile Academic Discipline Percentile Commitment to School Percentile Family Attitude toward Education Percentile 12345Sample 19th gradeBelow D's12399 12346Sample 29th gradeMostly C's126139949 12347Sample 39th gradeMostly C's3426503424 12348Sample 49th gradeMostly B's2624279921 12349Sample 59th gradeMostly C's215 4068 12350Sample 69th gradeMostly A's8589463099 12351Sample 79th gradeMostly A's8156889958 12352Sample 89th gradeMostly C's1322463499 12353Sample 99th gradeMostly C's1242499 12354Sample 109th gradeMostly C's128155068 12355Sample 119th gradeMostly C's74028 12356Sample 129th gradeMostly A's7147425068 12357Sample 139th gradeMostly C's162246349 12358Sample 149th gradeMostly B's3717424058 12359Sample 159th gradeMostly C's1714241724 12360Sample 169th gradeMostly B's749968 12361Sample 179th gradeMostly B's... 12362Sample 189th gradeMostly A's7765213499 12363Sample 199th gradeMostly C's156 3015 12364Sample 209th gradeBelow D's113301 12365Sample 219th gradeMostly B's77898599 12366Sample 229th gradeMostly B's244395028 12367Sample 23Mostly B's52312915 12368Sample 24Mostly B's6375543444 12369Sample 259th gradeMostly C's6282249 12370Sample 269th gradeMostly B's3734124038 12371Sample 279th gradeMostly B's65706699 12372Sample 289th gradeMostly B's5665669938 12373Sample 299th gradeMostly C's7227309 12374Sample 308th gradeMostly C's3920. 12375Sample 319th gradeMostly A's99 8599 12376Sample 329th grade--16251976 12377Sample 339th gradeMostly C's91171215

35. Workshop Agenda IntroductionCollege and Career Readiness ChallengeWhy Measure Academic Behaviors?What is ENGAGE and What Does It Measure?Administering ENGAGEENGAGE ReportsENGAGE ResourcesSummary and Conclusion

36. ENGAGE Resources

37. ENGAGE provides an innovative, easy-to-use, low stress, high impact method of Identifying at-risk students; justifying individual and school/district wide interventions; and helping all students reach their full academic potential and schools achieve their mission. In sum...

38. Thank you for your time. Kira J. Holt Principal Consultant, Southwest Region ACT, Inc. P: 512.320.1850 Kira.Holt@act.org