1. Getting the Most from your ACT Explore and ACT Plan Reporting Package

2. Helping people achieve education and workplace success
O U R M I S S I O N
Helping people achieve education and workplace success
O U R V A L U E S
Excellence
Diversity
Leadership
Empowerment
Learning
Sustainability

3. ACT Learning Insights Team What We Do
LIT-designed Professional Learning Experiences
Insights from
ACT Research
ACT Data
Insights from Professional Practice
Raise Academic Standards and Increase Achievement to Ensure All Students Are College and Career Ready (CCR)

4. Workshop Objectives Introduction
Describe ACT’s definition of college and career readiness
Explain ACT’s College and Career Readiness System and how ACT Explore/ACT Plan fit
Find key data points in the ACT Explore/ACT Plan Student and Summary Profile Reports
Translate data into insights about curriculum, instruction and support at the district, school, and classroom levels

5. College and Career Readiness Student Score Report
Workshop Agenda
College and Career Readiness
Student Score Report
Break
Profile Summary Report
Item Response Summary Report
Early Intervention Rosters
Reflections

6. Workshop Materials
Workbook
Road Map

7. Introduction College and Career Readiness
What does College and Career Readiness mean to you? 7

8. p. 5

9. ACT’s Definition of College Readiness
College Readiness is the level of preparation a student needs to be equipped to enroll and succeed – without remediation – in a credit-bearing, first-year course at a two-year or four-year institution, trade school, or technical school.
Same definition adopted by Common Core
p. 7

10. ACT’s College and Career Readiness System Components

11. The Core Practice Framework

12. Conducted every three to five years
ACT National Curriculum Survey® The Foundation of ACT’s College and Career Readiness System
Conducted every three to five years
Nationwide survey of educational practices and expectations
College instructors
High school teachers
Middle school teachers
Elementary teachers

13. Informs efforts to develop, refine, and update academic standards
ACT National Curriculum Survey® The Foundation of ACT’s College and Career Readiness System
Identifies the skills and knowledge postsecondary institutions expect of students
Guides the development of ACT’s assessments that measure college-ready skills
Informs efforts to develop, refine, and update academic standards
Inform policymakers and educators

14. Curriculum-based assessments in English, math, reading, and science
Career planning component

15. Longitudinal Assessments Common Score Scale Relationship36 32 25

16. ACT’s College Readiness Benchmarks
Test
College Course
8th Grade
9th Grade
English
English Composition 13 14 15 18
Math
College Algebra 17 19 22
Reading
Social Sciences 16 21
Science
Biology 20 24 22 23
Empirically derived
50% likelihood of achieving a B or higher or about a 75% likelihood of achieving a C or higher in the corresponding credit-bearing college course
p. 6

17. Condition of College and Career Readiness, 2012 National Results
Percent of ACT-Tested High School Graduates by Number of
ACT College Readiness Benchmarks Attained, 2012

18. Condition of College and Career Readiness, 2013 National Results
Percent of ACT-Tested High School Graduates by Number of
ACT College Readiness Benchmarks Attained, 2013

19. 2012-2013 Hawaii Results ACT Explore − 8th Grade Students
Percent of 8th Grade Students in Hawaii
At or Above Benchmark on ACT Explore, 2013
This slide provides a summary of early indicators of performance by Hawaii’s 8th graders on ACT Explore in 2013 compared with national performance.

20. 2012-2013 Hawaii Results ACT Explore − 9th Grade Students
Percent of 9th Grade Students in Hawaii
At or Above Benchmark on ACT Explore, 2013

21. 2013 Hawaii Results ACT Plan
Percent of 10th Grade Students in Hawaii
At or Above Benchmark on ACT Plan, 2013

22. College and Career Readiness Reflections
What insights have you gained from learning about ACT’s definition of College and Career Readiness?
Record your insights on the Readiness section of your Road Map.

23. Preparing to Unpack the Box
p. 13

24. p. 15

25. Student Score Report
p. 16/20

26. Student Score Reports Introduction
Components
College readiness indicators
Academic strengths and weaknesses
Suggestions for improvement
Career and postsecondary aspirations
Foundation of all aggregate reporting

27. Student Score Report Header p. 16/20 2. Intervention Planning
1. Academic Achievement & Education Planning
2. Intervention Planning
Header
3. Career Exploration
p. 16/20

28. Report Header Student Information
Student’s Name
Student’s Grade Level
Test Date
Student’s School
Test Form
p. 16/20 28

29. 1. Academic Achievement and Education Planning: Your Scores
Student Scores and Norms
p. 16/20

30. 1. Academic Achievement and Education Planning: Your Scores
Estimated Scores on ACT Plan or The ACT
p. 16/20

31. 1. Academic Achievement and Education Planning: Your Plans
High School Course Plans
p. 16/20

32. 1. Academic Achievement and Education Planning: Your Plans
Reported Needs
p. 16/20

33. 1. Academic Achievement and Education Planning: Your Plans
College Readiness
p. 16/20

34. 1. Academic Achievement and Education Planning: Your Plans Additional Information

35. 2. Intervention Planning: Your Skills Item Response Summary and Suggestions for Improvement35

36. 3. Career Exploration: Your Career Possibilities
World of Work
p. 17/21

37. 3. Career Exploration: Your Career Possibilities
World of Work
You and the
World of Work
Exploring Career
Options
Your Interests
p. 17/21 37

38. p. 17/21

39. 3. Career Exploration: Your Career Possibilities
World of Work
p. 17/21 39

40. Student Score Report Dissemination
What happens next?
Teachers/counselors learn to interpret individual student results
School administrators should be aware of individual student results
Teachers/counselors review results with students
Teachers/counselors review results with parents

41. Student Resources 41

42. Student Score Report Reflections
What insights have you gained from examining your Student Score Reports?
What implications does this report have for counseling students about:
Curriculum and Course Selection
Intervention and Student Support
Career Possibilities
Record your thoughts on the Student Score Report section of your Road Map.

43. Break (15 minutes)

44. p. 25

45. Profile Summary Report Introduction
What is the Profile Summary Report?
Aggregates the data from Student Score Reports
Identifies if students are on target to be college and career ready when they graduate from high school
Shows if their coursework aligns with their career interests and educational plans
p. 25

46. Frequency Distribution Table Profile Summary Report: Table 1a
ACT Explore: Page 2 in Profile Summary Report
ACT Plan: Page 2 in Profile Summary Report
p. 37/47

47. Frequency Distribution Table Profile Summary Report
191 Total Students
53 (28%) Students
Above Benchmark
Students on target to be college ready
100 (52%) Students on
the Cusp
44 in danger of slipping
41 within 2 points of benchmark
Students on the cusp
Benchmark
Students in need of real intervention
38 (20%) Students Below
Benchmark 47

48. Application Exercise Frequency Distribution Table
Use either your ACT Explore or ACT Plan data
Complete the activity on p. 27.
10 minutes
Answer questions 1-8
p. 37/47

49. ACT’s College Readiness Standards
Identify the knowledge and skills students are likely to demonstrate at various score levels on each academic test.
Help interpret what the scores earned on ACT Explore, ACT Plan, and The ACT mean.
Direct link between what students have learned and what they are ready to learn next.

50. provide suggestions to progress to a higher level
Statements that describe what students are likely to know and be able to do...
And statements that
provide suggestions to
progress to a higher level
of achievement 50

51. ACT Explore: Page 4 in Profile Summary Report
College Readiness Standard Score Ranges Profile Summary Report: Table 1c
ACT Explore: Page 4 in Profile Summary Report
ACT Plan: Page 4 in Profile Summary Report
48% 9%
p. 39/49

52. Profile Summary Report Local Items
12 multiple choice items added by Hawaii Dept. of Education to ACT Explore & ACT Plan
Topics covered:
Post-high school plans
Parental education level
Parental involvement in education
Experiences with bullying
Co-curricular activities
Academic behaviors

53. Profile Summary Report Local Item Report: Table 6

54. Profile Summary Report Additional information
Profile Summary Report also includes:
National comparisons
Differences by ethnic & gender groups
Relation between scores & coursework
Relation between scores and career/educational plans and interests

55. Profile Summary Report Reflections
What insights have you gained from examining your Profile Summary Report?
What implications do the data reveal for:
Curriculum
Staff Development
Instruction
Intervention/Student Support
Record your thoughts on the Profile Summary Report section of your Road Map.
Give them about 10 minutes to do the Road Map Activity (15 if needed)

56. Plan: p. 62
Explore: p. 56
p. 56/62

57. Item Response Summary Report Introduction
Provides data on the item-by-item performance of your students.
Is a very useful tool for curriculum review when used along with the test booklet.
Item response results are categorized by test (e.g., English), by subscore (e.g., Usage/Mechanics), and by content area (e.g., Punctuation) and provide comparisons to other students taking the same test form. District IRSR is a cumulative report of your participating school reports. Your district also receives copies of all school level reports.
Test Form

58. Item Response Summary Report
The IRSR Report shows you the percentage of your students who selected the:
-correct response to each item
-incorrect response.
-the percentage who did not answer the item.
-the average percentage of students who responded correctly to the items in each content area.
**Draw attention to the two answer choices at the top. Explain that the items alternate between A-E answer choices and F-K answer choices.
-Point to #23 as an example: this is a good instance of a situation where you need to pull out your test booklet and ask, “Why did 43% answer this question incorrectly? Why did 10% omit?”
p. 59/64 58

59. Application Exercise Item Response Summary Report
Pick 1 content area.
Circle the *asterisked numbers (correct answers) for each question.
Use your highlighters to mark only the circled numbers:
No Mark 75%+
Green %
Yellow %
Pink %
p. 56/62

60. Application Exercise Item Response Summary Report
No color % Correct
Green % Correct
Yellow % Correct
Pink % Correct

61. Color-Code No Mark 75%+ Green 50-74%
Replace image with what is in the workbook and fix the color coding key to match
Color-Code No Mark 75% Green 50-74%
Yellow 25-49% Pink 0-24%

62. Application Exercise Analysis
Look for the following patterns:
Dramatic differences from the reference group
High percentages clustered around a wrong answer
High percentages of omitted questions
High percentages clustered around a correct answer
Do any of these situations occur more frequently for some domains than others?

63. Clustered around correct answer
High Percentage Omitted
Dramatic Difference from Reference Group
Clustered on wrong answer

64. Item Summary Report Reflections
What insights have you gained from examining your Item Response Summary Report?
What implications do the data reveal for:
Curriculum
Staff Development
Instruction
Intervention/Student Support
Record your thoughts on the Item Response Summary Report section of your Road Map.

65. Early Intervention Rosters
p. 68/71

66. Early Intervention Roster Introduction
School-level reports that identify students who fall into three categories:
Roster 1: Students indicating they do not plan to finish high school or have no post-high school educational plans

67. ACT Plan Early Intervention Rosters Roster 1: Early Identification

68. ACT Plan Early Intervention Rosters Roster 2: Coursework Intervention
ACT Explore: Students scoring below the national 10th percentile
ACT Plan: students with
2a) composite score of 16 or higher who reported they have no plans to go to college
2b) reported that they plan to attend college but earned a composite score of 15 or less, or reported that they do not plan to take college core coursework.

69. ACT Plan Early Intervention Rosters Roster 2a: Coursework Intervention

70. ACT Plan Early Intervention Rosters Roster 2b: Coursework Intervention
Which of our students plan to go on to post secondary but lack the necessary skills or don’t plan to take college prep courses?

71. Early Intervention Roster Roster 3: Need for Assistance
Roster 3: Students who expressed a need for help in a particular area
This roster can help you identify instructional needs, design intervention strategies, and assist students with reaching their academic and career goals.

72. ACT Plan Early Intervention Rosters Roster 3: Need for Assistance
Are we providing programs or services to meet our students’ needs?

73. Reflections
What might you add to your intervention program based on these rosters?
What have you added to your understanding of College and Career Readiness at your school?

74. Conclusion Workshop Objectives
Describe ACT’s definition of college and career readiness
Explain ACT’s College and Career Readiness System and how ACT Explore/ACT Plan fit
Find key data points in the ACT Explore/ACT Plan Student and School Reports
Translate data into insights about curriculum, instruction and support at the district, school, and classroom levels.

75. Contact Customer Service:
Additional Resources
Future events shown at
Additional questions?
Contact Customer Service:

76. Have a great school year!
Mahalo
Mahalo for all you do for Hawaii’s students!
Have a great school year!