Presentation on theme: "Getting the Most from your ACT Explore and ACT Plan Reporting Package"— Presentation transcript:
1 Getting the Most from your ACT Explore and ACT Plan Reporting Package
2 Helping people achieve education and workplace success O U R M I S S I O NHelping people achieve education and workplace successO U R V A L U E SExcellenceDiversityLeadershipEmpowermentLearningSustainability
3 ACT Learning Insights Team What We Do LIT-designed Professional Learning ExperiencesInsights fromACT ResearchACT DataInsights from Professional PracticeRaise Academic Standards and Increase Achievement to Ensure All Students Are College and Career Ready (CCR)
4 Workshop Objectives Introduction Describe ACT’s definition of college and career readinessExplain ACT’s College and Career Readiness System and how ACT Explore/ACT Plan fitFind key data points in the ACT Explore/ACT Plan Student and Summary Profile ReportsTranslate data into insights about curriculum, instruction and support at the district, school, and classroom levels
5 College and Career Readiness Student Score Report Workshop AgendaCollege and Career ReadinessStudent Score ReportBreakProfile Summary ReportItem Response Summary ReportEarly Intervention RostersReflections
9 ACT’s Definition of College Readiness College Readiness is the level of preparation a student needs to be equipped to enroll and succeed – without remediation – in a credit-bearing, first-year course at a two-year or four-year institution, trade school, or technical school.Same definition adopted by Common Corep. 7
10 ACT’s College and Career Readiness System Components
12 Conducted every three to five years ACT National Curriculum Survey® The Foundation of ACT’s College and Career Readiness SystemConducted every three to five yearsNationwide survey of educational practices and expectationsCollege instructorsHigh school teachersMiddle school teachersElementary teachers
13 Informs efforts to develop, refine, and update academic standards ACT National Curriculum Survey® The Foundation of ACT’s College and Career Readiness SystemIdentifies the skills and knowledge postsecondary institutions expect of studentsGuides the development of ACT’s assessments that measure college-ready skillsInforms efforts to develop, refine, and update academic standardsInform policymakers and educators
14 Curriculum-based assessments in English, math, reading, and science Career planning component
15 Longitudinal Assessments Common Score Scale Relationship 363225
16 ACT’s College Readiness Benchmarks TestCollege Course8th Grade9th GradeEnglishEnglish Composition13141518MathCollege Algebra171922ReadingSocial Sciences1621ScienceBiology20242223Empirically derived50% likelihood of achieving a B or higher or about a 75% likelihood of achieving a C or higher in the corresponding credit-bearing college coursep. 6
17 Condition of College and Career Readiness, 2012 National Results Percent of ACT-Tested High School Graduates by Number ofACT College Readiness Benchmarks Attained, 2012
18 Condition of College and Career Readiness, 2013 National Results Percent of ACT-Tested High School Graduates by Number ofACT College Readiness Benchmarks Attained, 2013
19 2012-2013 Hawaii Results ACT Explore − 8th Grade Students Percent of 8th Grade Students in HawaiiAt or Above Benchmark on ACT Explore, 2013This slide provides a summary of early indicators of performance by Hawaii’s 8th graders on ACT Explore in 2013 compared with national performance.
20 2012-2013 Hawaii Results ACT Explore − 9th Grade Students Percent of 9th Grade Students in HawaiiAt or Above Benchmark on ACT Explore, 2013
21 2013 Hawaii Results ACT Plan Percent of 10th Grade Students in HawaiiAt or Above Benchmark on ACT Plan, 2013
22 College and Career Readiness Reflections What insights have you gained from learning about ACT’s definition of College and Career Readiness?Record your insights on the Readiness section of your Road Map.
26 Student Score Reports Introduction ComponentsCollege readiness indicatorsAcademic strengths and weaknessesSuggestions for improvementCareer and postsecondary aspirationsFoundation of all aggregate reporting
39 3. Career Exploration: Your Career Possibilities World of Workp. 17/2139
40 Student Score Report Dissemination What happens next?Teachers/counselors learn to interpret individual student resultsSchool administrators should be aware of individual student resultsTeachers/counselors review results with studentsTeachers/counselors review results with parents
42 Student Score Report Reflections What insights have you gained from examining your Student Score Reports?What implications does this report have for counseling students about:Curriculum and Course SelectionIntervention and Student SupportCareer PossibilitiesRecord your thoughts on the Student Score Report section of your Road Map.
45 Profile Summary Report Introduction What is the Profile Summary Report?Aggregates the data from Student Score ReportsIdentifies if students are on target to be college and career ready when they graduate from high schoolShows if their coursework aligns with their career interests and educational plansp. 25
46 Frequency Distribution Table Profile Summary Report: Table 1a ACT Explore: Page 2 in Profile Summary ReportACT Plan: Page 2 in Profile Summary Reportp. 37/47
47 Frequency Distribution Table Profile Summary Report 191 Total Students53 (28%) StudentsAbove BenchmarkStudents on target to be college ready100 (52%) Students onthe Cusp44 in danger of slipping41 within 2 points of benchmarkStudents on the cuspBenchmarkStudents in need of real intervention38 (20%) Students BelowBenchmark47
48 Application Exercise Frequency Distribution Table Use either your ACT Explore or ACT Plan dataComplete the activity on p. 27.10 minutesAnswer questions 1-8p. 37/47
49 ACT’s College Readiness Standards Identify the knowledge and skills students are likely to demonstrate at various score levels on each academic test.Help interpret what the scores earned on ACT Explore, ACT Plan, and The ACT mean.Direct link between what students have learned and what they are ready to learn next.
50 provide suggestions to progress to a higher level Statements that describe what students are likely to know and be able to do...And statements thatprovide suggestions toprogress to a higher levelof achievement50
51 ACT Explore: Page 4 in Profile Summary Report College Readiness Standard Score Ranges Profile Summary Report: Table 1cACT Explore: Page 4 in Profile Summary ReportACT Plan: Page 4 in Profile Summary Report48%9%p. 39/49
52 Profile Summary Report Local Items 12 multiple choice items added by Hawaii Dept. of Education to ACT Explore & ACT PlanTopics covered:Post-high school plansParental education levelParental involvement in educationExperiences with bullyingCo-curricular activitiesAcademic behaviors
53 Profile Summary Report Local Item Report: Table 6
54 Profile Summary Report Additional information Profile Summary Report also includes:National comparisonsDifferences by ethnic & gender groupsRelation between scores & courseworkRelation between scores and career/educational plans and interests
55 Profile Summary Report Reflections What insights have you gained from examining your Profile Summary Report?What implications do the data reveal for:CurriculumStaff DevelopmentInstructionIntervention/Student SupportRecord your thoughts on the Profile Summary Report section of your Road Map.Give them about 10 minutes to do the Road Map Activity (15 if needed)
57 Item Response Summary Report Introduction Provides data on the item-by-item performance of your students.Is a very useful tool for curriculum review when used along with the test booklet.Item response results are categorized by test (e.g., English), by subscore (e.g., Usage/Mechanics), and by content area (e.g., Punctuation) and provide comparisons to other students taking the same test form. District IRSR is a cumulative report of your participating school reports. Your district also receives copies of all school level reports.Test Form
58 Item Response Summary Report The IRSR Report shows you the percentage of your students who selected the:-correct response to each item-incorrect response.-the percentage who did not answer the item.-the average percentage of students who responded correctly to the items in each content area.**Draw attention to the two answer choices at the top. Explain that the items alternate between A-E answer choices and F-K answer choices.-Point to #23 as an example: this is a good instance of a situation where you need to pull out your test booklet and ask, “Why did 43% answer this question incorrectly? Why did 10% omit?”p. 59/6458
59 Application Exercise Item Response Summary Report Pick 1 content area.Circle the *asterisked numbers (correct answers) for each question.Use your highlighters to mark only the circled numbers:No Mark 75%+Green %Yellow %Pink %p. 56/62
60 Application Exercise Item Response Summary Report No color % CorrectGreen % CorrectYellow % CorrectPink % Correct
61 Color-Code No Mark 75%+ Green 50-74% Replace image with what is in the workbook and fix the color coding key to matchColor-Code No Mark 75% Green 50-74%Yellow 25-49% Pink 0-24%
62 Application Exercise Analysis Look for the following patterns:Dramatic differences from the reference groupHigh percentages clustered around a wrong answerHigh percentages of omitted questionsHigh percentages clustered around a correct answerDo any of these situations occur more frequently for some domains than others?
63 Clustered around correct answer High Percentage OmittedDramatic Difference from Reference GroupClustered on wrong answer
64 Item Summary Report Reflections What insights have you gained from examining your Item Response Summary Report?What implications do the data reveal for:CurriculumStaff DevelopmentInstructionIntervention/Student SupportRecord your thoughts on the Item Response Summary Report section of your Road Map.
66 Early Intervention Roster Introduction School-level reports that identify students who fall into three categories:Roster 1: Students indicating they do not plan to finish high school or have no post-high school educational plans
67 ACT Plan Early Intervention Rosters Roster 1: Early Identification
68 ACT Plan Early Intervention Rosters Roster 2: Coursework Intervention ACT Explore: Students scoring below the national 10th percentileACT Plan: students with2a) composite score of 16 or higher who reported they have no plans to go to college2b) reported that they plan to attend college but earned a composite score of 15 or less, or reported that they do not plan to take college core coursework.
69 ACT Plan Early Intervention Rosters Roster 2a: Coursework Intervention
70 ACT Plan Early Intervention Rosters Roster 2b: Coursework Intervention Which of our students plan to go on to post secondary but lack the necessary skills or don’t plan to take college prep courses?
71 Early Intervention Roster Roster 3: Need for Assistance Roster 3: Students who expressed a need for help in a particular areaThis roster can help you identify instructional needs, design intervention strategies, and assist students with reaching their academic and career goals.
72 ACT Plan Early Intervention Rosters Roster 3: Need for Assistance Are we providing programs or services to meet our students’ needs?
73 ReflectionsWhat might you add to your intervention program based on these rosters?What have you added to your understanding of College and Career Readiness at your school?
74 Conclusion Workshop Objectives Describe ACT’s definition of college and career readinessExplain ACT’s College and Career Readiness System and how ACT Explore/ACT Plan fitFind key data points in the ACT Explore/ACT Plan Student and School ReportsTranslate data into insights about curriculum, instruction and support at the district, school, and classroom levels.