Presentation on theme: "Getting the Most from your ACT Explore and ACT Plan Reporting Package"— Presentation transcript:
1Getting the Most from your ACT Explore and ACT Plan Reporting Package
2Helping people achieve education and workplace success O U R M I S S I O NHelping people achieve education and workplace successO U R V A L U E SExcellenceDiversityLeadershipEmpowermentLearningSustainability
3ACT Learning Insights Team What We Do LIT-designed Professional Learning ExperiencesInsights fromACT ResearchACT DataInsights from Professional PracticeRaise Academic Standards and Increase Achievement to Ensure All Students Are College and Career Ready (CCR)
4Workshop Objectives Introduction Describe ACT’s definition of college and career readinessExplain ACT’s College and Career Readiness System and how ACT Explore/ACT Plan fitFind key data points in the ACT Explore/ACT Plan Student and Summary Profile ReportsTranslate data into insights about curriculum, instruction and support at the district, school, and classroom levels
5College and Career Readiness Student Score Report Workshop AgendaCollege and Career ReadinessStudent Score ReportBreakProfile Summary ReportItem Response Summary ReportEarly Intervention RostersReflections
9ACT’s Definition of College Readiness College Readiness is the level of preparation a student needs to be equipped to enroll and succeed – without remediation – in a credit-bearing, first-year course at a two-year or four-year institution, trade school, or technical school.Same definition adopted by Common Corep. 7
10ACT’s College and Career Readiness System Components
12Conducted every three to five years ACT National Curriculum Survey® The Foundation of ACT’s College and Career Readiness SystemConducted every three to five yearsNationwide survey of educational practices and expectationsCollege instructorsHigh school teachersMiddle school teachersElementary teachers
13Informs efforts to develop, refine, and update academic standards ACT National Curriculum Survey® The Foundation of ACT’s College and Career Readiness SystemIdentifies the skills and knowledge postsecondary institutions expect of studentsGuides the development of ACT’s assessments that measure college-ready skillsInforms efforts to develop, refine, and update academic standardsInform policymakers and educators
14Curriculum-based assessments in English, math, reading, and science Career planning component
15Longitudinal Assessments Common Score Scale Relationship 363225
16ACT’s College Readiness Benchmarks TestCollege Course8th Grade9th GradeEnglishEnglish Composition13141518MathCollege Algebra171922ReadingSocial Sciences1621ScienceBiology20242223Empirically derived50% likelihood of achieving a B or higher or about a 75% likelihood of achieving a C or higher in the corresponding credit-bearing college coursep. 6
17Condition of College and Career Readiness, 2012 National Results Percent of ACT-Tested High School Graduates by Number ofACT College Readiness Benchmarks Attained, 2012
18Condition of College and Career Readiness, 2013 National Results Percent of ACT-Tested High School Graduates by Number ofACT College Readiness Benchmarks Attained, 2013
192012-2013 Hawaii Results ACT Explore − 8th Grade Students Percent of 8th Grade Students in HawaiiAt or Above Benchmark on ACT Explore, 2013This slide provides a summary of early indicators of performance by Hawaii’s 8th graders on ACT Explore in 2013 compared with national performance.
202012-2013 Hawaii Results ACT Explore − 9th Grade Students Percent of 9th Grade Students in HawaiiAt or Above Benchmark on ACT Explore, 2013
212013 Hawaii Results ACT Plan Percent of 10th Grade Students in HawaiiAt or Above Benchmark on ACT Plan, 2013
22College and Career Readiness Reflections What insights have you gained from learning about ACT’s definition of College and Career Readiness?Record your insights on the Readiness section of your Road Map.
26Student Score Reports Introduction ComponentsCollege readiness indicatorsAcademic strengths and weaknessesSuggestions for improvementCareer and postsecondary aspirationsFoundation of all aggregate reporting
27Student Score Report Header p. 16/20 2. Intervention Planning 1. Academic Achievement & Education Planning2. Intervention PlanningHeader3. Career Explorationp. 16/20
393. Career Exploration: Your Career Possibilities World of Workp. 17/2139
40Student Score Report Dissemination What happens next?Teachers/counselors learn to interpret individual student resultsSchool administrators should be aware of individual student resultsTeachers/counselors review results with studentsTeachers/counselors review results with parents
42Student Score Report Reflections What insights have you gained from examining your Student Score Reports?What implications does this report have for counseling students about:Curriculum and Course SelectionIntervention and Student SupportCareer PossibilitiesRecord your thoughts on the Student Score Report section of your Road Map.
45Profile Summary Report Introduction What is the Profile Summary Report?Aggregates the data from Student Score ReportsIdentifies if students are on target to be college and career ready when they graduate from high schoolShows if their coursework aligns with their career interests and educational plansp. 25
46Frequency Distribution Table Profile Summary Report: Table 1a ACT Explore: Page 2 in Profile Summary ReportACT Plan: Page 2 in Profile Summary Reportp. 37/47
47Frequency Distribution Table Profile Summary Report 191 Total Students53 (28%) StudentsAbove BenchmarkStudents on target to be college ready100 (52%) Students onthe Cusp44 in danger of slipping41 within 2 points of benchmarkStudents on the cuspBenchmarkStudents in need of real intervention38 (20%) Students BelowBenchmark47
48Application Exercise Frequency Distribution Table Use either your ACT Explore or ACT Plan dataComplete the activity on p. 27.10 minutesAnswer questions 1-8p. 37/47
49ACT’s College Readiness Standards Identify the knowledge and skills students are likely to demonstrate at various score levels on each academic test.Help interpret what the scores earned on ACT Explore, ACT Plan, and The ACT mean.Direct link between what students have learned and what they are ready to learn next.
50provide suggestions to progress to a higher level Statements that describe what students are likely to know and be able to do...And statements thatprovide suggestions toprogress to a higher levelof achievement50
51ACT Explore: Page 4 in Profile Summary Report College Readiness Standard Score Ranges Profile Summary Report: Table 1cACT Explore: Page 4 in Profile Summary ReportACT Plan: Page 4 in Profile Summary Report48%9%p. 39/49
52Profile Summary Report Local Items 12 multiple choice items added by Hawaii Dept. of Education to ACT Explore & ACT PlanTopics covered:Post-high school plansParental education levelParental involvement in educationExperiences with bullyingCo-curricular activitiesAcademic behaviors
53Profile Summary Report Local Item Report: Table 6
54Profile Summary Report Additional information Profile Summary Report also includes:National comparisonsDifferences by ethnic & gender groupsRelation between scores & courseworkRelation between scores and career/educational plans and interests
55Profile Summary Report Reflections What insights have you gained from examining your Profile Summary Report?What implications do the data reveal for:CurriculumStaff DevelopmentInstructionIntervention/Student SupportRecord your thoughts on the Profile Summary Report section of your Road Map.Give them about 10 minutes to do the Road Map Activity (15 if needed)
57Item Response Summary Report Introduction Provides data on the item-by-item performance of your students.Is a very useful tool for curriculum review when used along with the test booklet.Item response results are categorized by test (e.g., English), by subscore (e.g., Usage/Mechanics), and by content area (e.g., Punctuation) and provide comparisons to other students taking the same test form. District IRSR is a cumulative report of your participating school reports. Your district also receives copies of all school level reports.Test Form
58Item Response Summary Report The IRSR Report shows you the percentage of your students who selected the:-correct response to each item-incorrect response.-the percentage who did not answer the item.-the average percentage of students who responded correctly to the items in each content area.**Draw attention to the two answer choices at the top. Explain that the items alternate between A-E answer choices and F-K answer choices.-Point to #23 as an example: this is a good instance of a situation where you need to pull out your test booklet and ask, “Why did 43% answer this question incorrectly? Why did 10% omit?”p. 59/6458
59Application Exercise Item Response Summary Report Pick 1 content area.Circle the *asterisked numbers (correct answers) for each question.Use your highlighters to mark only the circled numbers:No Mark 75%+Green %Yellow %Pink %p. 56/62
60Application Exercise Item Response Summary Report No color % CorrectGreen % CorrectYellow % CorrectPink % Correct
61Color-Code No Mark 75%+ Green 50-74% Replace image with what is in the workbook and fix the color coding key to matchColor-Code No Mark 75% Green 50-74%Yellow 25-49% Pink 0-24%
62Application Exercise Analysis Look for the following patterns:Dramatic differences from the reference groupHigh percentages clustered around a wrong answerHigh percentages of omitted questionsHigh percentages clustered around a correct answerDo any of these situations occur more frequently for some domains than others?
63Clustered around correct answer High Percentage OmittedDramatic Difference from Reference GroupClustered on wrong answer
64Item Summary Report Reflections What insights have you gained from examining your Item Response Summary Report?What implications do the data reveal for:CurriculumStaff DevelopmentInstructionIntervention/Student SupportRecord your thoughts on the Item Response Summary Report section of your Road Map.
66Early Intervention Roster Introduction School-level reports that identify students who fall into three categories:Roster 1: Students indicating they do not plan to finish high school or have no post-high school educational plans
67ACT Plan Early Intervention Rosters Roster 1: Early Identification
68ACT Plan Early Intervention Rosters Roster 2: Coursework Intervention ACT Explore: Students scoring below the national 10th percentileACT Plan: students with2a) composite score of 16 or higher who reported they have no plans to go to college2b) reported that they plan to attend college but earned a composite score of 15 or less, or reported that they do not plan to take college core coursework.
69ACT Plan Early Intervention Rosters Roster 2a: Coursework Intervention
70ACT Plan Early Intervention Rosters Roster 2b: Coursework Intervention Which of our students plan to go on to post secondary but lack the necessary skills or don’t plan to take college prep courses?
71Early Intervention Roster Roster 3: Need for Assistance Roster 3: Students who expressed a need for help in a particular areaThis roster can help you identify instructional needs, design intervention strategies, and assist students with reaching their academic and career goals.
72ACT Plan Early Intervention Rosters Roster 3: Need for Assistance Are we providing programs or services to meet our students’ needs?
73ReflectionsWhat might you add to your intervention program based on these rosters?What have you added to your understanding of College and Career Readiness at your school?
74Conclusion Workshop Objectives Describe ACT’s definition of college and career readinessExplain ACT’s College and Career Readiness System and how ACT Explore/ACT Plan fitFind key data points in the ACT Explore/ACT Plan Student and School ReportsTranslate data into insights about curriculum, instruction and support at the district, school, and classroom levels.