Summative Reports Data Interpretation

Peg Thomsen Program Manager ACT Customer Success peg.thomsen@act.org NOTE: Change the text and insert a photo of yourself: Right click on the picture. Select “Fill”, Select “Picture” Upload a photo of yourself If the photo is distorted: Click on the picture Click on “Picture Tools” in the top bar Click on the expand arrow under “Crop” Click on “Fit” Move original photo to fit inside the shape as desired. Take a moment to offer a welcome and a brief bio for yourself.

Summative Reports Current Progress Supplemental Scores Individual Student Report Summative Reports

Generating Reports

Generating Reports 1 2 4 3 Select the Educator tab Select the report, in this case we will be viewing Current Progress Determine your selection criteria Click Find Students 3 4

The Current Progress report provides subject summary information for the grade level. - Each subject will include one of the four benchmark levels, In Need of Support, Close, Ready, or Exceeding. The subject average scale score. The gray circle represents past average Solid orange circle is current average which is 423. The circle below represents the National Average which is 420 so this group of students score above the National Average. The open orange circle is the predicted average for these students Finally the number of students on this report that took this test is shown.

Supplemental Scores This is an overview of the Supplemental Scores report, let’s take a closer look at the different components.

National Percentile Rank The ranks show how this group performed in comparison to other grade X students in the nation. For example, if the median English score is at the 73rd percentile, the typical student in this group achieved as well or better than 73% of the students in the nation. Text Complexity The reading test measures progress with text complexity by checking for understanding of texts from a range of complexity levels. National Percentile Rank - The ranks show how this group performed in comparison to other grade X students in the nation. For example, if the median English score is at the 73rd percentile, the typical student in this group achieved as well or better than 73% of the students in the nation. Text Complexity - The reading test measures progress with text complexity by checking for understanding of texts from a range of complexity levels. Additional information can be found in the Summative Technical Manual found on Avocet or hyperlinked at the end of this presentation.

ELA and STEM scores will be available depending on the subjects tested. There will be an ELA overall score. The dark orange bar represents the number of students that met the readiness benchmark. In this case 64% or 49 students met the benchmark. We also see that 36% or 28 students did not meet the benchmark. The same information is also available for STEM. Table W.22 is from the Technical Summative Manual and lists the updated ELA & STEM readiness benchmarks.

The Supplemental Score report for grades 8 and higher also contains Progress Toward Career Readiness. This is an early indicator of your group’s future achievement on the ACT Nation Career Readiness Certificate or (NCRC). Per this report 93% or 89 students are progressing towards Gold.

Individual Student Reports

The first page of the ISR contains similar data as the Current Progress report. The 2nd page includes reporting category information as well as Improvement Ideas.

You are already familiar with this format but I still want to point out a few items. Even though this student is Ready in both Science and Math, when we look at STEM, they are Below Readiness. There STEM score is 423, if you look at the table from the Summative Technical Manual you see the STEM benchmark for grade 5 is 425. This student is very close.

The ELA score is based off the English, Reading and writing test results. A writing scale score is not provided but on the 2nd page of the ISR report the writing reporting categories can be found. For additional information on writing scoring, please see the Writing exemplar booklets (with scoring rubrics). There is a hyperlink at the end.

Reporting Categories Going back to the student’s STEM score, how can we help that student improve? Looking at their Science reporting category scores, note for Evaluation of Models, Inferences, and Experimental Results they scored 5 of 9 or 56% and did not meet the readiness benchmark. Then by going to the Improvement Ideas section and looking at that same science reporting category we are provide an idea of how to help that student.

Still looking at an ISR but this time it is for a grade 10 student. A couple of differences to note: The student received a Composite Score – this represents the overall performance on the English, mathematics, reading and science tests. It is calculated as the average of the scale scores on the four subjects rounded to an integer They also received a Predicted ACT Composite Score Looking at each individual subject there is also a predicted ACT subject score Notice in math they are In Need of Support but they definitely improved since last year – next step would be to look at the reporting categories and improvement ideas Finally, the Progress Toward Career Readiness

Supporting Documents Summative Technical Manual Writing Exemplars The first 2 items listed are articles that were published and shared with our customers. These are available on Discover ACT Aspire and provide some insight to the decisions made on the ELA/STEM benchmark updates and the choice to not calculate a writing scale score. Additionally two of the other resources I mentioned are listed. The Summative Technical Manual is everything you need to know about the design of the test. The Writing Exemplars can be referenced for the scoring rubrics.

Questions?

Thank you. Interested in learning more? Contact us at CustomerEducation@act.org All recipients of ACT data and student information are reminded that they are responsible for protecting the confidentiality of that information in accordance with applicable laws and institutional policies. Score recipients assume responsibility for protecting the confidentiality of ACT data reported to them.