1. 1 Setting the Right Course for College Success

2. 2 COMPASS INTERNET STATUS Why problems occurred –Item Pool update (April 825 new items) What are we doing to correct the problem –New workstation registrations will no longer go to the “update” done a at sametime –Current users Validation process will hardly be noticed ( now typically 30-40 seconds) –If item pool doesn’t match, the screen will walk user through the update process. It will/must get BETTER

3. 3 Nationwide Usage Over 1,260 postsecondary sites throughout the country as of September 1, 2011 85% in 2-year community and technical colleges 95% internet delivery 11 statewide agreements Available for Windows® XP, Vista, and Windows 7; Internet Explorer 6, 7, 8, or 9

4. 4 Nationwide Usage Over 2.5 million students tested, completing over 7.5 million tests (Sept 1, 2010 through Aug 31, 2011) 17% of students tested “still in high school” Growing International Use (via International Sites and COMPASS Remote Testing Network)

5. 5 1.COMPASS Item Pool Updates (expanding test contents to align more strongly with Common Core and State Requirements) a.April, 2011 (825 pretest items, Reading, Writing Skills, and Mathematics) b.October 27, 2011 (additional pretest items, adding new operational items) c.February, 2012 (additional pretest items, adding new operational items)

6. 6 2. COMPASS Accommodations Test Form (paper/pencil; large type, Braille, audio, reader script) a.Writing Skills, Reading, Prealgebra (late fall, 2011) b.Algebra, College Algebra, Trigonometry, Geometry (late spring, 2011) c.Secure materials, request test materials and answer documents from ACT, return to ACT for scoring

7. 7 3. COMPASS Group Testing Form (under discussion; paper/pencil) a.High School Outreach/Early Preparation b.Dual Enrollment For situations where there are more students in a group than computers available -scanning at ACT (or at site?) -results into COMPASS for Reporting

8. 8 4. COMPASS and ESL ATB Preparation Procedures (to meet US DOE regulations effective 7/1/2011; ATB Information at www.act.org/compass/advant/atb.html) Certification of all ATB Test Administrators (proctors) by ACT; Application on web ) ATB Test Administration Manual on web ATB Test Administrator Knowledge Test on web; applicants must “pass” ACT Confirms ATB Test Administrator Certification (3-4 weeks after application is submitted; 2,000+ certified) WORK with DOE for regs, Retesting, portability of scores, take all three tests on same day, setup separate test package with ATB listed, Internet only, No Remote testing

9. 9 4. COMPASS ATB Procedures for Testing (US DOE regulations effective 7/1/2011) f.Identification of ATB Testers (use ATB Test Package) g.Administer ATB Test Package h.Completion of ATB Student Identification Form Prior (ATB student completes part of form; Certified ATB Test Administrator adds Code and Signature to form) i.College runs ATB Test Record listing (new function being added to Sessions TAB to generate CSV file, for late October), adds Certified ATB Test Administrator Code to data from CSV file in EXCEL, and e-mails EXCEL file to ACT in November j.Watch for More Details and Instructions (to be sent in October via e-mail to COMPASS Campus Coordinators)

10. 10 5. Additional e-Write Prompts a.3 New e-Write 2-12 Prompts (to be Added December, 2011) b.3 New ESL e-Write 2-12 Prompts (need additional ESL essay pretest sites, for students enrolled in fall ESL classes, 2011 for final pre- testing; prompts to be added in fall, 2012)

11. 11 6. National Fall 2011 COMPASS Entering Student Descriptive Report (ESDR) a. National, State, Campus ESDR’s (end of October, 2011; will replace 2010 ESDR reports) www.act.org/compass/reports/research.html b. Two Year Colleges (estimate 1.7 million students; total group, 19 and under, 20 and above) c.Four Year Colleges/Universities (estimate 200,000 students; total group, 19 and under, 20 and above) d.ESDR: No charge for college or high school ESDR reports

12. 12 7. New COMPASS Training Resources For the Remote Test Site Locator Service (US and International), the “Getting Started” Series, and Various “How To” Guides, go to: www.act.org/compass/resources.html

13. 13 REMOTE TESTING Why/Why not Can you give a COMPASS Remote test to Walk- ins? Can you give Remote test overseas? Other Global options Software list not always same as Locator list on COMPASS website Is High School testing technically a Remote test? Can you charge the student $100 to administer a Remote test?

14. 14 COMPASS Web Addresses COMPASS WEBSITE www.act.org/compass COMPASS Reference Manual http://act.org/compass/resources.html USER NAME: COMESL-PLACEMENT PASSWORD: DOCS User Name and Password in caps COMPASS Practice: http://www.act.org/compass/tests/index.html http://online.gtcc.edu/moodle/public Guilford Technical CC Jamestown NC » »

15. 15 COMPASS WEBSITES cont. http://www.hostos.cuny.edu/oaa/compass/ index.asp CITY UNIVERSITY OF NEW YORK http://gsc.edu/academics/acadenrich/ls/CPE /pages/default.aspx GAINESVILLE COLLEGE LEARNING SUPPORT

16. 16 COMPASS RETESTING

17. 17 COMPASS Retest Gain Scores Average score gain, students tested less than 2 days apart TestNAverage Gain25th PercentileMedian75th Percentile Pre-algebra95953.1-4210 Algebra94113.3-329 College algebra7564.4-4313 Reading116774.6-3513 Writing132309.6-6927 Average score gain, students tested no more than one week apart TestNAverage Gain25th PercentileMedian75th Percentile Pre-algebra211325.3-2413 Algebra219605.2-2311 College algebra16576.7-2515 Reading291076.1614 Writing2981613.5-21330

18. 18 COMPASS Retest Gain Scores Average score gain, students tested no more than two weeks apart TestNAverage Gain25th PercentileMedian75th Percentile Pre-algebra267055.7-2413 Algebra277985.4311 College algebra20536.9516 Reading364626.3714 Writing37069141430 Average score gain, students tested no more than one month apart TestNAverage Gain25th PercentileMedian75th Percentile Pre-algebra292815.8-2413 Algebra302175.5311 College algebra22427.2616 Reading397016.3714 Writing4011614.21430

19. 19

20. 20

21. 21 DO WE HAVE A RETESTING POLICY?

22. 22 Factors other than examinee’s ability are believed to have influenced previous testing Scores obtained from earlier testing are not believed to reflect examinees current ability

23. 23 COMPASS and HIGH-STAKES TESTING A look at one colleges position on retention, admissions, developmental education with COMPASS use Southwestern Michigan College Charlotte McGowan

24. 24 New ACT Research Effectiveness of dual credit offerings Effect of college readiness on graduation from 4-year colleges Effect of college readiness on degree attainment at 2-year colleges Do teacher attributes (like experience, and subject matter expertise) matter in terms of student learning outcomes Student growth and accountability

25. 25 Next Generation COMPASS Give your ideas/requests to ACT staff member or e-mail to john.roth@act.org): john.roth@act.org a.Please Improve: b.Please Add: c.Please Remove: d.Other comments, suggestions: e.Name, Institution, Contact Information (optional, so we can follow up if necessary)

26. 26 Upcoming COMPASS Conferences: Mark Your Calendars November 16-18, 2011: COMPASS/ASSET Southeast Region Hilton Head Conference at Crowne Plaza, Hilton Head, SC (to submit Program Proposal and for additional information, send e-mail to Frank Potter at frank.potter@act.org) April 18-20, 2012: 16th Annual Southwest Region Post Secondary Conference for Student Success at Marriott River Center, San Antonio, TX (to submit Program Proposal and for additional information, send e-mail to Don Pitchford at don.pitchford@act.org) April 26-27, 2012: 11th Annual Midwest Region COMPASS and Assessment Conference: April 26-27, 2012, at the Hyatt Lodge, Oak Brook, IL (to submit Program Proposal and for additional information, send e-mail to Tim Osborn at tim.osborn@act.org)

27. 27 COMPASS Update News You Can Use Questions/Discussion Thank You

28. 28 Setting the Right Course for College Success