1. Utah Test Item Pool Service UTIPS January 17, 2007 Julie Quinn Accountability/UTIPS Specialist Utah State Office of Education

2. January 17, 2007 UTIPS Introduction Julie Quinn Accountability/UTIPS Specialist Utah State Office of Education 2 Utah Test Item Pool System (UTIPS) TIPS transition to UTIPS –TIPS is no longer maintained by USOE http://tips.usoe.k12.ut.us Math, Science, ELA items will be removed UTIPS functional fall of 2004 –http://utips.orghttp://utips.org

3. January 17, 2007 UTIPS Introduction Julie Quinn Accountability/UTIPS Specialist Utah State Office of Education 3 UTIPS Improvements Reporting features Improved items in the item pools Process in place for item quality control Multiple choice, short answer, matching, and essay Surveys

4. January 17, 2007 UTIPS Introduction Julie Quinn Accountability/UTIPS Specialist Utah State Office of Education 4 UTIPS Improvements Partnership with Curriculum –Professional Development on formative assessment Improves classroom assessment Creates items Teachers also create items –Alignment to standards/objectives provides reports –Opportunity to submit for item pool consideration

5. January 17, 2007 UTIPS Introduction Julie Quinn Accountability/UTIPS Specialist Utah State Office of Education 5 UTIPS Reports Student summary –Can be exported to Excel Pie chart by mastery –Clickable to show individual students in each group Bar graph with percent correct by item –Clickable to show item with response percentages & students who chose each option Individual student mastery –Indicates mastery level by student for standards and objectives

6. January 17, 2007 UTIPS Introduction Julie Quinn Accountability/UTIPS Specialist Utah State Office of Education 6 Report: Student Summary

7. January 17, 2007 UTIPS Introduction Julie Quinn Accountability/UTIPS Specialist Utah State Office of Education 7 Report: Pie Chart

8. January 17, 2007 UTIPS Introduction Julie Quinn Accountability/UTIPS Specialist Utah State Office of Education 8 Report: Bar Graph

9. January 17, 2007 UTIPS Introduction Julie Quinn Accountability/UTIPS Specialist Utah State Office of Education 9 Report: Standards Mastery

10. January 17, 2007 UTIPS Introduction Julie Quinn Accountability/UTIPS Specialist Utah State Office of Education 10 Report: Objectives Mastery

11. January 17, 2007 UTIPS Introduction Julie Quinn Accountability/UTIPS Specialist Utah State Office of Education 11 Improving Instruction Obstacles Summative results of assessment systems Varied definitions of “formative assessment” UTIPS training takes time Availability of local expertise with UTIPS programming language

12. January 17, 2007 UTIPS Introduction Julie Quinn Accountability/UTIPS Specialist Utah State Office of Education 12 Improving Instruction Successes Growing attention to using feedback to improve instruction Increasing number of UTIPS trainers Local technical expertise is growing Professional Development: School and District –Share teaching strategies and resources –Focused on feedback and data Item pools expanding –Better items, more subjects

13. January 17, 2007 UTIPS Introduction Julie Quinn Accountability/UTIPS Specialist Utah State Office of Education 13 Common Assessments Departments or teams can administer common assessments –Administrative rights can be given that view individual and aggregate results of the test Districts are beginning to use UTIPS to administer benchmark tests

14. January 17, 2007 UTIPS Introduction Julie Quinn Accountability/UTIPS Specialist Utah State Office of Education 14 Common Assessments USOE Science pre-tests –http://science.utips.orghttp://science.utips.org Results are most effective when followed up by discussion centered around results

15. January 17, 2007 UTIPS Introduction Julie Quinn Accountability/UTIPS Specialist Utah State Office of Education 15 Non-CRT Subjects Many non-CRT subjects have curriculum entered into UTIPS Teachers can align their questions, and submit for consideration –Questions should be original and non- copyrighted Item pools are being seeded in CTE, Fine Arts, Social Studies, etc

16. January 17, 2007 UTIPS Introduction Julie Quinn Accountability/UTIPS Specialist Utah State Office of Education 16 More than Testing UTIPS provides a public webpage for each account Documents can be uploaded Websites can be linked Media can be imported (sound, video, etc) Calendar feature Blogging tool

17. January 17, 2007 UTIPS Introduction Julie Quinn Accountability/UTIPS Specialist Utah State Office of Education 17 Classroom Access UTIPS assessments can be administered on-line, or paper/pencil –Paper/pencil tests can be scanned, with the results sent to the teacher’s account as if the test was taken on-line

18. January 17, 2007 UTIPS Introduction Julie Quinn Accountability/UTIPS Specialist Utah State Office of Education 18 State-Wide System UTIPS is available regionally, through servers set up locally Information and Training Manuals are available via USOE’s UTIPS website http://www.schools.utah.gov/eval/Info_UTIPS.asp http://www.schools.utah.gov/eval/Info_UTIPS.asp UTIPS is available regionally, through servers set up locally

19. January 17, 2007 UTIPS Introduction Julie Quinn Accountability/UTIPS Specialist Utah State Office of Education 19 Contact Information Julie Quinn Accountability/UTIPS Specialist Assessment and Accountability Utah State Office of Education (801) 538-7723 julie.quinn@schools.utah.gov