Presentation is loading. Please wait.

Presentation is loading. Please wait.

TCAP Achievement Transition Laura Atkins Office of Assessment, Evaluation, & Research.

Similar presentations


Presentation on theme: "TCAP Achievement Transition Laura Atkins Office of Assessment, Evaluation, & Research."— Presentation transcript:

1 TCAP Achievement Transition Laura Atkins Office of Assessment, Evaluation, & Research

2 Questions to Explore When the new TCAP achievement test is administered in 2010? Will it be a criterion-referenced assessment or a norm-referenced assessment? Will the test administered in 2010 have a close correlation to the states new curriculum standards?

3 Questions to Explore Will the test administered in 2010 be NAEP like? Will roll-outs be conducted during the spring of 2009 to prepare leadership teams in school systems for working with teachers as assessment processes change?

4 Questions to Explore Would you consider holding a state testing conference or regional roll-outs for this unique transitional period resulting from implementation of new curriculum standards and a new assessment process in ?

5 Questions to Explore How can TVASS information be used most effectively to develop the instructional program to meet student needs as curriculum standards change and added rigor is applied?

6 Questions to Explore What plans (if any) are in place to change the K-2 assessment process? What plans (if any) are in place to change the assessment process for ELL and SPED students? Discuss security procedures.

7 New Achievement Contract & Timeline Office of Assessment, Evaluation, & Research

8 New Achievement Contract Grades K-2 (Optional NRT) Grades 3-8 (Mandated CRT) Modified Academic Achievement Standards Assessment (MAAS) English Linguistically Simplified Assessment (ELSA)

9 New Vendors Pearson Educational Measurement (PEM) Reporting Logistics Pearson Access K-2 testing Educational Testing Service (ETS) Write custom items for TN grades 3-8

10 New Achievement Contract October 1, 2007: New content standards to Assessment December 2007: Release of Achievement RFP January 2008: SBE approval of content standards January to March 2008: Creation and review of New Items by CTB

11 New Achievement Contract March 2008: New Achievement Contract begins March to August 2008: Continued creation and review of New Items by Pearson/ETS (Vendor Transition including Item Bank transfer) June 2008: Review of New Passages (ETS)

12 New Achievement Contract August 2008: Review of New Items (ETS) December 2008: Passage Review (ETS) February 2009: Item Review (ETS)

13 New Achievement Contract TCAP T: Spring 2009 (Operational items assess current SPIs) TCAP A: Spring 2010 New Operational Assessment (Assess revised SPIs for RLA, Math, & Science) TBA: New Cut Scores Established (Standard Setting Required)

14 Resources Office of Assessment, Evaluation, & Research

15 TCAP T Time Limits Grade 3 SUBTESTTEST ITEMSTIME LIMIT Science, Part Science, Part Social Studies, Part Social Studies, Part Grades 4-8 SUBTESTTEST ITEMSTIME LIMIT Science, Part Science, Part Social Studies, Part Social Studies, Part Same as Form S (Spring 2008)

16 TCAP Achievement (3-8) State Performance Indicator Chart Spring 2009

17 TCAP Achievement (3-8) Third Grade Pilot Pilot results are in… Results are positive! ALL students grades 3 – 8 will now use a separate answer document. ALL students (3 – 12) may mark in test booklets.

18 TCAP Achievement (3-8) Practice Answer Document Practice answer document created as a resource for teachers of grades 3-8. Designed for practice in filling in bubbles on a document similar to the TCAP Achievement answer document. Available online at:

19 TCAP Achievement (3-8)

20 Unique Identification Numbers Beginning with the Summer 2008 Gateway/EOC test administration, both the student social security number and the State unique identification number (EIS) will be captured in an effort to phase out the use of social security numbers.

21 TCAP Achievement (3-8) For information about Curriculum roll-out sessions contact the Office of Curriculum and Instruction. 615/

22 TCAP Achievement The Office of Curriculum and Instruction (TDOE) is developing companion documents to the new curriculum standards. Users Guide to the Tennessee Mathematics Curriculum Framework Scott Eddins 615/

23 TCAP Achievement Overview General Organizational Format Webb Levels and the TN Curriculum Vision of Standards Based Science, Technology Engineering & Mathematics Education Implementation Users Guide to the Tennessee Mathematics Curriculum Framework

24 TCAP Achievement Formative and Summative Assessment Mapping Webb Depth of Knowledge Levels Alignment with ACT & NAEP Comparison of Former & New Standards Vocabulary in Focus Content in Focus Users Guide to the Tennessee Mathematics Curriculum Framework

25 State Performance Indicator Chart Spring 2009

26 TCAP Achievement (3-8) Online Resources Item Samplers & Practice Tests (Current) Educators Guide to Test Interpretation (will be revised) Teacher Directions (will be revised) Frequently Asked Questions (will be revised)

27 K-2 Testing Office of Assessment, Evaluation, & Research

28 Grades K-2 Shelf Test (Norm-Referenced) Optional No longer use TerraNova Use Stanford Achievement Test Spring 2009 K-2 Testing New Stanford 10

29 Levels SESAT 2 (Kindergarten) Primary 1 (First Grade) Primary 2 (Second Grade) K-2 Testing New Stanford 10

30 Subtests Reading Mathematics Language Spelling Listening Science Social Studies K-2 Testing New Stanford 10

31 Flexible time limits Content reflects national standards Full-color Easy-to-navigate Normed in 2002 Must order before Thanksgiving! K-2 Testing New Stanford 10

32 New Assessments Office of Assessment, Evaluation, & Research

33 New Assessments Modified Academic Achievement Standards (MAAS) English Linguistically Simplified Assessment (ELSA)

34 Achievement - ELSA English Linguistically Simplified Assessment (ELSA) Available for ACH - Spring 2010 Intended for Limited English Proficient (LEP) students ACH test in simplified English

35 Achievement – ELSA Characteristics of simplified language assessments Reduce wordiness Use common words Avoid words with multiple meanings Use concrete words Reduce complexity of sentence structure Use the simplest verb forms Use less complex context

36 Reduce linguistic barriers to measurement of the intended knowledge or skill The knowledge or skill being assessed must not be changed Challenging vocabulary should be used only when it is relevant to the knowledge or skill being assessed Same ACH test (e.g., large print and Braille versions) Achievement– ELSA

37 Achievement– MAAS April 2007, federal regulations finalized an option for an alternate assessment based on modified academic achievement standards Resource: National Center on Educational Outcomes (NCEO)

38 Achievement– MAAS TDOE adopts Modified Academic Achievement Standards (MAAS) Assessment Pearson/ETS contracted to field test MAAS items in Spring 2009 MAAS to be operational in Spring 2010 MAAS becomes one component of the NCLB Adequate Yearly Progress (AYP)

39 Achievement– MAAS Available for all 3-8 content areas (Reading and Language Arts, Mathematics, Science, and Social Studies)

40 Achievement– MAAS Assess same content standards as ACH Modify test format Modify test questions Modify achievement standards

41 Achievement– MAAS Referred to as the 2% solution Students for whom the alternate assessment is too easy Students who cannot demonstrate achievement on TNs ACH Design an assessment with more valid score interpretation for the 2% population

42 Achievement– MAAS Develop modified achievement standards (performance levels) For on-grade-level content standards Challenging for eligible students Assess a students mastery for grade- level content But at a less difficult level than grade- level achievement standards (performance levels)

43 Eligibility Guidance from State Department of Education (Special Education Division) IEP Team Content Standards (same as ACH) Achievement Standards (specific to MAAS) Achievement– MAAS

44 State must establish clear and appropriate guidelines for IEP teams to determine eligibility. Students may be assessed on the modified assessment in one or more subjects. Eligible students may be from any of the disability categories listed in the IDEA. Achievement– MAAS

45 State must ensure students IEPs include goals for content standards for the grade in which the student is enrolled. Students must have access to the curriculum and instruction for the grade in which the student is enrolled.

46 Achievement– MAAS Students cannot be precluded from attempting to complete the requirements for a regular high school diploma. A students IEP Team continues to determine how the student will participate in State and district-wide assessments. (OESE)

47 Achievement– MAAS Achievement expectations may be modified to provide a better method for assessing growth over time for the 2% population. Achievement standards should promote challenging expectations for this population.

48 After performance level descriptors for each achievement level are obtained, appropriate cut scores can be set for each proficiency level. Educator committees will be convened to recommend cut scores for this population on this new assessment. Achievement– MAAS

49 Test design changes include: Three answer option choices Shorter reading passages Reduced reading load Simplified language Decreased cognitive complexity Achievement– MAAS

50 Format changes include: Print styles simplified (modified use of italics, underlining, bold-facing) Charts, graphs, and tables simplified Print type size enlarged Essential information reinforced Fewer items on each page TCAP Achievement– MAAS

51 Pearson Access Office of Assessment, Evaluation, & Research

52 November/December 2008 TDOE will upload student data to PEMSolutions (pre-id) Pearson Access Spring Testing Coordinators will use the PEMSolutions tool of Pearson Access to: manage student data (before and after testing) access reports

53 November/December 2008 TDOE will upload student data to PEMSolutions (pre-id) Last name, First name, MI Student ID number Birthdate Gender Ethnicity Code A/B Grade Pearson Access

54 Visit the Computer Lab for a demonstration Login/Logout & Reset Password (use same passwords as order entry) Administrative Management Student Demographic & Enrollment Data Test Results Support FAQ & much more PearsonAccess PEMSolutions

55 RANDA Solutions Office of Assessment, Evaluation, & Research

56 TCAP Achievement Program Transition TurnLeaf (CTB) available through June 2009 Our online applications site is down for upgrades: https://www.eval.k-12.state.tn.us/login https://tnors.turnleaf.com

57 TCAP Achievement Program Transition New Tech Vendor (upgraded & enhanced) Achievement Orders RIs SGLs Training Videos https://tdoe.randasolutions.com

58 TCAP Achievement (3-8) Achievement Orders: Please verify all quantities (check Braille and LP). For late orders or changes contact: Freddie Summers 615/ Order #s and EIS upload information will be used to decide how many tests to order for each school. Systems must continuously update EIS

59 Test Window Office of Assessment, Evaluation, & Research

60 Spring 2009 Test Window For the school year , school systems can now select 6 consecutive school days to administer the TCAP Achievement Test. This change has been made to accommodate school systems with large ELL and SPED populations. The six consecutive school days must fall within the state testing window.

61 Spring 2010 Test Window Guidance from the U.S. Department of Education concerning the reporting of AYP information states that beginning with the school year , the State Department of Education will be required to report AYP information no later than 14 days before the start of the school year.

62 This new regulation will require reporting AYP information at least two weeks earlier than the current AYP reporting date. Since some Tennessee schools open as early as July 14, we must adjust the TCAP Achievement Test dates in order to comply with the new directive. Spring 2010 Test Window

63 We have drafted two possible solutions that will have the least impact on the Spring 2010 administration of the TCAP Achievement Test: Option 1: March 29 - April 9, 2010 (two-week window) Option 2: March 22 - April 9, 2010 (three-week window) Spring 2010 Test Window

64 Easter Sunday – April 4, 2010 Good Friday – April 2, 2010 Option 1: March 29 - April 9, 2010 (two-week window) Option 2: March 22 - April 9, 2010 (three-week window) Spring 2010 Test Window

65 March 21 March 22 March 23 March 24 March 25 March 26 March 27 March 28 March 29 March 30 March 31 April 1 April 2 Good Friday April 3 April 4 Easter Sunday April 5 April 6 April 7 April 8 April 9 April 10 Sun Mon Tues Wed Thurs Fri Sat Achievement Window March 30 – April 24 Spring 2010 Test Window

66 Test Security Office of Assessment, Evaluation, & Research

67 Test Security T.C.A states: Any person found not to have followed security guidelines… placed on immediate suspension placed on immediate suspension grounds for dismissal grounds for dismissal includes dismissal of tenured employees includes dismissal of tenured employees grounds for revocation of state license grounds for revocation of state license

68 Test Security 1) Adopt a locally monitored test security policy that incorporates, at a minimum, these State Test Security Guidelines. This policy should include a Testing Code of Ethics for personnel to sign and leave at the district office for documentation. State Test Security Guidelines The Public School Systems, State Special, and Non-Public Schools MUST:

69 Test Security 2) Train all personnel involved in the testing process on State Test Security Law, Security Guidelines, local policy, and test administration procedures; retain training documentation for system records. 3) Implement check-in, check-out, and quantity verification procedures for all test materials at the system level, at the school level, and for each test session.

70 Test Security 4) Restrict handling of test materials to authorized personnel at all times. 5) Implement policies and procedures to prohibit all personnel from obtaining knowledge of test items or passage content before, during, and after testing.

71 Test Security 6) Return test materials immediately after each test session and when the entire administration is completed. Store test materials in a centrally located locked room that is inaccessible to unauthorized persons. 7) Create a secure, yet positive, environment for testing.

72 Test Security 8) Conceal or remove all instructional or reference materials in the test setting that are related to the content area being assessed, such as maps, posters, student samples, bulletin board items, familiar study aids such as graphic organizers, models, or number lines that relate to subject content.

73 Test Security Any information regarding the content being measured on the test MUST be concealed during the test administration. Including but not limited to the following: Maps Charts Posters Student Work Bulletin Board Items Writing Formulas Word Lists Parts of Speech Graphic Organizers Number Lines Definitions Word Walls Displays Models

74 Test Security 9) Turn off all electronic communication devices (cell phones, pagers, PDAs, etc.) in the test setting. Ensure proper calculator use as outlined in the Test Administration Manual, making sure that calculators are cleared before and after administration of each test.

75 Test Security 10) Confirm each student is the person named on the answer document for every testing session. A photo ID may be required if administrators are not responsible for normal classroom instruction. 11) Require Test Administrators and Proctors to carefully adhere to all test administration and accommodation instructions, following appropriate schedules and time limits, outlined in all test directions.

76 Test Security 12) Require Test Administrators and Proctors to remain with the students and be observant and nondisruptive throughout the testing session. 13) Prohibit coaching students in any way during State assessments. 14) Prohibit reading test items and passages by anyone other than those reading to students being tested through read aloud, unless indicated in test instructions or accommodations.

77 Test Security 15) Ensure students respond to test without assistance from anyone. 16) Ensure that test items are not reproduced, duplicated, or paraphrased in any way, for any reason, by any person. 17) Maintain confidentiality of student- specific accountability demographic information and test results at all times.

78 Test Security 18) Document test security concerns, including missing materials, on the Breach of Testing Security Report form. 19) Failure to report a breach of security compromises the integrity of the testing process and should be treated as a breach of testing security.

79 Item Review Office of Assessment, Evaluation, & Research

80 Item Review Purpose: Obtain Tennessee educator input Support the content validity of the Achievement Test Two sets of committees content reviews bias and sensitivity reviews

81 Item Review Item Content Review Committees Grades 3-4 (4 content areas) Grades 5-6 (4 content areas) Grades 7-8 (4 content areas) Item Bias Review Committees Reading and Language Arts Grades 3-8 Mathematics Grades 3-8 Social Studies Grades 3-8 Science Grades 3-8

82 Item Development Cycle Items developed by ETS Items reviewed by TN educators Items field- tested Field-test results analyzed Items selected for test

83 Item Review ETS brings a range of items developed for all performance indicators. Following a structured process educators read all items individually the committee discusses items Educators mark their individual comment form with input on items

84 Each committee reviews all ACH items and all MAAS items for a grade span (3-4; 5-6; 7-8). Each committee is comprised of teachers of regular and special education students, as well as teachers of limited English proficient (LEP/ELL) students. Item Review

85 For each item, educators will recommend: accept as is accept with edits reject

86 Item Review Guiding Questions Does the item measure the SPI? Does the item reflect sound instructional practice at the grade level? Is the item clearly and concisely stated? Does the item have one, and only one, clearly correct answer?

87 Item Review Guiding Questions Does the item measure the SPI? Does the item reflect sound instructional practice at the grade level? Is the item clearly and concisely stated? Does the item have one, and only one, clearly correct answer?

88 Item Review Guiding Questions Are the other answer options clearly incorrect? Are all stimuli and/or graphics clear and understandable, and important to answering the item? Is the item appropriate for all groups of students?

89 Questions??? Contact Information Laura Atkins – Achievement (615)

90 Questions??? Contacts Laura Atkins - Achievement Uma Natarajan – NAEP Lori Nixon – Special Ed. Assessment (portfolio/MAAS) Steven Nixon – ELDA/ELSA/ELL Assessment Marcy Tidwell – Assessment Literacy Freddie Summers – Achievement Orders Mary Taylor – GWY/EOC/ACT/Plan/Explore Charlotte Woehler – Writing 615/


Download ppt "TCAP Achievement Transition Laura Atkins Office of Assessment, Evaluation, & Research."

Similar presentations


Ads by Google