Presentation is loading. Please wait.

Presentation is loading. Please wait.

2015 Smarter Balanced Assessment Site Coordinator Training March 12 and 17, 2015 April 29 and 30, 2015 Assessment Services.

Similar presentations

Presentation on theme: "2015 Smarter Balanced Assessment Site Coordinator Training March 12 and 17, 2015 April 29 and 30, 2015 Assessment Services."— Presentation transcript:

1 2015 Smarter Balanced Assessment Site Coordinator Training March 12 and 17, 2015 April 29 and 30, 2015 Assessment Services

2 Agenda Overview Testing Schedule Technology Test Security Accessibility Tools TOMS Test Administration Training Teachers Post Test Administration Resources & Support 2 Assessment Services

3 Overview Who ? What? Why? When? Where?

4 Grades 3–8Grade 11 All students in Grades 3–8, and Grade 11 Exceptions: California Alternate Assessment (CAA) ◦ Students participating in the California Alternate Assessment (CAA) English learners (ELs) less than 12 months ◦ For the English language arts (ELA) test only, English learners (ELs) who have been enrolled in a U.S. school less than 12 months parent exemption ◦ Students who have a parent exemption Who Takes Smarter Balanced? BLM 4 Assessment Services pages 23-24 in manual

5 What Tests Are Given? Content areas: ◦ English language arts (ELA) ◦ Mathematics Two components per content area: ◦ Computer adaptive test (CAT) = adjusts the difficulty of questions based on prior responses ◦ Performance task (PT) = extended activity requiring the student to integrate knowledge and skills across multiple standards 5 Assessment Services

6 Why are We Administering Smarter Balanced? Part of the California Assessment of Student Performance and Progress (CAASPP) System which has replaced STAR Aligned to the Common Core State Standards (CCSS) Promotes high-quality teaching and learning through the use of a variety of assessment approaches and item types 6 Assessment Services

7 Traditional Traditional calendar schools: ◦ Grades 3-8: April 6- June 15, 2015 ◦ Grade 11: April 24- June 15, 2015 Year-round Year-round calendar schools: ◦ Grades 3-8: May 11- July 21, 2015 When is the Testing Window? Stagger test sessions to enable the necessary technology equipment required, bandwidth performance, and support during testing 7 Assessment Services

8 Where? CAASSP Portal 8 Assessment Services

9 Testing Schedule

10 Estimated Testing Time Content AreaGrades Computer Adaptive Test (CAT) items hrs : mins Performance Task (PT) hrs : mins Total hrs : mins Classroom Activity (administered prior to the PT)* hrs : mins Total hrs : mins English Language Arts/Literacy 3–51:302:003:30:304:00 6–81:302:003:30:304:00 112:00 4:00:304:30 Mathematics 3–51:301:002:30:303:00 6–82:001:003:00:303:30 112:001:303:30:304:00 Both 3–53:00 6:001:007:00 6–83:303:006:301:007:30 114:003:307:301:008:30 10 Assessment Services pages 26-31 in manual

11 Scheduling Testing Recommended: CAT first, PT second The classroom activity should be completed within 3 days prior to administering a PT ELA PTs have 2 parts and can be completed over 2 days Mathematics PTs have 1 part and can be completed in 1 day Recommended: PTs should not be administered on the same day as the CAT CAT Classroom Activity Performance Task 11 Assessment Services page 28 in manual

12 Scheduling Testing: Test Expiration A student’s CAT remains active until the student completes and submits the test or 45 calendar days after the student has begun the test ◦ Recommended: students complete CAT portion of the test within five days of starting the designated content area The PT remains active only for 10 calendar days after the student has begun the PT ◦ Recommended: students complete the PT within three days of starting in each content area 12 Assessment Services page 26 in manual

13 Technology

14 High-level Technology Overview State hosted- test delivery servers TA using standard Web browser Student using Smarter Balanced California Secure Browser software application 14 Assessment Services

15 Inventory devices and ensure they are working; identify problems so they can be reported to the ITSS Help Desk and resolved before the testing window begins Ensure secure browser was installed on each device Inventory necessary equipment, making sure they are working (i.e., headphones and external keyboards for iPads) Plan to set aside at least 3-5 back-up devices for a classroom during testing Required Technology 15 Assessment Services page 22 in manual

16  Students must use the secure browser to log in to the Student Interface  The secure browser must be installed annually  Prevents students from accessing other computer or Internet applications or copying test information  Volume on the device must be adjusted BEFORE launching the secure browser  iPads: Guided Access must be enabled and activated  External user applications must be closed; will not work if the computer detects that a forbidden application is running Note: Test Administrator computers will use a standard Web browser (IE 9+, Firefox 2.0+, Chrome 4+, Safari) )3+) Secure Browser 16 Assessment Services pages 74-78 in manual

17 Technology Issues: Who Do I Call? Assessment Services ◦ Resetting SCs Passwords ◦ Issues with TOMS ◦ Issues with TA Interface ◦ Error messages or problems within the SBAC testing software ITSS Help Desk ◦ Problems with secure browser installation ◦ Devices not working ◦ Connectivity issues 17 Assessment Services

18 Procedures for Reporting A Technology Issue Technology Issue w/SBAC Software Occurs TA reports to Test Site Coordinator Test Site Coordinator reports to Assessment Services Assessment Services reports to CALTAC 18 Assessment Services When reporting an issue experienced with the SBAC software we need the following information: device 1.Type of device being used for the test error messages 2.Any error messages that appeared (code and description) SSIDgradecontentarea PTCAT 3.Any relevant student and school information, including SSID, grade level, content area, and whether it was during the PT or CAT

19 Test Security

20 Site Coordinators must read, sign, and return the Security Agreement Test Administrators must sign the Security Affidavit ◦ Make copies and keep for at least 1 year ORANGE ◦ Return originals to Assessment Services in ORANGE envelope (provided) Test Security Forms for the 2014–15 School Year BLM 20 Assessment Services

21 Test Security: General Rules login sheets Student login sheets- considered secure; must collect and lock up between test sessions; destroy after testing Scratch paper Scratch paper- considered secure and must be collected and destroyed after testing electronic devices prohibited ; airplane mode Use of unauthorized electronic devices (e.g., cell phones) in the testing session is prohibited ; phones should be set on airplane mode Instructional materials Instructional materials must be covered or removed BLM 21 Assessment Services pages 13-16 in manual

22 Test Impropriety low impactUnusual circumstance that has a low impact on the testing individual or group of students Low risk of affecting student performance, test security, or test validity Correctable and containable at local level Severity & Potential Effect Types of Issues LOW Impropriety Student(s) making distracting gestures/sounds or talking during the test session that creates a disruption in the test session for other students. Student(s) leave the test room without authorization. 22 Assessment Services pages 17-19 in manual

23 Procedures for Reporting Improprieties An impropriety incident occurs TA reports to Test Site Coordinator using the appropriate form Test site Coordinator submits form to LEA CAASPP Coordinator and keeps copy LEA Coordinator retains incident forms at the district 23 Assessment Services Submit all incident forms in your orange envelope

24 Test Irregularity Unusual circumstance that impacts the testing individual or group of students May affect student performance, test security, or test validity Severity & Potential Effect Types of Issues MEDIUM Irregularity Student(s) cheating or providing answers to each other, including passing notes, giving help to other students during testing, or using hand-held electronic devices to exchange information. Student(s) accessing the Internet or any unauthorized software or applications during a testing event. Student(s) accessing or using unauthorized electronic equipment (e.g., cell phones, PDAs, iPods, or electronic translators) during testing. Administrator or Coordinator failing to ensure administration and supervision of the Smarter Balanced assessments by qualified, trained personnel. Administrator or teacher failing to present Classroom Activity prior to performance task administration. Administrator or Coordinator giving out his or her username/password (via e-mail or otherwise) to other authorized users. Administrator or teacher coaching or providing any other type of assistance to students that may affect their responses. Must report to the CDE within 24 hours 24 Assessment Services pages 17-19 in manual

25 Test Breach Event that threatens test validity (e.g., release of secure materials) Severity & Potential Effect Types of Issues HIGH BREACH Administrator or Coordinator modifying student responses or records at any time. The live Student Interface or TA Interface being used for practice instead of the Training or Practice Tests. Adult or student posting items or test materials on social media (e.g., Twitter, Facebook, etc.). Adult or student copying, discussing, or otherwise retaining test items, stimuli, reading passages, writing prompts, or answers for any reason. This includes the use of photocopiers or digital, electronic, or manual devices to record or communicate a test item. This also includes using secure test items, modified secure test items, reading passages, writing prompts, or answer keys for instructional purposes. Secure test materials being shared with the media (such as the writing prompts, test items, or reading passages), or allowing media to observe a secure test administration. Adult or student improperly removing secure testing materials such as test items, stimuli, reading passages, writing prompts, or scratch paper from the testing environment. 25 Assessment Services Must report to the CDE within 24 hours pages 17-19 in manual

26 Procedures for Reporting Irregularities and Breaches An irregularity incident occurs TA reports to Test Site Coordinator Test Site Coordinator reports to the LEA Coordinator and submits form LEA Coordinator reports to the CDE California regulations require that irregularities be reported to the CDE within 24 hours (California Code of Regulations, Title 5, Education, § 859 [e]) 26 Assessment Services

27 Testing Irregularity Report Form Available at nistration/forms/. nistration/forms/ Reporting Improprieties and Irregularities 27 Assessment Services

28 Accessibility Tools

29 Universal Tools Universal Tools = available to all students; based on student preference and selection Designated SupportsDesignated Supports = available to all students who can benefit from them; must be indicated by an educator or group of educators AccommodationsAccommodations = based on a student’s Individualized Education Program (IEPs) or Section 504 Plan Universal Tools, Designated Supports, and Accommodations 29 Assessment Services pages 34-36 in manual

30 Universal Tools, Designated Supports, and Accommodations Embedded: digitally delivered via the online testing platform Non- embedded: provided by the school 30 Assessment Services pages 67-72 in manual see handout

31 Accessibility Tools Continued Process for identifying students for designated supports 1.Teachers become familiar with the accessibility tools available 2.Teachers identify students who will benefit from designated supports & submit to the Site Coordinator:  English learners  Students with attention difficulties  Students with other needs 3.Parents and students should be part of the decision making process Assessment Services 31 ISSAPP form

32 Accessibility Tools Continued General guidelines for use of all accessibility features:  Student is familiar with the support(s)  Supports are same or similar to those used for instruction and classroom assessment  Student has multiple opportunities to practice in the test environment Assessment Services 32

33 Individualized Aid (Unlisted) Online form must be submitted by the Test Coordinator Approval will be granted by the CDE Requires an IEP or 504 Plan Must be submitted 10 days prior to testing 33 Assessment Services

34 Using the Test Operations Management System (TOMS)  Add and manage TAs  Review student data  Assign online test settings to students  Appeals Assessment Services 34 (IE 9+, Firefox 2.0+, Chrome 4+, Safari 3+)

35 Adding Testing Administrators (TAs) 1. Select Add under Users 2. Complete the required fields (*) 3. Select Organization 4. Select Role (Test Administrator) 5. Click “Add Role” 35 Assessment Services

36 Trouble-shooting- Issues with Passwords Scenario 1: Scenario 1: User received email from with temporary password; set a permanent password; now can’t log in: Ensure user is typing in user name and password correctly (case sensitive; user name is not email address or employee ID) User should use FireFox or Chrome Have user clear cache/cookies Scenario 2: Scenario 2: User never received an email from or deleted it by Reset password 36 Assessment Services

37 Resetting Passwords 1. Select View & Edit under Users 2. Type in the name of TA 3. Click on the pencil icon next to TA’s name 37 Assessment Services

38 Resetting Passwords Continued 4. Click “Reset Password” 5. Send user an email with their user name 38 Assessment Services Allow for 24 hours; instant password resetting will not be available on the day of testing

39 Reviewing Student Data Students’ grade levels must be correct in TOMS before testing All students who are going to test must appear in TOMS 39 Assessment Services TOMS Verify student demographic data Configure test settings Manage user accounts TOMS Verify student demographic data Configure test settings Manage user accounts CALPADS (California Longitudinal Pupil Achievement Data System) CALPADS (California Longitudinal Pupil Achievement Data System) PowerSchool Make corrections to student demographic data PowerSchool Make corrections to student demographic data 123 Changes in CALPADS take 24-48 hours to reflect in TOMS

40 Student Profile in TOMS: Demographics All demographic data is read-only 40 Assessment Services

41 Student Profile in TOMS: Parent Exemptions 41 Assessment Services 1. After selecting student, click on the Test Mode tab 2. Click on Parent Exemption next to the applicable tests

42 24 hoursStudent online test settings must be configured at least 24 hours prior to testing SCs are authorized to set accessibility supports for students in TOMS One-by-one through student profile Template upload Setting Accessibility Supports (Test Settings) in TOMS 42 Assessment Services

43 Student Profile in TOMS: Test Settings 43 Assessment Services

44 TOMS Online Test Settings File Upload 44 Assessment Services

45 TOMS: Submitting Appeals Type of AppealDescription RESET Resetting a student’s test removes that test from the system and enables the student to start a new test. INVALIDATION Invalidating a student’s test eliminates the test. The test will not be scored. REOPEN Reopening a test allows a student to access a test that has already been submitted or has expired. RESTORE Restoring a test returns a test from the Reset status to its prior status. This action can only be performed on tests that have been reset. (if reset was in error) 45 Assessment Services pages 20-21 in manual

46 Test Administration

47 Establishing Appropriate Testing Conditions Testing students in classroom-sized groups is preferable (Reduces test fear and anxiety; facilitates monitoring and control for TAs) Room should have good lighting, ventilation, and free from noise and interruptions Remove or cover displayed information that might be used by students to help answer questions (Rubrics, vocabulary charts, student work, posters, graphs, charts, etc) Make appropriate seating arrangements prior to test administration (Students should be seated so that they cannot view the answers of others) 47 Assessment Services BLM pages 13 and 37 in manual

48 Establishing Appropriate Testing Conditions (cont.) Cell phones or other electronic devices are not allowed to be used during testing (e.g., turned off or airplane mode and put away) 48 Assessment Services BLM

49 General Test Rules pageStudents must answer all test items on a page before moving on to the next page segmentStudents may not return to a test segment once it has been completed and submitted submittedStudents must answer all test items before the test can be submitted SAYscriptTAs must follow the “SAY” script exactly each time a test session is administered 49 Assessment Services pages 24-26 in manual

50 Administering a Test Session 1.The TA logs on to the TA Interface from on a standard Web browser 50 Assessment Services

51 Administering a Test Session (cont.) 2.The TA selects the test category, the grade, and content area 51 Assessment Services 3.The TA selects the tests to administer

52 52 Assessment Services Administering a Test Session (cont.) 4.The TA starts a test session 5.The TA informs students of the test Session ID Write or display clearly in a place all students can see Session IDs are automatically generated upon selecting the [Start Session] button

53 Administering a Test Session (cont.) 6.Students log on through the secure browser To log on, students need:  First Name (Confirmation Code): Student’s legal first name as spelled in CALPADS  State-SSID: “CA” followed by a hyphen “-” and the student’s SSID  Session ID: TA-generated Session ID 53 Assessment Services Important: Student personal information is secure and must be collected and securely stored at the end of a test session, then securely destroyed at the end of the test administration. see handout

54 Administering a Test Session (cont.) 7. Upon selecting a test, students will wait for TA approval 8. TA will see approvals populate in the Approvals queue of the TA Interface; the TA then selects “Approve” (TA can approve all or one at a time) 54 Assessment Services

55 General Pause Rules If there is a technical issue (e.g., power outage or network failure), students will be logged out and the tests will automatically be paused If a test is paused, the student must log in again to resume testing Highlighted text and global notes will not be preserved 55 Assessment Services page 79 in manual

56 CAT ◦ If a CAT is paused for more than 20 minutes, the student is: Presented with the test page containing the test item he/she was last working on or the next page if all items on previous test page were answered NOT permitted to review or change any test items on previous test pages CATIf a CAT is paused for less than 20 minutes, the student is: Presented with the test item or passage he/she was working on when the test was paused and may answer previously shown items within a segment PTThere are no pause rules for the PT Please Note: Please Note: ELA PTs are divided into 2 parts; after a student completes Part 1, he/she cannot return to it General Pause Rules Continued 56 Assessment Services

57 Test Timeout Due to Inactivity 30 minutes inactivityAs a security measure, students are automatically logged out of the test after 30 minutes of inactivity Activity means: −Selecting an answer −Using a navigation option in the test (e.g., selecting [Next] or [Back], using the Questions drop-down list) −Note: Moving the mouse or selecting an empty space on the screen is not considered activity Before the system logs out, a warning message will be displayed 57 Assessment Services

58 Stopping an Entire Test Session TAs can stop a test session (and therefore pause tests for all students in the session) –Select the [Stop Session] button in the upper-left corner of the TA Interface –An “Important!” box will appear, requesting verification to end the session and log students out –Select [OK] to continue or [Cancel] to keep the test session open TA must read EAP Section instructions for grade 11 students 58 Assessment Services page 51 in manual

59  Classroom Activity Purpose: provide students with important context, concepts, and key terms prior to taking the PT Recommended: No more than a 3-day lapse between the classroom activity and the PT administration Computers, projectors, and other technology are allowed but not required for the classroom activity Designed to fit into a 30-minute window Students may take notes during the classroom activity, but the notes must be collected before proceeding to the PT Classroom Activity Administration Guidelines 59 Assessment Services pages 41-52 in manual

60 The SC should download the assigned classroom activity and provide to TAs at least 1–2 days prior TAs should provide the appropriate accommodations for students who normally use them during instruction while administering the classroom activity Classroom Activity Administration Guidelines (cont.) 60 Assessment Services pages 39-40 in manual pages 65-66 in manual Classroom Activity assignments posted at

61 Training Teachers

62 Training Teachers: Review Security Procedures security affidavit Review security affidavit and have all TAs sign process for reporting Review process for reporting improprieties, irregularities, and breaches 62 Assessment Services

63 Training Teachers: Test Administration DFA Review the Directions for Administration (DFA) Script job aid Review the “Creating a Test Session” job aid Training TA Interface Practice Tests Encourage teachers to use the Training TA Interface and Practice Tests Assessment Services 63 pages 41-52 in manual see handout

64 Training TA Interface and Practice Tests Assessment Services 64

65 Training Teachers Continued Review the process for reporting technology issues Assessment Services 65 Review accessibility tools and process for identifying students

66 Post Test Administration: Final Tasks

67 Post Test Administration Orange Envelope Submit Orange Envelope to Assessment Services: ◦ Signed security affidavits ◦ Principal’s Certification/Apportionment Form ◦ Testing impropriety reports Destroy all used scratch paper Destroy all log in sheets Assessment Services 67 page 53 in manual

68 Resources & Support 68 Assessment Services

69 Resources and Support http://caaspp.org Erin Gordon 619-725-5687 Denise Ormsbee 619-725-7059 Assessment Services main line 619-725-7065 ITSS Help Desk 619.209.HELP (4357) 69 Assessment Services

Download ppt "2015 Smarter Balanced Assessment Site Coordinator Training March 12 and 17, 2015 April 29 and 30, 2015 Assessment Services."

Similar presentations

Ads by Google