1. 2017-18 Kindergarten Assessment Data Collection Training Optional for Data Submitters
Hello, my name is Jordan Heide and I am the Data Owner for the Kindergarten Assessment Collections. This is the Kindergarten Assessment Data Collection training webinar for the school year. This webinar is optional for any personnel entering Kindergarten Assessment data into the Oregon Department of Education’s data collections. Today’s webinar will be fairly short, with a quick overview of the slides from the module posted on the ODE website, a few reminders and updates, and then giving folks a chance to ask questions. For more information about Kindergarten Assessments, see the Data Collection Module on ODE’s website or the Data Collection Manual on the district site.

2. The Kindergarten Assessment Collections include:
Overview
The Kindergarten Assessment Collections enable district and school staff to enter results for the statewide Kindergarten Assessment.
The Kindergarten Assessment Collections include:
Kindergarten Assessment: Early Literacy
Kindergarten Assessment: Early Mathematics
Kindergarten Assessment: Approaches to Learning
Data Submission
Audit/Review
Validation
The Kindergarten Assessment Collections enable district and school staff to enter results for the statewide Kindergarten Assessment.
The Kindergarten Assessment Collections are composed of three separate collections.
The collection process includes *click* the Data Submission window (where the initial data entry takes place), an Audit window (when ODE staff have reviewed preliminary data and flagged any errors for districts to review and correct), and finally, a Validation window (where districts ensure the accuracy of the data).
Schedule of Due Dates (SoDD) Webpage

3. 2017-18 Important Dates Administration Window
Opens: Tuesday, August 8, 2017
Closes: Thursday, October 19, 2017
Data Entry Window (Consolidated Collections)
Opens: Thursday, August 10, 2017
Closes: Monday, October 30, 2017
Audit Review Period (Consolidated Collections)
Opens: Monday, November 20, 2017
Closes: Monday, December 4, 2017
Validation Window (Achievement Data Insights (ADI))
Opens: Thursday, January 4, 2018
Closes: Friday, January 19, 2018
Delinquent Date: Friday, January 26, 2018
As previously mentioned, the Kindergarten Assessment collections have three different types of windows for designated personnel to edit data. Each of these collections can be accessed through ODE’s District website, but in different applications.
The data entry window and Audit Review Period take place in the consolidated collections application.
The Validation window, however, takes place in the Achievement Data Insights application.
Important to note: The last day to submit data is also known as the Delinquent Date.
SoDD Webpage

4. Security Reminder Operational Scoresheets
and Approaches to Learning Scoresheets that contain student information and responses are secure materials
Data submitters must complete the Kindergarten Assessment Assurance Form
Security Reminder:
Even though the Kindergarten Assessment items are no longer secure, any materials that have been populated with student information and responses to items are considered secure and should be properly handled and stored in accordance with Section 2.4 of Oregon’s Test Administration Manual. Data submitters who are handling secure materials also must complete the Kindergarten Assessment Assurance Form located in Appendix D of the TAM.
Test Administration Manual, Appendix D: Assurance of Test Security Forms

5. New in 2017-18: Removed Measures
Measure 1: Legacy English Letter Names
Measure 2: Legacy English Letter Sounds
Measure 3: Spanish Letter Sounds
For , ODE has removed the first three measures in the Early Literacy Collection.
Last year, Measures 1 and 2 were used by selected field test schools for a legacy measure study. Now that the study has been conducted and is complete, these measures will no longer be used by any district.
Measure 3, Spanish Letter Sounds, will not be collected in due to the temporary suspension of the measure. ODE will be looking to find a replacement measure that is research-based and better demonstrates Spanish-speaking English learners Spanish letter sound knowledge.

6. New in : Code Changes
End-dated Administration Codes (all collections)
‘E’ (Eligible student not tested- Spanish Speaking EL)
‘2’ (Modified Language)
Early Math
LEP flag no longer required
Language of Origin flag no longer required
Spanish flag removed
Early Literacy
New Code Changes for
Administration codes ‘E’ and ‘2’ are being end-dated for all collections. ‘E’ is being removed because there is no longer a requirement that a student be an officially identified Spanish-speaking EL to receive language supports and ‘2’ is being removed because modified language refers to simplifying or re-wording the item itself, which does not apply to the Kindergarten Assessment.
LEP and language of origin flags are no longer required for the Early Math and Early Literacy collections because of the removal of the officially identified Spanish-speaking EL requirement and the Spanish flag will be removed because students will be allowed to have language supports as a designated support and designated supports do not have student-specific requirements that determine eligibility.
File Formats

7. New in 2017-18: Data Entry User Guide
New section in the collection manual:
Directions
Screenshots
There is a new section to the end of the Kindergarten Assessment Data Collections Manual to assist first-time users in entering data. This section walks users through the process step-by-step with screenshots that were previously presented during this webinar. If you still have questions after reviewing this section of the manual, please reach out to your Regional ESD Partner or myself. Our contact information is located on the final two slides of this presentation. We would love to hear feedback about steps that are not included to insert into the manual throughout the data collection window.

8. Approaches to Learning Form
This is the form that data submitters will be entering data from for the Approaches to Learning collection. This form is the same format as last year with a few improvements. In the left-hand corner *click* you’ll see there is a table that includes the school name, teacher name, and test administration date. In the right-hand corner *click* there is a list of administration codes for teachers to use for each student. There is not a specific field on this form that is designated for writing down attempt and admin codes. During the DTC webinar for Kindergarten Assessment, users were directed to omit these codes for students that were provided a standard administration (attempt code = y and admin code = 0). If other codes are required, users were directed to put them next to the student’s name and SSID in the column on the left. If your district established a different method of capturing these codes, that is completely fine, too.

9. Operational Scoresheet
The following screenshots were taken from the Operational Scoresheet which data submitters will be entering data from for both the Early Literacy and Early Math collections. *click* On the first page you will see the student’s information for submission. When you open the booklet *click* you will see the Early Literacy Measures on the left-hand side of the page. The information you will need for data submission is located in the table to the right of each letter grid. On the right-hand side of the open scoresheet *click*, the Early Math begins. You will need to look at the top box *click* for the attempt code, administration code, and assessment administration date, and then *click* the right-hand columns should be populated with the student response for each item.

10. Updated Admin Code Descriptions
Name
Description
Not Applicable
Default 1
Student absent for extended period of time
Indicating a student was absent over the course of the administration, making them ineligible to participate in the assessment 3
Modified - Disability
A student’s Individualized Education Plan identifies a student to participate in the assessment under modified conditions 4
Home schooled/Out of State
A student who does not receive primary instruction in at the school (less than 50% instruction completed at the school), is a foreign exchange student, or a student who resides or attends school outside of the state 5
Not enrolled at current school during district testing window for
subject area
A student who is no longer enrolled in the district; a student who moved before the assessment could be administered; or a student who moved into district during the last 3 weeks of administration 6
Medical Emergency during the testing window
A student who cannot take the assessment during the entire testing window because of a significant medical emergency 7
Invalidated test with no opportunity to retest
ONLY for ODE use. Testing improprieties must be reported to ODE 9
Not Assessed due to Parental Request
OAR permits parents to request exemption on the basis of disability or religion C
Student Refusal - Whole Test
In cases where the student was presented with the opportunity to test and refuses to participate i.e., hides under desk, pushes booklet away, says "no", etc. D
Repeat Kindergartener
In cases when a student is repeating kindergarten and the district decides not to assess them in the subject area
Previously the description field was a duplicate of the name field and codes were not being applied consistently. This year ODE has updated the descriptions for the Administration Codes to better direct districts to which code is appropriate for which kind of scenario. These changes are reflected in the collection manual, file formats, and lookup value reports.
File Formats

11. Admin Codes: Commonly Misused
3 (Modified due to Disability)
4 (Home Schooled/Out of State)
7 (Invalidated)
9 (Not Assessed due to Parent request)
C (Student Refusal)
The following codes have been commonly misused in previous years of administration:
Code 3 (modified due to disability) should only be used when a student’s Individualized Education Plan identifies a student to participate in the assessment under modified conditions and the modified conditions are NOT listed as a support in the Oregon Accessibility Manual. A specific example of this would be eliminating an answer option on the math portion of the assessment to only include the correct answer and one distractor. When the assessment is modified under these conditions, the test is invalid and not counted toward participation
Code 4 (Home Schooled/Out of State) should only be used when a student who does not receive primary instruction in at the school (less than 50% instruction completed at the school), is a foreign exchange student, or a student who resides or attends school outside of the state.
Code 7 (Invalidated) should only be used when a testing impropriety has been reported to ODE and the District Test Coordinator has received an ODE Approved Outcome of “invalidation”.
Code 9 (Not Assessed due to Parent request) should only be used for students whose parents have requested exemption in accordance with OAR for religion or disability
Code C (Student Refusal) should be used in cases where the student was presented with the opportunity to test and refuses to participate (i.e., hides under desk, pushes booklet away, says "no", etc.)
File Formats

12. Updating/Editing Student Information
Student information fields (First Name, Last Name, SSID, DOB, etc.) must match across all of the three Kindergarten Assessment Collections (Early Literacy, Early Math, and Approaches to Learning) and First Period Cumulative ADM
Updating/Editing Student Information:
Student information fields (First Name, Last Name, SSID, Date of birth, etc.) must match across all three of the Kindergarten Assessment Collections (Early Literacy, Early Math, and Approaches to Learning).
For example, if a data submitter updates a student’s gender in the Early Math collection, he/she will need to go into the Early Literacy and Approaches to Learning collections to make the same edits. If the edits are not made across all three collections, that record will produce a flag to review during the Audit/Review window.
Kindergarten Assessment Data Collection Manual

13. Available Reports: Production Download
There are three reports available for each collection. All reports can be run and generated when the collections are opened or closed and each serves a different purpose.
This screenshot shows an example of the Production Download Report. This report lists each individual student that has been entered into the system and shows all fields (demographics and scores) and is only available in spreadsheet format. This report is most useful for people who enter and QC data to ensure all required fields have been entered. The format of this report is more technical than others that are available for non-data submitters.
Consolidated Collections Application

14. Available Reports: Student Roster
The slide contains examples of the different Student Roster Report formats. This report generates in the online interface (please note that this screenshot only shows the column headers in this view to protect secure student data that cannot be hidden) and can be exported to pdf *click* and CSV formats *click* which are shown in these bottom two screenshots. This report is an abbreviated version of the production download that has removed most of the student demographic information so that it can be used to easily print out district, school, and classroom-level rosters for teachers and administrators with all item response columns on one page for all three collections. This report is designed to be more user-friendly for non-data submitters than the Production Download Report.
Consolidated Collections Application

15. Available Reports: Verification
The final report available is the Verification Report. This report includes the overall count of records, date of last posted record, the count of errors and/or warnings waiting to be fixed/accepted, and the date the errors were last updated. This report is intended to be used by people who verify and QC data and is web generated, but can be exported to both CSV format *click* and pdf format *click*.
For more information about how to download these reports, please see the Kindergarten Assessment Collections User Guide posted to the KA Resources page on the District site.
Consolidated Collections Application

16. Common Audit Types Inconsistently reported flags
Student missing from other student-level collections
Inconsistently reported flags
Student identifying data issues
It is crucial that districts validate their data during the audit window. The most common Audit Types include:
*click* Inconsistently reported flags occurs when students are reported with multiple subgroup flags across all three collections or the subgroup flags do not match the student’s record in First Period Cumulative ADM.
*click* Student missing from other student-level collections occurs when the student has a record in First Period Cumulative ADM, but not the KA collection(s), student has a record in the KA collections but not in First Period Cumulative ADM, or the student has a record in one KA collection and not the others.
*click* Student identifying data issues occurs when Student’s SSID was merged, the student was reported with multiple genders in Kindergarten collections or does not match the gender in First Period Cumulative ADM, or the student’s age appears to be too old or too young for the enrolled grade.
For more information about Audit types and how to fix errors, see the Kindergarten Assessment Audit Manual on ODE’s District website.
Audit Manual

17. Resources Data Collection Test Administration
Schedule of Due Dates (SoDD)
Video Training Webpage
KA Data Collection Resource Page
Kindergarten Assessment Resource Page
Preliminary Test Administration Manual
The webpages listed on this slide are available to schools and districts to assist with the data submission process. The Schedule of Due Dates page includes the KA Data Collection Submission and Data Review dates. The Video Training Webpage is where you can access all KA Training handouts and recorded trainings. The KA Data Collection Resource page includes File Layouts, Manuals, and User Guides. The KA Assessment Resource Page includes Assessment Results, Interpretive Guidance, Specifications & Blueprints, and the Parent Brochure. And the Test Administration Manual outlines polices and procedures for Oregon’s Kindergarten Assessment to ensure test reliability, security, and validity.

18. Regional ESD Partners Karen Brown Smith Peter Campbell Ronda Thornburg
If you have questions your District Test Coordinator cannot answer regarding data collection submission, contact your Regional ESD Partners.
Karen Brown Smith
x3124 or (541)
Peter Campbell
x3203 or (541)
Ronda Thornburg
x3140 or (541)
If you have questions your District Test Coordinator cannot answer regarding data collection submission, contact one of the Regional ESD Partners listed on this slide.

19. ODE Contact Information
Jordan Heide
Kindergarten Data Owner
Holly Dalton
Early Literacy and Early Math Assessment Specialist
ODE Helpdesk
Technical Assistance
If you have any questions regarding Kindergarten Assessment data collections, you can you also contact me.
If you have questions related to the assessment content, policies, and procedures, please contact Holly Dalton, ODE’s Early Literacy and Early Math Assessment Specialist.
If you having technical difficulties with the collections or ODE district webpage, please contact the ODE helpdesk.