Agenda  What is On Demand Testing?  Types of Tests Available  Uses and Benefits of On Demand Testing  Progress Tests  Linear Test Reports (Progress Tests)  Computer Adaptive Tests  Interpretation of On Demand Test Outcomes  Software Upgrades  Future Directions  Contacts

What is On Demand Testing?  The VCAA Assessment Online System delivers online tests from a central repository to student PCs via the Internet and a school’s local network.  Teachers may use the resource when, where and how they choose.  It is optional, time-saving and able to be administered to a single student and/or a whole class.

Type of Tests Available Computer Adaptive Tests English Mathematics (30 or 60 question tests) Linear Tests English Mathematics Progress Tests (30 question tests) and Standard Linear Tests (15 to 25 question tests)

Uses of On Demand Testing  LIT Program pre-testing and post-testing students (168 schools, 500 teachers)  Teaching and Learning Coaches Initiative (382 Schools, 1500 teachers - Mathematics and Science)  NMR Zones Improvement Project (55 schools)  Assisting in forward planning of teaching programs  Corroborating teacher judgments  Online trials of new items/tests

Benefits of On Demand Testing  Identifying strengths or weaknesses of individual student’s learning outcomes (Linear/Progress Tests)  Testing the general range a student can perform in (Adaptive Test)  Reporting on performance and student progress tracking

Progress Tests  All questions and tests are created by the VCAA P-10 Unit, and are referenced to the Victorian Essential Learning Standards (VELS).  Progress tests have been designed to provide an estimated VELS Progression Point outcome for students.  Progress tests’ results are limited to a given VELS range eg 2.0 to 2.5  To confirm results for students who achieve close to zero or perfect scores on these tests it is recommended that an additional test at a higher or lower level be administered.

Progress Tests  Mathematics: Number (six tests)  English: Reading (six tests) VELS 2.0 to 2.5 VELS 2.5 to 3.0 VELS 3.0 to 3.5 VELS 3.5 to 4.0 VELS 4.0 to 4.5 VELS 4.5 to 5.0

Progress Tests

Linear Test Reports (Progress Tests)  Student Raw Score by Question Standard Level Report  Class Raw Score by Question Standard Level Report  Student Percentage Correct by Question Standard Level Report  Student Percentage Correct by Key Area Report  Student Skills Report  Class Skills Report

Computer Adaptive Tests  All questions correspond to a curriculum outcome  Selected from a large pool of Mathematics and English questions downloaded to the school  Test adapts to each student’s ability  30 question single dimension CAT 60 question general CAT across a domain  Tests take about minutes  Variable timing for questions that timeout (i.e. 60, 90, 120 secs etc)

Computer Adaptive Tests  Students cannot return to previous questions  Students will get more challenging questions as they answer  Paper & pencil/pen are allowed  No calculators allowed during the test

Computer Adaptive Tests Sample Answer Roadmap (Individual Student) 4M 3H 4M 5L 3H 3L 4M 5L 5H 3M 4L 5M 4H

Adaptive Test Report

Interpretation of On Demand Test Outcomes  VELS Translation Table  Progress Test Student Data  Adaptive Test Report  Comparing Progress Test and Adaptive Test Standard Scores

VELS Translation Table (Excerpt)

Progress Test Sample Data

Adaptive Test Report

Progress Tests Vs Adaptive Tests

Software Upgrades  The On Demand system is packaged with Virtual Machine (VM) Ware.  The On Demand VM Ware package is distributed on CASES 21 to Government schools.  Upgrades to the School Server are important. Upgrades include new features and system maintenance.

Future Directions  Review of the VCAA Assessment Online system  On Demand usage survey  Program rebuild  Adaptive Test expansion  Extend to Years 9 and 10 (English and Mathematics)  Top up Years 2 to 8 to 200%

VCAA ASSESSMENT ONLINE CONTACTS  WEB  Helpdesk Freecall Number 