Welcome to the MaLT CAT 3 demo network, multi-user version This demo shows you how to get the best out of the MaLT CAT version 3 www.hoddereducation.co.uk www.hoddertests.co.uk

What is MaLT CAT? MaLT stands for Mathematics Assessment for Learning and Teaching. It combines standardised, summative year-on-year assessment with formative assessment, opening up a new dimension of individual diagnostic error analysis and group performance evaluation. CAT stands for Computer-Adaptive Testing. MaLT CAT now includes audio support, so can be used from about age 6, and covers the full spectrum of ability to age 14+. (A single-user version of MaLT CAT, without the group testing and reporting facilities, is also available for individual learning support.)

What is computer-adaptive testing? Computer-adaptive testing (CAT) is sensitive to each pupil’s answers – automatically selecting and presenting new questions that are optimally matched to actual performance. If a question is answered incorrectly, a slightly easier question is offered; if a question is answered correctly, a slightly harder question follows, until a picture of the pupil’s ability emerges. Adaptive testing ensures that the questions are neither too easy nor inappropriately difficult – ideal for assessing mixed-ability groups. Adaptive testing probes each pupil’s maths understanding and skills at the cusp of their own ability, giving a clear profile of what the pupil can and cannot do. MaLT CAT also makes for highly efficient assessment which yields meaningful results and significantly reduces teacher workload.

What does MaLT CAT do? MaLT CAT tests are taken fully on-screen: the program automatically matches questions to each pupil’s performance, and records errors as well as correct answers. MaLT CAT lets you create Progress Tests and Diagnostic Tests across a wide age and ability range. MaLT CAT Progress Tests draw on the complete question bank and give standardised scores, percentiles and NC levels… … or you can define your own test parameters to create your own Diagnostic Tests. MaLT CAT tests all provide diagnostic analysis of errors, to pinpoint misunderstandings, misconceptions and individual learning needs. PLUS now MaLT CAT 3 includes optional audio support (up to about age 10), meaning that it can assess a pupil’s mathematical ability independently of reading.

MaLT CAT 3 … is purpose-designed for on-screen, standardised assessment of mathematics enables accurate assessment and instant results, in 30 minutes or less automatically matches questions to each pupil’s own ability, and captures errors as well as correct answers yields valuable diagnostic feedback, to inform and enhance teaching provides optional audio support, plus more questions … audio enables the inclusion of more lower-level questions which are presented aurally is ideal for mixed-ability class screening and individual progress tracking

MaLT CAT 3 … covers an exceptionally wide age and ability range … across ages 6 to 14 and up to NC level 7 can be used at any time during the school year allows regular re-testing, drawing on the large question bank automatically calculates standardised scores, percentiles and National Curriculum levels generates detailed pupil reports, plus comprehensive class and whole yeargroup listings and performance analyses enables individual progress monitoring through the school.

Let the computer do all the work! All pupil details can be imported from your school management information system Intuitive navigation and attractive presentation engages the pupil and makes the test accessible The questions are clearly presented on-screen, and answered by clicking, typing or dragging and dropping, using a mouse If the question allows the use of a calculator, an on-screen calculator is available Timing and scoring are fully automatic All reports and performance analyses are immediately available Your data can be printed or exported at the touch of a button

Progress or diagnostic test? – you choose CAT Progress Tests draw upon the full question bank and are designed to be taken termly or yearly. Pupils’ results on previous tests can be compared with their current results, to see trends and evaluate progress. Allow pupils up to 45 minutes to complete a test – but most will finish in 20–30 minutes. CAT Diagnostic Tests, created by the teacher, let you focus in on particular attainment targets, and can be defined more narrowly to NC level. For each question there is only one right answer – but there may be up to four ‘diagnostic errors’. Each one may reveal something different about the pupil’s understanding of mathematical concepts.

Setting up a test – 1 It couldn’t be easier to create a new test – in the Set up/Assign Tests screen you can: decide whether to include three practice questions select whether you want to include audio support select your assessment criteria (for a Diagnostic test) set the stopping password (this prevents pupils from exiting the test prematurely) name the test, and save it. This is also where you can delete a test – but remember, that will delete all related test performance data too.

Setting up a test – 2

Assigning a test – 1 Every Progress Test draws on the full item bank, with over 550 carefully calibrated questions available. You assign one test on each occasion – to an individual pupil, a class or a whole yeargroup. By default, the program will select all the pupils in a class. To de-select one or several pupils – for instance, if they have already taken the test – just click their names. Pupils only take a given test once: you re-test by creating and assigning a new test, as often as you wish.

Assigning a test – 2

Taking a test – 1 Tests can be taken yearly, termly or even more frequently. Each pupil logs in using their unique username and password, and takes the test assigned by their teacher. Because the program responds to performance – presenting a similar or easier question if the previous answer was incorrect, or vice versa – pupils cannot go back to previous questions. If audio is enabled, the pupil can click on a loudspeaker icon to hear the question again Allow pupils up to 45 minutes to complete a test – but most will finish in 30 minutes or less.

Taking a test – 2 A series of three practice questions is available to introduce the test – but these can be skipped if the pupils have taken these tests before.

Taking a test – 3 Every test starts with an easy question (relative to the pupil’s age) and each question is presented individually, one per screen:

Taking a test – 4 Clicking ‘Next’ takes the pupil on to the next question.

Reports As well as an individual Pupil Report, Progress Report and Performance Map, you can run a number of group performance analyses and listings.

Pupil Report – 1 The Pupil Report gives a standardised score, percentile and NC level, and much more …

Pupil Report – 2 The Pupil Report lists all of the questions presented to that pupil: you can review the pupil’s responses in the same order, or by attainment target or strand. It also shows the time taken for each question, giving an indication of its relative difficulty for that pupil.

Pupil Report – 3 The Pupil Report also details the mathematical understanding and skills the pupil has demonstrated successfully. This is followed by an interpretation of any diagnostic errors that were recorded on particular questions.

Performance Map Each pupil’s Performance Map shows any unusual pattern of errors – ‘easy’ questions a pupil got wrong (why?), and ‘difficult’ questions they got right …

Pupil Progress Report The Pupil Progress Report compares current performance with scores on all previous MaLT CAT Progress tests …

Group Report - 1 The Group Report for a class analyses the overall results from a MaLT CAT Progress test and shows aggregated class performance data, by gender, and the class NC level distribution …

Group Report - 2 When all classes within a yeargroup have taken the same MaLT CAT test, selecting the ‘all classes’ Group Report option gives you a range of useful comparative data, including overall NC level distributions and class and whole-cohort averages …

Pupil Performance Listings Comprehensive Pupil Performance Listings – generated in Excel, by class or cohort, and ready to take into any spreadsheet – let you make the performance comparisons YOU want.

Error Descriptions and National Marking Codes Reports The Error Descriptions Report, also generated in Excel, summarises your own pupils’ answers and diagnostic errors, with descriptors, enabling you to pinpoint particular problem areas. The National Marking Codes Report lets you relate your own pupils’ answers, and errors, to those made by over 12000 pupils in the national standardisation sample.

Getting started When you first run the program, you’ll need to set up your school name. Then set up the school’s cohorts, typically by year of intake – for instance, 2012 for the September 2012 intake. Next, you record which classes are attached to those cohorts. Finally, you register the pupils. The quickest and easiest way is to import pupil data from your own school management information system via an Excel spreadsheet, but you can also key in pupil details. Whichever route you choose, all your pupils are now there in the database, ready for you to create and assign a test. You can review individual pupil information at any time, as well as change passwords and usernames. If you’re upgrading from MaLT CAT 2, when you first run the program you will be prompted to import your existing database – it couldn’t be easier!

Technical details MaLT CAT 3 is fully networkable for whole-school use and comes with a two-year licence. A comprehensive User’s Manual (supplied as a pdf file on the CD-ROM) gives full information on how to install, use and get the most out of the system. Installation requires system administrator access: we strongly advise that your network administrator undertakes the program installation and initial set-up. This program is a 32-bit Windows® application that requires the .Net framework 4.0 to be installed on your PC in order to run: this will checked during installation and you will be prompted to install it if necessary. To run the framework and application, you require a PC running Windows® Server 2008, XP, Vista™ or Windows 7, with a 1.5 GHz or faster processor, with at least 256 Mb of memory (512 Mb recommended) and approximately 100 Mb of disk space to install the program (and an extra 150Mb if you need to install the .Net framework) and 100 Mb to run it. For quicker results you will need a PC with a faster CPU and more RAM. If you are working through a server, this may have an additional effect on the perceived speed. You will also need a mouse and SVGA monitor, set to a screen resolution of 1024 x 768 or higher. support@candlservices.co.uk technical support helpline: 01275 541253

Thank you for your interest in MaLT CAT 3 You can find out more at www.hoddertests.co.uk To order, go to www.hoddereducation.co.uk or telephone 01235 827827 You may also email orders to us on education@bookpoint.co.uk Note: the list price quoted is for a larger secondary school or college with 800+ students on roll, and is for a two-year site licence. Discounts are available to smaller secondary schools, and to primary schools: for a quotation, ring 01235 827827 now. www.hoddereducation.co.uk www.hoddertests.co.uk