Question Level Analysis in RAISEonline May 2009

Agenda 9.30am – Start 1.Why do question level analysis? 2.What question level analysis is possible in RAISEonline 3.Populating RAISEonline with question level data Step 1. Creating a pupil level CTF from SIMS Step 2. Importing CTF into RAISEonline Step 3. Producing template for entering question level data Step 4. Populating question level template Step 5. Importing completed question level template 4. Understanding and avoiding errors 10.30am-10.45am - break 12 noon - finish

1. Why do question level analysis?

2. What question level analysis is possible in RAISEonline

3. Populating RAISEonline with question level data

Populating RAISEonline with a pupil level common transfer file (CTF) NB. This must be done before you download question level templates or your question level files will not import into RAISEonline. Two steps: Step 1. Creating a pupil level CTF from SIMS Step 2. Importing CTF into RAISEonline See RAISEonline guidance notes: how to populate RAISEonline with a pupil level CTF handout for step by step guidance

Step 3. Producing template for entering question level data Once you have imported your CTF successfully, question level templates can be downloaded from the data management section of RAISEonline by clicking on data management, then import data…..

…then download example templates, then download QLA Step 3. Producing template for entering question level data

…then selecting the relevant year group, academic year, subject and paper and then clicking on download template NB. Only interim option available for 2009 at this stage. You will not need to tick this box once 2009 papers available (later in term)  When asked save your template to an appropriate folder. Step 3. Producing template for entering question level data

Step 4. Populating question level template  Navigate to where you have saved your template and open it  Macros must be enabled to ensure the data you enter will upload into RAISEOnline. NB. If your security settings are set to not allow you to enable macros you will need to use a different PC or contact your IT support

Step 4. Populating question level template  A template will then open which should contain the names and UPNs of the pupils in the chosen year group and a column for each question for the chosen paper NB. If you do not have any names in your template or you have the wrong year group in your template then your CTF has not imported correctly – you will need to get this right before you start populating your template

Step 4. Populating question level template All marks must be entered, if there are any blanks the results will not be uploaded into RAISE Where a pupil didn’t attempt a question ‘N’ must be entered  NB. This is different from PAT where a – was used if a child did not attempt the question and different from how NFER sent data back last year to schools who had their papers externally marked (they used an X).  Marks can then be typed directly into the template

Step 4. Populating question level template An error message will be displayed if an incorrect character is entered

Step 4. Populating question level template If there are blanks in the template an error message will be displayed when trying to save the document. You must correct any errors before importing your data  Note the message re. pupils who did not take the test – you should delete these pupils from the spreadsheet by selecting the relevant row, right clicking and choosing delete

Step 4. Populating question level template How to deal with pupils who have left your school since sitting the tests  Any pupils who took the test but have since left will not appear in the template if they were not in your CTF  You can not just add these to the bottom of the template as they will not import into RAISEonline.  You can add a pupil directly into RAISEonline (using the create a new pupil option in data management) but consider whether it is necessary to include children who have left in your analysis?

Step 4. Populating question level template How to populate the template if you already have your question level data electronically (eg. from NFER)  It is not actually the template you enter the marks in that feeds into RAISEonline. Saving the file populates a second data sheet and it is this that RAISEonline reads.  Therefore you can not just amend a spreadsheet you already have your data in so it looks like the RAISEonline spreadsheet as this will not import into RAISEonline  Instead ensure the two files contain the same children in the same order (alphabetically by surname in RAISEonline template), ensure any non answered questions are populated with Ns and there are no blanks or incorrect characters and then copy the question marks from your spreadsheet into the RAISEonline template.

Step 5. Importing completed question level template To import your completed QLA template click on data management, then import data, then question level analysis….

Step 5. Importing completed question level template Use the browse button to navigate to your completed, saved QLA template and then click open

Step 5. Importing completed question level template Then click upload file. RAISEonline will tell you your file has been uploaded (whether it has or hasn’t). You will then get a message at the bottom of the page either saying completed with result type yes, which means your file has uploaded, or completed with results type no, which means your file has not uploaded and need to view the upload report, correct any problems and try again

4. Understanding and avoiding errors

Error 1. Tried to import file containing a pupil with no results Solution: go back to your template and either enter results for or delete this pupil

Error 2. Tried to import file containing a Xs for omitted questions rather than Ns Solution: go back to your template and change Xs to Ns.

Error 2. Tried to import file containing a Xs for omitted questions rather than Ns Solution: go back to your template and change Xs to Ns.

If RAISEonline can not work out what the error was you will get this screen Examples of where you get this include trying to import another type of spreadsheet other than the RAISEonline template or importing a RAISEonline template where you have deleted one of the required populated or formula fields Solution: ensure you are importing a RAISEonline template and be very careful if pasting data into the template to not lose any of the required fields

Summary – points to remember  Before you can download and complete question level templates you must first create a CTF from SIMS and successfully import this into RAISEonline  You must enable macros when opening the template  If the template does not contain the relevant pupils names your CTF has not uploaded and you will need to try again.  Ensure you only enter either a relevant mark (usually a 0 or a 1) or an N  Ensure there are no blanks. Any pupils who did not sit the tests should be deleted.  If you have the question level data electronically you need to copy this into the RAISEonline template for importing (ensuring you only have valid characters and the pupils are in the same order)  When importing the QLA template you need a “completed with result type yes” message before you are able to start analysing your data

More information: Kim Price / Meri Pesola / /