Presentation on theme: "Www.radii.org radii.org 2007 1. www.radii.org radii.org 2007 2 Australian Council of Educational Leaders Conference, Sydney, Oct 10–12, 2007 A REAL-TIME."— Presentation transcript:
radii.org Australian Council of Educational Leaders Conference, Sydney, Oct 10–12, 2007 A REAL-TIME PERFORMANCE MONITORING SYSTEM FOR IMPROVING LEARNING Prof Peter Cuttance Research Australia Development & Innovation Institute (www.radii.org)
radii.org Emerging Performance and Accountability Increased public access to data on individual schools. Advances in our understanding of effective instruction and learning. Professional educators must take control of the reins as the drivers of schooling. We need to tale the reins from politicians – and cranky organisations – meddling with educational practice if they cannot evidentially demonstrate how best to teach children, politicians need to restrict their focus to broad policy issues, funding and regulation.
radii.org Present context in schools Inefficient (& expensive) information gathering Much data gathering is done partly or fully by hand. Ineffective assessment Formative assessment is difficult to manage Diagnostic assessment is time-consuming Summative assessment is only for accountability & reporting. Data scattered everywhere, but no integrated framework Difficult to integrate information for case managing students needing personalised attention and support. Inefficient access to data to monitor strategic directions.
radii.org Information context Stakeholder feedback is difficult to access in real-time, when it would be of most use. Information relevant to the dynamics of schools is not readily available. Most resource allocation is informed only at the margins by data that is current and reliable. Information relevant to accountability is more readily available than data relevant to the improvement of learning outcomes.
radii.org Information context (cont) Much data available in schools is too far out-of-date for many purposes. Access to assessment data is inefficient and not well- integrated into teacher workflow. Assessment moderation is relatively weak. Achievement data is not available in a form that supports personalisation of learning.
radii.org Of the 1800 minutes in formal learning environments each week, less than 5 minutes comprises feedback by the teacher to the individual student.
radii.org Information about how and why the student understands and misunderstands, and what directions they must take to improve are powerful factors in learning.
radii.org Expectations are about setting appropriate and specific challenging goals beyond the student aiming to do their best students need to know what type & level of performance is to be attained …feedback allows them to set reasonable goals…track their performance…[and make] adjustments in effort, direction and strategy…
radii.org Formative assessment has an effect size of 0.4 – 0.75 ie. It can move the average level of achievement from the 50 th percentile to the 65–80 th percentile. More frequent formative assessment (1–2 times a week) has a much greater impact (ES = 0.75) than infrequent assessment (once every three weeks ES = 0.5 ).
radii.org …formative assessment can help all pupils, it yields particularly good results with low achievers by concentrating on specific problems with their work and giving them a clear understanding of what is wrong and how to put it right. Black & Wiliam, 1998
radii.org ProLearning An integrated real-time school improvement performance system
radii.org A school-centric approach to: Real-time gathering of intelligence through online, telephone, and mobile surveys in a range of community languages. Continuous assessment–for–learning. Integration of data focussed on key performance monitoring areas. Integrated real-time reporting against a schools priorities.
radii.org Leading–edge survey technology Adaptive intelligence gathering. Direct measures of progress (PIs). Automated deployment and processing. Delivered online, SMS and hand-helds. Multiple community languages. Random sampling replicates. Flexible reporting period and format.
radii.org Innovations for schools Frequent 2-minute (1-page) rapid surveys to gather information in real-time. Adaptive surveys Q1. Teachers at the school challenge my child to do their best Strongly Disagree Agree Agree Disagree Strongly My child does not get on well with teachers My child is often bored at school My child needs more help at school Yes Not No Sure My child likes to be extended My child is involved in many school activities My childs teachers are very supportive Yes Not No Sure
radii.org The Integrated Teaching and Learning Assessment Cycle (iTaLAc)
radii.org Instructional design Deliver y Feedback Reporting
radii.org TEACHER FEDBACK DIRECT FEEDBACK STUDENT PEER ASSESSMENT TASK LEVEL REPORT TO TEACHER EXTERNAL ASSESSMENT REPORT TO PARENT TEACHING OF UNIT STUDENT UNDERTAKES ASSESSMENT TASK DESIGNREPORTINGDELIVERYFEEDBACK DEVELOP UNIT ASSESSMENT TASKS PLANNING TEACHING UNIT
radii.org HERMES SURVEY KIOSK an online library of surveys for parents, students and teachers
radii.org Take the hassle out of doing surveys Put a survey link on your school Home Page Choose from a library of survey questions Choose which schools to benchmark against Automated monitoring enhances response rates Automated reporting High security environment
radii.org Designed for the needs of schools Library of surveys developed to research standards Over 2000 questions covering 400+ topics We can upload your own survey Many school system surveys are also available Run them at the time that best suits your school
radii.org Unique features based on leading-edge technologies Customise to the look-and-feel of your school Add your own questions Automated reports sent to you within 24-hours Soar with the eagles access a tutor to build your first survey in less than 45 minutes Free telephone and online voice-help Option for students and parents to listen to the questions in community languages
radii.org Purpose developed for schools School improvement focus Gather feedback from parents, students, teachers Online available anywhere Build your own survey by topic Translation into community languages on demand Pencil-and-paper versions of parent surveys
radii.org Examples of student surveys available… Student well-being and engagement Understanding of gender differences Cyber bullying Literacy Student meta-cognitive development Behaviour at school
radii.org Examples of teacher surveys available… Meta-cognitive development Understanding of strategies for boys learning Student-teacher relationships Co-operative group learning knowledge Evaluation of professional learning programs
radii.org Examples of parent surveys available… School-family-community partnerships Communicating with the school Homework Supporting middle-years students at home School satisfaction
radii.org Appointment Book Parents can book a time to meet with teachers Manage the booking schedule for staff appraisal meetings Students can book a time to meet with advisors and counsellors
radii.org Excursion Manager Parents have online access to book students into excursions Parents can pay online, or print an invoice to pay by cheque/bank transfer Parents can download your authorisation form to sign and send/fax to the school
radii.org Online Payments Parents can pay online for school fees & charges secure credit card processing online, or print invoice to pay by cheque/bank transfer Schools can receive online payments eg. for tax deductible Building Funds Parents can pay online for any activity
radii.org Take the hassle out of managing events Students can book themselves into swimming, tennis competitions, etc Parents make appointments with teachers Parents book before/after hours programs Teachers book for professional learning programs arranged across multiple schools Parents book online for end-of-year functions
radii.org Manage any facility or equipment that requires within-school access to be booked… computer rooms & portable computer trolleys portable equipment cameras, laptops, musical instruments library & sports facilities
radii.org Thank you for the opportunity to share these developments with you. I invite you to keep in touch through by registering at the radii.org website. if you require further