We think you have liked this presentation. If you wish to download it, please recommend it to your friends in any social system. Share buttons are a little bit lower. Thank you!
Presentation is loading. Please wait.
Published bySarah Daley
Modified over 4 years ago
© radii.org 2007
A REAL-TIME PERFORMANCE MONITORING SYSTEM FOR IMPROVING LEARNINGAustralian Council of Educational Leaders Conference, Sydney, Oct 10–12, 2007 A REAL-TIME PERFORMANCE MONITORING SYSTEM FOR IMPROVING LEARNING Prof Peter Cuttance Research Australia Development & Innovation Institute ( © radii.org 2007
Emerging Performance and AccountabilityIncreased public access to data on individual schools. Advances in our understanding of effective instruction and learning. Professional educators must take control of the reins as the drivers of schooling. We need to tale the reins from politicians – and cranky organisations – meddling with educational practice — if they cannot evidentially demonstrate how best to teach children, politicians need to restrict their focus to broad policy issues, funding and regulation. © radii.org 2007
Present context in schoolsInefficient (& expensive) information gathering Much data gathering is done partly or fully by hand. Ineffective assessment Formative assessment is difficult to manage Diagnostic assessment is time-consuming Summative assessment is only for accountability & reporting. Data scattered everywhere, but no integrated framework Difficult to integrate information for case managing students needing personalised attention and support. Inefficient access to data to monitor strategic directions. © radii.org 2007
Information context Stakeholder feedback is difficult to access in real-time, when it would be of most use. Information relevant to the ‘dynamics’ of schools is not readily available. Most resource allocation is informed only at the margins by data that is current and reliable. Information relevant to accountability is more readily available than data relevant to the improvement of learning outcomes. © radii.org 2007
Information context (cont)Much data available in schools is too far out-of-date for many purposes. Access to assessment data is inefficient and not well-integrated into teacher workflow. Assessment moderation is relatively weak. Achievement data is not available in a form that supports ‘personalisation’ of learning. © radii.org 2007
MOST POWERFUL TEACHING STRATEGIES© radii.org 2007
Source of ContributionEffect Size Source of Contribution 1.13 Reinforcement 0.94 Corrective feedback 0.79 Graded homework 0.76 Co-operative learning 0.65 Remediation feedback 0.40–0.70 Formative assessment 0.50 Peer tutoring 0.49 Teacher professional learning 0.46 Parent involvement 0.40 Tutoring © radii.org 2007 8 © radii.org 2007
Of the 1800 minutes in formal learning environments each week, less than 5 minutes comprises feedback by the teacher to the individual student. © radii.org 2007
Information about how and why the student understands and misunderstands, and what directions they must take to improve are powerful factors in learning. © radii.org 2007
Expectations are about setting appropriate and specific challenging goalsbeyond the student aiming to ‘do their best’ students need to know what type & level of performance is to be attained “…feedback allows them to set reasonable goals…track their performance…[and make] adjustments in effort, direction and strategy…” © radii.org 2007
Formative assessment has an effect size of 0.4 – 0.75ie. It can move the average level of achievement from the 50th percentile to the 65–80th percentile. More frequent formative assessment (1–2 times a week) has a much greater impact (ES = 0.75) than infrequent assessment (once every three weeks — ES = 0.5 ). © radii.org 2007
“…formative assessment can help all pupils, it yields particularly good results with low achievers by concentrating on specific problems with their work and giving them a clear understanding of what is wrong and how to put it right.” Black & Wiliam, 1998 © radii.org 2007
ProLearning An integrated real-time school improvement performance system© radii.org 2007
A school-centric approach to: Real-time gathering of ‘intelligence’ through online, telephone, and mobile surveys in a range of community languages. Continuous assessment–for–learning. Integration of data focussed on key performance monitoring areas. Integrated real-time reporting against a school’s priorities. © radii.org 2007
© radii.org 2007 16 • Formative assessment HERMES SURVEY KIOSKDISTRICT/REGIONAL AGGREGATION OF DATA (EQIPS) • System-level surveys with each school able to add their own questions and receive report for their own respondents. • 24-hour surveys to gather brief information from schools, with SMS/ /fax notification and reminders to schools. HERMES SURVEY KIOSK Information gathered from: • Parents • Students • Teachers SCHOOL PRIORITIES TARGETS PERFORMANCE INDICATORS SCHOOL-CENTRIC IMPROVEMENT & PERFORMANCE INFORMATION ASSESSMENT KIOSK (iTaLAc) • Formative assessment • Real-time feedback to, students, teachers & parents • Tasks aligned to curriculum frameworks REPORTING TO COMMUNITY REPORTING TO PARENTS © radii.org 2007 16 © radii.org 2007
Leading–edge survey technologyAdaptive ‘intelligence’ gathering. Direct measures of progress (PIs). Automated deployment and processing. Delivered online, SMS and hand-helds. Multiple community languages. Random sampling replicates. Flexible reporting period and format. © radii.org 2007
Innovations for schoolsFrequent 2-minute (1-page) ‘rapid’ surveys to gather information in real-time. Adaptive surveys Q1. Teachers at the school challenge my child to do their best Strongly Disagree Agree Agree Disagree Strongly Yes Not No Sure Yes Not No Sure My child is often bored at school My child likes to be extended My child does not get on well with teachers My child is involved in many school activities My child needs more help at school My child’s teachers are very supportive © radii.org 2007
The Integrated Teaching and Learning Assessment Cycle(iTaLAc) © radii.org 2007
Reporting Instructional design Feedback Delivery © radii.org 2007
DESIGN DELIVERY FEEDBACK REPORTING TEACHER FEDBACK DIRECT FEEDBACKSTUDENT PEER ASSESSMENT TASK LEVEL REPORT TO TEACHER DEVELOP UNIT ASSESSMENT TASKS PLANNING TEACHING UNIT TEACHING OF UNIT STUDENT UNDERTAKES ASSESSMENT TASK EXTERNAL ASSESSMENT REPORT TO PARENT DESIGN DELIVERY FEEDBACK REPORTING © radii.org 2007
HERMES SURVEY KIOSK — an online library of surveys for parents, students and teachers© radii.org 2007
Take the hassle out of doing surveysPut a survey link on your school Home Page Choose from a library of survey questions Choose which schools to benchmark against Automated monitoring enhances response rates Automated reporting High security environment © radii.org 2007
Designed for the needs of schoolsLibrary of surveys developed to research standards Over 2000 questions covering 400+ topics We can upload your own survey Many school system surveys are also available Run them at the time that best suits your school © radii.org 2007
Unique features based on leading-edge technologies Customise to the look-and-feel of your school Add your own questions Automated reports sent to you within 24-hours Soar with the eagles — access a tutor to build your first survey in less than 45 minutes Free telephone and online voice-help Option for students and parents to listen to the questions in community languages © radii.org 2007
Purpose developed for schoolsSchool improvement focus Gather feedback from parents, students, teachers Online — available anywhere Build your own survey by topic Translation into community languages on demand Pencil-and-paper versions of parent surveys © radii.org 2007
Examples of student surveys available…Student well-being and engagement Understanding of gender differences Cyber bullying Literacy Student meta-cognitive development Behaviour at school © radii.org 2007
Examples of teacher surveys available…Meta-cognitive development Understanding of strategies for boys learning Student-teacher relationships Co-operative group learning knowledge Evaluation of professional learning programs © radii.org 2007
Examples of parent surveys available…School-family-community partnerships Communicating with the school Homework Supporting middle-years students at home School satisfaction © radii.org 2007
3-STEPS TO RUNNING YOUR SURVEYThe world’s easiest to use survey kiosk Designed from the ground-up especially for schools © radii.org 2007 © radii.org 2007
Choose from surveys for your target groupSELECT A NEW SURVEY FROM THE LIBRARY Choose from surveys for your target group Preview any survey © radii.org 2007 © radii.org 2007
Preview your survey as it will be seen by the person responding to itPREVIEW THE SURVEY Preview your survey as it will be seen by the person responding to it © radii.org 2007 © radii.org 2007
Add your own questions to the surveyADD YOUR OWN QUESTIONS TO YOUR SURVEY Add your own questions to the survey © radii.org 2007 © radii.org 2007
Enhance response rates by making the survey your own by — customise to the look-and-feel of your school website © radii.org 2007 © radii.org 2007
Match colours to your school© radii.org 2007 © radii.org 2007
Help available on all screensClick on the calendar to set a closing date © radii.org 2007 © radii.org 2007
RUN YOUR SURVEY Set your survey running — and place a link on your home page or the URL to respondents © radii.org 2007 © radii.org 2007
MONITOR RESPONSES SO YOU KNOW WHEN TO SEND OUT A REMINDERMonitor your survey to know when to remind your target audience to respond © radii.org 2007 © radii.org 2007
WHEN THE SURVEY HAS CLOSED — REQUEST THE REPORTWhen the closing date has passed, just click this button The report will arrive within 24-hours © radii.org 2007 © radii.org 2007
Reports include tables and graphics, plus a list of any text responses© radii.org 2007 © radii.org 2007
SCHOOLEVENT A flexible event management service and booking system for schools © radii.org 2007
Functionality Appointment book Excursion manager Online paymentsBooking kiosk © radii.org 2007
Parents can book a time to meet with teachers Appointment Book Parents can book a time to meet with teachers Manage the booking schedule for staff appraisal meetings Students can book a time to meet with advisors and counsellors © radii.org 2007
Parents have online access to book students into excursionsExcursion Manager Parents have online access to book students into excursions Parents can pay online, or print an invoice to pay by cheque/bank transfer Parents can download your authorisation form to sign and send/fax to the school © radii.org 2007
Parents can pay online for school fees & charges Online Payments Parents can pay online for school fees & charges secure credit card processing online, or print invoice to pay by cheque/bank transfer Schools can receive online payments — eg. for ‘tax deductible’ Building Funds Parents can pay online for any activity © radii.org 2007
Take the hassle out of managing eventsStudents can book themselves into swimming, tennis competitions, etc Parents make appointments with teachers Parents book before/after hours programs Teachers book for professional learning programs arranged across multiple schools Parents book online for end-of-year functions © radii.org 2007
Manage any facility or equipment that requires within-school access to be booked…computer rooms & portable computer trolleys portable equipment — cameras, laptops, musical instruments library & sports facilities © radii.org 2007
Thank you for the opportunity to share these developments with you. I invite you to keep in touch through by registering at the radii.org website. if you require further information. © radii.org 2007
Numbers Treasure Hunt Following each question, click on the answer. If correct, the next page will load with a graphic first – these can be used to check.
Jack Jedwab Association for Canadian Studies September 27 th, 2008 Canadian Post Olympic Survey.
FedEx Ship Manager® at fedex.com Shipping Administration
2011年上半年 我院团学工作活动图片展播 2011年8月28日.
AP STUDY SESSION 2.
Copyright © 2003 Pearson Education, Inc. Slide 1 Computer Systems Organization & Architecture Chapters 8-12 John D. Carpinelli.
Science Subject Leader Training
Preschool Learning Foundations and Curriculum Framework, Volume 2
Microsoft Access 2007 Advanced Level. © Cheltenham Courseware Pty. Ltd. Slide No 2 Forms Customisation.
1 DPAS II Process and Procedures for Teachers Developed by: Delaware Department of Education.
Local Customization Chapter 2. Local Customization 2-2 Objectives Customization Considerations Types of Data Elements Location for Locally Defined Data.
Custom Services and Training Provider Details Chapter 4.
Add Governors Discretionary (1G) Grants Chapter 6.
1 10 pt 15 pt 20 pt 25 pt 5 pt 10 pt 15 pt 20 pt 25 pt 5 pt 10 pt 15 pt 20 pt 25 pt 5 pt 10 pt 15 pt 20 pt 25 pt 5 pt 10 pt 15 pt 20 pt 25 pt 5 pt BlendsDigraphsShort.
Southern Regional Education Board 1 Preparing Students for Success in High School.
1 Career Pathways for All Students PreK-14 2 Compiled by Sue Updegraff Keystone AEA Information from –Iowa Career Pathways –Iowa School-to-Work –Iowa.
Plan My Care Brokerage Training Working in partnership with Improvement and Efficiency South East.
© 2018 SlidePlayer.com Inc. All rights reserved.