Presentation is loading. Please wait.

Presentation is loading. Please wait.

© radii.org 2007.

Similar presentations


Presentation on theme: "© radii.org 2007."— Presentation transcript:

1 © radii.org 2007

2 A REAL-TIME PERFORMANCE MONITORING SYSTEM FOR IMPROVING LEARNING
Australian Council of Educational Leaders Conference, Sydney, Oct 10–12, 2007 A REAL-TIME PERFORMANCE MONITORING SYSTEM FOR IMPROVING LEARNING Prof Peter Cuttance Research Australia Development & Innovation Institute (www.radii.org) © radii.org 2007

3 Emerging Performance and Accountability
Increased public access to data on individual schools. Advances in our understanding of effective instruction and learning. Professional educators must take control of the reins as the drivers of schooling. We need to tale the reins from politicians – and cranky organisations – meddling with educational practice — if they cannot evidentially demonstrate how best to teach children, politicians need to restrict their focus to broad policy issues, funding and regulation. © radii.org 2007

4 Present context in schools
Inefficient (& expensive) information gathering Much data gathering is done partly or fully by hand. Ineffective assessment Formative assessment is difficult to manage Diagnostic assessment is time-consuming Summative assessment is only for accountability & reporting. Data scattered everywhere, but no integrated framework Difficult to integrate information for case managing students needing personalised attention and support. Inefficient access to data to monitor strategic directions. © radii.org 2007

5 Information context Stakeholder feedback is difficult to access in real-time, when it would be of most use. Information relevant to the ‘dynamics’ of schools is not readily available. Most resource allocation is informed only at the margins by data that is current and reliable. Information relevant to accountability is more readily available than data relevant to the improvement of learning outcomes. © radii.org 2007

6 Information context (cont)
Much data available in schools is too far out-of-date for many purposes. Access to assessment data is inefficient and not well-integrated into teacher workflow. Assessment moderation is relatively weak. Achievement data is not available in a form that supports ‘personalisation’ of learning. © radii.org 2007

7 MOST POWERFUL TEACHING STRATEGIES
© radii.org 2007

8 Source of Contribution
Effect Size Source of Contribution 1.13 Reinforcement 0.94 Corrective feedback 0.79 Graded homework 0.76 Co-operative learning 0.65 Remediation feedback 0.40–0.70 Formative assessment 0.50 Peer tutoring 0.49 Teacher professional learning 0.46 Parent involvement 0.40 Tutoring © radii.org 2007 8 © radii.org 2007

9 Of the 1800 minutes in formal learning environments each week, less than 5 minutes comprises feedback by the teacher to the individual student. © radii.org 2007

10 Information about how and why the student understands and misunderstands, and what directions they must take to improve are powerful factors in learning. © radii.org 2007

11 Expectations are about setting appropriate and specific challenging goals
beyond the student aiming to ‘do their best’ students need to know what type & level of performance is to be attained “…feedback allows them to set reasonable goals…track their performance…[and make] adjustments in effort, direction and strategy…” © radii.org 2007

12 Formative assessment has an effect size of 0.4 – 0.75
ie. It can move the average level of achievement from the 50th percentile to the 65–80th percentile. More frequent formative assessment (1–2 times a week) has a much greater impact (ES = 0.75) than infrequent assessment (once every three weeks — ES = 0.5 ). © radii.org 2007

13 “…formative assessment can help all pupils, it yields particularly good results with low achievers by concentrating on specific problems with their work and giving them a clear understanding of what is wrong and how to put it right.” Black & Wiliam, 1998 © radii.org 2007

14 ProLearning An integrated real-time school improvement performance system
© radii.org 2007

15 A school-centric approach to:
Real-time gathering of ‘intelligence’ through online, telephone, and mobile surveys in a range of community languages. Continuous assessment–for–learning. Integration of data focussed on key performance monitoring areas. Integrated real-time reporting against a school’s priorities. © radii.org 2007

16 © radii.org 2007 16 • Formative assessment HERMES SURVEY KIOSK
DISTRICT/REGIONAL AGGREGATION OF DATA (EQIPS) • System-level surveys with each school able to add their own questions and receive report for their own respondents. • 24-hour surveys to gather brief information from schools, with SMS/ /fax notification and reminders to schools. HERMES SURVEY KIOSK Information gathered from: • Parents • Students • Teachers SCHOOL PRIORITIES TARGETS PERFORMANCE INDICATORS SCHOOL-CENTRIC IMPROVEMENT & PERFORMANCE INFORMATION ASSESSMENT KIOSK (iTaLAc) • Formative assessment • Real-time feedback to, students, teachers & parents • Tasks aligned to curriculum frameworks REPORTING TO COMMUNITY REPORTING TO PARENTS © radii.org 2007 16 © radii.org 2007

17 Leading–edge survey technology
Adaptive ‘intelligence’ gathering. Direct measures of progress (PIs). Automated deployment and processing. Delivered online, SMS and hand-helds. Multiple community languages. Random sampling replicates. Flexible reporting period and format. © radii.org 2007

18 Innovations for schools
Frequent 2-minute (1-page) ‘rapid’ surveys to gather information in real-time. Adaptive surveys Q1. Teachers at the school challenge my child to do their best Strongly Disagree Agree Agree Disagree Strongly Yes Not No Sure Yes Not No Sure My child is often bored at school My child likes to be extended My child does not get on well with teachers My child is involved in many school activities My child needs more help at school My child’s teachers are very supportive © radii.org 2007

19 The Integrated Teaching and Learning Assessment Cycle
(iTaLAc) © radii.org 2007

20 Reporting Instructional design Feedback Delivery © radii.org 2007

21 DESIGN DELIVERY FEEDBACK REPORTING TEACHER FEDBACK DIRECT FEEDBACK
STUDENT PEER ASSESSMENT TASK LEVEL REPORT TO TEACHER DEVELOP UNIT ASSESSMENT TASKS PLANNING TEACHING UNIT TEACHING OF UNIT STUDENT UNDERTAKES ASSESSMENT TASK EXTERNAL ASSESSMENT REPORT TO PARENT DESIGN DELIVERY FEEDBACK REPORTING © radii.org 2007

22 HERMES SURVEY KIOSK — an online library of surveys for parents, students and teachers
© radii.org 2007

23 Take the hassle out of doing surveys
Put a survey link on your school Home Page Choose from a library of survey questions Choose which schools to benchmark against Automated monitoring enhances response rates Automated reporting High security environment © radii.org 2007

24 Designed for the needs of schools
Library of surveys developed to research standards Over 2000 questions covering 400+ topics We can upload your own survey Many school system surveys are also available Run them at the time that best suits your school © radii.org 2007

25 Unique features based on leading-edge technologies
Customise to the look-and-feel of your school Add your own questions Automated reports sent to you within 24-hours Soar with the eagles — access a tutor to build your first survey in less than 45 minutes Free telephone and online voice-help Option for students and parents to listen to the questions in community languages © radii.org 2007

26 Purpose developed for schools
School improvement focus Gather feedback from parents, students, teachers Online — available anywhere Build your own survey by topic Translation into community languages on demand Pencil-and-paper versions of parent surveys © radii.org 2007

27 Examples of student surveys available…
Student well-being and engagement Understanding of gender differences Cyber bullying Literacy Student meta-cognitive development Behaviour at school © radii.org 2007

28 Examples of teacher surveys available…
Meta-cognitive development Understanding of strategies for boys learning Student-teacher relationships Co-operative group learning knowledge Evaluation of professional learning programs © radii.org 2007

29 Examples of parent surveys available…
School-family-community partnerships Communicating with the school Homework Supporting middle-years students at home School satisfaction © radii.org 2007

30 3-STEPS TO RUNNING YOUR SURVEY
The world’s easiest to use survey kiosk Designed from the ground-up especially for schools © radii.org 2007 © radii.org 2007

31 Choose from surveys for your target group
SELECT A NEW SURVEY FROM THE LIBRARY Choose from surveys for your target group Preview any survey © radii.org 2007 © radii.org 2007

32 Preview your survey as it will be seen by the person responding to it
PREVIEW THE SURVEY Preview your survey as it will be seen by the person responding to it © radii.org 2007 © radii.org 2007

33 Add your own questions to the survey
ADD YOUR OWN QUESTIONS TO YOUR SURVEY Add your own questions to the survey © radii.org 2007 © radii.org 2007

34 Enhance response rates by making the survey your own by — customise to the look-and-feel of your school website © radii.org 2007 © radii.org 2007

35 Match colours to your school
© radii.org 2007 © radii.org 2007

36 Help available on all screens
Click on the calendar to set a closing date © radii.org 2007 © radii.org 2007

37 RUN YOUR SURVEY Set your survey running — and place a link on your home page or the URL to respondents © radii.org 2007 © radii.org 2007

38 MONITOR RESPONSES SO YOU KNOW WHEN TO SEND OUT A REMINDER
Monitor your survey to know when to remind your target audience to respond © radii.org 2007 © radii.org 2007

39 WHEN THE SURVEY HAS CLOSED — REQUEST THE REPORT
When the closing date has passed, just click this button The report will arrive within 24-hours © radii.org 2007 © radii.org 2007

40 Reports include tables and graphics, plus a list of any text responses
© radii.org 2007 © radii.org 2007

41 SCHOOLEVENT A flexible event management service and booking system for schools © radii.org 2007

42 Functionality Appointment book Excursion manager Online payments
Booking kiosk © radii.org 2007

43 Parents can book a time to meet with teachers
Appointment Book Parents can book a time to meet with teachers Manage the booking schedule for staff appraisal meetings Students can book a time to meet with advisors and counsellors © radii.org 2007

44 Parents have online access to book students into excursions
Excursion Manager Parents have online access to book students into excursions Parents can pay online, or print an invoice to pay by cheque/bank transfer Parents can download your authorisation form to sign and send/fax to the school © radii.org 2007

45 Parents can pay online for school fees & charges
Online Payments Parents can pay online for school fees & charges secure credit card processing online, or print invoice to pay by cheque/bank transfer Schools can receive online payments — eg. for ‘tax deductible’ Building Funds Parents can pay online for any activity © radii.org 2007

46 Take the hassle out of managing events
Students can book themselves into swimming, tennis competitions, etc Parents make appointments with teachers Parents book before/after hours programs Teachers book for professional learning programs arranged across multiple schools Parents book online for end-of-year functions © radii.org 2007

47 Manage any facility or equipment that requires within-school access to be booked…
computer rooms & portable computer trolleys portable equipment — cameras, laptops, musical instruments library & sports facilities © radii.org 2007

48 Thank you for the opportunity to share these developments with you.
I invite you to keep in touch through by registering at the radii.org website. if you require further information. © radii.org 2007


Download ppt "© radii.org 2007."

Similar presentations


Ads by Google