Feedback and learning Professor Steve Higgins,

Slides:



Advertisements
Similar presentations
Literacy Subject Leaders
Advertisements

© PMB 2007 Assessment for Learning (AfL) Unit 3: Formative Feedback.
Effective Assessment and Feedback
Formative Assessment: Looking beyond the techniques Dr Jeremy Hodgen Kings College London.
Using assessment for learning
USING EVIDENCE TO INFORM YOUR LEADERSHIP APPROACH AND SUPPORT SCHOOL IMPROVEMENT ROB CARPENTER 26 TH SEPTEMBER 2013
Dorset Leadership Conference, 2013 Using evidence to inform your leadership approach and support school improvement James Richardson 5 th November 2013.
Session Outcomes Explain how assessment contributes to the learning process Use a model of feedback to enhance student learning Identify a range of feedback.
Exploring Research-Led Approaches to Increasing Pupil Learning Steve Higgins School of Education, Durham University Addressing.
Pupil premium toolkit: what works best at raising school achievement? Dr Lee Elliot Major, Director of Research and Policy, Sutton Trust, and EEF trustee.
Spending the Pupil Premium: Strategies to Improve Learning
Research-Led Approaches to Increasing Pupil Learning BOWDEN ROOM.
1 The Pupil Premium How to Spend it Wisely Robert Coe Director of the Centre for Evaluation & Monitoring (CEM) and Professor of Education, Durham University.
The University of Auckland New Zealand 7 August 2015 An introduction to formative assessment by Irene Anderson Media Studies Beacon Group.
Assessment for Learning
Using research to get the best value from the Pupil Premium Steve Higgins, School of Education, Durham National.
Research evidence and effective use of the Pupil Premium Professor Steve Higgins, School of Education, Durham
Network of School Planners in Ireland Mark Fennell 28 th April 2012 Implementing effective changes to improve student learning:
Woodlands PS How to use an Instructional Intelligence Framework to develop continuity and consistency across all year levels.
Welcome & Introduction.  The largest educational research unit in a UK university (75 staff)  1.1 million assessments are taken each year  More than.
Research-Led Approaches to Increasing Pupil Learning Robert Coe Capita Conference: Implementing the Pupil Premium Newcastle, 8 July 2013.
Office of School Improvement Differentiated Webinar Series Formative Assessment – Feedback February 28,2012 Dr. Dorothea Shannon, Thomasyne Beverly, Dr.
Formative assessment and effective feedback at Manor Lakes College
The Power of Feedback Hattie & Timperley (2007) from Review of Educational Research, 77(1)
Assessment and Reporting in the Primary School Wednesday 29 th October 2014.
David Didau. What works? Homework (Secondary) How do you improve a school? Cost per pupil Effect Size (potential months gain) £ £1000 Meta-cognition.
1. Assessment Mobile phones Be HERE Bags / laptops / office work away from table Have an open mind Ask questions Listen to learn Be honest Confidentiality.
Dylan Wiliam Why and How Assessment for Learning Works
V i s i b l e L e a r n i n g. The typical influence on achievement So what is the typical effect across  750+ meta-analysis  50,000 studies, and 
Formative Feedback. What Do We Mean by Formative Feedback? ‘Feedback to any pupil should be about the particular qualities of his or her work, with advice.
The power of feedback: insights from research Dr Lee Elliot Major Director of Research, Sutton Trust, Chair of evaluation advisory group, Education Endowment.
SOME KEY POINTS ABOUT TEACHING WRITING TO UNDER-ACHIEVING STUDENTS
Marking to improve student outcomes. Marking and feedback – are they the same?  Marking is the annotating of a piece of written work, using words, symbols.
Why do we mark children’s work? More to the point why do they think we mark their work?
Effective Feedback.
Welcome Feedback Policy
National Board Certification Cohort
Growth mindset How can we challenge the mindset of the more able?
Professor Steve Higgins, School of Education, Durham University
Growing Learners: Parents’ Briefing.
Assessment and Reporting Without Levels February 2016
Evidence-based Feedback
Belfast Boys’ Model School.
Metacognition and Self-regulation.
St Peter’s Catholic Primary
Welcome.
Seminar Four Quality Academic feedback: oral and written
Developmental Reading Assessment
Preparation for KS2 SATs
Raising student achievement by promoting a Growth Mindset
Developmental Reading Assessment
Visual map of the EEF Sutton Trust toolkit
VISIBLE LEARNING John Hattie.
Effective Feedback.
Feedback.
Developing Potentials for Learning: Evidence, assessment, and progress
BCELC Leadership Seminar Series
Professional evidence
Welcome to Year 10 Information Evening
Mathematics Specialism
(Guidance – Ofsted, updated 12 April 2018,
Selsdon Primary School September 2013
“Good feedback should be more work for the recipient than the donor…”
Evidence based approach to boost maths performance
TA Toolkit Teacher Session
CPD: The Coaching & Mentoring Model
Growth mindset & Questioning
Effective teaching and learning
FEEDBACK Dr. Mohammed Moizuddin Khan Associate Professor.
Presentation transcript:

Feedback and learning Professor Steve Higgins, School of Education, Durham University s.e.higgins@durham.ac.uk @profstig

Overview Why feedback? What is feedback? Some challenges Evidence from the Sutton Trust/EEF Toolkit Applying evidence from research What is feedback? A simple model Some practical strategies A more complex model Some challenges

EEF Project Best bets (on average) https://educationendowmentfoundation.org.uk/resources/teaching-learning-toolkit

Good bets (on average)

High risk (on average)

Summaries What is it? How effective is it? How secure is the evidence? What are the costs? What should I consider? Downloads Printable summary Technical appendix Printable summary Technical Appendix Further reading Case studies/ video Related EEF projects

Overview of value for money 1.0 Promising Feedback Meta-cognition Could be worth it EY intervention Effect Size (potential months gain) Peer tutoring Homework (Secondary) 1-1 tutoring Summer schools Digital technology Phonics Smaller classes Parental involvement After school Individualised learning Needs careful thought Teaching assistants Performance pay £0 Ability grouping £1000 Cost per pupil

The Bananarama Principle It ain’t what you do, it’s the way that you do it…

So what is feedback?

‘Feedback’: a simple feedback loop

Feedback follows performance… Feedback is information given to the learner and/or the teacher about the learner’s performance relative to the learning goals which can then redirect the teacher’s and the learner’s actions to achieve the goal. The ‘Learning Loop’ Set/ agree learning goals Assess where pupils are (including self or peer assessmeent Adapt teaching to meet goals Learner adapts strategy It is about teachers seeking feedback from pupils to adapt teaching. Specific, accessible learning intentions. Feedback that has real impact for future learning. Fundamental everyday change. Hattie model Teachers as learners, learners as teachers. It is about changing teacher’s actions. Wiliam’s formative assessment. Not AfL. … to close the ‘gap’

Feedback is reactive Feedback is powerful when it addresses faulty interpretations but not total lack of understanding -- clearly feedback is one part of the teaching process Feedback happens second – after the pupil has responded to initial instruction – when information is provided regarding some aspect(s) of the student’s task performance.

Purposes of feedback provide alternative strategies to understand material increase effort, motivation or engagement confirm that the responses are correct or incorrect indicate that more information is available or needed point to directions that could be pursued to restructure understandings

Summary of effect-sizes relating to feedback effects No. of No. of No. of Variable meta-analyses studies effects Effect-size Cues 3 89 129 1.10 Feedback (overall) 74 4157 5755 .95 Reinforcement 1 19 19 .94 Video/audio feedback 1 91 715 .64 CAI feedback 4 161 129 .52 Goals & feedback 8 640 121 .46 Student evaluation feedback 3 100 61 .42 Corrective feedback 25 1149 1040 .37 Delayed vs. immediate 5 178 83 .34 Reward 3 223 508 .31 Immediate vs. delayed 8 398 167 .24 Punishment 1 89 210 .20 Praise 11 388 4410 .14 Programmed Instruction 1 40 23 -.04

Summary of effects by types of feedback (adapted from Kluger & DeNisi, 1996) Moderator No. ES Correct feedback It is correct 114 .43 It is incorrect 197 .25 F/bk about changes from Yes 50 .55 previous trials No 380 .28 F/bk designed to discourage Yes 49 -.14 the student No 388 .33 F/bk with praise Yes 80 .09 No 358 .34 F/bk frequency Lots 97 .32 Little 171 .39

Summary of effects by types of feedback (adapted from Kluger & DeNisi, 1996) Moderator No. ES Task complexity Very complex 107 .03 Not complex 114 .55 Goal setting Difficult goals 37 .51 Easy goals 373 .30

Optimal feedback Provide feedback about correct (and incorrect)… …previous attempts …for tasks not too complex… …but which relate to more challenging goals … …and does not discourage the pupil… …or threaten their self-efficacy

Two helpful models Outward bound schemes (Hattie) Challenging and specific goals Learners seek instant feedback Instructors reassess and redirect learner’s strategies Sports programmes (Wiliam) Develop and produce talent Challenging and specific goals Specific feedback to move learning on Split into manageable steps for action It is about teachers seeking feedback from pupils to adapt teaching. Specific, accessible learning intentions. Feedback that has real impact for future learning. Fundamental everyday change. Hattie model Teachers as learners, learners as teachers. Wiliam’s formative assessment. Not AfL.

Hattie’s four feedback levels

Feedback features Form – what? Source – who? Timing – when? Oral, spoken, audio Written Pictoral/ iconic Timing – when? Prospective – what next? ‘Live’ Retrospective – what did you learn? Source – who? Teacher/ TA / other professional Peer Self Book/Computer

From feedback to feed-forward Feedback given or feedback received? What does the pupil hear/see? What do they think this means? What do they think they should do about it? Feedback for task success or feedback for learning?

Problems with traditional marking Tended to focus on four elements: presentation surface features (punctuation, grammar and especially spelling) quantity of work effort involved Time consuming Easy to overload Often not actionable: “but what am I supposed to do?”

Some challenges (1: recap) Getting the task difficulty right Too difficult – overload – too much feedback needed Too easy – no need for feedback Getting the level of feedback right Too complex/ too many points – overload Too simple – doesn’t help A “Goldilocks” problem – you have to get it just right

Some challenges (2) Time What to focus on? Time to diagnose Time to ‘judge the nudge’ so that it feeds forward Time to embed/ habituate What to focus on? Diagnosing key needs ‘Thorny’ problems Correcting/ re-learning

Some challenges (3): teacher/pupil talk Teacher/ pupil talk is like a genre on writing Questions can: Appear as imperatives “Why are you doing that?” = “Stop doing that!” Imply a correct answer the teacher already knows Not require an answer (rhetorical) Hard to ensure authentic dialogue

Suggested exploration Choose one area to explore with a colleague you currently work with What feedback is given and what is received? Is it for task success or for learning? Is it spoken/ written Can less be more?

Final thoughts… Develop mini-feedback strategies (cues, prompts, reminders) Make is as challenging as the learner can accept Give sparingly (needs to be meaningful) Don’t overload (key points, break into stages etc) Specific and received (relating to learning goals) Give positive feedback too (you got it right, because you…) Needs to be timely – (before/ during/ after) Focus on task and process (avoid self level 'clever boy’, good girl etc) Fade the feedback (from the teacher, from peers to self-regulation) Develop a culture of peer and self-assessment Try to avoid comparisons between pupils – self – and focus on how has improved in relation to previous personal bests – practical tips for this

Remember the Bananarama principle… “It ain’t what you do, it’s the way that you do it… that’s what gets results” High challenge, high support Authentic feedback Understood and actionable by the pupil? How do you create feedback loops which amplify learning?