1. Visible Teaching Visible Learning Visible Assessment John Hattie Visible Learning Laboratories University of Auckland March, 2009

2. Influences on Achievement ? DecreasedEnhancedZero 0

3. Reducing Class Size on Achievement? DecreasedEnhancedZero 0 What is the effect of reducing class size Hundreds of evaluations of reducing class size ….

4. Effect on Achievement over time? DecreasedEnhanced Zero 0.20 Reducing Class Size 1.0 An effect-size of.201.0 advancing achievement9 mths3 yrs % improving rate of learning10% 45% r variable & achievement.10.45 % of students with treatment exceeding those not treated834

5. The typical influence on achievement So what is the typical effect across  800+ meta-analysis  50,000 studies, and  200+ million students

6. Effect on Achievement over time? Decreased Enhanced Zero 0.20 Typical Effect Size 1.0.40

7. Distribution of effects

8. Influences on Achievement

9. Rank these 12 effects: Answers  Acceleration  Feedback  Student-teacher relationships  Teaching study skills  Reading Recovery  Cooperative learning  Homework  Individualized instruction  Ability grouping  Open vs. traditional classes  Retention (hold back a year)  Shifting schools

10. Rank these 12 effects: Answers  Acceleration.88  Feedback.73  Student-teacher relationships.72  Teaching study skills.59  Reading Recovery.50  Cooperative learning.41  Homework.29  Individualized instruction.22  Ability grouping.12  Open vs. traditional classes.01  Retention (hold back a year) -.16  Shifting schools -.34

11. The Disasters... RankInfluenceStudiesEffectsES 130 College halls of residence 1023.05 131 Multi-grade/age classes 9472.04 132 Student control over learning 6538.04 133 Open vs. Traditional 315333.01 134 Summer vacation 3962-.09 135 On Welfare Policies 88-.12 136 Retention 2072675-.16 137 Television 37540-.18 138 Mobility 181540-.34

12. The Disasters... RankInfluenceStudiesEffectsES 120 Mentoring 74.15 121 Teacher education 85391.12 122 Ability grouping 5001369.12 123 Gender 29266051.12 124 Diet 23125.12 125 Teacher subject matter knowledge 92424.09 126 Distance Education 8391643.09 127 Out of school curricula experiences 5250.09 128 Perceptual-Motor programs 180637.08 129 Whole language 64197.06

13. The Disasters... RankInfluenceStudiesEffectsES 110 Learning hierarchies24.19 111 Co- Team teaching13647.19 112 Web based learning45.3136.18 113 Family structure8451733.17 114 Extra-curricula Programs10268.17 115 Teacher Immediacy16.16 116 Within class grouping129181.16 116 Home-school programs14.16 118 Problem based learning285546.15 119 Sentence Combining programs3540.15

14. Not Worth it yet... RankInfluenceStudiesEffectsES 100 Finances189681.23 101 Illness13.23 101 Religious Schools71.23 103 Individualized instruction6381185.22 104 Visual/Audio-visual methods359231.22 105 Comprehensive Teaching Reforms2821818.22 106 Class size96785.21 107 Charter Schools18.20 108 Aptitude/treatment interactions61340.19 109 Personality2341481.19

15. Typical “average teacher” territory... RankInfluenceStudiesEffectsES 90 Exercise/Relaxation programs2271971.28 91 Desegregation335723.28 92 Mainstreaming150370.28 93 Teaching test taking & coaching275372.27 94 Use of calculators2221083.27 95 Values/Moral Education Programs8497.24 96 Competitive vs. individualistic learning831203.24 96 Special College Programs108.24 98 Programmed instruction493391.23 99 Summer school105600.23

16. Typical “average teacher” territory... RankInfluenceStudiesEffectsES 80 Decreasing disruptive behavior165416.34 81 Drugs4671839.33 82 Simulations361482.33 83 Inductive teaching97103.33 84 Ethnicity99.32 85 Teacher effects18.32 86 Inquiry based teaching205420.31 87 Ability grouping for gifted students125202.30 88 Homework161295.29 89 Home visiting7152.29

17. Closer to Average … RankInfluenceStudiesEffectsES 70 Time on Task100136.38 71 Computer assisted instruction48998914.37 72 Adjunct aids73258.37 73 Bilingual Programs128727.37 74 Principals/ School leaders4911257.36 75 Attitude to Mathematics/Science288664.36 76 Exposure to Reading114293.36 77 Drama/Arts Programs715728.35 78 Creativity21447.35 79 Frequent/ Effects of testing5691749.34

18. Average RankInfluenceStudiesEffectsES 60 Mathematics programs7062404.43 61 Behavioral organizers/Adjunct questions5771933.41 63 Cooperative learning306829.41 64 Science8842592.40 65 Social skills programs5402278.40 66 Reducing anxiety1211097.40 67 Integrated Curricula Programs6180.39 68 Enrichment214543.39 69 Career Interventions143243.38

19. Average RankInfluenceStudiesEffectsES 50 School effects168.48 51 Motivation327979.48 52 Early Intervention17049369.47 53 Questioning211271.46 54 Pre school programs3581822.45 55 Quality of Teaching141195.44 56 Writing Programs262341.44 57 Expectations674784.43 58 School size21120.43 59 Self-concept3242113.43

20. Let’s have them.... RankInfluenceStudiesEffectsES 40 Keller's PIS263162.53 41 Peer influences12122.53 42 Classroom management1005.52 43 Outdoor/ Adventure Programs187429.52 44 Interactive video methods4413930.52 45 Parental Involvement7161783.51 46 Play Programs70.50 47 Second/Third chance programs521395.50 48 Small group learning78155.49 49 Concentration/Persistence/ Engagement146587.48

21. Exciting …. RankInfluenceStudiesEffectsES 30 Worked examples62151.57 31 Home environment35109.57 32 Socioeconomic status499957.57 33 Concept mapping287332.57 34 Challenging Goals604820.56 35 Visual-Perception programs6835035.55 36 Peer tutoring7671200.55 37 Cooperative vs. competitive learning1024933.54 38 Pre-term birth weight46136.54 39 Classroom cohesion88841.53

22. Among the Winners... RankInfluenceStudiesEffectsES 20 Problem solving teaching221719.61 21 Not labeling students79.61 22 Teaching strategies566713572.60 23 Cooperative vs. individualistic learning774284.59 24 Study skills6682217.59 25 Direct Instruction304597.59 26 Tactile stimulation programs19103.58 27 Phonics instruction4475990.58 28 Comprehension programs4152653.58 29 Mastery learning377296.58

23. The Winners... RankInfluenceStudiesEffectsES 11 Teacher-Student relationships2291450.72 12 Spaced vs. Mass Practice63112.71 13 Meta-cognitive strategies63143.69 14 Prior achievement36079209.67 15 Vocabulary programs301800.67 16 Repeated Reading programs54156.67 17 Creativity Programs685837.65 18 Self-verbalization & Self-questioning1131150.64 19 Professional development5371884.62

24. The Winners... RankInfluenceStudiesEffectsES 1 Self-reported grades2093051.44 2 Piagetian programs51651.28 3 Providing formative evaluation3078.90 4 Micro teaching402439.88 5 Acceleration3724.88 6 Classroom behavioral160942.80 7 Comprehensive interventions for learning disabled students3432654.77 8 Teacher clarity00.75 9 Reciprocal teaching3853.74 10 Feedback12872050.73

25. Identifying what matters Percentage of Achievement Variance Students Teachers Home Peers Schools Principal

26. Visible teaching & Visible learning  What some teachers do!  In active, calculated and meaningful ways  Providing multiple opportunities & alternatives  Teaching learning strategies  Around surface and deep learning  That leads to students constructing learning

27. Visible Teaching – Visible Learning

28. Teachers  Clear learning intentions  Challenging success criteria  Range of learning strategies  Know when students are not progressing  Providing feedback  Visibly learns themselves

29. Students …  Understand learning intentions  Are challenged by success criteria  Develop a range of learning strategies  Know when they are not progressing  Seek feedback  Visibly teach themselves

30. The Contrast  An active teacher, passionate for their subject and for learning, a change agent OR  A facilitative, inquiry or discovery based provider of engaging activities

31. Activator or Facilitator ?

33. Message for Learning/Assessment  Balance of surface, deep, & constructed knowing  Teachers preach deep, students see surface!  Learning strategies  To reduce cognitive load  To use when stuck (welcome error!)  Requires deliberative practice  Builds expectations of “can do”  Thrives on challenge  Requires feedback

34. Feedback …

35. Priority to maximize FEEDBACK to THE TEACHER  Feedback is information provided by an agent (e.g., teacher, peer, book, parent, self/experience) regarding aspects of one’s performance or understanding.

36. Feedback is evidence about:  Where am I going?  How am I going?  Where to next?

37. Frequency of feedback How much feedback does the typical student get in a typical classroom on a typical day?

38. Tests are Feedback to the teacher  Whether their teaching methods have been successful or not  Whether their learning intentions are worthwhile & challenging  Whether students are attaining their desired success criteria  Which students have learnt or not learnt  Where teachers can capitalize on student strengths & minimize gaps  Where students are on the learning ladder  Whether they have a shared conception of progress  What is optimal to teach next Whenever we test in classes it is primarily to help teachers know:

39. Assessment and Feedback: asTTle (Assessment Tools for Teaching and Learning)

40. Welcome screen for Teachers

41. Customize a test

42. Choose difficulty

44. Choose Curriculum Strands

46. Create a test

47. Reporting to Teachers

49. Comparisons or Multi-test Reports

50. Individual Learning Pathways

51. Group Learning Pathway

52. Curriculum Level Report

53. Progress Report

54. Target Setting/ Expectations Teacher or student target Polynomial regression target

55. What Next Report Anna.Lena.Larsson@Skolverket.se

56. j.hattie@auckland.ac.nz www.education.auckland.ac.nz/st aff/j.hattie/ www.visiblelearning.co.nz Connecticut March 2009 Achievement & Assessment through Feedback