1. The Dynamic Trio of Effective Teaching Measures: Classroom observations, student surveys and achievement gains Thomas Kane Harvard Graduate School of Education

2. Which team would you pick? Or

3. 3  Largest study of instruction ever undertaken  3,000 teacher volunteers in 7 districts  Multiple Measures –>22,500 classroom observations –Student surveys –Student achievement gains on state tests & supplemental tests

4. Student Achievement Gains

5. ? MATH 7.6 months of learning Student Achievement Gains Bottom 25% Top 25%

6. Actual scores for 7500 lessons. 6 Classroom Observations

7. Actual scores for 7500 lessons. 7 1. UNSATISFACTORY Yes/no questions Posed in rapid succession Few students participate 2. BASIC Some questions ask for explanation Uneven attempts to engage all students 4. PROFICIENT Most questions ask for explanation Discussion develops/teacher steps aside All students participate 4. ADVANCED All questions high quality Students initiate questions Students engage each other Creating Environment of Respect & Rapport Creating environment of respect & rapport Managing classroom procedures Engaging students in learning Managing student behavior Establishing a culture of learning Using assessment in learning Establishing a culture of learning Using questioning & discussion techniques Communicating with students Classroom Observations

8. Student Achievement Gains Bottom 25% Top 25% Better Observation Scores, Higher Achievement Gains Difference - 0.11Managing student behavior+ 0.080.19 - 0.17Environment of respect & rapport+ 0.020.19 - 0.14Engaging students in learning+ 0.080.22 - 0.07Managing classroom procedures+ 0.140.21 - 0.13Establish culture of learning+ 0.120.25 - 0.03Using assessments+ 0.060.09 - 0.11Questioning and discussion+ 0.020.13 - 0.07Communicating with students - 0.010.06

9. 9 Student Perception Surveys

10. 10 Student Perception Surveys

11. Difference - 0.09Care+ 0.290.38 - 0.36Control+ 0.120.48 - 0.11Clarify+ 0.410.52 + 0.08Challenge+ 0.570.49 - 0.11Captivate+ 0.310.42 - 0.14Confer+ 0.220.36 -0.04Consolidate+ 0.420.46 Better Student Perceptions, Higher Achievement Gains Student Achievement Gains Bottom 25% Top 25%

12. Student Perceptions = Highest Reliability Correlation for same teacher on same measure, two different course sections Observation Scores Student Achievement Gains Student Survey Results

13. 13 Dynamic Trio Most predicts student outcomes, No diagnostic use Most diagnostic, Potentially least reliable Predictive, Most reliable Value-Added Observations Student Surveys

14. 14 Relative to What? Master’s Experience Dynamic Trio Months of Learning (MATH)

15. www.metproject.org