California Educational Research Association Annual Meeting CERA Session 3 Day 1 – Preparation and Professional Development Rancho Mirage, CA – December.

Slides:

Advertisements

Similar presentations

Performance Assessment

Advertisements

What is Assess2Know ® ? Assess2Know is an assessment tool that enables districts to create high-quality reading and math benchmark assessments for grades.

Victorian Curriculum and Assessment Authority

PK & PCK Discussion Session Facilitated by Dr Zahari Hamidon.

Gwinnett Teacher Effectiveness System Training

Assessing Science PCK of Technology Educators Tyler S. Love.

California Educational Research Association Annual Meeting San Diego, CA November 18 – 19, 2010 Terry Vendlinski Greg Chung Girlie Delacruz Rebecca Buschang.

American Educational Research Association Annual Meeting New York, NY - March 23, 2008 Eva L. Baker and Girlie C. Delacruz What Do We Know About Assessment.

Progress and Consistency Tool (PaCT)

MEASURING TEACHING PRACTICE Tony Milanowski & Allan Odden SMHC District Reform Network March 2009.

PaCT What is the Progress & Consistency Tool?  The PaCT has two parts:  Frameworks that break down and illustrate aspects of maths, reading and writing.

Math Newsletter Project Overview Teacher Planning Work Samples & Reflections Teaching Resources Assessment & Standards Classroom Teacher Guide Preservice.

Supporting Teachers to make Overall Teacher Judgments The Consortium for Professional Learning.

Overview of Cognitively Guided Instruction Research.

© 2012 Common Core, Inc. All rights reserved. commoncore.org NYS COMMON CORE MATHEMATICS CURRICULUM A Story of Units Module Focus Grade 2- Module 4.

Customer Focus Module Preview

Measuring teacher expertise in the sciences Robin Millar.

Project Overview Teacher Planning Work Samples & Reflections Teaching Resources Assessment & Standards Classroom Teacher Guide Pre-service Teacher Guide.

AISSA “Down the Track” Seminar April 7-8, 2011 Backward Mapping: curriculum planning for aligning pedagogy and assessment Dr. Katie Weir.

1 Oregon Content Standards Evaluation Project, Contract Amendment Phase: Preliminary Findings Dr. Stanley Rabinowitz WestEd November 6, 2007.

C R E S S T / U C L A Evaluating the Impact of the Interactive Multimedia Exercises (IMMEX) Program: Measuring the Impact of Problem-Solving Assessment.

What is Effective Professional Development? Dr. Robert Mayes Science and Mathematics Teaching Center University of Wyoming.

Developing a Knowledge and Understanding of English Language Teaching Resources Project Overview Teacher Planning Work Samples & Reflections Standards.

1 Developing an Evaluation Plan _____________________ The Mathematically- Connected Communities MSP Developed for the February, MSP Conference Dr.

PDHPE K-6 Using the syllabus for consistency of assessment © 2006 Curriculum K-12 Directorate, NSW Department of Education and Training.

1 Studying Teacher Professional Development: Challenges and Possible Solutions Nicole Kersting Research Scientist LessonLab Research Institute, Santa Monica,

CCSSO-National Conference on Student Assessment 2013 National Harbor, MD– June 21, 2013 Girlie C. Delacruz, Eva L. Baker, Gregory K. W. K. Chung Solving.

Examining the Induction of Middle School Mathematics Teachers Kristin L. McGraner Research Associate Peabody College, Vanderbilt University Supported by.

1 Studying Teacher Professional Development: Challenges and Possible Solutions Rossella Santagata Assistant Professor, University of California, Irvine.

Forum - 1 Assessments for Learning: A Briefing on Performance-Based Assessments Eva L. Baker Director National Center for Research on Evaluation, Standards,

Professional Development Activity Log: A New Approach to Design, Measurement, Data Collection, and Analysis AERA Annual Meeting San Diego April 13, 2004.

1 Lesson Planning and Video Analysis as Data Tools for Assessing PCK Fran Arbaugh, John Lannin, Kathryn Chval, Troy P. Regis, Sarah Pomerenke, Aina Appova,

CERA 87 th Annual Conference- Effective Teaching & Learning: Evaluating Instructional Practices Rancho Mirage, CA – December 4, 2008 Noelle C. Griffin,

California Educational Research Association Annual Meeting CERA Session 4 Day 2, Special Topics Sarah Joy Bittick and Gregory K.W.K. Chung Use of Narrative:

© Regents of University of California 1 Functional Validity: Extending the Utility of State Assessments Eva L. Baker, Li Cai, Kilchan Choi, Ayesha Madni.

Assessment-Understanding by Design-Differentiated Learning.

What is Teacher Effectiveness and How May it Be Assessed? David E. Meltzer Department of Physics, University of Washington and Seattle Country Day School.

VCE Assessment PE Curriculum II Tutorial 3. Delivery of VCE material Lecture Tutorial  Worksheets – concept maps (software - inspiration  Discussion.

Educators’ Attitudes about the Accessibility and Integration of Technology into the Secondary Curriculum Dr. Christal C. Pritchett Auburn University

Using Appropriate Technology to Enhance Learning and Appreciation of Mathematics Quality Education for Minorities Network Strengthening Teacher Education.

Introduction to Curriculum Topic Study – Bridging the Gap Between Standards and Practice.

California Educational Research Association Annual Meeting Rancho Mirage, CA – December 5, 2008 Hoky Min, Gregory K. W. K. Chung, Rebecca Buschang, Lianna.

+ about HIV Project Overview Teacher Planning Work Samples & Reflections Teaching Resources Assessment & Standards Learning Areas Levels Objectives Description.

California Educational Research Association Disneyland Hotel – Anaheim, CA December 1, 2011 Terry Vendlinski Julia Phelan Improving Middle School Math.

National Standards in Reading & Writing Sources : NZ Ministry of Education websites. G Thomas, J Turner.

Developing an Effective Evaluation to Check for Understanding Part 2 Susan E. Schultz, Ph.D. Evaluation Consultant PARK Teachers.

 Newport MS and HS › Math and Science Teachers  Higher Education › Dr. Bethany Noblitt, NKU › Dr. Ted Hodgson, NKU › Dr. Vern Hicks, NKU.

Session 1 Introduction: Assessment & Evaluation Assessment & Evaluation.

How to Apply it in the Classroom Elicit ideas Elaboration & Reconstruc- tion Frequent problem based activities Variety of info. & resources Collaboration.

October 10, Start/end on time All technology is on-task Hold each other accountable Dive in to make this your own: no acting Stop and ask your burning.

SUMMATIVE ASSESSMENT A process – not an event. Summative assessment “Information is used by the teacher to summarize learning at a given point in time.

Key Documents: Mandatory Information DocumentPurpose Course specification Explains the overall structure of the Course, including its purpose and aims.

PARENT UNIVERSITY: Preparing Your Child for Success Presented by: Dr. Alicia Scelso, Principal, Pequannock Township High School Richard M. Hayzler, Principal,

Dyslexia at School Survey United States California and Texas Compared.

1 Oregon Standards Evaluation Project, Contract Amendment Phase: Summary of Preliminary Findings Dr. Stanley Rabinowitz WestEd December 6, 2007.

Strategies for blended learning in an undergraduate curriculum Benjamin Kehrwald, Massey University College of Education.

Developing pre-service elementary mathematics teachers’ knowledge bases through Standards-based curriculum materials Andrew M. Tyminski Clemson University.

立足学生认知实实现知识转化永嘉中学肖飞燕. 困惑 1 困惑 1 ：听懂不会做困惑 2 困惑 2 ：物理越教越难教 ●教学的困惑立足学生认知进行有效教学.

IDENTIFYING DEEP SUBJECT KNOWLEDGE An evaluative study of the nature of primary teachers’ deep subject knowledge when teaching mathematics Paul Broadbent.

Inquiry process To Focus our Professional Learning.

“All measurement is approximate” -- National Math Panel.

HOW TEACHERS’ ADAPTIVE EXPERTISE IS ILLUSTRATED BY REFLECTING THEIR PERSONAL PRACTICAL THEORIES Iina Männikkö & Jukka Husu, Department of Teacher Education,

Paula Miles School of Psychology & Neuroscience

Mathematics Specialist Specialization Proposal

Can Embedding Assessment Literacy Exercises within the Curriculum Raise Levels of Student Achievement and Satisfaction with Assessment and Feedback? Learning.

Measuring 21st Century Skills in a Common Core Era

Chapter 9 Transforming Professional Practice

Mentoring Novice Science Teachers

Pedagogical Content Knowledge (PCK) for Elementary Teachers

NextGen STEM Teacher Preparation in WA State

Presentation transcript:

California Educational Research Association Annual Meeting CERA Session 3 Day 1 – Preparation and Professional Development Rancho Mirage, CA – December 4 th, 2008 Rebecca E. Buschang Validating Measures of Math Teacher Knowledge

2 / 31 Plan Background information Study methods and measures Results Conclusions Future directions

3 / 31 Background Math teacher knowledge is complex Content knowledge Pedagogical content knowledge Knowledge of students and groups of students Knowledge of curriculum and resources Currently, no widely accepted measures of math teacher knowledge Shulman, 1986, Hill et al, 2004, 2005, 2008

4 / 31 Need for valid measures Assessments of different forms of math teacher knowledge… Give us information about level of knowledge and types of knowledge teachers have Can be helpful to professional development providers

5 / 31 Purpose and research questions Purpose: to gather validity evidence about how different tasks measure math teacher knowledge Research Questions Do these measures distinguish between expertise? Do these measures relate to each other?  Pedagogical content knowledge  Content knowledge

6 / 31 Methods 86 participants math experts (n = 13) teacher experts (n = 10) novice teachers (n = 17) experienced teachers, non- NBC teachers (n = 46) 4 tasks + background survey

7 / 31 Overview of measures Content Knowledge Content knowledge mapping task PCK Knowledge Pedagogical content knowledge mapping task Multiple choice measure of teaching knowledge Student work analysis task

8 / 31 Content knowledge map

9 / 31 Pedagogical content knowledge map Solve for the unknown 5x + 3(x + 4) =

10 / 31 Multiple choice measure of teaching knowledge (example #1)

11 / 31 Multiple choice measure of teaching knowledge (example #2)

12 / 31 Multiple choice measure of teaching knowledge (example #3)

13 / 31 Student work analysis task

14 / 31 Analysis of Data Group differences (ANOVAs) Correlations between tasks (Spearman) Whole group Split by participant group

15 / 31 Group Differences

16 / 31 Performance on concept knowledge map

17 / 31 Performance on PCK knowledge map

18 / 31 Performance on multiple choice measure of math teaching knowledge

19 / 31 Performance on multiple choice measure of math teaching knowledge

20 / 31 Performance on student work analysis task 3 4

21 / 31 Summary of findings (group differences) Performance differed by group Two tasks sensitive to expertise

22 / 31 Relation between tasks

23 / 31 Correlations Between Tasks MC measure Content KM PCK KMStudent work analysis MC measure 1.46**.53**.04 Content KM 1.49**.05 PCK KM 1.15 Student work analysis 1

24 / 31 Correlations Between PCK Tasks PCK KMStudent work analysis MC measure Math experts Teacher experts.66.64* Experienced teachers.64**.22 Novice teachers PCK knowledge map Math experts ** Teacher experts---.92** Experienced teachers Novice teachers.32

25 / 31 Correlations between content and PCK tasks MC measure PCK KMStudent work analysis Content Knowledge map CK experts PCK experts ET.42**.58**.02 NT.47.36

26 / 31 Summary of findings (relation of tasks) Evidence that different types of knowledge are being measured Evidence that there are differences by expertise Evidence that math teacher knowledge is complex

27 / 31 Overall findings and conclusions Evidence for validity Two tasks sensitive to expertise (group differences) Tasks measuring different types of knowledge (correlations) Using different expert groups generated key results Teacher knowledge is complex to assess Limitations Small sample size in several groups

28 / 31 Future Directions Create measures more sensitive to expertise Create measures that are sensitive to pedagogical content knowledge but not masked by content knowledge Parse apart different aspects of pedagogical content knowledge

29 / 31 Acknowledgements Dr. Eva L. Baker Dr. Gregory K.W.K Chung Girlie C. Delacruz Joanne Michiuye

Rebecca E. Buschang