Presentation on theme: "IDEA What it is and How to Implement the System Texas A & M, February 2013 Shelley A. Chapman, PhD Senior Educational Consultant."— Presentation transcript:
IDEA What it is and How to Implement the System Texas A & M, February 2013 Shelley A. Chapman, PhD Senior Educational Consultant
Individual Development Educational Assessment Teaching Improvement Faculty Evaluation Curriculum Review Program Assessment Accreditation
What is teaching effectiveness? Being Organized Being Prompt Being Clear Relating course material to real life situations Requiring critical thinking Forming learning teams Introducing stimulating ideas Inspiring students to set and achieve goals
Most Surveys How well do the instructor’s methods resemble those of a “model” teacher? How well do students rate their progress on the types of learning the instructor targeted? Teaching Effectiveness
What is teaching effectiveness? Philosophy of IDEA Primary indicant of Teaching Effectiveness = Facilitating Learning
Conditions for Good Use The instrument Targets learning Provides suggested action steps for teaching improvement Has evidence for validity
Conditions for Good Use The Faculty Trust the process Value student feedback Are motivated to make improvements
Conditions for Good Use Campus Culture Teaching excellence - high priority Resources to improve - provided Student ratings - appropriate weight
Conditions for Good Use The Evaluation Process 30-50% of evaluation of teaching 6-8 classes, more if small (<10) Not over-interpreted (3-5 performance categories)
Reflective Practice using Individual Reports Collect Feedback Interpret Results Read & Learn Reflect & Discuss Improve IDEA resources that are keyed to reports Talk with colleagues Try new ideas Online, Paper What the reports say and what they mean
Underlying Philosophy of IDEA Teaching effectiveness is determined primarily by students’ progress on the types of learning the instructor targets.
Faculty Information Form
Student Learning Model Specific teaching behaviors are associated with certain types of student progress under certain circumstances. Student Learning Teaching Behaviors Circumstances
Student Learning Model: Diagnostic Form Student Learning Items Teaching Behaviors Items 1-20 Circumstances Students: Items 36-39, 43 Course: Items Summary Items: Research Items: Up to 20 extra items
FIF: Selecting Objectives 3-5 as “Essential” or “Important” Is it a significant part of the course? Do you do something specific to help students accomplish the objective? Does the student’s progress on the objective influence his or her grade? Be true to your course.
Faculty Information Form
Common Misconception #1 Students are expected to make significant progress on all 12 learning objectives in a given course.
Common Misconception #2 Effective instructors need to successfully employ all 20 teaching methods in a given course.
Relationship of Learning Objectives to Teaching Methods
Common Misconception #3 The 20 teaching methods items should be used to make an overall judgment about teaching effectiveness. Faculty Evaluation
Faculty Information Form: Discipline Codes
Faculty Information Form: Local Code
Course Description Items (FIF) Used for research Best answered toward end of term Do NOT influence your results Bottom of Page 1 Top of page 2
FIF Online Delivery Reminders are delivered by Start/end dates are determined by Institution Access is unlimited while available Questions can be added Objectives can be copied
Student Survey Online Delivery Link is on Howdy Reminders are sent by Start/end dates determined by Institution Submission is confidential and restricted to one
Online Response Rates – Best Practices Create value for feedback Prepare Students Monitor and Communicate
Example: Course Syllabus Objective 3: Learning to apply course material (to improve thinking, problem solving, and decisions) Students will be able to apply the methods, processes, and principles of earth science to understanding natural phenomena Students will think more critically about the earth and environment Objective 8: Developing skill in expressing myself orally or in writing Students will be able to present scientific results in written and oral forms IDEA Center Learning Objective Course Learning Outcomes
Diagnostic Report Overview 1.How did students rate their learning experience? 2.What contextual factors impacted those ratings? 3.How do my scores compare to: IDEA, discipline, and institution? 4.What might I do to facilitate better learning for my students next time?
Your Average (5-point Scale) RawAdj. A.Progress on Relevant Objectives 1 Four objectives were selected as relevant (Important or Essential—see page 2) If you are comparing Progress on Relevant Objectives from one instructor to another, use the converted average. 1. How did Students Rate their Learning?
Progress On Relevant Objectives
Summary Evaluation: Five-Point Scale Report Page 1 Your Average Score (5-point scale) RawAdj. A.Progress on Relevant Objectives Four objectives were selected as relevant (Important or Essential—see page 2) Overall Ratings B. Excellent Teacher C. Excellent Course D. Average of B & C Summary Evaluation (Average of A & D) % 25%
2. What contextual factors impacted those scores?
3. How do my scores compare to: IDEA, Discipline, Institution?
Comparisons (Norms): Converted Averages
4. What might I do to facilitate better learning next time?
Page 2: What did students learn?
Page 3: Suggested Action Steps #16 #18 #19
POD-IDEA Notes on IDEA Website
POD-IDEA Notes Background Helpful Hints Application for online learning Assessment Issues References and Resources
IDEA Papers Resources for Faculty Evaluation Faculty Development
IDEA Terminology Student Ratings of Instruction = student survey FIF = Faculty Information Form OCC = On Campus Coordinator Sub-OCC = Person who works with the OCC on campus GSR = Group Summary Report Aggregate Data File = Excel spreadsheets of all data Benchmarking Report Discipline Code = modified CIP codes Local Code = code for creating groups Converted Averages = T Scores Adjusted Scores = Scores that take into consideration variables outside the control of the instructor
IDEA Website and Who’s Who
Questions ? Visit our IDEA Help Community!IDEA Help