1. Data-Guided Faculty Development Planning University of Alabama Birmingham September 11, 2012 Shelley A. Chapman, PhD

2. Plan for this Session O Helping underperforming teachers O Strategic Use of IDEA for Planning Faculty Development O Customizing for School/College purposes

3. Reflective Practice using Individual Reports Collect Feedback Interpret Results Read & Learn Reflect & Discuss Improve Help them use IDEA resources that are keyed to reports Invite Conversations Suggest new ideas to try Help them use the FIF well Help them interpret Individual reports

4. Recommended: Diagnostic Form O More data O Specific suggested action steps based on research O IDEA resources (no cost) are keyed to reports

5. UAB Spring 2012

6. Research Based Relationship: Teaching Methods to Learning Objectives

7. I. Individual Faculty 1. Individual Consultations O Faculty Information Form O How to select objectives O Adjusted and Converted scores O Suggested Actions

8. UAB Spring 2012

9. UAB Core Learning Outcomes

10. 2. Help them Learn How to Log their Results on the Faculty Worksheet

12. Reflective Practice using Individual Reports Collect Feedback Interpret Results Read & Learn Reflect & Discuss Improve Help them use IDEA resources that are keyed to reports Invite Conversations Suggest new ideas to try Help them use the FIF well Help them interpret Individual reports

13. Suggested Action Steps from Page 3 #16 #18 #19 3. Help them to make connections

14. IDEA Website

15. POD-IDEA Notes O Background O Helpful Hints O Assessment O References and Resources

17. Reflective Practice using Individual Reports Collect Feedback Interpret Results Read & Learn Reflect & Discuss Improve Help them use IDEA resources that are keyed to reports Invite Conversations Suggest new ideas to try Help them use the FIF well Help them interpret Individual reports

18. 4. Encourage “Conversations” about IDEA O Coffee and Conversations O Paired Discussions O Brown Bag Lunch/Supper Conversations O Testimonials at End-of-year Faculty Meetings O Classroom “Visitations” or “Observations”

19. Classroom Observations TimeWhat HappenedWhat Was Said

20. Classroom Observations TimeWhat HappenedWhat Was Said 8:05 8:10 8:15 Instructor shut door Students are shuffling papers, opening books. Student comes in late Several students raise hands Female in first row is called on Instructor (I): OK, Class. Let’s begin. Make sure you turned in your homework as you came in. Today we will begin our discussion on the brain. Turn in your textbooks to chapter 5. Is your brain more like a computer or a jungle? Who would like to respond first? Student (S) My brain is a jungle! I am so unorganized! (class laughs)…

21. Flow of Communication Map Instructor M F F F M M M M M M M M F F F F F F F F F

22. Encourage the Use of the IDEA Help Community IDEA Help Community Search for information Ask specific questions Talk to other clients who use IDEA Share ideas about how to use IDEA

23. II. Groups of Faculty 1. Workshops (Sample Topics) O Incorporating IDEA into a Syllabus O How to Select “Important” or “Essential” Objectives O Encouraging High Response Rates O Interpreting Reports (Adjusted & Converted Scores, Contextual data, etc.) O How to get better ratings: Focus on learning O How to use POD IDEA Center Notes

24. 2. Use IDEA for feedback on Faculty Development “Courses” O Example: Faculty Summer Institute at PLNU Using IDEA for Faculty Development at Point Loma Nazarene University tile

25. Using IDEA for Faculty Development at Point Loma Nazarene University Integrating IDEA with the TILE Program tile

26. Model the Good Use of IDEA O Consult IDEA research for planning TILE activities O Correlation Studies O Relationship between Methods and Learning Objectives O Relationship between Methods and Global Items (Excellence of Course and Excellence of Teacher) tile

27. Relationship of Teaching Methods to Learning Objectives Use Proactively to Plan Faculty Development Learning Activities tile

28. Relationship of Teaching Methods to Global Items Use Proactively to Plan Faculty Development Learning Activities tile

29. Learning Objectives O How to select “important” or “essential” IDEA objectives related to the course O Use the Teaching Goals Inventory to help select objectives: Use the Three Guiding QuestionsTeaching Goals Inventory O Is this a significant part of the course? O Do you do something specific to help students accomplish this objective? O Is progress on it part of their grade? tile

30. Incorporating IDEA into Syllabus O Show examples of how faculty put IDEA Objectives in their syllabi with their specific course objectives. Example: My three objectives are for you to 1. learn to analyze and critically evaluate ideas, arguments, and points of view. O To do this, you will be reading and critiquing scholarly articles and participating in class discussions. 2. develop skill in expressing yourself in writing. O To do this, you will propose a written research project in APA format. 3. learn how to find and use resources. O To do this, you will use scholarly books and articles for your research proposal. tile

31. Bloom’s Taxonomy and IDEA BLOOM’S TAXONOMY IDEA OBJECTIVES 1. Gaining factual knowledge 2. Principles, generalizations, theories 3. Application for improved thinking 4. This profession’s points of view, skills 5. Team skills 6. Creative capacities 7. Broad, liberal education 8. Expressiveness (written and oral) 9. Find & use resources 10. Personal values 11. Analyze and critically evaluate ideas 12. Learn more by asking questions 1 2, 7 3, 8, 9 10, 11 6

32. Average Ratings for Objectives IDEA OBJECTIVES 1. Gaining factual knowledge 2. Principles, generalizations, theories 3. Application for improved thinking 4. This profession’s points of view, skills 5. Team skills 6. Creative capacities 7. Broad, liberal education 8. Expressiveness (written and oral) 9. Find & use resources 10. Personal values 11. Analyze and critically evaluate ideas 12. Learn more by asking questions Objective #Average Rating 14.0 23.9 34.0 4 53.9 6 73.7 83.8 93.7 103.8 113.8 123.8

33. Week 3: CATs and Midterm Feedback O Think about your IDEA objectives and create a midterm evaluation just for yourself. O Ask questions that get at whether they feel they are making progress on the types of objectives you said are relevant. tile

34. UAB Response Rates Spring 2012

35. IDEA Response Rates O Talk about ways to boost response rates: O Can’t “set it and forget it” O Create a culture of reflective practice O Show sample report O Put objectives is syllabus O Talk about how you use student feedback O Explain its reciprocal value tile

36. End-of-TILE Assessment O Administer the Diagnostic Form to participants O Instructors use the FIF in a way to assess team teaching tile

37. 3. Using IDEA in a Curriculum Caucus

38. UAB Core Shared Vision for a UAB GraduatePossible IDEA Learning Objectives Communication8, 11 Knowledge1, 2, 7, 9 Problem Solving3, 11, 12 Citizenship2, 10, extra questions

39. What learning are we targeting? Name of Course123456789101112 English Composition IXXXX Introductory Biology IXXXX Finite MathematicsXX The Art ExperienceXXX Western Civilization IXXXX Introduction to PsychologyXXXX IDEA Learning Objectives

40. What learning are we targeting? Name of Course123456789101112 English Composition IXXXX Introductory Biology IXXXX Finite MathematicsXX The Art ExperienceXXX Western Civilization IXXXX Introduction to PsychologyXXXX IDEA Learning Objectives

41. Using GSRs to Analyze Targeted Learning Page 2 Percent of Classes Selecting Obj. as Important or Essential This GroupInstitutionIDEA System Objective 116%70%78% Objective 213%59%75% Objective 341%58%75% Objective 432%35%55% Objective 523%19%32% Objective 632%14%25% Objective 722%27% Objective 878%43%47% Objective 919%23%41% Objective 107%11%23% Objective 1168%42%49% Objective 1220%23%41% Average # of Obj. Selected3.74.25.7

42. How do students rate their learning? GSR page 3

43. Do Students’ report of learning meet our expectations? GSR, Pages 5 and 6 Raw Average Adj. Average # of Classes This Report 3.9 11 Institution 4.2 3,963 IDEA System 4.0 31,991 Objective 1: Gaining factual knowledge (terminology, classifications, methods, trends )

44. Which Teaching Methods Should We Target for Improvement? % of Classes Where Method was “Infrequently” Used

45. 4. Use Data from IDEA to Target Specific Needs Collect Feedback Interpret Results Read & Learn Reflect & Discuss Improve

46. Overall Progress Ratings (Courses) Page 3 Percent of Classes at or Above the IDEA database Average

47. Relationship of Teaching Methods to Global Items Plan workshops to target needs

48. Correlation of Teaching Method Items to Summary Items IDEA Teaching MethodExcellent Teacher Excellent Course 6.Make it clear how each topic fits into the course.84.80 10.Explain course material clearly and concisely.90.79 13.Introduce stimulating ideas about the subject.83.82 4.Demonstrate the importance and significance of the subject matter.83.80

49. Other Considerations O Consider sending faculty to the IDEA User Group Meeting to do presentations O Consider becoming a member of POD and joining these conversations on the international level O Design a Faculty Development Day around some of these ideas

50. Questions?