1. New Faculty Orientation Institutional Research and Accountability Sarah Logan August 18, 2011

2. Institutional Research and Accountability  Located in Mayer Administration Building, Room 102  Phone: 942-2259  Staff Sarah Logan, Associate VP for IR&A Kathy Ashton, Office and Evaluation Coordinator Jay Simons, Research Data Analyst Chris Case, Institutional Research Assistant

3. IRA Information Sites  ASU intranet ‘Everyone on fileserv2’ (R:) R:\Institutional Research: Fact Book and graduation data NOTE: find the file you want, double click entry ending in “Report” R:\Institutional Research NON Banner data\IDEA: information about IDEA FIFs and yearly department and college comparison data  IR&E webpage (fact books and IDEA FIFs): www.angelo.edu/publications/institutional_research/ Faculty Assessment /IDEA tab Research Data tab: common data set, Mini Fact Books Institutional Resources tab: peer institutions, federal/state reports  IDEA website (www.theideacenter.org): Student Ratings of Instruction (under Our Services) FIF, survey, & report examples IDEA Papers & POD-IDEA Notes (found on the left bar) VERY HELPFUL!

4. Electronic FIF Process  Electronic Process Early to mid-semester you will receive an email from Kathy Ashton and/or your department Office Coordinator with the FIF due date Go to the Faculty Assessment/IDEA tab on the IRA webpage Complete the FIF per the FIF format on the next slides Save the FIF in YOUR files Attach the FIF to an email to your department office coordinator  FIF format Be complete. Follow the example (the first column in the FIF template) carefully  Punctuation (or lack of) and capital letters are important  Spacing is vital. Please do not add extra spaces  You can make changes almost anytime; call or email IRA

5. Electronic Faculty Information Form (FIF)  For each class to be evaluated, fill out a new column of the FIF  Kathy Ashton holds FIF workshops at the beginning of each fall. Look for her email and plan to attend. You can complete FIFs at it.  On the IRA webpage in the Faculty Assessment/IDEA tab, Choose IDEA Department Faculty Information Forms (FIF) Click on your department  Objectives Choose the 3 – 5 objectives on which you spend the most time If you spend twice as much time and energy on 1 or 2 objectives, mark it/them E for Essential. E’s are waited double in data analysis Mark the other objectives of choice I for Important All other objectives, even though you may do them to some extent, are marked M for Minor

6. Choosing Long (Diagnostic) or Short IDEA Forms  Both forms include the 12 objectives have spaces at the end to add items  Diagnostic form ( Long Form ) also includes 20 items about teaching style and teacher-student interaction, which are especially important to new faculty does not take much longer than short forms for students to complete sometimes department/program heads want instructors to use the same type of forms, usually Long, or some of the same objectives  Short form is sometimes used when instructors teach a course they have taught several times and have not changed content or methodology assess multiple sections of the same course

7. Which Classes to Evaluate with IDEA  Fall Evaluate all types of lecture courses Faculty teaching multiple sections of a course do not have to evaluate all sections. New faculty need to build a teaching record, so evaluating all sections is advised  Spring Evaluate all types of lecture courses not taught in fall  Summer Evaluate the classes you, your department head, and dean want to assess  NOTE: Individual (e.g., research, music, thesis) and team- taught classes are tough to evaluate. Call Kathy for methods

8. Evaluation Process  Packets arrive in your department mid-semester Check the label; make necessary changes. IRA checks labels when packets are returned and makes updates  Evaluation Day Instructions Remind students about which objectives you are most interested. Encourage meaningful feedback Ask them to rate all 12 objectives You may wish to tell them how you plan to use results If applicable, show them where to answer extra items and provide hardcopy or an overhead of those items

9. Evaluation Process cont.  Evaluation Day Have pencils. (Your department and IRA have extras.) Students are more apt to take the form seriously if you do. Leave the room until the students are finished. Ask a colleague ahead of time to  collect ALL forms (including unused forms),  seal the packet with the sticker,  return the packet to the department office coordinator or slip it under the department door (night classes).

10. Evaluation of On-line Classes  FIF submission is same as for on-site classes  Let Kathy know if the course is cross-listed  Course must be in Blackboard. Have E-learning help set up course so IDEA Building Blocks will work and show students the IDEA button. Kathy can pull your class roster. Make sure it is updated. Instruct students to use angelo.edu email address  Getting Student Input  Explain the ways evaluations are important to you.  Tell students the time frame (Kathy provides this) the evaluations will be available for them to complete.  FREQUENTLY encourage students to complete the evaluation.

11. IDEA & Promotion and Tenure  IDEA evaluations are used as part of promotion and tenure decisions.  Overall scores from the IDEA report are used.  Because of portfolio due dates, evaluations from fall do not come back in time for inclusion.  Very small and team-taught classes can be a challenge to present. Contact your department head or IRA for suggestions.