1. Improving the Online Evaluation Process and Response Rates SAIR 2011

2. WCU 9,352 students Master’s Comprehensive Mountain location Resident and Distance

3. History of Evaluations at WCU No university-wide policy on administration, instruments, courses covered, and use of results Scanned, paper forms administered during class time Long wait for results No flexibility in types of reports Poor security– esp. comments

4. Implementation Timeline 2002 through 2006 Faculty Senate establish ‘teaching evaluation committee’ Provost mandated online evaluations (PACE initiative) Developed SAI instruments based on course types Developed guidelines for results usage Researched available options for administering evals and selected ConnectEdu’s CoursEval Faculty “own” the evaluation process!

5. Timeline cont.: Course Evaluation Pilot – Spring 2007 5 departments 328 courses (5689 surveys) 45% response rate Problems: log-in and email issues lack of experience

6. Timeline cont.: Establishing Procedures (2007-2008) Scheduling guidelines Low-enrolled courses Student incentives Refined SAI instruments Planned validity study Advertising/incentives Faculty training Summer parts-of-term Instrument defaults Student email policy Login issues Faculty SenateImplementation Committee

7. Lessons Learned Lesson 1: Involve everyone with a stake in the evaluation procedures and results; everyone with experience in processing & administering evaluations Lesson 2: Consider all issues before implementing Lesson 3: Build a strong communication system between faculty and survey administrators

8. IR Responsibilities Set-up & administer each semester’s evaluations “Help desk” for faculty and students Learn about new tools and related software, reporting, and response rates Communicate to Faculty Senate any issues arising affecting senate policies and survey administration

9. Overview of Current Policies All course sections, all terms Open period set by course length University-wide incentives allowed Low-enrolled courses Crosslisted courses Periodic response rates & student reminders Faculty evaluation (not course content) Results availability Use in faculty AFE/TPR process IR office responsible for administration Department heads have final say in instrument used

10. Response Rates over time TermRate Spr 0744.7% Fall 0743.5% Spr 0832.8% Fall 0846.5% Spr 0947.3% Fall 0943.4% Spr 1049.6% Fall 1073.4% Spr 1173.4%

11. Marketing StrategyDid it work? Large BannersYes PostcardsMaybe EmailsYes Flyers around campusMaybe Radio announcementMaybe GiveawaysNo “Early” grade releaseYES!

12. “Early” Grade Release Students are encouraged to complete evaluations in order to receive their final grades “early” A list of all students who complete evaluations is sent to the Registrar Emails go out to students as faculty members submit grades Those who do not complete evaluations get final grades after exam week is over

13. Overall, what works for us Faculty Senate owns the process Changes are made slowly, with much deliberation Small, centralized survey administration SaaS – few technical issues on our end, backed up data, no questions about data integrity

14. Features of CoursEval that we like Students and Faculty – Find all associated courses and surveys with one click Consolidation of people without deleting anything Active Directory login Automated emails, open/close, results release Response rates – real time, easy to locate and email Easy to use administrative tools Customizable emails and log-in site

15. Features we would like More flexibility with reports Advance notice of outages and problems Ability to access individual student responses (for research purposes) Faculty member attached to course cannot be changed More stream-lined set-up

16. Contact Information WCU’s Course Evaluation website: http://www.wcu.edu/8356.asp “Guidelines & Procedures for Administration & Oversight of Student Assessment of Instruction” Institutional Planning & Effectiveness: http://www.wcu.edu/12829.asp 828-227-7239 Elizabeth Snyderecaveny@email.wcu.edu 828-227-2570 Alison Joseph ajoseph@email.wcu.edu 828-227-3042 ConnectEdu website: http://www.connectedu.com/