1 Briefing session on Online Student Evaluation of Teaching and Learning for Administrative and Clerical Staff Prepared by Social Sciences Research Centre of The University of Hong Kong

2 SETL process  SETL form covers course, teachers, tutors and demonstrators  Uses SIS database record of course/teacher/tutor/demonstrator  All teachers/tutors/demonstrators must have staff ID (HKU requirement and needed for staff review)  All courses with enrollment of at least 5 students must undertake SETL (unless PVC Tsui agrees), although the teacher/tutor/demonstrator parts are only done if there are such persons for the class  Must use standard forms unless PVC Tsui approves  Tutor means person running tutorials, demonstrator means person responsible for lab or field sessions (role descriptions)

3 Online SETL process  This year, online process covers all Common Core courses and undergrad courses with at least 50% first year or second year students, otherwise use paper  Separate online forms for course, teacher, tutor, demonstrator as needed. Up to 4 teachers can be evaluated, but only 1 tutor or demonstrator selected from a list (or evaluated as a group)  Cannot add other courses or merge courses in the online process  Cannot currently change teacher names in system, which come from Human Resources  Online yields lower response rates, but better open-ended responses, which is good for improvement  To ensure good response rates, need to ensure that students are given time at the end of a class to complete the form (although they can complete any time before the deadline)

4 SETL Workflow Prepared by Social Sciences Research Centre of The University of Hong Kong

5 SETL Workflow  SIS list of courses with teacher/tutor/demonstrator names and indication of whether online or paper process will be sent out to departments on or before 11 Oct, so departments can check for errors and missing information (Please refer to Course List, Teacher List, Tutor List and Demonstrator List).  SIS system will re-open for any data amendments between 11 and 18 Oct  The final SIS list of courses with teacher/tutor/demonstrator names will be sent out to departments on or before 25 Oct for the final check. If any errors occurs, please contact SSRC through immediately (on or before 26 Oct).

6 SETL Workflow  For the Department Items (max. 5 extra questions) for both on-line and paper evaluation forms, please contact and confirm with SSRC staff, Ms. C.C. Ho at or on or before 18  For the paper evaluation forms, the departments should inform SSRC for printing at least 2 weeks before the evaluation date. Departments collects the blank forms plus a survey package and carries out the evaluation.  For the on-line evaluation, SSRC will provide a student list to the Computer Centre on Oct 28 for sending out reminder s on 10 November and 1 December

7 Instructions for Online SETL The teacher concerned should inform the students in advance the date of the online evaluation (soon after Nov 11), and that the students are encouraged to bring a mobile internet device (such as laptop, tablet or smartphone) to class at the scheduled time. Before administration

8 Instructions for Online SETL Similar to the paper exercise, the SETL questionnaire should NOT be administered by the course teacher, but Faculty/department staff. The teacher should briefly explain the objectives of the student evaluation and then leave the room leaving it to Faculty/department staff to oversee the process. On the day of administration

9 Instructions for Online SETL read out: “Please go to the weblink where you should see a list of all forms that you need to complete. Your evaluation will be saved anonymously, without any identification. There are separate forms for the course, teacher (and if appropriate) tutor and demonstrator. There are instructions, an FAQ link and a link for you to report any missing courses at the weblink.” Faculty/Department staff should

10 Instructions for Online SETL Access the SETL system via the weblink where there are instructions, FAQ and a list of forms for completion (separate links for the course, teacher, tutor, demonstrator forms) Complete the forms for the class between Nov 11 and Dec 6 if they cannot find the course that they have enrolled in, send an to SSRC using the link on the page so SSRC staff can rectify this promptly Students should

11 SETL Workflow  For the paper evaluation forms, departments should deliver to SSRC all completed forms, completed cover sheet on the top of each envelope and a completed packing list (Excel file)  Departments collect their evaluation reports, CD and completed forms (for paper evaluation forms only) upon notice from SSRC on or after 23 January 2014 (after the examination result release date 22 January 2014)

12 Instructions for Online SETL I will now demonstrate Online SETL, so you can see how the process works in practice:

13 Thank you! I am happy to answer questions. Prepared by Social Sciences Research Centre of The University of Hong Kong