1. 1 Careers Advisory Service Tom Davie Deputy Head of Service/Careers Adviser Careers Advisory Service Durham University

2. 2 If you would like…  A copy of this PowerPoint  Examples of our evaluation forms  Information on our Student Consultative Forum Then email me – tom.davie@durham.ac.uk tom.davie@durham.ac.uk

3. 3  Range of evaluation methods at Durham  What and how we evaluate - some emphasis on information  Why we evaluate – purpose  Who we evaluate  When we do it What are we going to focus on today?

4. 4 Definitions of evaluation  ‘Any effort to use assessment evidence or performance measurements to improve organizational effectiveness.’ USA Government I prefer  “True genius resides in the capacity for evaluation of uncertain, hazardous, and conflicting information.”

5. 5 MATRIX elements 7 and 8 say... That we should... ‘...proactively seek the views of service users, staff and other agencies to regularly evaluate the quality of the service.’ And ‘Formal and informal comments on the service are evaluated and acted upon as appropriate.’ Also ‘Effectiveness is regularly monitored and evaluated against the aims and objectives of the service.’ ‘Appropriate action is taken to improve the service to individuals.’ ‘The service is continuously developed and improved.’

6. 6 So...why do we evaluate? To:  Obtain MATRIX!  Conform to our aims objectives and missions statements?  Get pats on the back?  Have genuine feedback on how we operate?  Receive views on how we can operate more effectively?  Have an ear to the student voice  Obtain complaints – to give as evidence for more resources  Monitor usage

7. 7 Careers Advisory Service Mission statement, To achieve, deliver and sustain excellence in the provision of information, advice and guidance. Evaluation strategy says,  When we evaluate we take action or respond in some way  We never ignore comments  When we can’t change something we give a brief explanation why

8. 8 Who do we evaluate? Final years Employers Student Employment Service registrants Students

9. 9 How do we evaluate?  Paper based  On – line - website  On – line – Bristol – final year survey  Student Consultative Forum  Survey Monkey

10. 10 Examples of questions we ask CAREERS ADVISORY SERVICE Information Room Evaluation Course: ……………………………Year of Graduation: ………..College……………………… We are constantly looking for ways to improve the services provided to our users and would welcome your views. Could you please spare a few minutes of your time to complete this questionnaire. Please indicate the response which closely matches your views. 1 = not well at all2 = not well3 = fairly well 4= very well OVERALL FIRST IMPRESSIONS - We aim to treat all users courteously and provide easy assess to all facilities. Were you greeted in a friendly manner? 1 2 3 4 How well were the services we provide explained to you? 1 2 3 4 Were the staff you met knowledgeable? 1 2 3 4 How well did they respond to your request? 1 2 3 4 ACCESS TO INFORMATION – We aim to provide you with a range of resources to help you in your career choices. How well do we achieve this? Providing the information you were looking for? 1 2 3 4 Were you able to find the information easily? 1 2 3 4 Helping you find the information or referring you to other sources? 1 2 3 4 What facilities have you used either on this visit or previous occasions? (Please tick all that apply) Career & Employer folders ( ) Vacation Work folders ( ) PG study information ( ) IT facilities* -see question ( ) Overseas Work & Study section ( ) Videos/ DVD’s ( ) Career Planning & Job Applications Section ( ) Employer Reports ( ) Newspapers & magazines ( ) Reference books ( ) If you have used any software programme please state the programme used and how useful the programme was to you. Programme(s)………………………………………………………………………………………. Usefulness 1 2 3 4 Was there any information you came in for that we did not have? Please tell us what this was. ………………………………………………………………………………………………………………………. Please add any other comments relevant to improving the quality of the facilities provided in the Information Room. Continue overleaf if necessary. ……………………………………………………………………………………………………………………………………………………………………………………………………………………………… ……………………………………………………………………………………………………………………………………………… Thank you for help. Please post completed form in the box provided.

11. 11 Outcomes - You asked...we responded ‘We need resources to help with on line assessment tests.’ We gave purchased the license for MyPotential which offers Durham students the chance to take a range of on line tests. ‘We would like to see more local part – time jobs advertised on the Student Employment Service website.’ The Student Employment Service is continually canvassing local employers on your behalf and encouraging them to advertise their vacancies on our website. ‘We don’t like waiting a long time to see a Careers Adviser on duty.’ We have implemented a new on line booking system…Don’t forget you can also speak to our Information Team who can help you with a range of queries and point you in the direction of some very useful resources.

12. 12 How often should a Service evaluate?  Daily - what everything?  Weekly – what everything?  Annually?  Biennially?  Are clients surveyed out – especially students??

13. 13 What we do  Information, advice and guidance - weekly and rotationally  Website (employers and students) - continuous  Talks – continuous  Events - employers every time - students biennially  Student Consultative Forum - termly but ongoing

14. 14 Any...

15. 15 Enjoy the conference