1. Usability as an Assessment Method: An introduction that examines how usability studies can provide useful evidence to inform decision-making Information Services Assessment Council May 11, 2006

2. assessment an ongoing process in which services, resources and performance are measured against the expectations of users, and improvements are made to satisfy user needs effectively and efficiently.

3. What do we need to know?

4. Who can tell us?

5. How can we get the information?

6. What will it enable us to do?

7. How much will it cost?

8. ISO standard ISO 9241-11 (1998) Guidance on Usability defines usability as: – The extent to which a product can be used by specified users to achieve specified goals with effectiveness, efficiency and satisfaction in a specified context of use.

9. Usability Testing A means for measuring how well people can use a web page (or a computer interface, document, or device) for its intended purpose.

10. Benefits of Usability Testing Better user experience Better understanding of users Lower support costs

11. Conduct a Usability Study When: Designing a new user interface Re-designing an existing interface Results will inform specific decisions Time and other resources permit

12. Test early and often

13. Usability Testing Process Specify objectives Identify tasks Get permission from HSCL Decide method of capturing results Recruit participants Choose a facilitator Conduct tests

14. Usability Testing Process cont. Analyze and report results Identify problems and possible solutions Do another round of testing to determine if your solutions work

15. Specify Objectives What do you want to learn? How will the information be used?

16. Identify tasks Test important features Test areas where you expect problems Test your assumptions

17. Recording methods Observers taking notes Note takers and video recording Screen capture software Software that combines screen capture and video

18. Recruiting Participants 3-4 participants per study Recruit loosely and grade on a curve. - Steve Krug

19. Facilitation Get their consent Make it clear that you’re testing the site, not them Encourage them to think out loud

20. Analyzing results Can they find their way around? Look at task completion times Watch for head slappers and shocks Remember, you’re seeing their best behavior

21. Reporting results Report problem areas to developers Test possible solutions to make sure the chosen solution works Do a presentation to tell everyone how much usability testing improved your site

22. Usability Testing Resources Jeffrey Rubin’s Handbook of Usability Testing Steve Krug’s Don’t Make Me Think! A Common Sense Approach to Web Usability Steve Krug’s site, www.sensible.com

23. Information Services Assessment Council members Susanne Clement, Libraries Jill Glaser, IT Ryan Papesh, NTS Thelma Simons, IT John Stratton, Libraries Bill Myers, IS

24. Call on ISAC members to: Consult, advise and assist in the development of assessment initiatives. Identify other campus resources for assessment-related services. Provide oversight and assure coordination with other IS assessment activities.

25. Assessment presentations available at: www.informationservices.ku.edu/assessment/