1. Trials and Tribulations of Usability Testing by Scott Grissom1 Trials and Tribulations of Usability Testing Scott Grissom Grand Valley State University

2. Trials and Tribulations of Usability Testing by Scott Grissom2 Timeline Oct 2002 developed prototype Nov usability testing Jan 2003 redesigned prototype Feb repeat usability testing April sneak peek July release

3. Trials and Tribulations of Usability Testing by Scott Grissom3 Our Website Goals provide useful content / services make the site easy to use create a satisfying experience for the visitor

4. Trials and Tribulations of Usability Testing by Scott Grissom4 An Easy to Use Website… can increase student applications can increase donations can improve faculty/staff performance can decrease training costs

5. Trials and Tribulations of Usability Testing by Scott Grissom5 User Centered Design early focus on the audience collect empirical measures iterative design

6. Trials and Tribulations of Usability Testing by Scott Grissom6 Evaluation Techniques usability checklist usability inspection user testing

7. Trials and Tribulations of Usability Testing by Scott Grissom7 Usability Testing target each audience select representative tasks collect objective and subjective data use the data to compare against the current site OR our expectations

8. Trials and Tribulations of Usability Testing by Scott Grissom8 Target Audiences prospective students students faculty & staff alumni & friends

9. Trials and Tribulations of Usability Testing by Scott Grissom9 Benchmark Tasks “Find the last day you can drop a course this semester” “Find the e-mail of another student in your class” “Where can you eat on campus on Saturday at 3:00?” “What is the yearly premium for the new vision plan recently announced?”

10. Trials and Tribulations of Usability Testing by Scott Grissom10 Usability Measures Performance Time Success Rate Visitor Satisfaction

11. Trials and Tribulations of Usability Testing by Scott Grissom11 Performance Time Ideal < 1 minute Satisfactory < 3 minutes Poor 3 - 5 minutes Failure > 5 minutes Our target is 80% satisfactory (with no failure)

12. Trials and Tribulations of Usability Testing by Scott Grissom12 Performance Time

13. Trials and Tribulations of Usability Testing by Scott Grissom13 Visitor Satisfaction Five point Likert scale confusing 1 2 3 4 5 clear distracting 1 2 3 4 5 attractive difficult 1 2 3 4 5 easy frustrating 1 2 3 4 5 enjoyable Appearance target is 4.0 average Ease of Use target is 4.0 average

14. Trials and Tribulations of Usability Testing by Scott Grissom14 Satisfaction with Appearance

15. Trials and Tribulations of Usability Testing by Scott Grissom15 Satisfaction with Ease of Use

16. Trials and Tribulations of Usability Testing by Scott Grissom16 Home Page

17. Trials and Tribulations of Usability Testing by Scott Grissom17 Searching 70% of participants used searching during first test 50% were successful Less than 10% used searching during the second test

18. Trials and Tribulations of Usability Testing by Scott Grissom18 Tips for Testing follow campus guidelines for human studies number of participants? budget? use a trained and unbiased observer provide small gifts use “think out loud” protocol record performance time

19. Trials and Tribulations of Usability Testing by Scott Grissom19 In Summary Involve the target audiences early and often Identify target usability measures Repeat the design process until the targets have been met Our materials are available on the Web