Trials and Tribulations of Usability Testing by Scott Grissom1 Trials and Tribulations of Usability Testing Scott Grissom Grand Valley State University.

Slides:



Advertisements
Similar presentations
Improving Web Usability with a Content Management System Fred Miller, Rick Lindquist, & Curtis Kelch Illinois Wesleyan University.
Advertisements

Town Hall Meeting Budget Update and Planning April 11, 2007.
Homepage Design Audience Satisfaction Survey. Survey Goal: The new website design should invoke an aesthetic emotional response with our audience. The.
Web E’s goal is for you to understand how to create an initial interaction design and how to evaluate that design by studying a sample. Web F’s goal is.
Usability and taste  Taste is subjective  but not necessarily trivial  Taste is subject to fashion  Changes over time  Influenced by other people.
1 User-Centered Design CSSE 376, Software Quality Assurance Rose-Hulman Institute of Technology April 17, 2007.
Web Site Design: Learn from Observing Your Customers Web Site Design Panel Web Site Strategy and Tactics Workshop Yaffe Center, University of Michigan.
Selecting Your Evaluation Tools Chapter Five. Introduction  Collecting information  Program considerations  Feasibility  Acceptability  Credibility.
Web Usability by Scott Grissom1 Web Usability Scott Grissom Computer Science & Information Systems.
COMP6703 : eScience Project III ArtServe on Rubens Emy Elyanee binti Mustapha Supervisor: Peter Stradzins Client: Professor Michael.
Part 4: Evaluation Chapter 20: Why evaluate? Chapter 21: Deciding on what to evaluate: the strategy Chapter 22: Planning who, what, where, and when Chapter.
Senior Project Database: Design and Usability Evaluation Stephanie Cheng Rachelle Hom Ronald Mg Hoang Bao CSC 484 – Winter 2005.
Design and Evaluation of Iterative Systems n For most interactive systems, the ‘design it right first’ approach is not useful. n The 3 basic steps in the.
Virtual Learning Environments – How usable are they? Ian Cole Lecturer in Information & Communication Technology University of York United Kingdom.
User testing New Technology for Supporting Students.
Web Design cs414 spring Announcements Project status due Friday (submit pdf)
Web 2.0 Testing and Marketing E-engagement capacity enhancement for NGOs HKU ExCEL3.
Usability Testing From: earnusa/index.html I.
About Waterloo website Project report June Outline Overview of process Project deliverables Lessons learned.
1 The Benefits of Using Eye Tracking in Usability Testing Jennifer C. Romano Usability Laboratory Statistical Research Division U.S. Census Bureau.
The 5 C’s of Web Design Craig Duncan Project Manager ReliefWeb United Nations Office for the Coordination of Humanitarian.
Usability Test Jeffrey Aguilar Loren Trejo Chris AbuGhazaleh May 18, 2007 WebUT.
“Come on! Give me ten!” What users really want and really do on library web sites Darlene Fichter OLA Super Conference 2003.
LibQUAL + ™ Data Summary An overview of the results of the LibQUAL+™ 2003 survey with comparisons to the 2001 survey.
Usability By: Sharett Wooten and Gwen Payne. What is Usability Usability addresses the relationship between tools and their users. In order for a tool.
Assessment of Web-based Education Tools: Are your Students Learning Through Technology? Andrea Irby Undergraduate Academic Programs North Carolina State.
INDIVIDUAL ACHIEVEMENT. EDUCATIONAL EXCELLENCE. ADMINISTRATIVE INNOVATION. INSTITUTIONAL PERFORMANCE. Improving Web Usability with a Content Management.
Put it to the Test: Usability Testing of Library Web Sites Nicole Campbell, Washington State University.
MAC Fall Symposium: Learning What You Want to Know and Implementing Change Elizabeth Yakel, Ph.D. October 22, 2010.
1 Usability and accessibility of educational web sites Nigel Bevan University of York UK eTEN Tenuta support action.
Uswebusabilityproblems.ppt1 Web Usability Overview This workshop attempts to give a quick overview of web usability: by demonstrating some common usability.
Usability testing. Goals & questions focus on how well users perform tasks with the product. – typical users – doing typical tasks. Comparison of products.
PRO-CTCAE Face-To-Face Meeting #2 Advancing the Science of Adverse Symptom Monitoring in Cancer Treatment Trials Amy P. Abernethy, MD Task 6: Usability.
Website St. Augustine A Technical Viewpoint Deja Vu anyone?
Usability Testing & Web Design by Alex Andujar. What is Usability? Usability measures the quality of a user's experience when interacting with a Web site,
ASSESSMENT. Assessment is the systematic and on-going process of collecting and reviewing evidence about the College's academic and administrative programs.
Web Design Guidelines by Scott Grissom1 A Quick Introduction to Web Design Scott Grissom Associate Professor Computer Science & Info Systems
My.umich.edu Partial Integration of Dynamic Services with Visual Design.
Web Site Usability. Benefits of planning usability Increased user satisfaction, which translates directly to trust and brand loyalty Increased user productivity,
INTRO TO USABILITY Lecture 12. What is Usability?  Usability addresses the relationship between tools and their users. In order for a tool to be effective,
V v USABILITY 30 April UX Team of One Basic question: who are your core audience, what do they need, and what do they want to accomplish? Share.
Promoting the Sustainability of a Digital Initiatives Project User-Centered Assessment and Testing of Aerial Photographs of Colorado Holley Long, Kathryn.
Testing and Maintaining a Web Site Presented by: Angelo Russo Student number: 10 Acknowledgement: This information is primarily gathered from: – Web Design,
Putting Assessment into Practice - Library Websites Steve Burks, LIS Web Developer Saint Michael’s College Library
Ingenieur- und Marketing-Lösungen Guideline for the development of a Search Engine optimized and user Friendly Internet presentation, with consideration.
Web Design Guidelines by Scott Grissom 1 Designing for the Web  Web site design  Web page design  Web usability  Web site design  Web page design.
Chapter 8 Usability Specification Techniques Hix & Hartson.
Design Process … and some design inspiration. Course ReCap To make you notice interfaces, good and bad – You’ll never look at doors the same way again.
Evaluating & Maintaining a Site Domain 6. Conduct Technical Tests Dreamweaver provides many tools to assist in finalizing and testing your website for.
© 2012 Adobe Systems Incorporated. All Rights Reserved. Copyright 2012 Adobe Systems Incorporated. All rights reserved. ® DESIGN PROJECT PRODUCTION PHASES.
Information Architecture Week 1. Information Architecture CALENDAR.
An Industry Case Study SES – Chicago: 2006 Web 2.0.
Attracting Prospective Graduate Students through the Web Site Analysis and Redesign of a Department Website Lori Brunner CI 603 Spring 2006.
AVI/Psych 358/IE 340: Human Factors Evaluation October 31, 2008.
Usability Testing TECM 4180 Dr. Lam. What is Usability? A quality attribute that assesses how easy user interfaces are to use Learnability – Ease of use.
© 2012 Adobe Systems Incorporated. All Rights Reserved. Copyright 2012 Adobe Systems Incorporated. All rights reserved. ® INTRODUCTION TO INFORMATION ARCHITECTURE.
Collegiate Times Grades James O’Hara Hang Lin Client: Alex Koma, managing editor, Collegiate Times Blacksburg March 4, 2014 Virginia Tech CS 4624.
UCI Library Website Chris Lee Archana Vaidyanathan Duncan Tsai Karen Quan.
Evaluation / Usability. ImplementDesignAnalysisEvaluateDevelop ADDIE.
Introduction to System Evaluation IS 588 Dania Bilal & Lorraine Normore Spring 2007.
USABILITY Student Anna Sysova Group Minsk 2016 BELARUSIAN STATE UNIVERSITY OF INFORMATICS AND RADIOELECTRONICS.
User-Centered Design Services for MSU Web Teams Sarah J. Swierenga, Director Usability & Accessibility Center MSU Webmasters 402 Computer Center February.
User Interface Evaluation
Usability Testing and Web Design
Katherine Prentice, MSIS Richard Usatine, MD
It’s On the Way: Conducting Library Website Usability Test
Usability Testing T/TAC Online Project Design Team
How to Test Usability Modified from Keith Instone, Argus Associates.
Introduction to Web Authoring
Presentation transcript:

Trials and Tribulations of Usability Testing by Scott Grissom1 Trials and Tribulations of Usability Testing Scott Grissom Grand Valley State University

Trials and Tribulations of Usability Testing by Scott Grissom2 Timeline Oct 2002 developed prototype Nov usability testing Jan 2003 redesigned prototype Feb repeat usability testing April sneak peek July release

Trials and Tribulations of Usability Testing by Scott Grissom3 Our Website Goals provide useful content / services make the site easy to use create a satisfying experience for the visitor

Trials and Tribulations of Usability Testing by Scott Grissom4 An Easy to Use Website… can increase student applications can increase donations can improve faculty/staff performance can decrease training costs

Trials and Tribulations of Usability Testing by Scott Grissom5 User Centered Design early focus on the audience collect empirical measures iterative design

Trials and Tribulations of Usability Testing by Scott Grissom6 Evaluation Techniques usability checklist usability inspection user testing

Trials and Tribulations of Usability Testing by Scott Grissom7 Usability Testing target each audience select representative tasks collect objective and subjective data use the data to compare against the current site OR our expectations

Trials and Tribulations of Usability Testing by Scott Grissom8 Target Audiences prospective students students faculty & staff alumni & friends

Trials and Tribulations of Usability Testing by Scott Grissom9 Benchmark Tasks “Find the last day you can drop a course this semester” “Find the of another student in your class” “Where can you eat on campus on Saturday at 3:00?” “What is the yearly premium for the new vision plan recently announced?”

Trials and Tribulations of Usability Testing by Scott Grissom10 Usability Measures Performance Time Success Rate Visitor Satisfaction

Trials and Tribulations of Usability Testing by Scott Grissom11 Performance Time Ideal < 1 minute Satisfactory < 3 minutes Poor minutes Failure > 5 minutes Our target is 80% satisfactory (with no failure)

Trials and Tribulations of Usability Testing by Scott Grissom12 Performance Time

Trials and Tribulations of Usability Testing by Scott Grissom13 Visitor Satisfaction Five point Likert scale confusing clear distracting attractive difficult easy frustrating enjoyable Appearance target is 4.0 average Ease of Use target is 4.0 average

Trials and Tribulations of Usability Testing by Scott Grissom14 Satisfaction with Appearance

Trials and Tribulations of Usability Testing by Scott Grissom15 Satisfaction with Ease of Use

Trials and Tribulations of Usability Testing by Scott Grissom16 Home Page

Trials and Tribulations of Usability Testing by Scott Grissom17 Searching 70% of participants used searching during first test 50% were successful Less than 10% used searching during the second test

Trials and Tribulations of Usability Testing by Scott Grissom18 Tips for Testing follow campus guidelines for human studies number of participants? budget? use a trained and unbiased observer provide small gifts use “think out loud” protocol record performance time

Trials and Tribulations of Usability Testing by Scott Grissom19 In Summary Involve the target audiences early and often Identify target usability measures Repeat the design process until the targets have been met Our materials are available on the Web