Usability as an Assessment Method: An introduction that examines how usability studies can provide useful evidence to inform decision-making Information.

Slides:



Advertisements
Similar presentations
ACCOUNTING INFORMATION SYSTEMS
Advertisements

CS305: HCI in SW Development Evaluation (Return to…)
Usability Testing: Easier is Better Cokie Anderson Associate Professor Oklahoma State University
Each individual person is working on a GUI subset. The goal is for you to create screens for three specific tasks your user will do from your GUI Project.
Chapter 10 Schedule Your Schedule. Copyright 2004 by Pearson Education, Inc. Identifying And Scheduling Tasks The schedule from the Software Development.
Web Site Redesign: Perspectives from the Field What do they want? Usability Testing Robin Leech Head, Digital Initiatives LITA National Forum Cincinnati,
Darlene Fichter Data Coordinator, University of Saskatchewan Libraries February 20, 2002 Usability Testing on a Shoestring.
Customer: Rosalva Gallardo Team members: Susan Lin Buda Chiou Jim Milewski Marcos Mercado November 23, 2010.
Group Project. Don’t make me think Steve Krug (2006)
CS CS 5150 Software Engineering Lecture 12 Usability 2.
Identifying Needs and Establishing Requirements John Thiesfeld Jeff Morton Josh Edwards.
Administrivia  Review Deliverable 2 –Overview (audience) –Excellent additions  User Goals  Usability Goals  User Group (who are you designing for?)
Web Usability by Scott Grissom1 Web Usability Scott Grissom Computer Science & Information Systems.
The Survey as an Assessment Method: Why, when and how surveys provide evidence to inform decision-making Carrie Towns, Office of Institutional Research.
Project Sharing  Team discussions –Share results of heuristic evaluations –Discuss your choice of methods and results  Class-level discussion –Each spokesperson.
OSU Libraries presented by the u-team.
Web Design, Usability, and Aesthetics 2 Billboard Design 101 “Designing pages for scanning not reading” Notes from book “Don’t Make Me Think: by Steve.
1 CS 430 / INFO 430 Information Retrieval Lecture 24 Usability 2.
How are we doing with assessment? Update from the Information Services Assessment Council March 8, 2006.
Conducting Focus Groups: Talk Informing Action Information Services Assessment Council June 8, 2006.
Creating a User-Centered Culture of Assessment Stella Bentley and Bill Myers University of Kansas EDUCAUSE Southwest Regional Conference 2005.
Assessment: What it means What we’ve done What’s ahead Update from the Information Services Assessment Council March 30, 2006.
Web Usability UCR Webmasters Support Group Michael Yonezawa September 9th, 2004.
Providing Orientation and Training
The 5 C’s of Web Design Craig Duncan Project Manager ReliefWeb United Nations Office for the Coordination of Humanitarian.
Evaluation IMD07101: Introduction to Human Computer Interaction Brian Davison 2010/11.
Web Usability 101: Watch (and Discuss) A Live Test John Fritz UMBC.
The person or persons who have associated work with this document (the "Dedicator" or "Certifier") hereby either (a) certifies that, to the best of his.
Evaluation of Products for Accessibility: The CUDA Lab at CSULB and Technical Evaluation at the Campus Level Fred Garcia and Shawn Bates.
Demystifying the Business Analysis Body of Knowledge Central Iowa IIBA Chapter December 7, 2005.
Measuring the Power of Learning.™ California Assessment of Student Performance and Progress (CAASPP) Using Formative Assessment and the Digital Library.
1 Usability and accessibility of educational web sites Nigel Bevan University of York UK eTEN Tenuta support action.
Usability Testing intro.12.ppt CS 121 “Ordering Chaos” “Mike” Michael A. Erlinger.
What is Usability? Usability Is a measure of how easy it is to use something: –How easy will the use of the software be for a typical user to understand,
Copyright © 2008 Pearson Education, Inc. Publishing as Pearson Addison-Wesley The Resonant Interface HCI Foundations for Interaction Design First Edition.
What is a Business Analyst? A Business Analyst is someone who works as a liaison among stakeholders in order to elicit, analyze, communicate and validate.
“But I’m Not a Usability Expert”: Testing Tips for the Resource- Sharing Professional Uta Hussong-Christian Jane Nichols Jennifer Ward September 15, 2011.
What is USABILITY and why should I care? Adriana Corona, Senior Experience Designer User Experience & Web ITS MARCH.
ASSESSMENT. Assessment is the systematic and on-going process of collecting and reviewing evidence about the College's academic and administrative programs.
Agenda Usability Usability Testing Method Demo IX Lab Tour 02/15/2006School of Information, The University of Texas at Austin1/12 Usability and Testing:
Usability testing: A reality check for Plain Talk A brief overview October 7, 2008 Dana Howard Botka Manager, Customer Communications, L&I Plain Talk Coordinator,
1 ISE 412 Usability Testing Purpose of usability testing:  evaluate users’ experience with the interface  identify specific problems in the interface.
CS 235: User Interface Design October 8 Class Meeting Department of Computer Science San Jose State University Fall 2014 Instructor: Ron Mak
1 Technical & Business Writing (ENG-315) Muhammad Bilal Bashir UIIT, Rawalpindi.
Putting Assessment into Practice - Library Websites Steve Burks, LIS Web Developer Saint Michael’s College Library
Audience Analysis & Usability. The Writing Process Focusing and Planning Drafting Assessing & Evaluating Assessing & Editing Publishing and Evaluating.
Welcome to the Usability Center Tour Since 1995, the Usability Center has been a learning environment that supports and educates in the process of usability.
Creating User Interfaces Review midterm. Work on User Observation studies Homework: Spring break! Use opportunity to work on user observation study!
OSU Libraries presented by the u-team.
By Godwin Alemoh. What is usability testing Usability testing: is the process of carrying out experiments to find out specific information about a design.
June 5, 2007Mohamad Eid Usability Testing Chapter 8.
Usability Testing TECM 4180 Dr. Lam. What is Usability? A quality attribute that assesses how easy user interfaces are to use Learnability – Ease of use.
Useability testing Software Development Unit 4 Outcome 1.
Guerilla Usability Testing and Communicating Value Eka NCSU Libraries Fellow Code4Lib conference, 8 March 2016.
Evaluation / Usability. ImplementDesignAnalysisEvaluateDevelop ADDIE.
Design Evaluation Overview Introduction Model for Interface Design Evaluation Types of Evaluation –Conceptual Design –Usability –Learning Outcome.
Crew-centered Design and Operations of ships and ship systems CyClaDes Workshop ( )
MAKING IT WORK FOR THE USER: A CRASH WORKSHOP INTO USABILITY TESTING FOR LIBRARY WEBSITES JUNIOR TIDAL WEB SERVICES & MULTIMEDIA LIBRARIAN NEW YORK CITY.
Day 8 Usability testing.
KIMBERLY BABCOCK MASHEK INFORMATION LITERACY LIBRARIAN WARTBURG COLLEGE Library Technology Conference March 17 th, 2010 Getting Your Library Users Involved.
Controlled Assessment Unit 2 – (25% of the GCSE).
Stages of Research and Development
SA Capstone Requirements and Design Week 10 SYST Winter 2016
Software Development Unit 4 Outcome 1
Katherine Prentice, MSIS Richard Usatine, MD
HCI – DESIGN RATIONALE 20 November 2018.
An Introduction to the Problem Solving Process
An Introduction to the Problem Solving Process
homework assignment due Feb 23
The User Interface Design Process
Presentation transcript:

Usability as an Assessment Method: An introduction that examines how usability studies can provide useful evidence to inform decision-making Information Services Assessment Council May 11, 2006

assessment an ongoing process in which services, resources and performance are measured against the expectations of users, and improvements are made to satisfy user needs effectively and efficiently.

What do we need to know?

Who can tell us?

How can we get the information?

What will it enable us to do?

How much will it cost?

ISO standard ISO (1998) Guidance on Usability defines usability as: – The extent to which a product can be used by specified users to achieve specified goals with effectiveness, efficiency and satisfaction in a specified context of use.

Usability Testing A means for measuring how well people can use a web page (or a computer interface, document, or device) for its intended purpose.

Benefits of Usability Testing Better user experience Better understanding of users Lower support costs

Conduct a Usability Study When: Designing a new user interface Re-designing an existing interface Results will inform specific decisions Time and other resources permit

Test early and often

Usability Testing Process Specify objectives Identify tasks Get permission from HSCL Decide method of capturing results Recruit participants Choose a facilitator Conduct tests

Usability Testing Process cont. Analyze and report results Identify problems and possible solutions Do another round of testing to determine if your solutions work

Specify Objectives What do you want to learn? How will the information be used?

Identify tasks Test important features Test areas where you expect problems Test your assumptions

Recording methods Observers taking notes Note takers and video recording Screen capture software Software that combines screen capture and video

Recruiting Participants 3-4 participants per study Recruit loosely and grade on a curve. - Steve Krug

Facilitation Get their consent Make it clear that you’re testing the site, not them Encourage them to think out loud

Analyzing results Can they find their way around? Look at task completion times Watch for head slappers and shocks Remember, you’re seeing their best behavior

Reporting results Report problem areas to developers Test possible solutions to make sure the chosen solution works Do a presentation to tell everyone how much usability testing improved your site

Usability Testing Resources Jeffrey Rubin’s Handbook of Usability Testing Steve Krug’s Don’t Make Me Think! A Common Sense Approach to Web Usability Steve Krug’s site,

Information Services Assessment Council members Susanne Clement, Libraries Jill Glaser, IT Ryan Papesh, NTS Thelma Simons, IT John Stratton, Libraries Bill Myers, IS

Call on ISAC members to: Consult, advise and assist in the development of assessment initiatives. Identify other campus resources for assessment-related services. Provide oversight and assure coordination with other IS assessment activities.

Assessment presentations available at: