SIMS 213: User Interface Design & Development

Slides:



Advertisements
Similar presentations
Chapter 15: Analytical evaluation
Advertisements

User Modeling CIS 376 Bruce R. Maxim UM-Dearborn.
Predictive Assessment of Usability Laura Marie Leventhal.
Evaluation Types GOMS and KLM
Task Analysis (continued). Task analysis Observations can be done at different levels of detail fine level (primitives, e.g. therbligs, keystrokes,GOMS.
The Essential Role of Mental Models in HCI: Card, Moran and Newell
GOMS Analysis & Automated Usability Assessment Melody Y. Ivory (UCB CS) SIMS 213, UI Design & Development March 8, 2001.
Human Perception Christine Robson September 20, 2007.
Cognition in the virtual world. Which is easiest to read? What is the time?
1 Action Analysis Automated Evaluation. 2 Hall of Fame or Hall of Shame? java.sun.com.
GOMS and You CS125a - HCI Alex Feinman. Overview Background of GOMS Application of GOMS A Few Examples Related Work.
Fitts’ Law and the Model Human Processor
GOMS Analysis & Automating Usability Assessment Melody Y. Ivory SIMS 213, UI Design & Development March 19, 2002.
KLM and GOMS Professor: Tapan Parikh TA: Eun Kyoung Choe
Objectives Define predictive and descriptive models and explain why they are useful. Describe Fitts’ Law and explain its implications for interface design.
SIMS 213: User Interface Design & Development Marti Hearst Tues, April 6, 2004.
SIMS 213: User Interface Design & Development Marti Hearst Tues, April 19, 2005.
Predictive Evaluation Predicting performance. Predictive Models Translate empirical evidence into theories and models that can influence design. Performance.
Chapter 4 Cognitive Engineering HCI: Designing Effective Organizational Information Systems Dov Te’eni Jane M. Carey.
Some questions of hypermedia and CHI Josep Blat Universitat Pompeu Fabra.
I213: User Interface Design & Development Marti Hearst Tues, April 17, 2007.
Analytical Evaluations 2. Field Studies
Predictive Evaluation Simple models of human performance.
Prepared By: Rekah Veloo Date:16 th Aug 2010 Lecture: Dr. Balakrishnan Muniandy Course Code: QIM 501E.
©2011 1www.id-book.com Analytical evaluation Chapter 15.
Cognitive Models. 2 Contents Cognitive Models Device Models Cognitive Architectures.
Chapter 5 Models and theories 1. Cognitive modeling If we can build a model of how a user works, then we can predict how s/he will interact with the interface.
Interaction Design Specification (lecture-6)
The Growth of Cognitive Modeling in Human- Computer Interaction Since GOMS By Judith Reitman Olson and Gary M. Olson The University of Michigan.
User Models Predicting a user’s behaviour. Fitts’ Law.
UNDERSTANDING USERS: MODELING TASKS AND LOW- LEVEL INTERACTION Human-Computer Interaction
Slides based on those by Paul Cairns, York ( users.cs.york.ac.uk/~pcairns/) + ID3 book slides + slides from: courses.ischool.berkeley.edu/i213/s08/lectures/i ppthttp://www-
Stanford hci group / cs October 2008 Inp ut Scott Klemmer.
User Modeling 1 Predicting thoughts and actions. Agenda Cognitive models Physical models Fall 2006PSYCH / CS
GOMS CS 160 Discussion Chris Long 3/5/97. What is GOMS? l A family of user interface modeling techniques l Goals, Operators, Methods, and Selection rules.
Overview of the rest of the semester Iteratively design interface to help people log their food intake over the long term.
Gary MarsdenSlide 1University of Cape Town Human-Computer Interaction - 6 User Models Gary Marsden ( ) July 2002.
Testing & modeling users. The aims Describe how to do user testing. Discuss the differences between user testing, usability testing and research experiments.
GOMs and Action Analysis and more. 1.GOMS 2.Action Analysis.
Chapter 15: Analytical evaluation Q1, 2. Inspections Heuristic evaluation Walkthroughs Start Q3 Reviewers tend to use guidelines, heuristics and checklists.
Analytical evaluation Prepared by Dr. Nor Azman Ismail Department of Computer Graphics and Multimedia Faculty of Computer Science & Information System.
Cognitive Modeling 1 Predicting thougts and actions
Task Analysis CSCI 4800/6800 Feb 27, Goals of task analysis Elicit descriptions of what people do Represent those descriptions Predict difficulties,
ITM 734 Introduction to Human Factors in Information Systems
The Psychology of Human-Computer Interaction
Brugergrænseflader til apparater BRGA Presentation 3: Cognitive Psychology & usable methods.
Prof. James A. Landay University of Washington Winter 2007 (1) Action Analysis (2) Automated Evaluation January 8, 2007.
6.813/6.831 User Interface Design and Implementation
Evaluation Using Modeling. Testing Methods Same as Formative Surveys/questionnaires Interviews Observation Documentation Automatic data recording/tracking.
Cognitive Models Lecture # March, 2008Human Computer Intercation Spring 2008, Lecture #10 2 Agenda Cognitive models –KLM –GOMS –Fitt’s Law –Applications.
마스터 제목 스타일 편집 마스터 텍스트 스타일을 편집합니다 둘째 수준 셋째 수준 넷째 수준 다섯째 수준 The GOMS Family of User Interface Analysis Techniques : Comparison and Contrast Bonnie E. John.
Chapter 15: Analytical evaluation. Aims: Describe inspection methods. Show how heuristic evaluation can be adapted to evaluate different products. Explain.
Introduction to Evaluation without Users. Where are you at with readings? Should have read –TCUID, Chapter 4 For Next Week –Two Papers on Heuristics from.
1CS 338: Graphical User Interfaces. Dario Salvucci, Drexel University. Lecture 15: User Modeling.
GOMS Analysis & Web Site Usability Melody Y. Ivory (UCB CS) SIMS 213, UI Design & Development April 15, 1999.
1 1 ITM 734 Introduction to Human Factors in Information Systems Cindy Corritore This material has been developed by Georgia Tech HCI.
Prof. James A. Landay University of Washington Winter 2009 (1) Action Analysis (2) Automated Evaluation January 13, 2009.
A Survey on User Modeling in HCI PRESENTED BY: MOHAMMAD SAJIB AL SERAJ SUPERVISED BY: PROF. ROBERT PASTEL.
Copyright 2006 John Wiley & Sons, Inc Chapter 5 – Cognitive Engineering HCI: Developing Effective Organizational Information Systems Dov Te’eni Jane Carey.
Human Computer Interaction
Task Analysis CSCI 4800/6800 Feb 27, 2003.
CIS 376 Bruce R. Maxim UM-Dearborn

GOMS Adapted from Berkeley Guir.
GOMS as a Simulation of Cognition
Evaluation.
Model based design NGOMSL and CPM- GOMS
Testing & modeling users
Model based design keystroke level model
Presentation transcript:

SIMS 213: User Interface Design & Development Marti Hearst Tues, April 18, 2006

Today Evaluation based on Cognitive Modeling Keystroke-Level Model low-level description of what users must do to perform a task. GOMS structured, multi-level description of what users must do to perform a task Fitts’ Law Used to predict time needed to select a target

Keystroke-level Model Another “discount” usability method Main idea: Walk through the interface, counting how many operations it would take an expert user to perform Look for ways to optimize Look for potential sources of error KLM is very low-level (tiny operations)

Keystroke-Level Model How to make a KLM List specific actions user does to perform task Keystrokes and button presses Mouse movements Hand movements between keyboard & mouse System response time (if it makes user wait) Add Mental operators Assign execution times to steps Sum execution times Only provides execution time and operator sequence Slide adapted from Chris Long

KLM Example Replace all instances of a 4-letter word. (example from Hochstein)

Slide adapted from Chris Long What is GOMS? A family of user interface modeling techniques Goals, Operators, Methods, and Selection rules Higher-level than KLM Input: detailed description of UI and task(s) Output: various qualitative and quantitative measures Slide adapted from Chris Long

Applications of GOMS analysis Compare UI designs Profiling Building a help system GOMS modelling makes user tasks and goals explicit Can suggest questions users will ask and the answers Slide adapted from Chris Long

Slide adapted from Chris Long What GOMS can model Task must be goal-directed Some activities are more goal-directed than others Even creative activities contain goal-directed tasks Task must a routine cognitive skill Can include serial and parallel tasks Slide adapted from Chris Long

Slide adapted from Chris Long GOMS Output Functionality coverage and consistency Does UI contain needed functions? Are similar tasks performed similarly? (NGOMSL only?) Operator sequence In what order are individual operations done? Abstraction of operations may vary among models Slide adapted from Chris Long

Slide adapted from Chris Long Output (cont’d) Execution time By expert Error recovery Procedure learning time (NGOMSL only) Accurate for relative comparison only Does not include time for learning domain knowledge Slide adapted from Chris Long

How to do (CMN-)GOMS Analysis Generate task description Pick high-level user Goal Write Method for accomplishing Goal - may invoke subgoals Write Methods for subgoals This is recursive Stops when Operators are reached Evaluate description of task Apply results to UI Iterate Slide adapted from Chris Long

Slide adapted from Chris Long Operators vs. Methods Operator: the most primitive action Method: requires several Operators or subgoal invocations to accomplish Level of detail determined by KLM level - keypress, mouse press Higher level - select-Close-from-File-menu Different parts of model can be at different levels of detail Slide adapted from Chris Long

GOMS Example 1: PDA Text Entry goal: enter-text-PDA move-pen-to-text-start goal: enter-word-PDA ...repeat until no more words write-letter ...repeat until no more letters [select: goal: correct-misrecognized-word] ...if incorrect expansion of correct-misrecognized-word goal: move-pen-to-incorrect-letter write-letter Slide adapted from Chris Long

GOMS Example 2: Graph Drawer goal: draw-graph goal: draw-node ...repeat until no more nodes goal: draw-circle draw-circle-gesture goal: verify-circle-gesture [select: goal: correct-gesture] ...if misrecognized or drawn incorrectly goal: connect-node ...repeat until no more connections draw-line-gesture move-pen-to-node-just-drawn goal: name-node make-naming-gesture goal:enter-text Slide adapted from Chris Long

Slide adapted from Chris Long GOMS Example 2 expansion of correct-gesture goal move-pen-to-undo-button tap-undo-button goal: copy-node move-pen-to-node draw-copy-gesture drag-pen-to-destination Slide adapted from Chris Long

GOMS Example 3 Move text in a word processor (example from Hochstein)

GOMS Example 3 Move text in a word processor (example from Hochstein)

GOMS Example 3 Move text in a word processor (example from Hochstein)

Slide adapted from Chris Long Members of GOMS Family Keystroke-Level Model (KLM) – Card, Moran, Newell (1983) CMN-GOMS Card, Moran, Newell GOMS Natural GOMS Language (NGOMSL) -Kieras (1988+) Critical Path Method or Cognitive, Perceptual, and Motor GOMS (CPM-GOMS) John (1990+) Slide adapted from Chris Long

Slide adapted from Chris Long Other GOMS techniques NGOMSL Regularized level of detail Formal syntax, so computer interpretable Gives learning times CPM-GOMS Closer to level of Model Human Processor Much more time consuming to generate Can model parallel activities Slide adapted from Chris Long

Real-world GOMS Applications KLM Mouse-based text editor Mechanical CAD system NGOMSL TV control system Nuclear power plant operator’s associate CPM-GOMS Telephone operator workstation Slide adapted from Chris Long

Engineering Model of Human Performance From The Psychology of Human-Computer Interaction, by Card, Moran, and Newell Quantitative predictions Usefully approximate Based on the “Model Human Processor” Slide adapted from Chris Long

Slide adapted from Chris Long Advantages of GOMS Gives several qualitative and quantitative measures Model explains why the results are what they are Less work than user study Easy to modify when interface is revised Research ongoing for tools to aid modeling process Slide adapted from Chris Long

Slide adapted from Chris Long Disadvantages of GOMS Not as easy as heuristic analysis, guidelines, or cognitive walkthrough Only works for goal-directed tasks Assumes tasks are performed by expert users Evaluator must pick users’ tasks/goals Does not address several important UI issues, such as readability of text memorability of icons, commands Does not address social or organizational impact Slide adapted from Chris Long

Slide adapted from Chris Long GOMS Summary Provides info about many important UI properties But does not tell you most of what you want to know about a UI Substantial effort to do initial model, but still (potentially) easier than user testing Changing later is much less work than initial generation Slide adapted from Chris Long

Slide adapted from Newstetter & Martin, Georgia Tech Fitts’ Law Models movement time for selection tasks The movement time for a well-rehearsed selection task increases as the distance to the target increases decreases as the size of the target Slide adapted from Newstetter & Martin, Georgia Tech

Slide adapted from Newstetter & Martin, Georgia Tech Fitts’ Law Time (in msec) = a + b log2(D/S+1) where a, b = constants (empirically derived) D = distance S = size ID is Index of Difficulty = log2(D/S+1) Slide adapted from Newstetter & Martin, Georgia Tech

Slide adapted from Pourang Irani Fitts’ Law Time = a + b log2(D/S+1) Target 1 Target 2 Same ID → Same Difficulty Slide adapted from Pourang Irani

Slide adapted from Pourang Irani Fitts’ Law Time = a + b log2(D/S+1) Target 1 Target 2 Smaller ID → Easier Slide adapted from Pourang Irani

Slide adapted from Pourang Irani Fitts’ Law Time = a + b log2(D/S+1) Target 1 Target 2 Larger ID → Harder Slide adapted from Pourang Irani

Determining Constants for Fitts’ Law To determine a and b design a set of tasks with varying values for D and S (conditions) For each task condition multiple trials conducted and the time to execute each is recorded and stored electronically for statistical analysis Accuracy is also recorded either through the x-y coordinates of selection or through the error rate — the percentage of trials selected with the cursor outside the target Slide adapted from Pourang Irani

A Quiz Designed to Give You Fitts http://www.asktog.com/columns/022DesignedToGiveFitts.html Microsoft Toolbars offer the user the option of displaying a label below each tool. Name at least one reason why labeled tools can be accessed faster. (Assume, for this, that the user knows the tool.) Slide adapted from Pourang Irani

A Quiz Designed to Give You Fitts The label becomes part of the target. The target is therefore bigger. Bigger targets, all else being equal, can always be acccessed faster, by Fitt's Law. When labels are not used, the tool icons crowd together. Slide adapted from Pourang Irani

A Quiz Designed to Give You Fitts You have a palette of tools in a graphics application that consists of a matrix of 16x16-pixel icons laid out as a 2x8 array that lies along the left-hand edge of the screen. Without moving the array from the left-hand side of the screen or changing the size of the icons, what steps can you take to decrease the time necessary to access the average tool? Slide adapted from Pourang Irani

A Quiz Designed to Give You Fitts Change the array to 1X16, so all the tools lie along the edge of the screen. Ensure that the user can click on the very first row of pixels along the edge of the screen to select a tool. There should be no buffer zone. Slide adapted from Pourang Irani

Summary We can use Cognitive Modeling to make predictions about interface usability Complementary to Usability Studies In practice: GOMS not used often Fitts law often used for determining best case for new kinds of input methods