1. 2.7 Cognitive Walkthrough
What is wanted
Analysis
Design
Evaluation

2. Cognitive Walkthrough
Exploratory learning
Users tend to love learning by exploration
Similar to software code walkthrough
user
Software
(EOU)
Software
(usefulness)

3. Inputs of Cognitive Walkthrough
Design specification or prototype
User descriptions
Task descriptions
Action sequence

4. Questions Asked by Evaluator
問題：正確動作的控制項是否明顯？
問題：正確動作的控制項與其目標之間的關係是否明顯？
問題：使用者是否能夠評估系統回應的正確性？
任務問題：使用者要完成的目標是什麼？

5. Cognitive Walkthrough Example
Train ticket vending machine
from [Newman & Lamming 1995]
1. Choose destination or enter fare
Newark
Rahway
Metropark
Metuchen
Edison
New Brunswick
2. Indicate journey type
One-way
Round-trip
3. Deposit money
coins
bills
4. Press to receive ticket and change
LIFT for ticket and change
取票與零錢區

6. Cognitive Walkthrough Example
Scenario
A novice user wants to buy a one-way ticket to New Brunswick.
She has a $5 bill in her pocket + some change.
Task-definition question Q0: “What is the user trying to achieve?”
Answer: “Buy a one-way ticket to New Brunswick.”

7. Cognitive Walkthrough Example
1. Will the correct action be evident to the user?
問題：使用者要做出正確動作會不會很困難？(X)
1. Choose destination or enter fare
Newark
Rahway
Metropark
Metuchen
Edison
New Brunswick
2. Indicate journey type
One-way
Round-trip
3. Deposit money
coins
bills
4. Press to receive ticket and change
LIFT for ticket and change 7

8. Cognitive Walkthrough Example
1. Will the correct action be evident to the user? (subgoals provided to user)
1. Choose destination or enter fare
Newark
Rahway
Metropark
Metuchen
Edison
New Brunswick
2. Indicate journey type
One-way
Round-trip
Yes
3. Deposit money
coins
bills
LIFT for ticket and change
4. Press to receive ticket and change 8

9. Cognitive Walkthrough Example
2. Will the user connect the correct action’s description/label with his/her intent?
1. Choose destination or enter fare
Newark
Rahway
Metropark
Metuchen
Edison
New Brunswick
2. Indicate journey type
One-way
Round-trip
3. Deposit money
coins
bills
LIFT for ticket and change
4. Press to receive ticket and change 9

10. Cognitive Walkthrough Example
2. Will the user connect the correct action’s description/label with his/her intent?
1. Choose destination or enter fare
Newark
Rahway
Metropark
Metuchen
Edison
New Brunswick
2. Indicate journey type
One-way
Round-trip
Yes
3. Deposit money
coins
bills
LIFT for ticket and change
4. Press to receive ticket and change 10

11. Cognitive Walkthrough Example
3. Will the user properly interpret the system’s response? (know if chose right/wrong?)
1. Choose destination or enter fare
Newark
Rahway
Metropark
Metuchen
Edison
New Brunswick
2. Indicate journey type
One-way
Round-trip
3. Deposit money
coins
bills
LIFT for ticket and change
4. Press to receive ticket and change 11

12. Cognitive Walkthrough Example
3. Will the user properly interpret the system’s response? (know if chose right/wrong?)
1. Choose destination or enter fare
Newark
Rahway
Metropark
Metuchen
Edison
New Brunswick
2. Indicate journey type
One-way
Round-trip
Yes (if button lights up…)
3. Deposit money
coins
bills
LIFT for ticket and change
4. Press to receive ticket and change 12

13. Cognitive Walkthrough Example
1. Will the correct action be evident to the user?
1. Choose destination or enter fare
Newark
Rahway
Metropark
Metuchen
Edison
New Brunswick
2. Indicate journey type
One-way
Round-trip
3. Deposit money
coins
bills
LIFT for ticket and change
4. Press to receive ticket and change 13

14. Cognitive Walkthrough Example
1. Will the correct action be evident to the user?
Yes
1. Choose destination or enter fare
Newark
Rahway
Metropark
Metuchen
Edison
New Brunswick
2. Indicate journey type
One-way
Round-trip
3. Deposit money
coins
bills
LIFT for ticket and change
4. Press to receive ticket and change 14

15. Cognitive Walkthrough Example
2. Will the user connect the correct action’s description/label with his/her intent?
1. Choose destination or enter fare
Newark
Rahway
Metropark
Metuchen
Edison
New Brunswick
2. Indicate journey type
One-way
Round-trip
3. Deposit money
coins
bills
LIFT for ticket and change
4. Press to receive ticket and change 15

16. Cognitive Walkthrough Example
2. Will the user connect the correct action’s description/label with his/her intent?
1. Choose destination or enter fare
Newark
Rahway
Metropark
Metuchen
Edison
New Brunswick
2. Indicate journey type
One-way
Round-trip
Yes
3. Deposit money
coins
bills
LIFT for ticket and change
4. Press to receive ticket and change 16

17. Cognitive Walkthrough Example
3. Will the user properly interpret the system’s response? (know if chose right/wrong?)
1. Choose destination or enter fare
Newark
Rahway
Metropark
Metuchen
Edison
New Brunswick
2. Indicate journey type
One-way
Round-trip
3. Deposit money
coins
bills
LIFT for ticket and change
4. Press to receive ticket and change 17

18. Cognitive Walkthrough Example
3. Will the user properly interpret the system’s response? (know if chose right/wrong?)
1. Choose destination or enter fare
Newark
Rahway
Metropark
Metuchen
Edison
New Brunswick
2. Indicate journey type
One-way
Round-trip
Yes …
One-way
$6.35
3. Deposit money
coins
bills
LIFT for ticket and change
4. Press to receive ticket and change 18

19. Cognitive Walkthrough Example
1. Will the correct action be evident to the user?
1. Choose destination or enter fare
Newark
Rahway
Metropark
Metuchen
Edison
New Brunswick
2. Indicate journey type
One-way
Round-trip
One-way
$6.35
3. Deposit money
coins
bills
LIFT for ticket and change
4. Press to receive ticket and change 19

20. Cognitive Walkthrough Example
1. Will the correct action be evident to the user?
Yes
1. Choose destination or enter fare
Newark
Rahway
Metropark
Metuchen
Edison
New Brunswick
2. Indicate journey type
One-way
Round-trip
One-way
$6.35
3. Deposit money
coins
bills
LIFT for ticket and change
4. Press to receive ticket and change 20

21. Cognitive Walkthrough Example
2. Will the user connect the correct action’s description/label with his/her intent?
1. Choose destination or enter fare
Newark
Rahway
Metropark
Metuchen
Edison
New Brunswick
2. Indicate journey type
One-way
Round-trip
One-way
$6.35
3. Deposit money
coins
bills
LIFT for ticket and change
4. Press to receive ticket and change 21

22. Cognitive Walkthrough Example
2. Will the user connect the correct action’s description/label with his/her intent?
1. Choose destination or enter fare
Newark
Rahway
Metropark
Metuchen
Edison
New Brunswick
2. Indicate journey type
One-way
Round-trip
One-way
$6.35
3. Deposit money
Yes
coins
bills
LIFT for ticket and change
4. Press to receive ticket and change 22

23. Cognitive Walkthrough Example
3. Will the user properly interpret the system’s response? (know if chose right/wrong?)
1. Choose destination or enter fare
Newark
Rahway
Metropark
Metuchen
Edison
New Brunswick
2. Indicate journey type
One-way
Round-trip
One-way
$6.35
3. Deposit money
coins
bills $5
LIFT for ticket and change
4. Press to receive ticket and change 23

24. Cognitive Walkthrough Example
3. Will the user properly interpret the system’s response? (know if chose right/wrong?)
1. Choose destination or enter fare
Newark
Rahway
Metropark
Metuchen
Edison
New Brunswick
2. Indicate journey type
One-way
Round-trip
3. Deposit money
coins
bills
4. Press to receive ticket and change
LIFT for ticket and change
$6.35
Recv’d: $5.00
No, need feedback!
 Add received amount display 24

25. Cognitive Walkthrough Example
Not enough $…
1. Will the correct action be evident?
1. Choose destination or enter fare
Newark
Rahway
Metropark
Metuchen
Edison
New Brunswick
2. Indicate journey type
One-way
Round-trip
3. Deposit money
coins
bills
4. Press to receive ticket and change
LIFT for ticket and change
$6.35
Recv’d: $5.00 25

26. Cognitive Walkthrough Example
Probably not!
Not enough $…
1. Will the correct action be evident?
1. Choose destination or enter fare
Newark
Rahway
Metropark
Metuchen
Edison
New Brunswick
2. Indicate journey type
One-way
Round-trip
3. Deposit money
coins
bills
4. Press to receive ticket and change
LIFT for ticket and change
$6.35
Recv’d: $5.00 ? ? ? 26

27. Cognitive Walkthrough Example
Probably not!  Add a new UI element to make it clear!
Not enough $…
1. Will the correct action be evident?
1. Choose destination or enter fare
Newark
Rahway
Metropark
Metuchen
Edison
New Brunswick
2. Indicate journey type
One-way
Round-trip
One-way
$6.35
Recv’d: $5.00
3. Deposit money
coins
bills
Cancel & return money
LIFT for ticket and change
4. Press to receive ticket and change 27

28. Sample Cover Form for Cognitive Walkthrough
Cognitive walkthrough data collection sheet
Evaluator
Date
Amanda
2013/9/9
User
Familiar with VCRs
Not acquainted with this design
Task
Time-record a program [18:00-19:15] on channel 4 on 2013/11/9
Design specification (or prototype)
See next slide
Action sequence
(action descriptions)

29. Initial Design of VCR Remote Control

30. Action Description Actor(#) Description of Action or Response UA 1
Press the ‘timed record’ button
SD 1
Display moves to timer mode.
Flashing cursor appears after ‘start:’
UA 2
Press digits
SD 2
Digits are displayed as typed.
Flashing cursor moves to next position.
UA 3
Press the ‘timed record’ button.
SD 3
Flashing cursor moves to ‘end:’
UA 4
Press digits
SD 4

31. Sample Form for Cognitive Walkthrough
UA 1
Press the ‘timed record’ button
Questions
Evaluation result
Severity Q0
使用者目標
The user tries to record TV show … -- Q1
控制項明顯?
Yes
(the button can be seen clearly) Q2
控制項連結意義?
Uneasy
(as there’re also other icons that might mislead a user)
Medium Q3
回應容易解讀?
(The display change is apparent)

32. Cognitive Walkthrough for the Web (CWW)
Based on CoLiDes
Contextual rich goal descriptions
Interaction
(navigation)
Task/Goal
Webpages
Human

33. CoLiDeS (Comprehension-based Linked Model of Deliberate Search)

34. CoLiDeS (Comprehension-based Linked Model of Deliberate Search)

35. Four Problem Types Detected
Weak scent link
Unfamiliar problem
Competing headings
Competing links
0’55”

36. Sample Category Page From Sony Australia
The Definitive Internet TV Experience
Breathtaking. A must have Full HD TV
Home Entertainment Powered with the Internet
Matchless quality and a world of possibilities
Monolithic Design and Immersive 3D Technology
Full HD 3D Equipped with Network Capability
The Ultimate TV and Web Surfing Experience
Network Capability with High Picture Quality
Vibrant images, seamless network capacity
Superior Image Technology & Energy Efficiency
All-round Entertainment and Enjoyment

37. Summarizing Cognitive Walkthrough
Usability evaluation with expertise
Usability specialist
Design team members
NOT End Users
Subjectivity issue
Cost issue
Use the Delphi method
Address the subjectivity issue
Achieve consensus
Anonymity

38. Any Question?