1. Said Achmiz, Alexander Gountras, Xinxin He

2. Problem Space Currently users in the home, performing a manually intensive task, do not have an easy and efficient way to access relevant information without using complex or interruptive methods.

3. Current Primary Methods of Accessing Information LaptopsTablets Mobile Devices

4. Conceptual Design Basic Concept: User Interface for large, touch and voice command capable displays, to be used in parts of the house where people do various household and personal activities. Goal: To make the task of looking up relevant information in various areas of the home, easy, efficient and to create an overall enjoyable experience.

5. Basic Design Large Recognizable Icons/ Buttons Simple UI Lack of small UI Elements Easy Navigation Easy to see feedback on the screen No clutter Enables user to see UI from a distance (21+” screen 1920x1080) Allows for Immediate access to information needed to support activity Simple Touch and Voice Command Capable

6. Requirements Questionnaire Asked Users About: Activities they typically perform Physical and cognitive constraints Potential uses in the home

7. Questionnaire Results ●Activities: Preparing Food, Personal Grooming, Working on Equipment, Eating ●Physical and Cognitive Constraints: Physically: Both of my hands are occupied almost continuously throughout these activities. Cognitively: I can do the activity almost mechanically, takes up little concentration. ●Potential Uses: Viewing static content, Listening to Music, Viewing related video content

8. Based on Results Need to segregate the program into contexts (Kitchen, Garage, Bathroom) Needs to be capable of supporting some type of music player and possibly other desired media applications. Must be able to view static content and have capabilities to view related video

9. Some Preliminary Sketches Homepage (Kitchen Selected)Homepage (Common Selected)

10. Low-Fidelity Prototype Samples HomescreenHomescreen to Kitchen

11. Hi-Fidelity Prototype Demo

12. Evaluation methods ○ Task-based user walkthrough ○Interview and questionnaire ○Internal walkthrough

13. Task-based walkthrough Participants Four users (selected by convenience) Tasks Find Salami pizza Listen to music/minimize music window Maximize recipe screen Step-by-step recipe Find cook video/timer

14. Interview and questionnaire Participants Four users (selected by convenience) Tasks Interview users and let them do a questionnaire after their walkthrough Points If the product is easy to use If the task is difficult to achieve If the interface is clear and well-identified

17. User feedback - Positive 1. The concept is good, especially for voice commands and gestures 2.Interfaces are easy to navigate for the most part 3.The function of each button can be easily recognized at a glance 4.Tasks like finding a pizza, listening to music are easy to achieve 5.The click area is convenient and easy to touch

18. User feedback - Negative 1. Media icon is a bit confusing and is a little big 2.Recipe “by type” is confusing, better to use “Category” 3.Better to explain “Hands-free” concept on some screen. 4.Build a shopping list 5.Better to have step by step recipe. 6.What’s the device? How can I upload music, USB,Wifi? Where can I download Apps? Where do the recipes come from?

19. Internal walkthrough 1. Big round button is not a good filter and make up a lot of space 2.Voice commands and gesture don’t have indicators 3.Left panel would be like addible 4.Correlation between icons and windows should be added. 5.Full screen is needed.

20. Revision – user feedback 1.Audio / gesture desirability — users want to use voice commands and gestures 2.The Media button and cooking video button was confusing 3.Wanted more navigation options on recipe widget 4.Preferred instructional videos to be contextualized in recipe viewer, even associated with individual steps 5.Walkthrough showed necessity for full-screen view 6.Users wanted “My favorite recipes”

21. Audio / gesture desirability - users want to use voice commands and gestures ➢ We added "speakable screen" indicator and "speakable item" indicators on UI elements 1

22. The Media button was confusing ➢ We added an "add widget" button and integrated the Music and other media as regular widgets 2

23. Users wanted more navigation options on recipe widget ➢ We are expanding category and ingredient search options 3

24. Users preferred instructional cooking videos to be contextualized in recipe viewer, even associated with individual steps ➢ We're adding embedded video into the recipe viewer itself, rather than having a separate instructional video button 4

25. Walkthrough showed necessity for full-screen view ➢ So, we added full-screen option to recipe viewer widget 5

26. ➢ “My favorite recipes” screen added 6