Meet Meetings with a purpose.. Meet: The Team Derin D. Dartis W. Lorena H.L. Peter W. Engineering UX/UI PM Engineering.

Slides:



Advertisements
Similar presentations
Testing through user observations User Observation: Guidelines for Apple Developers, Kathleen Gomoll & Anne Nicol, January 1990 Notes based on:
Advertisements

Express your kindness!. Introduction Problem and Solution Previous Design Updated Design Online Usability Study Recommendations for Change Wrap-up Overview.
Cognitive Walkthrough More evaluation without users.
Deciding How to Measure Usability How to conduct successful user requirements activity?
Location Based Social Networking For All Presenter: Danny Swisher.
ACTIVELY ENGAGING THE STAKEHOLDER IN DEFINING REQUIREMENTS FOR THE BUSINESS, THE STAKEHOLDER, SOLUTION OR TRANSITION Requirements Elicitation.
Chapter 14: Usability testing and field studies. 2 FJK User-Centered Design and Development Instructor: Franz J. Kurfess Computer Science Dept.
Disclaimer © 2015 John Straumann. All rights reserved. “Score It! Tennis” and other product names are or may be registered trademarks and/or trademarks.
CS CS 5150 Software Engineering Lecture 12 Usability 2.
© 2005 Prentice Hall12-1 Stumpf and Teague Object-Oriented Systems Analysis and Design with UML.
Evaluation Methodologies
An evaluation framework
Feedback from Usability Evaluation to User Interface Design: Are Usability Reports Any Good? Christian M. Nielsen 1 Michael Overgaard 2 Michael B. Pedersen.
Disclaimer © 2015 John Straumann. All rights reserved. “Score It! Tennis” and other product names are or may be registered trademarks and/or trademarks.
Damian Gordon.  Summary and Relevance of topic paper  Definition of Usability Testing ◦ Formal vs. Informal methods of testing  Testing Basics ◦ Five.
- where great ideas begin-. BrilNet is a web conferencing solution that allows you to always stay connected. With BrilNet, you can schedule, host and.
XP New Perspectives on Microsoft Access 2002 Tutorial 71 Microsoft Access 2002 Tutorial 7 – Integrating Access With the Web and With Other Programs.
SmartSenior Angela Gong, Joanie Hollberg, Maggie Skortcheva, Rassan Walker.
CS 352, W12 Eric Happe, Daniel Sills, Daniel Thornton, Marcos Zavala, Ben Zoon ANDROID/IOS RPG GAME UI.
Software Engineering 2003 Jyrki Nummenmaa 1 USE CASES In this lecture: Use cases - What are use cases? - Why to use use cases? - How to write.
© 2012 Adobe Systems Incorporated. All Rights Reserved. Copyright 2012 Adobe Systems Incorporated. All rights reserved. ® WRITING FOR THE WEB.
Wanderlust Pilot Field Study Presented by Brandon Bond.
Introduction to Usability By : Sumathie Sundaresan.
1.1 1 Introduction Foundations of Computer Science  Cengage Learning.
ESM Interface Re-Design HCI Undergraduate Project Team Bei Yang Derek Parham Wenyao Ho.
Software Engineering – University of Tampere, CS DepartmentJyrki Nummenmaa USE CASES In this lecture: Use cases - What are use.
Evaluation Framework Prevention vs. Intervention CHONG POH WAN 21 JUNE 2011.
1 SWE 513: Software Engineering Usability II. 2 Usability and Cost Good usability may be expensive in hardware or special software development User interface.
Chapter 11: An Evaluation Framework Group 4: Tony Masi, Sam Esswein, Brian Rood, & Chris Troisi.
Ch 14. Testing & modeling users
Human Computer Interaction An Introduction. Human-Computer Interaction "Human-computer interaction (HCI) is the study of the interaction between people,
TransTracker Pilot Usability Study Team: Drew Bregel - Development, Data Analysis Marianne Goldin - PM, UI Tester, Data Gathering, Presenter Joel Shapiro.
Allen Stauffer Rarihwenhawi LaFrance.  University students often lack time to keep track of grades and monitor progress  System would focus on providing.
EasyChair Reviewer sign up and bidding Art Hsieh Jean Huang Norik Davtian Ryan Nissenbaum.
Brandon S. Perelman Department of Cognitive and Learning Sciences, Michigan Technological University.
1 ISE 412 Usability Testing Purpose of usability testing:  evaluate users’ experience with the interface  identify specific problems in the interface.
Usability Test Mail Merge Function in Microsoft Word.
Conducting Usability Tests 4 Step Process. Step 1 – Plan and Prep Step 2 – Find Participants Step 3 – Conduct the Session Step 4 – Analyze Data and Make.
Final Presentation Red Team. Introduction The Project We are building an application that can potentially assist Service Writers at the Gene Harvey Chevrolet.
CS 352, W12 Eric Happe, Daniel Sills, Daniel Thornton, Marcos Zavala, Ben Zoon ANDROID/IOS RPG GAME UI.
1 Technical & Business Writing (ENG-715) Muhammad Bilal Bashir UIIT, Rawalpindi.
Usability Assessment Methods beyond Testing Chapter 7 Evaluating without users.
Final Presentation Ivan Tam Lindsay Tabas Katrina Rhoads John Mark Josling.
Usability Engineering Dr. Dania Bilal IS 582 Spring 2006.
Controlling Computer Using Speech Recognition (CCSR) Creative Masters Group Supervisor : Dr: Mounira Taileb.
Express your kindness!. Introduction Problem and Solution Online Usability Study Recap Revised Interface Design Prototype Overview Prototype Demonstration.
The Information School of the University of Washington Information System Design Info-440 Autumn 2002 Session #15.
By Godwin Alemoh. What is usability testing Usability testing: is the process of carrying out experiments to find out specific information about a design.
Human Computer Interface INT211
Assessment of Google Flights Lanny Chung Junior at Bentley University.
User Testing. CSE490f - Autumn 2006User Interface Design, Prototyping, & Evaluation2 Hall of Fame or Hall of Shame? frys.com.
Huddle Social Event Discovery Nadav Manager Brandon Design Joe User Testing Mike Development.
DOCUMENTATION REF: Essentials of IT (Hamilton et al) Chapter 1.
Day 8 Usability testing.
Design for usability E6: Human Factors Design IB Technology.
L O W – F I P R O T O T Y P E [ M I C R O ] A D V E N T U R E.
TOKEN Field Usability Study Janet An Stephany Yong Timi Opeke
Juliana Cook Adrienne Ivey Meredith Marks Nhien Tran
Achieving goals. Together.
clickED Field Usability Study
MBI 630: Week 11 Interface Design
Pre-Final Presentation
Problem Sometimes, people see an image, a pattern, or a style that they really like. Currently, there is no easy way for people to find items with a specific.
From Controlled to Natural Settings
Low-Fi Prototyping & Pilot Usability testing
Low-fi Prototyping & Pilot Usability Testing
Tiffany Ong, Rushali Patel, Colin Dolese, Joseph Lim
WEEK 5: Low-Fi Prototyping & Pilot Usability Testing
Week 4 - Functional Prototype and Usability Testing
Presentation transcript:

Meet Meetings with a purpose.

Meet: The Team Derin D. Dartis W. Lorena H.L. Peter W. Engineering UX/UI PM Engineering

Tasks 1) Schedule a Meeting (Complex) Implemented before quarter. 2) Respond and Manage Meetings (Moderate) Implemented before quarter. 1) View Historical Meeting Data (Simple)

Prototype Change Replace hardcoded historical meeting data with actual data.

Methodology

User 1: Camilo Product Manager at Facebook Tested in dorm room Age: 23

User 2: Vanessa Undergraduate (Public Policy) Tested in dorm room Age: 21

User 3: Frank Graduate Student (ECE) Tested in dorm room Age: 26

User 4: John Professor of Computer Science Tested in his office Age: 61

Equipment Used Prototype was deployed on an iPhone 6 POV of tests recorded with smartphone camera iOS Video Logging with Quicktime Player

What We Looked For (Process Data) TASK 1: SCHEDULE MEETINGS o Can the user figure out navigating through the screens? o Are any of the input methods too complicated?

What We Looked For (Process Data) TASK 2: RESPOND TO MEETING REQUESTS o Can the user easily find the invitation requests? o Does the user know how to deal with the talking points?

What We Looked For (Process Data) TASK 3: VIEW HISTORICAL MEETING DATA o Can the user quickly understand the historical data? o Can the user navigate through the charts of various time granularities?

Procedure 1)Sign consent form in quiet room 2)Described the basic idea of Meet as well as the 3 tasks we are testing for. Users were then asked to perform the 3 tasks (without details about the specifics of the tasks). 1)While participant interacted with device, we recorded using both screen logger and an external camera (POV) 1)Compensation: BROWNIES

Test Measures (Bottom- Line Data) 1) NUMBER OF ERRORS / TASK 2) TIME TO COMPLETE EACH TASK Both measures tell us how intuitive the tasks are for a first-time user.

Results

Number of Errors ParticipantHard TaskMedium TaskEasy Task n/a Mean

Time to Complete (s) ParticipantHard TaskMedium TaskEasy Task n/a Mean

Create Meeting: Major Observations Initially had trouble figuring out how to navigate through screens (4/4) Pressing “back” took user to dashboard rather than actually going back (3/4) There were so many time options present that the user took longer to choose a time (3/4)

Create Meeting: Major Observations very confusing navigation – hard to find and swiping back exits the “funnel” user loses data when leaving page

Respond to Meeting: Major Observations Needed prompting to discover the meetings to respond to (1/3) Users were able to accept all of the meetings once “funneled” into the meeting response sequence (3/3)

Meeting Analytics: Major Observations Had trouble discovering the tabs for viewing different time granularities (3/3). One user did not ever discover the tabs Clear confusion about what the statistics on the analytics chart even meant (1/3) Users quickly identified the analytics screen (3/3)

Meeting Analytics: Major Observations changing chart granularity is difficult to see confusion about what the chart is actually showing

Discussion

For a Larger Study… Instead of telling the users to execute a broad task, we should give them more guided instructions. o e.g. “Create a new meeting on Sunday, inviting exactly 3 people, with 2 talking points, and…” This will provide more concrete bottom-line data.

On the Interface Side of Things… App cannot crash during study! o Perform extensive stress-testing of the app before the study. Provide more visual cues to guide the user when creating a meeting or joining a meeting. Provide more visual cues about how the user can interact with the historical data, including clear labels on the graphs.

Summary Conducted an in-lab usability pilot study of Meet. Discovered that there is a bit more implementation that is required of our app, especially in regards to ease of usability of current features (rather than on creating new features).