1. SFnight SFnight 213 project Overview Special Challenges Heuristic Evaluation Results of the Pilot Study Formal Usability Study Demo of Current Design Last prototype Summary UC BERKELEY SIMS IS 213 MAY 2001 1: 17 BIN XIN + ROSA REN + HONG CAI + MONICA FERNANDES our agenda ?

2. Overview  The 213 design team focus The customization aspects of SFnight for nightlife consumers.  Solutions 1. List to store venues/events & can be emailed 2. Generic Newsletter 3. Customized Newsletter 4. Customized area in home page 5. MySFnight page - recommended calendar - user’s own calendar - user’s venue and event selections UC BERKELEY SIMS IS 213 MAY 2001 2: 17 BIN XIN + ROSA REN + HONG CAI + MONICA FERNANDES

3. Special Challenges 1.Schedule Coordination 213 project and the SFnight Final Project schedules do not always match 2.Version control: Low-fi prototype = Old SFnight prototype simplified Heuristic = 213 + SFnight old pages + other mockup pages Usability = the full integration of 213 + Final project 3.Implementation: Site-wise integration necessary, most 213 members not familiar enough to be able to help efficiently UC BERKELEY SIMS IS 213 MAY 2001 3: 17 BIN XIN + ROSA REN + HONG CAI + MONICA FERNANDES

4. Heuristic Evaluation I 1.BESS / BookMarket Team Great feedback and comments - Many thanks! 2.Issues addressed: - Registration - Email list - MySFnight Page 3.Issues not addressed: - parts not relevant to 213 part (search page) - Inconsistencies due to version control problems - Areas to be developed later: Help & Documentation 1 st Interactive Prototype Used for Heuristic Evaluation UC BERKELEY SIMS IS 213 MAY 2001 4: 17 BIN XIN + ROSA REN + HONG CAI + MONICA FERNANDES

5. Heuristic Evaluation II Registration  Language issues (“light weight”?)  No Cancel button  ‘Thank you” shown before process is complete  Inappropriate use of check boxes (O.D’d designer)  Not enough feedback after finishing MySFnight Sign Up E-mail, MyList, thing?  Button labels did not accurately communicate their functions  Location of buttons confusing  Text field too small for multiple email addresses + no explanation  Accomplishing different tasks by using one check box for each item is too confusing UC BERKELEY SIMS IS 213 MAY 2001 5: 17 BIN XIN + ROSA REN + HONG CAI + MONICA FERNANDES

6. Heuristic Evaluation III MySFnight  Not a very straightforward calendar  The design/purpose of two calendars were not clear enough  Ambiguous button usage UC BERKELEY SIMS IS 213 MAY 2001 6: 17 BIN XIN + ROSA REN + HONG CAI + MONICA FERNANDES Thanks again BESS/Book Market Team for your patience! Special thanks to Chan Jean also for evaluating SFnight.

7. UC BERKELEY SIMS IS 213 MAY 2001 7: 17 BIN XIN + ROSA REN + HONG CAI + MONICA FERNANDES Pilot Usability Study The Test  1 hour each session  Three tasks: send options, sign up, use MySFnight  Post task and post test questionnaires Participants  closely resembled our personas  3 males: 1 is 25-30, 2 are 30-35  professionals  lots of internet experience  enjoy going out at night

8. Registration  Sign-up entrances (3) were not obvious  Users want a page to confirm registration, instead of going to MySfnight General results Results of the Usability Testing I UC BERKELEY SIMS IS 213 MAY 2001 8: 17 BIN XIN + ROSA REN + HONG CAI + MONICA FERNANDES Did you say E-mail, My List, thing?  Still fighting with terminology: add + list + send + email  One wants more information to send: directions  Storing of addresses: since there would be some drawbacks, we have analyzed this before

9. Results of the Usability Testing II MySFnight  The first time a user sees the MySFnight page, the d istinction of the two calendars is not clear. Only after some manipulation do users feel more comfortable with the interface  Need to address calendar monthly view and be able to see beyond four weeks.  MySFnight top button, be more like a button  Need to indicate when the minimized Editor’s Picks has events General results UC BERKELEY SIMS IS 213 MAY 2001 9: 17 BIN XIN + ROSA REN + HONG CAI + MONICA FERNANDES

10. Formal Usability Study I Purpose How can our design accommodate different cognitive styles: visual v.s. text Independent variables - The Current MySFnight calendar (more visual-oriented) and a new text-oriented MySFnight calendar - Two groups of users with different cognitive style Hypothesis - Either Users will be more comfortable with the design that is geared towards their cognitive style - Or The two-calendar design is confusing regardless of whether the style is visual or text oriented UC BERKELEY SIMS IS 213 MAY 2001 10: 17 BIN XIN + ROSA REN + HONG CAI + MONICA FERNANDES

11. Formal Usability Study II Methods - Determine cognitive styles of users (30 ea. group) - Between subject design: each user only test one design Dependent variable - Readability of the information [what is] - The manipulation of information objects [how to, affordance] - Information organization [intuitive location] - Information usefulness [help accomplish goals/satisfy needs] Measures - Time to complete various tasks - Satisfaction questionnaire [post task, post test] - Log indicating wrong clicks and style [ergoBrowser] - Observation UC BERKELEY SIMS IS 213 MAY 2001 11: 17 BIN XIN + ROSA REN + HONG CAI + MONICA FERNANDES

12. Formal Usability Study III control sources of variance:  randomization of tasks: to statistically equalize the learning effect.  elimination of secondary sources of variance, such as choosing users who have no previous experience with the interfaces to reduce familiarity with the test site  statistic control: related to experience in using the Internet, nightlife events, and their cognitive style. UC BERKELEY SIMS IS 213 MAY 2001 12: 17 BIN XIN + ROSA REN + HONG CAI + MONICA FERNANDES

13. " MySFnight " UC BERKELEY SIMS IS 213 MAY 2001 13: 17 BIN XIN + ROSA REN + HONG CAI + MONICA FERNANDES

14. Current Design  The First Interactive Prototype were static pages  The Third Interactive Prototype (current design) the pages are generated dynamically, using information from a database: perl/cgi scripts  Several designed changes were implemented and is on going Demo UC BERKELEY SIMS IS 213 MAY 2001 14: 17 BIN XIN + ROSA REN + HONG CAI + MONICA FERNANDES

15. Registration  At the homepage, creating clearer text for Sign Up  Become more clear the benefits of signing up  Create a new feedback page E-mail, My List, thing  Change the name  Improve form MySFnight  Improve the button  Better differentiation between the calendars  Mock up of the month calendar (if time permits) Plans for the Last Interactive Prototype UC BERKELEY SIMS IS 213 MAY 2001 15: 17 BIN XIN + ROSA REN + HONG CAI + MONICA FERNANDES

16. Summary  More usability testing in the future  A specific study of calendar presentations, and better address the manipulation of these kind of data  Find a better way of providing version control UC BERKELEY SIMS IS 213 MAY 2001 16: 17 BIN XIN + ROSA REN + HONG CAI + MONICA FERNANDES

17. Questions ? Thank you UC BERKELEY SIMS IS 213 MAY 2001 17: 17 BIN XIN + ROSA REN + HONG CAI + MONICA FERNANDES