1. Information about all the ULABs left
Part B – 20 pts due 10/30
Part C – 20 pts due 11/9
ULAB presentation – 25 pts due 11/16
Ulab

2. Part B – 20 pts during 10/20 class time or equivalent
You may want to meet in the computer lab so that each of you has a computer to do the evaluation.
Make sure all team members have brought a copy of their Web D evaluation sheet. If any member did not bring their web D evaluation sheet – cancel meeting and reschedule.
One of the members needs to be the Scribe (secretary) for this meeting. Name: __________
List the Ulab member by last name (alphabetical order) and Mark their Eval as “XD1, XD2, XD3, XD4, etc. (where X is your ULAB team number)
Ulab

3. 4. Give the Web D evaluation sheets to each member using the alphabetical order (round robin). {If team is Badre, Johnson, Sawler, Quin. The Badre’s goes to Johnson, Johnson’s goes to Sawler, etc) 5. Separate, go to a quiet place and do the evaluation sheet while recording all the sheet asks you to record. If you want to make other notes – please do so. 6. Come back together and discuss the findings. The scribe should take notes of the discussion. 7. Decide on the top three and edit those evaluations as team. These three evals will be given to another team on Tuesday Nov. 1 so they need to be edited till perfect… Hand into Ulab assignment folder by 10/23 10/30
Ulab

4. Notes from Class on 10/13
Ulab

5. Ulab Part C – Evaluation testing of the three sites given by other ULAB Team
Preparation of ULAB EVAL part C
Before Tuesday, Nov 1 – decide and state the roles of your team members:
One Breifer/Debriefer for each eval
One User for each eval
Rest of members are Loggers for each eval
B/D responsibilities
Read, practice, and if necessary, edit the eval you will lead
Loggers responsibilities
Decide on the metrics you will uncover to assess the design stance of the site. Document this with justifications.
Users Responsibilities
Practice the “think out loud” method by documenting your Web D site task 2 again.
Ulab

6. On Tuesday, Nov 1
your ULAB team will be given 3 Evals to perform on their design stance.
Need:
Day/Time, members present, setting, environment & location
To start each of the Evals – need:
Demographics of the User
Validation that your have a “True User” - Assurance that you have representative users. 
Let’s look at an example of the start of an eval:
Ulab

7. Thanks for coming to help us evaluate this web site.
Did you have any problems finding our location?
Please tell us the following:
Your age ____
Profession _______________
Amount of free time per week ________
Have you played the game “Reversi” or “Othello”? Yes No
Do you like to play games? Yes No
If yes, Go to the next page.
__________________________
If no, please answer:
5. Would you play a game when you had free time. Yes No
If no, Thanks for you time! Here is your $50 payment.
Ulab

8. Eval Scenario
You are a person that likes to play games when you have free time.
You have lots of free time today. Is this true right now?______________
A friend has given you the URL for a fun game. me/reversi/
You decide to try it out on the computer..
Remember to think out loud
Ulab

9. Task 1- Tell us what you see.
You have found the online Reversi game site and have decided to get started to be able play computer opponent. Do this now but don’t start playing yet. Please remember to think out loud.
Please speak out loud the following information:
What do you see? Give your initial reactions and comments about what you see.
What will you do? Give your thoughts about what you will do. Can you explain why you will do your first action and exactly how will you do the action (give all movements, key strokes, etc.)
When you have explain all that you see and what will you do and why will you do what you decided on, you have completed Task 1 - please raise your hand.
Ulab

10. Examples of Data Gathered in each TASK
Recorded Time started
Facial Expressions -
Initial reactions-
 Comments
Items clicked on the interface:
Positive reactions:
Negative reactions:
Time Ended for task (raised hand).
Ulab

11. Task 2 – play your first move
At this time we would like you to play your first move of the game. Please remember to think out loud.
Slowly do your first move and give us everything that you see and hear.
What do you see after the first move?
What will you do for your second move? Give your thoughts about what you will do.
Can you explain why you will do your second action and exactly how will you do the action (give all movements, key strokes, etc.)
When you have explain all that you see and what will you do and why will you do what you decided on, you have completed Task 2 - please raise your hand.
Ulab

12. Task 3 – play your second move
At this time we would like you to play your second move of the game. Please remember to think out loud.
Slowly do your second move and give us everything that you see and hear.
What do you see after the second move?
What will you do for your third move? Give your thoughts about what you will do.
Are you winning the game?
When you have explain all that you see and what will you do and why will you do what you decided on, you have completed Task 3 - please raise your hand.
Ulab

13. Task 4 – This is your last task. Please remember to think out loud
Take a few minutes to look at the game. Please remember to think out loud. Tell us:
What do you think of the game?
Describe what you see.
What can you do in the game? You can do any movements to discover the game. (Tell us your thoughts as you explore)
What would you do to find help for the game?
Do you see anything that would be your score?
Please give us any other comments you have about what you see.
When you feel you have given us all your impressions, you have completed Task 4 - please raise your hand.
Ulab

14. Final Questionnaire Did you enjoy yourself? What was the hardest?
What was the easiest?
What needs to improve?
Any other comments you would like to give us?
Ulab

15. Ulab Part C is due Wednesday, 11/9 in D2L
Each Breifer/Debriefer hands into D2L a separate file of the documentation for their eval with the data, metrics, results, etc..
Ulab

16. Ulab Presentation – 25 pts – due Wednesday, 11/16
The last member who was not a B/D will be the presenter of the evaluations in the “Ulab Presentation” for 25 pts. If all team members were B/D – then the Ulab presentation is done by each of you.
The presentation is a Utube recording with all team members in attendance. The presenter discusses the design stance found by each user. Team members interject a final comment on each eval.
Please submit the URL of the recording in D2L. Make sure that the recording is not private so that I can view.
Ulab