1. IEEM 552 - Human-Computer Systems Dr. Vincent Duffy - IEEM Week 13 - Working in Groups May 4, 1999 http://www- ieem.ust.hk/dfaculty/duffy/552 email: vduffy@ust.hk

2. tonight n recall Visual C++ demo u presentations 5 - 10 minutes n video u Electronic meeting room at GM n QOTD u questions related to ‘Working in Groups’ n after break u arrange subject testing schedule F let me know if there is a problem with your scheduled time

3. Last papers for reading/presentation u No papers presented in week 13 u Week 14 - delayed presentation by 1 week F Read paper by Chi, C.F. and Lin, F.T., 1998 F ‘A comparison of seven visual fatigue assessment techniques in three data acquisition VDT tasks’, Human Factors, Vol. 40, no.4, 577-590. 35

4. In the coming weeks n wk13 4 may - present Visual C++ modifications u read ‘usability testing’ & ‘working in groups’ on reserves, u lecture on ‘working in groups’ & video u schedule participation as subject (#2), W5,F7,S8,M10, T11 n wk14 11 may - Review u read final paper, project rept. due u discuss take home exam question 10 points F related to your participation as subject (#2) & ‘software evaluation’ F you will get to try some analyses related to that data n xxx no meeting wk 15,18 may - no presentations n wk16 25 may -final exam - rm2302 6:45-9:30 36

5. small software development project and ‘thinking aloud evaluation n As a group member you will participate in u software development u ‘thinking aloud’ evaluation, analysis u using minimum of 2 subjects (15 minutes) u software modification/improvement u presentation of before/after interface F 4-5 minutes …during week 13. u report …due during week 14 F 1 -2 page summary, 1 page figures screen captures 31

6. report format n 1-2 page written u describe in bullet format F process, what helped? F what did you need to be careful of? F what were the main improvements made F who were the subjects in your study u presentation F during class in week l3, Apr. 5 u report F during class in week 14, May. 12 F please include your slides from the presentation in an appendix

7. n based on video and discussion tonight u see HBS case study - not required reading F (11 pages) u ‘The Center for Machine Intelligence: Computer Support for Cooperative Work’ (on images reserve) u p.499-513 from the book by Alan Dix called ‘Human-Computer Interaction’ (on images reserve) u QOTR need not be submitted

8. Group work - in electronic forum n group dynamics- roles and relationships within a group may change dramatically within the time of the task n physical layout - advantage of where to sit, etc. is leveled, particularly when the screen can be controlled from any terminal n experimental studies - can be of two types u discover how to gain acceptance of the technology u compare systems to find impact on effectiveness

9. Experimental studies of groups n more difficult than for individuals u differences in groups are more extreme than those of individuals u subjects? F for individual, 10 experiments means 10 subjects F for group, 10 experiments of group size 3 requires 30 F additional time needed to get familiar with others F more disruption, coordination, and expense F many reports of group work include only 3 or 4 groups F task - choosing a suitable task is difficult as well

10. n analysis - if you test multiple conditions, your number of groups and subjects increases dramatically to have any chance of getting statistical significance n for example u if you want to measure the difference between two sets of groups in ‘microsoft net meeting’ F with 3 individuals in a group F to see performance in ‘chat only’ and ‘audio’ conditions F minimium of 5 teams in each condition u you would need 30 subjects (as noted earlier). F if you add any other conditions, you would add many subjects to the experiment

11. Organizational issues of group work n critical mass u need a certain number of users to gain the benefits of the system u for example think of the telephone. if your friends don’t have one, the benefit is limited. n conflicting goals u (CSCW) cooperative work? u people in organizations have conflicting goals u the electronic system must consider these realities

12. video n Center for Machine Intelligence - General Motors

13. while viewing: Consider for discussion n 1. What are the benefits of the system in this work environment? n 2. What problems were encountered? (what are the limitations?) n 3. How is this system used? n 4. Who are the stakeholders that are affected by the system? n 5. How did they judge if the system was effective?

14. n 1. What are the benefits of the system in this work environment? F sometimes encourage and sometimes discourage consensus F helped see areas of agreement and uncovered areas of strong disagreement, F find the holes in the process n 2. What problems were encountered? (what are the limitations?) F who should pay? F how to determine if benefit/cost justified? n 3. How is this system used? F determine if vehicle architecture meets objectives F include cross-functional views- techn. and h.r.m.

15. n 4. Who are the stakeholders that are affected by the system? F engineering, manufacturing, financial F each has own independent operations but common objective - satisfy customers n 5. How did they judge if the system was effective? F note the relationships between technology and culture F time to complete task improved

16. QOTD n 1. What would be the benefits of a system of this type in your work environment? n 2. What problems would be encountered? (what are the limitations? n 3. How would this system be used, or how should this system be modified if it were to be used in your workplace? n 4. Who are the stakeholders that would be affected? n 5. How would you know if the system were effective?

17. n 1. What would be the benefits of a system of this type in your work environment? n 2. What problems would be encountered? (what are the limitations? n 3. How would this system be used, or how should this system be modified if it were to be used in your workplace?

18. n 4. Who are the stakeholders that would be affected? n 5. How would you know if the system were effective?