1. September 21 st, 2001Darren Gergle Visualizing Non-Verbal Behavior in Small Group Interactions ‘how to make friends without speaking’

2. September 21 st, 2001Darren Gergle Overview Address the modeling and sensing aspects of situationally appropriate systems Focus on small group interactions Meeting room behavior Small group public spaces Provide insight for automating sensing and modeling

3. September 21 st, 2001Darren Gergle Project Goals Develop and produce a high-level description of meeting group interactions Produce data visualizations that may be used to inform modeling and sensing

4. September 21 st, 2001Darren Gergle Project Proposal Stage 1: literature review and development of coding / notational description system Stage 2: collect data and create metadata descriptions using coding system Stage 3: produce visualizations of data to further understand potential utility of captured sensor data

5. September 21 st, 2001Darren Gergle Stage 1 Literature review to uncover list of target behaviors Develop notational coding system of chosen behaviors

6. September 21 st, 2001Darren Gergle What To Look For? Types of data –Non-verbal behavioral data Spatial orientation Spatial activity –Auditory cues (see Foote, Boreczsky & Wilcox, 1999) Localization Duration Level Levels of granularity –Event data Transitional events Indicator events (e.g., handshakes) –Sequential event data –Large scale temporal data

7. September 21 st, 2001Darren Gergle Example Events Interacting groups form structural arrangements in space (event – group formation) Handshakes may signify beginning of meeting

8. September 21 st, 2001Darren Gergle Example Sequential Event Sequential Events During group discussions, short glances of > 30 degrees occur. However, sustained glances of > 30 degrees usually lead to reorientation of entire body (Kendon, 1990)

9. September 21 st, 2001Darren Gergle Group Spatial Arrangements

10. September 21 st, 2001Darren Gergle Example Large Scale Temporal Patterns Traffic Patterns –Gather data on traffic patterns Rythmic Auditory Patterns –Examine patterns of vocal interaction over time (e.g., speaker1-speaker2-speaker3, vs. speaker1-speaker1-speaker1…)

11. September 21 st, 2001Darren Gergle Sample Concepts for Coding Scheme Individual Head Frw, L, R Body (N, NE, E, SE, S, SW, W, NW) Group Spatial Formations F-Form O-Form Auditory Actor i speaking Global activity Rhythm (Erickson, 1991) Traffic Patterns Activity level Path frequency

12. September 21 st, 2001Darren Gergle Stage 2 Collect data Review videos and code data

13. September 21 st, 2001Darren Gergle Collecting The Data Outfitted meeting room –Localized ceiling mic’s –Wide angle camera on the ceiling –2 to 3 wall-mounted or tripod digital video recorders Alternatively, use pre-recorded meetings as source data

14. September 21 st, 2001Darren Gergle Stage 3 Develop visualization of these data Allow users to explore visualizations and gather information regarding human perception of patterns Use this user data to facilitate formation of models

15. September 21 st, 2001Darren Gergle The Group Visualizer

16. September 21 st, 2001Darren Gergle Questions?