Whole Body Interaction Workshop HCI2008 September 1 st, 2008

2 AGENDA Presentations Coffee in room 322/ Presentations Lunch in room 322/ Discussion Coffee in room 322/ Discussion/Ways Forward

3 AGENDA Presentations –15 minutes –No time limit for discussions Discussion 1 –Towards Everyday WBI Discussion 2 –Ways forward –Research Agenda –ITN ?

4 Whole Body Interaction Developments –Improved and Marker-less motion capture Stanford –Advanced Interaction frameworks Jacob CHI2008 –Experiments by artists Nimoy, Rokeby, Botto –Bio-cybernetics and Biomechanics Understanding of patterns/gestures of movement Understand of human capabilities/limitations –And … ?

5 LJMU HCI Fun project

6 LJMU.

7

8 Some Initial Questions What would be the criteria for a useful and successful framework for addressing the research questions of Whole Body Interaction? What are some of the basic lessons that can be learned from previous attempts to framework the topic? Can we come up with a set of concepts and a terminology to support interdisciplinary design, analysis and evaluation?

9 Questions The mappings of the bodies’ movement to the system’s interpretation of that movement; were movements required physically possible. Does the system only expect normal movements – what of abnormal, exaggerated or other out of range movements? What is the users’ understanding and comprehension of the mappings and metaphors of their movement to system reaction? Could the user and system mutually adapt or would users be forced to adapt their body movements?

10 Questions What is the scope of whole body interaction and body as a data source for –Physical Presence/Cartesian Space – posture, movement, location, orientation –Physiological – Heart rate, breathe volume and rate, skin resistance as both data and control –Human senses – taste, smell, kinesthetic, vision, speech/sound, balance and the possibilities for synaesthesia between two or more senses.

11 Discussions Towards an everyday Whole Body Interaction –As ubiquitous as mouse & keyboard – How? Ways forward –Research agenda –Special Issue –CHI2009 Workshop (submitted) –FP7 Activities COST, ITN

Limitations/Constraints as source of creativity –Lessons, work-arounds Attending to the display vs inattentive interaction Underlying physical/human models Precision, drift Multiple people – occlusion, model deformation 12

Non-standing interaction –Feet as reference point MoCap infrastructure vs. in the field Micro-computers, SunSpots etc – in the field devices Experience of embodied interaction –Analysis software, filters How to study – lessons from sports science, biomechanics etc 13

Vs – Emotional, subjective Quality, coordination of movement and experience – value judgement rather than motion analysis Contexts, maths models, environment, goals (if any) – complex framework Interactions, awareness of others 14

Albrecht Schmidt Essen Eva Hornecker – Strathclyde Externals Paul Dourish Eindhoven ?? European Network – Body Movement France, Cog. Sci Benoit Bardy Montepellier Euro Centre for movement science 15

FP7 priorities and themes Does games fit? Games as a Lab environment Engaging Limited data, best fit – parameters Model/Middleware <- embodiment, biomechanics Cog Sci, 16

Re-Representing data to users –End user programming –Adaptation –Context –Mutual emergent understanding –User tools Open source micro-platforms Standards, platforms and API’s, and data 17

Forms of data Cross over from theory to practical use – e.g. Space theory Application drive? –Geospatial –Medical –Games –Security Existing areas augmented by WBI 18

Negative – Privacy, tracking, ethics ivilliberties.privacyhttp:// ivilliberties.privacy 64.stmhttp://news.bbc.co.uk/1/hi/magazine/ stm Interventions Embodied education –Achievement, pre-verbal, imitation Limits of gesture recognition 19

Embodied knowledge, intelligence –Teaching other knowledge – words etc 20