Hoelzl Gerold

Overview  Motivation  System design  Summary  Future work Hoelzl Gerold

Motivation Hoelzl Gerold

Motivation  During training (jogging) it is fun to listening to music  problem:  rhythm of the music ≠ rhythm of the runner music rhythm (bpm) running rhythm ≠ Hoelzl Gerold

Motivation  Idea  adaptive selection of music according to the running respectively the walking pace  additionally playing auditive status information like  heart rate  speed, distance  warnings if predefined limits are exceeded  … Hoelzl Gerold

System design Hoelzl Gerold

System design  3 tasks  movement analysis  audio analysis  mapping: movement music Hoelzl Gerold

System design  Movement analysis [Scholich M., 1978, S.93] acceleration maximum during heel- and toe ground contact g > 1,75 m/s² recognition of a footstep: phase 7: „front support phase“ phase 8,9: „rear support phase“ phase 7, 8,9 : „support phase“ [Larch R., 2001, S.3] Hoelzl Gerold

System design  Movement acceleration values extracted footsteps distance calculation -> d (i) [ms] d (0) d (1) d (2) d (3) d (4) Feature for classifying running rhythm defined as mean footsteptime (mft) Hoelzl Gerold

System design  Audio analysis  audio feature  beats per minute (bpm) (beat-tracking)  recognized as a binary regular pulse underlaying the music  separate calculation  too computational intensive on mobile devices  stored as metadata Hoelzl Gerold

System design  Mapping O [bpm] = F(M,f [mft] ) mapping function M = {m 1,…,m n }set of music pieces f [mft] feature O [bpm]  Mset of fitting music pieces O = F(M,f) mft [ms] feature f output O music pieces [bpm] Hoelzl Gerold

System design - Hardware Hoelzl Gerold

System design  Hardware  requirements(wearable-computing)  processing power, display, user input / output, sensing (sensors), energy  form, placement, weight, human movement, attachment, thermal issues, aesthetics  unobtrusiveness / unrestrictiveness  as small and light sensors as possible  wireless communication  running on a device the user takes with him anyway (mobile phone) Hoelzl Gerold

System design  Hardware  sensors  acceleration-sensor (movement analysis)  ECG-sensor (biofeedback)  GPS-sensor (speed, route, tracking)  communication technology  Bluetooth  controller  mobile phone (JavaME) Hoelzl Gerold

System design  Hardware (prototype)  acceleration-sensor Sparkfun WiTilt v3 3-axis acceleration sensor with integrated Bluetooth capabilities  ECG-sensor Polar Heart Rate Monitor Interface + AMB2300-EV-Bluetooth-Board  GPS-sensor (integrated in mobile phone) Hoelzl Gerold

System design - Software Hoelzl Gerold

System design  Software design Sensor- Controller ECG Sensor Acceleration Sensor GPS Sensor Controller- View Audioplayer Feature- calculation Mapping mft bpm Actors (pulse, speed,..) Hoelzl Gerold

System design  Software  JavaME  API´s  JSR 82: Bluetooth  JSR 179:Location (GPS)  JSR 135:Media (Audio, Video)  SonyEricsson JP8  current JavaME platform implementation Hoelzl Gerold

Summary & Future work Hoelzl Gerold

Summary  adaptive selection of music according to the running- respectively the walking pace  additionally playing auditive status information like  heart rate  speed, distance  warning if predefined limits are exceeded  … Hoelzl Gerold

Summary  Experimental results  prototype showed high accuracy and stability in both laboratory and naturalistic environments  short response time giving realtime “feeling” (~50 ms )  Unexpected:  crash of Bluetooth connections when built in GPS sensor was used Hoelzl Gerold

Summary  mapping function  difficult to define one function for many users  music rhythm / speed is perceived very subjective  learning „on the fly“ Hoelzl Gerold

Summary  integrated sensors  usage possible (less components)  but restriction of device usage likely (e.g. fixed position of acceleration sensor for movement analysis) Hoelzl Gerold

Future work  support training programs in adaptively selecting forcing / retaining music  pushing music if beneath a defined limit  assuasive music if above a defined limit Hoelzl Gerold

Future work  tracking with status information (using remote computer)  „control sportsman“  competitions (without borders) Hoelzl Gerold

Questions? Hoelzl Gerold