1. Hoelzl Gerold

2. Overview  Motivation  System design  Summary  Future work 17.09.2015 2 Hoelzl Gerold

3. Motivation 17.09.2015 3 Hoelzl Gerold

4. Motivation  During training (jogging) it is fun to listening to music  problem:  rhythm of the music ≠ rhythm of the runner 17.09.2015 4 music rhythm (bpm) running rhythm ≠ Hoelzl Gerold

5. Motivation  Idea  adaptive selection of music according to the running respectively the walking pace  additionally playing auditive status information like  heart rate  speed, distance  warnings if predefined limits are exceeded  … 17.09.2015 5 Hoelzl Gerold

6. System design 17.09.2015 6 Hoelzl Gerold

7. System design  3 tasks  movement analysis  audio analysis  mapping: movement music 17.09.2015 7 Hoelzl Gerold

8. System design  Movement analysis 17.09.2015 8 [Scholich M., 1978, S.93] acceleration maximum during heel- and toe ground contact g > 1,75 m/s² recognition of a footstep: phase 7: „front support phase“ phase 8,9: „rear support phase“ phase 7, 8,9 : „support phase“ [Larch R., 2001, S.3] Hoelzl Gerold

9. System design  Movement acceleration values extracted footsteps distance calculation -> d (i) [ms] 17.09.2015 9 d (0) d (1) d (2) d (3) d (4) Feature for classifying running rhythm defined as mean footsteptime (mft) Hoelzl Gerold

10. System design  Audio analysis  audio feature  beats per minute (bpm) (beat-tracking)  recognized as a binary regular pulse underlaying the music  separate calculation  too computational intensive on mobile devices  stored as metadata 17.09.2015 10 Hoelzl Gerold

11. System design  Mapping O [bpm] = F(M,f [mft] ) mapping function M = {m 1,…,m n }set of music pieces f [mft] feature O [bpm]  Mset of fitting music pieces 17.09.2015 11 O = F(M,f) mft [ms] feature f output O music pieces [bpm] Hoelzl Gerold

12. System design - Hardware 17.09.2015 12 Hoelzl Gerold

13. System design  Hardware  requirements(wearable-computing)  processing power, display, user input / output, sensing (sensors), energy  form, placement, weight, human movement, attachment, thermal issues, aesthetics  unobtrusiveness / unrestrictiveness  as small and light sensors as possible  wireless communication  running on a device the user takes with him anyway (mobile phone) 17.09.2015 13 Hoelzl Gerold

14. System design  Hardware  sensors  acceleration-sensor (movement analysis)  ECG-sensor (biofeedback)  GPS-sensor (speed, route, tracking)  communication technology  Bluetooth  controller  mobile phone (JavaME) 17.09.2015 14 Hoelzl Gerold

15. System design  Hardware (prototype)  acceleration-sensor Sparkfun WiTilt v3 3-axis acceleration sensor with integrated Bluetooth capabilities  ECG-sensor Polar Heart Rate Monitor Interface + AMB2300-EV-Bluetooth-Board  GPS-sensor (integrated in mobile phone) 17.09.2015 15 Hoelzl Gerold

16. System design - Software 17.09.2015 16 Hoelzl Gerold

17. System design  Software design 17.09.2015 17 Sensor- Controller ECG Sensor Acceleration Sensor GPS Sensor Controller- View Audioplayer Feature- calculation Mapping mft bpm Actors (pulse, speed,..) Hoelzl Gerold

18. System design  Software  JavaME  API´s  JSR 82: Bluetooth  JSR 179:Location (GPS)  JSR 135:Media (Audio, Video)  SonyEricsson JP8  current JavaME platform implementation 17.09.2015 18 Hoelzl Gerold

19. Summary & Future work 17.09.2015 19 Hoelzl Gerold

20. Summary  adaptive selection of music according to the running- respectively the walking pace  additionally playing auditive status information like  heart rate  speed, distance  warning if predefined limits are exceeded  … 17.09.2015 20 Hoelzl Gerold

21. Summary  Experimental results  prototype showed high accuracy and stability in both laboratory and naturalistic environments  short response time giving realtime “feeling” (~50 ms )  Unexpected:  crash of Bluetooth connections when built in GPS sensor was used 17.09.2015 21 Hoelzl Gerold

22. Summary  mapping function  difficult to define one function for many users  music rhythm / speed is perceived very subjective  learning „on the fly“ 17.09.2015 22 Hoelzl Gerold

23. Summary  integrated sensors  usage possible (less components)  but restriction of device usage likely (e.g. fixed position of acceleration sensor for movement analysis) 17.09.2015 23 Hoelzl Gerold

24. Future work  support training programs in adaptively selecting forcing / retaining music  pushing music if beneath a defined limit  assuasive music if above a defined limit 17.09.2015 24 Hoelzl Gerold

25. Future work  tracking with status information (using remote computer)  „control sportsman“  competitions (without borders) 17.09.2015 25 Hoelzl Gerold

26. Questions? 17.09.2015 26 Hoelzl Gerold