Presentation is loading. Please wait.

Presentation is loading. Please wait.

EyePhone: Activating Mobile Phones With Your Eyes Emiliano Miluzzo, Tianyu Wang, Andrew T. Campbell CS Department – Dartmouth College, Hanover, NH, USA.

Similar presentations


Presentation on theme: "EyePhone: Activating Mobile Phones With Your Eyes Emiliano Miluzzo, Tianyu Wang, Andrew T. Campbell CS Department – Dartmouth College, Hanover, NH, USA."— Presentation transcript:

1 EyePhone: Activating Mobile Phones With Your Eyes Emiliano Miluzzo, Tianyu Wang, Andrew T. Campbell CS Department – Dartmouth College, Hanover, NH, USA

2 Miluzzo what is the future of sensing?

3 Miluzzo mobile phone sensing

4 Miluzzo mobile phone sensing

5 Miluzzo mobile phone sensing computationally capable (up to 2GHz CPU and 1 GB RAM)

6 Miluzzo accelerometer digital compass microphone WiFi/bluetooth GPS light sensor/camera gyroscope air quality / pollution sensor mobile phone sensing ….

7 Miluzzo accelerometer digital compass microphone WiFi/bluetooth GPS light sensor/camera gyroscope air quality / pollution sensor mobile phone sensing …. light sensor/camera

8 Miluzzo accelerometer digital compass microphone WiFi/bluetooth GPS light sensor/camera gyroscope air quality / pollution sensor mobile phone sensing …. light sensor/camera camera

9 Miluzzo front facing camera

10 Miluzzo how can we use it?

11 Miluzzo emotion assessment

12 Miluzzo emotion assessment in-car safety

13 Miluzzo emotion assessment human-phone interaction in-car safety

14 Miluzzo why HPI?

15 Miluzzo human-computer interaction - HCI because…

16 Miluzzo human-computer interaction - HCI human-phone interaction - HPI because…

17 Miluzzo human-computer interaction - HCI human-phone interaction - HPI because…

18 Miluzzo fairly ideal conditions for sensing array of sophisticated sensors subjects mostly static “sensing context” fairly constant subjects are on the move (video frames are blurred) limited sensing capabilities not ideal sensing context (dark, bright, etc.) hardware limitations HPIHCI

19 Miluzzo EyePhone

20 Miluzzo

21 Miluzzo mapping the position of the eye to an application icon on the phone display

22 Miluzzo mapping the position of the eye to an application icon on the phone display

23 Miluzzo mapping the position of the eye to an application icon on the phone display

24 Miluzzo the selected application (e.g., music) is activated with a wink

25 Miluzzo the selected application (e.g., music) is activated with a wink

26 Miluzzo EyePhone design

27 Miluzzo eye template creation

28 Miluzzo eye template creation offline for different environments

29 Miluzzo eye template creation offline for different environments image differencing over a set of frames capturing a blink. The result is a binary image with the eye pair

30 Miluzzo eye template creation offline for different environments image differencing over a set of frames capturing a blink. The result is a binary image with the eye pair running on pcrunning on the N810

31 Miluzzo eye template creation offline for different environments image differencing over a set of frames capturing a blink. The result is a binary image with the eye pair eye tracking

32 Miluzzo eye template creation offline for different environments image differencing over a set of frames capturing a blink. The result is a binary image with the eye pair eye tracking on every frame

33 Miluzzo eye template creation offline for different environments image differencing over a set of frames capturing a blink. The result is a binary image with the eye pair eye tracking based on a correlation function operating over the current frame and the template on every frame

34 Miluzzo eye template creation offline for different environments image differencing over a set of frames capturing a blink. The result is a binary image with the eye pair eye tracking based on a correlation function operating over the current frame and the template on every frame

35 Miluzzo eye template creation offline for different environments image differencing over a set of frames capturing a blink. The result is a binary image with the eye pair eye tracking based on a correlation function operating over the current frame and the template on every frame wink detection

36 Miluzzo eye template creation offline for different environments image differencing over a set of frames capturing a blink. The result is a binary image with the eye pair eye tracking based on a correlation function operating over the current frame and the template on every frame wink detection based on the correlation function values used in the tracking phase

37 Miluzzo evaluation

38 Miluzzo C++ & OpenCV implemented on the Nokia Tablet 810

39 Miluzzo experimental results

40 Miluzzo accuracy steady, daylight

41 Miluzzo accuracy walking, daylight

42 Miluzzo accuracy Vs distance from display

43 Miluzzo accuracy Vs distance from display

44 Miluzzo possible applications?

45 Miluzzo beyond touch screen…

46 Miluzzo let’s recap…

47 Miluzzo let’s recap… smartphone’s computation capabilities are growing

48 Miluzzo let’s recap… smartphone’s computation capabilities are growing smarter open-eye template creation policies are needed (to be robust across different context) smarter open-eye template creation policies are needed (to be robust across different context)

49 Miluzzo let’s recap… smartphone’s computation capabilities are growing smarter open-eye template creation policies are needed (to be robust across different context) smarter open-eye template creation policies are needed (to be robust across different context) need for eye tracking techniques that are robust against context, mobility, distance from display

50 Miluzzo let’s recap… smartphone’s computation capabilities are growing smarter open-eye template creation policies are needed (to be robust across different context) smarter open-eye template creation policies are needed (to be robust across different context) need for eye tracking techniques that are robust against context, mobility, distance from display more efficient false eye pair and “false” winks filtering to avoid undesired app launches

51 Miluzzo in brief…

52 Miluzzo in brief… mobile phone sensing and HPI technology are the future!

53 Thank you! Miluzzo Mobile Sensing Group


Download ppt "EyePhone: Activating Mobile Phones With Your Eyes Emiliano Miluzzo, Tianyu Wang, Andrew T. Campbell CS Department – Dartmouth College, Hanover, NH, USA."

Similar presentations


Ads by Google