Presentation is loading. Please wait.

Presentation is loading. Please wait.

1 1 Date HealthCare Monitoring: GERHOME Project Monique Thonnat, Francois Bremond & Nadia Zouba PULSAR, INRIA.

Similar presentations


Presentation on theme: "1 1 Date HealthCare Monitoring: GERHOME Project Monique Thonnat, Francois Bremond & Nadia Zouba PULSAR, INRIA."— Presentation transcript:

1 1 1 Date HealthCare Monitoring: GERHOME Project Monique Thonnat, Francois Bremond & Nadia Zouba PULSAR, INRIA

2 2 2 Approach for video analysis Alarms Detection Classification Tracking & posture detection Activity Recognition A person is in the kitchen

3 3 3 Gerhome laboratory (CSTB, PULSAR) –GERHOME (Gerontology at Home) : homecare laboratory –Experimental site in CSTB (Centre Scientifique et Technique de Bâtiment) at Sophia Antipolis

4 4 4 Position of the sensors in Gerhome laboratory

5 5 5 Sensors in Gerhome laboratory Video cameras: installed in the kitchen and in the living-room used to detect and track a mobile objects (mostly people) evolving in the scene. Video cameras: installed in the kitchen and in the living-room used to detect and track a mobile objects (mostly people) evolving in the scene. Environmental sensors: used to collect information about the interactions with the objects in the environment: Environmental sensors: used to collect information about the interactions with the objects in the environment: Contact sensors: installed on different locations, they detect usage for doors, cupboards, drawers, fridge, … Contact sensors: installed on different locations, they detect usage for doors, cupboards, drawers, fridge, … Usage sensors: installed into an electrical outlets with the appliance plugging directly to the sensor, they detect whether an appliance is on or off (e.g. microwave). Usage sensors: installed into an electrical outlets with the appliance plugging directly to the sensor, they detect whether an appliance is on or off (e.g. microwave). Presence sensors: installed in front of sink and cooking stove to detect the Presence sensors: installed in front of sink and cooking stove to detect the presence of people near sink and stove. Water sensors: to detect the use of a water in the kitchen and in the bathroom. Water sensors: to detect the use of a water in the kitchen and in the bathroom. Pressure sensors: to detect when a person is sitting on a chair, armchair, … Pressure sensors: to detect when a person is sitting on a chair, armchair, …

6 6 6 Dans la cuisine Sensors installed in Gerhome laboratory Video camera in the living-room Pressure sensor underneath the legs of armchair Contact sensor in the window Contact sensor in the cupboard door

7 7 7 Posture recognition Posture recognition Posture recognition approach [Boulay, et al. PRL06]: Using a set of 3D models defining the postures of interest. standing (a), standing with arms up (b), standing with hands up (c), standing (a), standing with arms up (b), standing with hands up (c), bending (d), bending (d), sitting on a chair (e), sitting on the floor with outstretched legs (f), sitting on the floor with flexed legs (g), slumping (h), sitting on a chair (e), sitting on the floor with outstretched legs (f), sitting on the floor with flexed legs (g), slumping (h), lying on the side with flexed legs (i), lying on the back with outstretched legs (j). lying on the side with flexed legs (i), lying on the back with outstretched legs (j). These postures are used to detect primitive states and complex events (e.g. falling).

8 8 8 Postures Postures

9 9 9 Recognition of the Feeling faint event The person is recognized with the postures "standing bending, " sitting on the floor with flexed legs, and sitting on the floor with outstretched legs. The person is recognized with the postures "standing bending, " sitting on the floor with flexed legs, and sitting on the floor with outstretched legs. Visualization of the recognition of Feeling faint in the Gerhome laboratory

10 10 Recognition of the Falling down event Visualization of the recognition of Falling down in the Gerhome laboratory The person is recognized with the postures "standing, " sitting on the floor with flexed legs, and lying with outstretched legs. The person is recognized with the postures "standing, " sitting on the floor with flexed legs, and lying with outstretched legs.

11 11 Recognition of the Prepare meal event The person is recognized with the postures "standing, bending, located in the kitchen, using the fridge,and using the microwave. The person is recognized with the postures "standing, bending, located in the kitchen, using the fridge,, and using the microwave. Visualization of the recognition of Prepare meal in the Gerhome laboratory

12 12 Recognition of the Resting in living-room event The person is located in the living-room and recognized with the postures sitting The person is located in the living-room and recognized with the postures sitting and slumping. and slumping. Visualization of the recognition of Resting in living-room in the Gerhome laboratory

13 13 Recognition of the Prepare meal event with elderly person

14 14 Recognition of the Take meal event with elderly person

15 15 Trajectory Trajectory of the person in the apartment Stopping zones: person is standing for more than 20 s Distance walked during 3 hours = 3.71 km

16 16 Preliminary results

17 17 Incohérence capteurs Preliminary results

18 18 Déplacements + ou - rapides Preliminary results

19 19 Principales activités Preliminary results

20 20 + ou - dynamique Preliminary results

21 21 Utilisation + ou – facile Preliminary results


Download ppt "1 1 Date HealthCare Monitoring: GERHOME Project Monique Thonnat, Francois Bremond & Nadia Zouba PULSAR, INRIA."

Similar presentations


Ads by Google