Presentation is loading. Please wait.

Presentation is loading. Please wait.

Y.Tabata 1, T.Kuroda 2 and K.Okamoto 2 1 Kyoto College of Medical Science 2 Kyoto University Hospital 1 ICDVRAT2012.

Similar presentations


Presentation on theme: "Y.Tabata 1, T.Kuroda 2 and K.Okamoto 2 1 Kyoto College of Medical Science 2 Kyoto University Hospital 1 ICDVRAT2012."— Presentation transcript:

1 Y.Tabata 1, T.Kuroda 2 and K.Okamoto 2 1 Kyoto College of Medical Science 2 Kyoto University Hospital 1 ICDVRAT2012

2 The hearing impaired have the communication barrier in their social lives. 2 Sign Language Writing image Different grammar Communication sign language is the most familiar

3 Many researchers have tried to develop a sign translation system. 3 Hello Hi … Translation Necessary to have input device to capture sign Signer Sign Animation subtitle

4 Glove-type input device is … essential device for VR used to obtain hand postures expensive Price of the device would be higher than the price of a car.. 4 Still expensive as the price of the glove available for sign capturing

5 Proposed the method to define the minimum number of sensors to capture a set of the given hand posture ( in ICDVRAT2010 ) Estimated that a data-glove equipped with six low-resolution sensors could measure hand postures expressed in Japanese Finger spelling of Japanese Sign language. 5 Possibility to decide a number of sensors for user’s demands

6 To make a prototype of data-glove with six sensors for Japanese finger spelling. To evaluate the prototype 6 Prototype

7 Japanese Finger spelling Alphabet of Japanese Sign Language 7

8 8 1.Creating code-sensor Relation Table 2. Seeing if proposed optimizing problem reduces to a set cover problem 3. Trying to get solutions by using set cover algorithm Y.Tabata, T.Kuroda, K.Okamoto, Proc. ICDVRAT2010

9 9 1.Creating code-sensor Relation Table Given hand postures Code:α Code:β Code:γ Fully furnished data-glove Code-sensor relation table

10 All the code are identified with simple switches proposed problem reduces to a set cover problem All the code are not identified with simple switches proposed problem selects a brute-force method Seeing if proposed optimizing problem reduces to a set cover problem Code-sensor relation table( with simple switches) Pairwise code-sensor relation table

11 1. Omit non-contributing sensors and replaceable sensors from the instance ( pairwise code-sensor relation table ). 2. Solve the instance by using the exponential time algorithms of set cover problem Trying to get solutions by using set cover algorithm U V 17 V 26 V 27 V Pairwise code-sensor relation table minimum number of sensor 2 sensors 3 combinations : ( V 17, V 26 ) ( V 17 V 27 )( V 26 V 27 )

12 Minimum number of sensor : six sensors Five bending sensors ( yellow ) one contact sensor (red) 12 Sensor Layout A set cover for Japanese Finger spelling

13 Prototype Is applying to the existing StrinGlove TM Consists of five two-bits bend sensors and one one-bit contact sensor 13 Prototype

14 The prototype is evaluated Subject expressed the 28 hand postures of Japanese finger spelling by the prototype. Total number of subjects three (female : two, male : one) 14 the 28 hand postures of Japanese finger spelling

15 The prototype distinguished about 82 % of the given hand postures. The main cause of errors were the two sensors, no.5 and no.6. 15

16 Sensor no.6 :one of the main cause of errors A contact sensor used for measuring the contact between middle and ring fingers. A proximity sensor was utilized as the contact sensor and the sensor sometimes misfires. Even when the distance between two fingers is not zero. Sensor ‘s size is large 16 It may be useful to use sensor instead of the proximity sensor and to downsize the sensor

17 Sensor no.5 :one of the main cause of errors No.5 is the bending sensor for measuring angle of DIJ of pinkie. The slip between glove and pinkie might cause a lot of error. It may clear that a single sensor measurement error becomes fatal error under the optimized data-glove. 17 more stretchable material to fit the glove tightly

18 We made a prototype of data-glove for Japanese finger spelling. The prototype is a data-glove with six sensors. The prototype was evaluated. The prototype distinguished about 82 %. The prototype failed to distinguish the given hand postures because of simple error of sensors. It would be necessary to improve some sensors. 18

19 19

20 Y.Tabata 1, T.Kuroda 2 and K.Okamoto 2 1 Kyoto College of Medical Science 2 Kyoto University Hospital 20 ICDVRAT2012


Download ppt "Y.Tabata 1, T.Kuroda 2 and K.Okamoto 2 1 Kyoto College of Medical Science 2 Kyoto University Hospital 1 ICDVRAT2012."

Similar presentations


Ads by Google