Presentation is loading. Please wait.

Presentation is loading. Please wait.

Development of Communication aids for Deaf-blind people using Smartphone Shunsuke Takeno,Ryoji Yukino, Yutaka Tange, Yoshitaka Arakawa Dept. of Electric.

Similar presentations


Presentation on theme: "Development of Communication aids for Deaf-blind people using Smartphone Shunsuke Takeno,Ryoji Yukino, Yutaka Tange, Yoshitaka Arakawa Dept. of Electric."— Presentation transcript:

1 Development of Communication aids for Deaf-blind people using Smartphone Shunsuke Takeno,Ryoji Yukino, Yutaka Tange, Yoshitaka Arakawa Dept. of Electric and Computer Eng., Maizuru National College of Technology

2 1. Introduction: About The Deaf-Blind 2012/12/ Japan-Taiwan Symposium on iGO Technology 2 The Deaf-Blind people Lose more than 90% of sensory information Means of Communication Handwritten Braille Etc… UbitzkyBraille writer Supporting Devices Etc…

3 1. Introduction: The problems 2012/12/ Japan-Taiwan Symposium on iGO Technology 3 Deaf-blind people always need helpers The protection of their privacy is difficult. Imposing heavy burdens on helpers. The poor portability of supporting devices Most of them need to be connected to a PC. We need to learn a special language To communicate with the deaf-blind people, we need to learn communication methods for them.

4 1. Introduction: Finger Braille and Smartphone 2012/12/ Japan-Taiwan Symposium on iGO Technology 4 Good Portability Good Communication Function High Performance

5 2. System 2012/12/ Japan-Taiwan Symposium on iGO Technology 5 Android Bluetooth Module Microphone Camera I/O Device Bluetooth Module PIC Input Sensor Output Sensor Finger Braille Data Functions Translating between Text and Finger Braille Translating between Voice and Finger Braille Finge r Braill e Voice, Text

6 2.1 System: Functions of I/O Device 2012/12/ Japan-Taiwan Symposium on iGO Technology 6 Smartphon e Input Sensor Output Sensor Bluetooth Module PIC Interface Magnetic Sensors Vibrators

7 2.2 System: Functions of Smartphone application 2012/12/ Japan-Taiwan Symposium on iGO Technology 7 I/O Device Hello Speec h Documents Enables us to input Speech or Document via microphone or camera Outputting Speech or Text Hello Compatible with other applications ex) , Telephone...

8 2.3 System: Translating Finger Braille into Kana 2012/12/ Japan-Taiwan Symposium on iGO Technology 8 Advantages Makes development simpler Makes processing faster Makes the system more adaptable (Easy addition of other alphabets) We have used Associative Array to translate finger braille into Kana. Key3 Value2 ① ② ③ Key1 Value1 Key2 Value1 Key3 Value2 Key4 Value3 Data Table

9 2.4 System: Input Recognition of I/O Device 2012/12/ Japan-Taiwan Symposium on iGO Technology 9 Sensor1Sensor2Sensor3 Input2 Starting Trigger Any sensor is on Finishing Trigger All sensor is off Sensor3Sensor2Sensor Sensor3Sensor2Sensor Input SimpleHigh Recognition Precision & t

10 2.5 System: Movie 2012/12/ Japan-Taiwan Symposium on iGO Technology 10 Movie Translating Finger Braille into Kana

11 2.6 System: User Evaluation 2012/12/ Japan-Taiwan Symposium on iGO Technology 11 The System is very useful for us. We’d like you to make letters larger and clearer. Please hear opinions from others and improve system. School for the blind and the deaf in Maizuru, Kyoto Prefecture

12 3. Conclusion 2012/12/ Japan-Taiwan Symposium on iGO Technology 12 Productization Future Improvement: Speeding up in operation More user-friendly in GUI Development of other I/O devices Opinion poll Designin g System Feedback of opinions Improvement of System Trial Test

13 Thank you for your attention ! Please feel free to ask any questions


Download ppt "Development of Communication aids for Deaf-blind people using Smartphone Shunsuke Takeno,Ryoji Yukino, Yutaka Tange, Yoshitaka Arakawa Dept. of Electric."

Similar presentations


Ads by Google