HandTalk “Talk to the hand…” Hemant Sikaria Wesley Jin Bhargav Bhat Jorge Meza

Project Concept We are making a glove that will recognize American Sign Language (ASL) and convert it into speech. Today deaf people have trouble when communicating with people who don’t know ASL. Our product aims to solve this problem by translating ASL to English. Sensors attached to the glove will send information to an embedded processor. This processor will relay information to a hand-held device which will use the sensor values to figure out the corresponding text and convert it to speech.

Competitive Analysis KMI Embedded RF Finger System: Glove relays movements to a computer - Not portable.  Demonstration Video Demonstration Video Metamotion Data Glove: Too expensive!  Website Website Berkeley Acceleration Sensing Glove: Not portable, uses a computer  Website Website

Requirements Glove needs to recognize the ASL alphabet Glove needs to be portable and have low power consumption Glove needs to have a simple mechanism to switch between the ready and standby state System needs to recognize and voice sign within 2 seconds The support application on the cellphone/PDA needs to be compatible with most cellphones/PDAs currently on the market

Technical Specifications Processor: Gumstix Basix 400xm-bt Microcontroller: Robostix Sensors: 10 Flex Sensors (Electrotap T303B) ($59.00 ea.) websitewebsite 3D Accelerometer: ADXL330 ($34.95) website website Wireless Protocol: Bluetooth Software: Java text-to-speech engine for cellphone which receives input through Bluetooth – Java 2ME