Supervisor: Dr. Elsayed Eissa Hemayed

o Marwa Ibrahim Lamey. Mayada Ibrahim Aly. o Mona Sherif Ahmed. o Suad Mohamed Barakat. o Marwa Ibrahim Lamey. Mayada Ibrahim Aly. o Mona Sherif Ahmed. o Suad Mohamed Barakat. Team Members

Agenda o Introduction o Tools o Time Plan o Project Overview

Time Plan Tools Overview Intro.

Time Plan Tools Overview Problem definition Intro. o Hearing children can be taught many lessons and morals through stories. What about deaf children? o Hearing children can be taught many lessons and morals through stories. What about deaf children?

Time Plan Tools Overview Intro. o Fact: There exists 5 million deaf persons in Egypt Can’t we help them interacting with the community!??... o Fact: There exists 5 million deaf persons in Egypt Can’t we help them interacting with the community!??... Background

Time Plan Tools Overview Intro. This is not always the picture Al Amal School- Resala Charity

Time Plan Tools Overview Intro.

Time Plan Tools Overview Intro. o Our prototype is about to translate a category of children stories to the sign language in real time o Goal: To minimize the gap between hearing parents or teachers and deaf children o Our prototype is about to translate a category of children stories to the sign language in real time o Goal: To minimize the gap between hearing parents or teachers and deaf children Our Scope

Time Plan Tools Overview Intro. o Input: Arabic story speech signal o Output: Input translation to the sign language o Type: Desktop Application o Input: Arabic story speech signal o Output: Input translation to the sign language o Type: Desktop Application Description

Time Plan Tools Overview Intro. o iCommunicator o IBM SiSi o iCommunicator o IBM SiSi Market Survey

Time Plan Tools Overview Intro. o Arabic speech recognition o Start from speech and end up with sign language o Arabic speech recognition o Start from speech and end up with sign language SIGNlator Uniqueness

Time Plan Tools Overview Intro. o Translation of Arabic speech to sign language in real time. o Translation of Arabic text to sign language. o Learning mode. o Translation of Arabic speech to sign language in real time. o Translation of Arabic text to sign language. o Learning mode. SIGNlator Features

Time Plan Tools Overview Intro. Block Diagram Text to Sign language القاموس الاشاري العربي للصم Text to Sign language القاموس الاشاري العربي للصم Recognizer Graphics module

Time Plan Tools Overview Intro. Feature Extraction Search Acoustic Model Language Model Audio Words Dictionary Automatic Speech Recognition- Architecture Recognizer

Time Plan Tools Overview Intro. ASR Categories Word BasedPhoneme Based Isolated Words Word Based Isolated Words Phoneme Based Isolated Words Continuous Speech Word Based Continuous Speech Phoneme Based Continuous Speech Our Choice!! Very high accuracy Maximum 150 words. Unlimited words can be recognized if added to the dictionary. Less accurate but still acceptable accuracy

Time Plan Tools Overview Intro. o Tackling a new field o Phonemes of Arabic language. o Accents of Arabic language. o Arabic language model. o Prepare the training set. o Tackling a new field o Phonemes of Arabic language. o Accents of Arabic language. o Arabic language model. o Prepare the training set. Challenges

Time Plan Tools Overview Intro. o Adaptability. o Expendability. o Change program type to be mobile application. o Integrate with Ayat’s Project o Adaptability. o Expendability. o Change program type to be mobile application. o Integrate with Ayat’s Project Future Work

Time Plan Tools Overview Intro. o Recognizer : HTK o Text to Sign language o C# using Microsoft Visual Studio 2008 o SQL Server 2005 o Graphics module: Quest3D 4.0 o GUI: Expression Studio 2 ( Blend) o Recognizer : HTK o Text to Sign language o C# using Microsoft Visual Studio 2008 o SQL Server 2005 o Graphics module: Quest3D 4.0 o GUI: Expression Studio 2 ( Blend) Tools

Time Plan 54 days 54 days 25 d 25 d 34d 34d 6d 6d 38days 38days 13d 13d 18d 18d 43days 43days 16d 16d 14d 14d 51 days 51 days 7d 7d 6d 6d Brain Storming Market Research Design Mid-Terms Design Finals Implementation Integration Mid-Terms Implementation & Testing Finals Testing 8/7/09 26/10/09 30/9/09 27/10/09 1/10/09 30/11/09 5/12/0911/12/09 12/12/09 24/3/10 30/12/09 1/1/108/2/10 9/2/10 7/8/09 1/7/10 30/6/1010/5/10 9/5/1025/4/10 10/4/1025/3/10 24/4/1011/4/10 15/7/109/7/10 Doc Working Period Idle period

Sponsors

Thank you

Causes of deafness 9.6% Pregnancy-Related causes 8.4% Post-Natal causes 28% Genetic causes 54% Unknown causes Not necessary to be born for deaf parents