Department of Electrical and Computer Engineering He Zhou Hui Zheng William Mai Xiang Guo Advisor: Professor Patrick Kelly ASLLENGE Midway Design review Dec

Department of Electrical and Computer Engineering Outline  Project Overview  MDR Specifications  Project Progress  Software Implementation  Hardware Implementation  Design Spec  Team Roles  Timeline  Q/A

Department of Electrical and Computer Engineering Project Overview

Department of Electrical and Computer Engineering Project Progress  MDR goals reached: Hand tracking Some gestures recognition Basic GUI functional A internal testing database Functioning microcontroller

Department of Electrical and Computer Engineering System Requirements (Revised)  Motion Tracking: Track upper human body Recognize different human gesture Translate ASL to English word  Microcontroller: Accurate A/D conversion Reliable communication with chosen output interface  Graphical User Interface: Real-time operation Display text feedback  Cost Below $500.

Department of Electrical and Computer Engineering Software Design Flow

Department of Electrical and Computer Engineering GUI Design Progress  Achieved Goals Created a User Interface window Display translated text Display skeletal image  Future Goals/Expandable 3D Avatar Voice recognition Tutorial

Department of Electrical and Computer Engineering Test Database of body parts  Created a hierarchical tree data structure  Nodes contain information including: Area of tracking Location of next motion word associated with it

Department of Electrical and Computer Engineering Hardware Implementation  Increasing the resistance of the flex sensor with bend  Analog signal input to an Arduino Mega 2560  The Arduino Mega 2560 works as an AD converter  PC captures the signal via USB or Bluetooth 9 Flex Sensor Glove Arduino Mega 2560

Department of Electrical and Computer Engineering More detail for Implementation  Impedance buffet with relation at  Digital number display on the Ardunio software is equal to  Experimental result is almost linear from 0 to 5 volts Arduino reading Impedance Buffer

Department of Electrical and Computer Engineering Cost of Major Components 11

Department of Electrical and Computer Engineering Team Roles  He Zhou(CSE): test and integrate software prototype  Hui Zheng(CSE): database development and programming  William Mai (EE): build microcontroller to detect finger and palm movements  Xiang (EE): build Arduino board, overall testing, building ASL database, and website administration 12

Department of Electrical and Computer Engineering CDR Deliverables  Complete and expand basic databases for both finger tracking and upper body tracking.  Complete the finger tracking module.  Build a fully functioning system prototype.

Department of Electrical and Computer Engineering Timeline 14

Department of Electrical and Computer Engineering Q&A 15