Net-Centric Software and Systems I/UCRC Copyright © 2011 NSF Net-Centric I/UCRC. All Rights Reserved. Bio-Com Project Project Lead: Krishna Kavi and Robert Akl Date: December 5, 2011

2011/Current Project Overview 2011/Current Project Overview Bio-Com Project 2 Tasks: 1.Develop a prototype using off the shelf components from I-CubeX that can measure the EMG in the arm as a result of hand movement (using BioFlex sensor) and convert it to an electrical signal that is transmitted wirelessly (using Wi-microSystem). The received electric signal is then decoded and the hand gesture is identified. (3 months from start date) 2.Investigate the current state of the art of EMG hand and arm sensors available including an in-depth study of different feasible implementations and solutions to this project. (6 months from start date) 3.Develop a prototype using the proposed solution that was presented in the report in Task 2. The prototype will be able to distinguish between different hand gestures and signals and generate an RF signal. The system will be calibrated and tested to recognize multiple gestures from different individuals. (9 months from start date) 4.Investigate different graphical interfaces including the development of a prototype that will decode the RF signals that are generated in Task 3 and display it on a HUD. (12 months from start date) Project Objective: Build a prototype that allows soldiers to communicate silently and convey hand signals and gestures wirelessly to a head’s up display in the absence of line-of-sight.

Standardized Hand Signals Standardized Hand Signals Bio-Com Project 3

Project Results to Date 4 TaskStatusProgress and Accomplishment 1. Develop a prototype using off the shelf components from I-CubeX that can measure the EMG in the arm as a result of hand movement (using BioFlex sensor) and convert it to an electrical signal that is transmitted wirelessly (using Wi- microSystem). X 2 sets of BioFlex sensors are used on the upper and lower arm. The signal is transmitted wirelessly using Bluetooth. Signal is received using MATLAB running on MacOS X using Bluetooth interface. Signal is displayed and compared to templates in memory. 2. Investigate the current state of the art of EMG hand and arm sensors available including an in-depth study of different feasible implementations and solutions to this project. X BioFlex sensors do not provide enough resolution to allow us to distinguish between the different finger gestures. Looking into other sensors as better candidates. 3. Develop a prototype using the proposed solution that was presented in the report in Task 2. X Future task Task Complete Task Partially Complete Task Not Started

Project Results to Date: MATLAB GUI 5 Through the GUI we can set the sampling rate. Capture the EMG signals for the hand movements. Display the EMG signals from each sensor. Match the captured signals with our stored templates. Investigated different techniques for matching: FFT Correlation Other statistical measures like variance, covariance, etc. Need to explore more techniques to differentiate the signal and be more robust in identifying the signals.

Project Results to Date: MATLAB GUI 6

Bio-Com Project 6 Questions?