VAHCS Voice Activated Home Control System By: Kyle Joseph Troy Resetich Advisors: Dr. Malinowski Dr. Schertz

Presentation Outline Project Summary Functional Description Block Diagram Scheduled Milestones Tasks Completed Tasks Remaining Revised Schedule

Project Summary Control any IR activated device Control any IR activated device Via voice command Via voice command Learnable Learnable Learn IR Code Learn IR Code Learn Voice Command Learn Voice Command Learn Multiple IR Commands per Voice Command User interface

Functional Description Inputs Voice Commands Voice Commands IR Sequences To Be Captured IR Sequences To Be Captured Key Presses (based on User-Interface Menu) Key Presses (based on User-Interface Menu)Outputs User Interface Menu Via LCD Screen User Interface Menu Via LCD Screen IR learned Sequences IR learned Sequences Speaker Queuing User To Say Command Word Speaker Queuing User To Say Command Word

Functional Description Modes Of Operation Continuous Voice Recognition Command Recognized IR Transmit IR Transmit Keypad Initiated Learn Mode Learn Voice Command Learn Voice Command Learn IR Command(s) Learn IR Command(s) Keypad Initiated Erase Mode IR Sequences IR Sequences Voice Commands Voice Commands

Block Diagram Sub-Systems 8051 Microprocessor Sensory Voice Direct II (Voice - recognition chip ) LCD (liquid crystal display) Keyboard IR Receiver IR Transmitter Microphone Speaker

Original Schedule TroyJanuary Re-introduction to Emac Board Re-introduction to Emac BoardFebruary IR capture IR captureMarch IR transmit IR transmit User interface User interfaceApril Integrate w/ Kyle’s software Integrate w/ Kyle’s softwareMay Prepare Final Presentation and Paper Prepare Final Presentation and Paper

Accomplished 1 Accomplished 1 Emac Initialization Understood Logic of Capture Has Changed from Counting Time Lows and Highs, to Sampling Each Sample Saved as Bit in External Memory Each Sample Saved as Bit in External Memory

Accomplished 2 Accomplished 2 Panasonic DVD Play Sony VCR Play Sony Receiver Aux IR to X-10 DVD Discrete Off

Accomplished 3 Accomplished 3 Sample every 100 µs 72 ms Recording time for each IR Sequence 720 samples 720 samples Logic Low Header not Included Logic Low Header not Included Each Sequence Requires 90 Bytes of Memory Start at 8300h in External Memory Equates to bytes that can be used Equates to bytes that can be used

Set Backs 1 Set Backs 1 Some IR Codes Can Not Be Stored Using This Method DVD Discrete On DVD Discrete On IR to X-10 IR to X-10

Set Backs 2 Set Backs 2 Panasonic DVD Play Sony VCR Play Sony Receiver Aux IR to X-10 DVD Discrete Off

Remaining Remaining Capture IR commands Done Today or Next Week Done Today or Next Week Transmission of IR Logic from Receiving can be Applied to Transmission Logic from Receiving can be Applied to Transmission LCD User Messages

Schedule Schedule Close to Original Schedule Close to Original Schedule Capture IR Sequences Very Soon Capture IR Sequences Very Soon Transmission by End of March Transmission by End of March Integrate With Kyle’s Software In April Integrate With Kyle’s Software In April Write Final Report & Presentation In May Write Final Report & Presentation In May

Original Schedule: Kyle KyleJanuary Re-introduction to Emac Board Re-introduction to Emac Board Learn Slave Mode of Voice Direct II Learn Slave Mode of Voice Direct IIFebruary User Interface User Interface Voice Activation control software Voice Activation control softwareMarch Integrate User Interface with Voice Activation control software Integrate User Interface with Voice Activation control softwareApril Integrate w/ Troy’s software Integrate w/ Troy’s softwareMay Prepare for student expo and presentations Prepare for student expo and presentations

VDII +User Interface Outline: VDII +User Interface Outline: Problems: Slave mode, memory Solutions 2 Voice-Direct II boards in parallel VDII EMAC interface User interface Future Planning

Problems: Slave mode: “not supported” “not supported” Stand-alone (4 modes): Stand-alone (4 modes): ESR, SCL, MCL, SWS We select SCL “Single Trigger Continuous Listening Memory: 60 words different modes 60 words different modes SCL 1 trigger word + 15 words Number of I/0 pins available

Solution: 2 VDII boards working in Parallel 2 trigger-words or “systems” 2 trigger-words or “systems” 30 commands or 15 per system 30 commands or 15 per system Ports: Ports: Share 8 pin parallel inputTALK signal Share 8 pin parallel inputTALK signal Monitor Talk signal Monitor Talk signal Duration of 176ms Duration of 32 ms

Voice Direct II/EMAC interface Voice Direct II Board Input/output configuration TALK OUT1 OUT2 OUT3 OUT4 OUT5 OUT6 OUT7 OUT8 MODE1 MODE2 TRAIN TRIG-TRAIN RESET Held Externally Emac Outputs Emac Inputs

EMAC/Voice Direct II interface: EMAC Board Input/output configuration VDII TALK Sys. 1 TALK Sys. 2 OUT1 OUT2 OUT3 OUT4 OUT5 OUT6 OUT7 OUT8 RECOG(1) TRAIN(1) TRIG-TRAIN(1) RECOG(2) TRAIN(2) TRIG-TRAIN(2) RESET(1) RESET(2)

Programming for VDII interface: Initializations: Initializations: Reset both boards Reset both boards TRAIN & RECOG set HIGH TRAIN & RECOG set HIGH Add New System: Add New System: 0 system 0 system Sys. 1  TRIG-TRAIN set HIGH 1 system 1 system Sys. 2  TRIG-TRAIN set HIGH 2 systems 2 systems Report “Memory Full” Return to Main Menu

Remove System Remove System System 1 System 1  set TRAIN & RECOG System 1  set TRAIN & RECOG Clear IR memory Clear IR memory System 2 System 2  set TRAIN & RECOG System 2  set TRAIN & RECOG Clear IR memory Clear IR memory Programming for VDII interface:

Add Command Add Command Select 1 or 2 for system Check if memory is full. Check if memory is full. Set TRAIN HIGH  Record word Set TRAIN HIGH  Record word Set TRAIN HIGH Set TRAIN HIGH Input IR Signal Input IR Signal Set RECOG HIGH Set RECOG HIGH Restart ALL System 1: set TRAIN & RECOG HIGH System 1: set TRAIN & RECOG HIGH System 2: set TRAIN & RECOG HIGH System 2: set TRAIN & RECOG HIGH

User Interface: Main Menu: O P T : 1 – A D D / N E W 2 – D E L ▓ L I S T E N I N G S E L : Goes on when TALK is High Opt. 1 Menu: O P T : 1 – A D D S Y S T E M 2 – A D D C O M M A N D S E L :

User Interface: Opt. 2 Menu: R E M O V E S Y S T E M 1 O R 2 S E L : Opt. 1 menu: Opt. 1 menu: Enter 1 : Add System Enter 1 : Add System Enter 2 : Add Command Enter 2 : Add Command Enter System # Opt. 2 menu: Opt. 2 menu: Enter 1 : Remove System 1... Enter 1 : Remove System 1... Enter 2 : Remove System 2... Enter 2 : Remove System 2...

Schedule: TALK signal capture TALK signal capture Complete VDII EMAC control Complete VDII EMAC control Memory location designation Memory location designation User interface integration User interface integration IR memory/user interface integration IR memory/user interface integration

Questions: