1. Remote Control of a Television Set via Thought Patterns Dr. William Hunt, Project Advisor Josh Rosner Drew Petry Gary Grimm George Melcer Thursday, March 11, 2010

2. The MindLink System Manipulates television functions via user thought patterns Provides independence to handicapped and disabled persons Estimated development cost at $80,940; per unit cost will be approximately $500

3. Design Objectives Minimize system costs to maximize target market Offer intuitive interface for non-technical users Manipulate simple command set for IR (Infrared) controlled devices Detect EEG (Electroencephalogram) signals in real- time to provide reliable thought pattern analysis Utilize Emotiv API (Application Programming Interface) in analysis software Interface with modified off-the-shelf remote control

4. Current Status EEG Headset –Selected and purchased headset –Commenced training with one engineer Host PC / EAS –Designed Pseudo code and learned about API SPB /URC –Completed Circuit Design and Board Layout

5. EEG Headset

6. Illustration

7. Input Propagation

8. Emotiv Control Panel

9. Cognitive Suite

10. Expressive Suite

11. EEG Headset - Problems / Issues Problem: Consistency of EEG signal from user Proposed Solutions –More training –Alter sensitivity settings –Use Expressive Suite Problem: Placement of headset Proposed Solutions –Need consistent signals to test –Seek advice from Emotiv online community

12. Host PC: EmoState Analysis Software

13. Software Process

14. Software Logic

15. EAS – Problems / Issues Problem: Invoking and communicating with Emotiv API Proposed Solutions –Should include EDK.h and link with EDK.dll –Use EE_EngineConnect for communication with headset; EE_EngineRemoteConnect used for communication with EmoComposer (debugging) Problem: Sending commands to Synergy board Proposed Solutions –Propose communication of serial connection –Invoke.NET System.IO.Ports namespace and use instance of SerialPort class

16. Synergy Prototyping Board & Universal Remote Control

17. Synergy Prototyping Board

18. SPB Layout

19. Synergy Prototyping Board Firmware

20. SPB – Problems / Issues Problem: MOSFETs did not interface with URC as expected Proposed Solution –Opted for bi-lateral switches instead of MOSFETs because we are open/closing a circuit, NOT pulling the signal high or low Problem: Simulation of SPB requires too much time Proposed Solution –Use “trial and error” approach with physical implementation of the board Problem: Soldering joints are weak on URC Proposed Solution –Use RTV silicone to isolate joints and prevent breaks

21. Acceptance Testing EPOC Headset –Train and test with Emotiv Control Panel EmoState Analysis Software –Utilize EmoComposer, printf stream, and debug symbols Synergy Prototyping Board & Universal RC –Component Testing (Switches, Microcontroller, etc.) –Board Testing (LED Blink Program) MindLink System –Iterate through defined thought patterns

22. Projected Schedule March 19 th –EAS Development Complete –SPB Firmware Development Complete April –16 th : System Integration Complete –30 th : Final Project Summary Complete May 6 th –Final Report Complete –Successful Project Demonstration

23. Budget & Cost Analysis MindLink Venture Prototype –Initial Capital Expenditure:$750 –Labor Costs:$80,000 –Per Unit Component Cost:$500 10,000 Units Production over 60 Months –Total Costs:$3,700,000 –Total Sales ($500 per unit):$5,000,000 –Net Profits:$1,300,000

24. Future Work Headset –Complete Emotiv Control Panel Training EmoState Analysis Software –Port pseudo code to C# –Develop and test serial port interface class –Test and debug Synergy Prototyping Board –Order PCB and generate Gerber Files –Order Additional Components –Develop Firmware –Test and debug MindLink System –Complete component integration –Test and debug

25. Questions / Feedback EmoState Analysis Software –How to interface C# with serial ports? Synergy Prototyping Board –Alternative Solutions?