1. Voice-Activated Television Remote Control (VAR) Senior Design I Final Presentation [1]

2. VAR Team Members Team Leader Electrical Engineer Design Hardware Documentation Computer Engineer Website Voice Recognition Coding PIC programming Computer Engineer Website Voice Recognition Coding PIC programming Adviser: Dr. Pan Li Electrical Engineer Hardware Research Debugging Melissa Webb David Trosclair Bobby Britton Bader Yaseen

3. Outline Problem Solution Constraints Technical Practical Testing Prototype Future Tasks Questions

4. Problem and Solution

5. Problem Some people do not have the ability to operate a standard hand-held television remote control. Our market is the elderly and/or disabled. “During the 20 th century, the number of people in the United States aged 65 or over increased by a factor of 11, growing from 3 million to 33 million” [2, 3].

6. Solution The VAR will allow users to operate their television by using voice commands. By speaking into a microphone, the user is able to control 6 key functions of the television: - Power- Mute - Volume Up- Volume Down - Channel Up- Channel Down

7. What is the VAR? The user will speak the commands into a microphone attached to a computer with our voice recognition software. The software will translate and wirelessly send the signal to the VAR. A microprocessor will convert from the wireless input to an IR signal and output to the television. VAR

8. Technical and Practical Constraints

9. Technical Constraints NameDescription Power Supply The VAR must operate from a standard 120V wall outlet. Response Time Target time for complete process is less than two seconds. Transmission Distance The wireless signal and the IR signal’s maximum distances are 15 feet. Voice CommandsThe VAR will recognize six vocal commands. IR Accuracy The IR signal must be transmitted and received accurately 98% of the time.

10. System Overview

11. Practical Constraints NameDescription Product SizeThe VAR will be no larger than 8” x 8” x 3”. Operating SystemThe VAR will be Windows OS compatible.

12. Practical Constraints Manufacturability: Product Size The VAR will be no larger than 8’’ x 8’’ x 3’’. Convenient for user Easily fits into any space Portable Comparable to devices such as modems and routers

13. Practical Constraints Manufacturability: Operating System The VAR software will be Windows OS compatible. Microsoft Windows is one of the most commonly used operating systems for personal computers [4]. Executable files of the program can easily be made.

14. Testing

15. Testing: Voice Recognition Software

16. Extra Functions: Volume Up/Volume Down- Intervals of 5 Channel Numbers- 1 through 9 Channel Key Words- PlayStation: TV’s Input Channel (A/V)

17. Testing: Voice Recognition Software UserPercent Error for each User (%) Power Volume Up Volume Down Channel Up Channel Down Mute Bader000000 Bobby00010 David000000 Melissa000010

18. Testing: Bluetooth

19. Char value sent from Bluetooth transmitter to Bluetooth receiver. Each command has a char value.

20. Testing: Microcontroller

23. Testing: IR Transmitter Accuracy CommandAccuracy (%) 15 ft. Straight Ahead 15 ft. 15° to right 15 ft. 15° to left Obstructed View Power100 0 Volume Up100 0 Volume Down100 0 Channel Up100 0 Channel Down100 0 Mute100 0

24. Testing: Latency CommandTime (s) Power0.65 Volume Up0.66 Volume Down0.61 Channel Up0.70 Channel Down0.73 Mute0.51

25. Testing: Sunny Day Case User enters correct COM port VAR is connected User says key word “Listen” Command is recognized User says command “Power” Television responds by turning on or off

26. Testing: Sunny Day Case

27. User enters the correct COM port. Software informs user that the COM port is closed i.e. VAR is off VAR still tries to connect. Once the connection is made, the VAR is connected and normal operation continues. Testing: Rainy Day Case- Bluetooth not Connected

29. Testing: Rainy Day Case- Unrecognized Command User enters the correct COM port VAR is connected User says key word “Listen” Command is recognized User says command “Power” Command is not recognized User prompted to repeat command

30. Testing: Rainy Day Case- Unrecognized Command

31. Working Prototype

32. Breadboard

33. On/Off Switch

34. Breadboard Status LED

35. Breadboard BlueSMiRF Silver Bluetooth Receiver

36. Breadboard PIC24HJ64GP502

37. Breadboard IR Transmitter

38. VAR System Setup

39. TV

40. VAR System Setup VAR

41. VAR System Setup PC

42. VAR System Setup Mic

43. Video

44. Future Tasks

45. Software Refinement PCB Design using Eagle layout PCB Populating Enclosure Testing

46. AugustSeptemberOctoberNovember Software Refinement PCB Design PCB Populating Enclosure Testing Timeline

47. Enclosure

48. References [1] (2012, February 18). “Elderly Couple Watching TV,” in fotosearch. [Online]. Available: http://www.fotosearch.com/photos-images/television-programme.htmlhttp://www.fotosearch.com/photos-images/television-programme.html [2] F. Hobbs. (2012, January 21). “The Elderly Population,” in U.S. Census Bureau. [Online]. Available: http://www.census.gov/population/www/pop-profile/elderpop.htmlhttp://www.census.gov/population/www/pop-profile/elderpop.html [3] (2012, January 21). “Sixty-Five Plus in the United States,” in U.S. Census Bureau. [Online]. Available: http://www.census.gov/population/socdemo/statbriefs/agebrief.htmlhttp://www.census.gov/population/socdemo/statbriefs/agebrief.html [4] (2012, February 18). “Operating System,” in StatCounter Global Stats. [Online]. Available: http://gs.statcounter.com/#os-ww-monthly-201202-201202-barhttp://gs.statcounter.com/#os-ww-monthly-201202-201202-bar

49. Voice-Activated Television Remote Control (VAR) Senior Design I End-Semester Presentation Questions?