Controlling of robot using voice CAPSTONE PROJECT Controlling of robot using voice Authors: Hồ Công Anh Nguyễn Tuấn Anh Đỗ Đắc Hải Huỳnh Học Phan Thành Hưng Supervisor: Hoàng Xuân Sơn Summer2015

Content 1 2 3 4 5 6 Introduction Project Management Plan System Requirement 3 Implement and Testing 4 Demo 5 Future 6

1. INTRODUCTION Idea

1. INTRODUCTION Scope Robot can listen and recognize human voice control remotely by a smartphone Following features need to be implemented to build the robot. Chassis to mount robot component Motors and wheel to help movement robot. Using IC HM2007 Controller board to handle communication with other devices. Using Radio frequency communications. Using Bluetooth communication

2. MANAGEMENT PLAN Contents Project process model. Role and Responsibilities. Infrastructure and Tools. Work breakdown structure (Time plan).

Iterative and incremental development process model 2. MANAGEMENT PLAN Process model Iterative and incremental development process model

Role and responsibility 2. MANAGEMENT PLAN Role and responsibility

Infrastructure and tools 2. MANAGEMENT PLAN Infrastructure and tools

Infrastructure and tools 2. MANAGEMENT PLAN Infrastructure and tools

2. MANAGEMENT PLAN Time Plan

3. SYSTEM REQUIREMENT Contents Functional Requirement Non Functional Requirement

3. SYSTEM REQUIREMENT Function requirement

Non-Function requirement 3. SYSTEM REQUIREMENT Non-Function requirement

4. IMPLEMENTATION AND TESTING Contents System Architecture Voice Recognition Transceiver Movement Android Testing

4. IMPLEMENTATION AND TESTING System architecture Voice kit controller

4. IMPLEMENTATION AND TESTING System architecture Android controller

4. IMPLEMENTATION AND TESTING Voice recognition Speaker Dependent : Recognition only for specific users Example: IC HM2007 Speaker Independent : Recognition for all users. Example: Google, Siri Apple, Microsoft....

4. IMPLEMENTATION AND TESTING Voice recognition IC hm2007

4. IMPLEMENTATION AND TESTING Voice recognition IC HM2007 features Algorithm: Artificial Neural Network- ANN Single chip voice recognition CMOS LSI. External 64k SRAM Maximum 40 words Maximum 1.92 sec Power supply: 5V Two control mode: Manual mode and CPU mode.

4. IMPLEMENTATION AND TESTING Voice recognition IC HM2007 pins Waiting control input. Wait = “L” : Do not accept voice input Wait = “H” : Accept voice input

4. IMPLEMENTATION AND TESTING Voice recognition IC HM2007 pins Work in manual mode Step 1: When Wait = “H”, RDY set to “L” : HM2007 is ready to accept the voice input Step 2 : RDY return to “H” : HM2007 begins its recognition process.

4. IMPLEMENTATION AND TESTING Voice recognition IC HM2007 pins Word length select WLEN = “H” : Word length = 1.92 sec. 20 words maximum WLEN = “L” : Word length = 0.92 sec. 40 words maximum

4. IMPLEMENTATION AND TESTING Voice recognition IC HM2007 pins Microphone connect pin. Connected : Capacitor and Resistor. Low pass filter

4. IMPLEMENTATION AND TESTING Voice recognition Schematic

4. IMPLEMENTATION AND TESTING Voice recognition IC HM2007 circuit

4. IMPLEMENTATION AND TESTING Transceiver Arduino Uno

4. IMPLEMENTATION AND TESTING Transceiver Arduino Uno Circuit Board microcontroller use AVR ATmega328. 14 digital pins and 6 analog pins Powerful applications. Power supply: 5V. Rich library system Data rate: 16 MHz

4. IMPLEMENTATION AND TESTING Transceiver nRF24L01

4. IMPLEMENTATION AND TESTING Transceiver nRF24L01 Work in 2.4GHZ. 126 channel. Data rate 1Mbps or 2Mbps. Power supply: 1.9 – 3.6V. 4 pin SPI

4. IMPLEMENTATION AND TESTING Transceiver Arduino Mega

4. IMPLEMENTATION AND TESTING Transceiver Arduino Mega Circuit Board microcontroller use AVR ATmega2560. 54 pins digital Powerful applications. Power supply: 5V. Rich library system Data rate: 16 MHz

4. IMPLEMENTATION AND TESTING Movement Diagram assembly

4. IMPLEMENTATION AND TESTING Movement Module L2596s Input voltage: 3 to 40VDC Output voltage: 1.5 to 35VDC Maximum current = 3A Efficiency: ~ 92%

4. IMPLEMENTATION AND TESTING Movement L298 Have 14 pins L298 driver IC can drive two DC motors or one stepper motor 4 phases. Heat-resistant radiator assembled to IC, which helps IC control 2A power circuit

4. IMPLEMENTATION AND TESTING Movement Motor Operating voltage: with 3V to 9V DC (recommended operating voltage of about 6 to 8V)  Maximum torque: 800gf cm min (at 3V) No-load speed: 120rpm (3V)  and  200rpm (5V) Load current: 70mA (250mA MAX) (3V pm)

4. IMPLEMENTATION AND TESTING Android App Connect Module Bluetooth with Arduino Workflow diagram of Arduino Software Design

4. IMPLEMENTATION AND TESTING Android App Connect Module Bluetooth with Arduino

4. IMPLEMENTATION AND TESTING Android App Workflow diagram

4. IMPLEMENTATION AND TESTING Android App Software Design

4. IMPLEMENTATION AND TESTING Test Plan Execute Test Report

4. IMPLEMENTATION AND TESTING Test Plan

4. IMPLEMENTATION AND TESTING Execute test Controlling of robot using voice. Controlling of robot using Android application.

Controlling of robot using voice 4. IMPLEMENTATION AND TESTING Testing Execute test Controlling of robot using voice Unit Test: + Motor + nRF24L01 + KIT HM2007 Integration test + Robot System test + Control Robot

Controlling of robot using ANDROID Application. 4. IMPLEMENTATION AND TESTING Testing Execute test Controlling of robot using ANDROID Application. Unit Test: + Main screen + Request permission dialog screen + Auto pairing + Send change speed robot + Send control robot - System test + Control Robot

4. IMPLEMENTATION AND TESTING Report All function are checked successfully. Control robot successfully. Have some test case fail (sound wave interference, noise…).

5. DEMO Now… It’s time for demo

6. DEMO Film support. Apply for smart home. Support for disabled people. Apply for FPT canteen. Apply for digital solution