PROPOSAL : The Use of Voice Command in Operating Personal Computer By : COLLEGE OF ART & SCIENCE UNIVERSITI UTARA MALAYSIA STIW5023 ADVANCED PROGRAMMING Lecturer : Mazen S. H. Elsayed Group Name : VINISKAZU Virakwan A/P Hai Kelian (800355) Anis Eliani Binti Abd. Rahman (802329) Kamal Harmoni Kamal Ariff (801584) Mohd Fazudli Bin Saad (804213) Group Members :

:: Abstract This study aims to develop an application that can execute command in operating system to allow user operate the personal computer through voice. It will provide a proved of concept on how user will be able to operate the personal computer using voice. This application will receive, analyzes, searches and matches an input voice with the set of grammar which is stored in the database and returns matching results to users. It is another solution for users to easy work with personal computer instead of using a graphical input device.

:: Introduction Application that will be developing in this study is the voice input command that use to operate the personal computer. According to Austin. J, (__), all communication with personal computers will someday be by voice alone. This means that keyboards will be obsolete. Therefore this study will provide a proved of concept how user able to operate the personal computer using voice. Java platform classes and compatible with Sphinx 4.0 will design to work in Windows and Linux operating system. According to (Meir and Zamir, 2007), Sphinx 4.0 able to greatly improve the speech recognition capabilities and Sphinx 4.0 platform proved very to be reliable, relatively easy to use and highly portable.

:: Problem Statement Users facing problem to interact with personal computer due to the inability of using hands or eyes and also handicap persons. New users facing problem to remember the command line that used to execute the application on personal computer. To provide a convenient and ability to use the personal computer, application that can execute command in operating system to allow user operate the personal computer through voice is to develop.

:: Objectives The aim of this study is to produce three (3) commands that able to understand by Windows and Linux operating system. Sub objective To understand and how to use Sphinx 4.0. To develop a Java class that can be interact with Sphinx 4.0 classes. To make the developed class able to convert voice command into command line. Main objective

:: Scope Java classes that able to use in Windows and Linux operating system by using Sphinx 4.0. Classes will be use to convert voice into command line. Only three (3) commands will introduce into this studies. The three (3) command that want personal computer execute in this studies are Run Paint, Run Calculator and List File command.

:: System Specification VoiceCommand Package RunCommand ClassConvertVoiceToText Class

:: VoiceCommand Package // OVERVIEW : This package run the voice recognition application built using Sphinx 4.0 // Uses the Sphinx 4.0 and contains of two (2) main classes that will receive, // analyzes, searches and matches an input voice with the set of dictionary and // grammar. // which is stored in the database and returns matching results to users by run and // display the application on the personal computer screen monitor. // REQUIRES : ConvertVoiceToText class to identify, analyze voice input and convert it //into text. // RunCommand class to execute input and display application on the screen // monitor. // EFFECTS : If voice input is valid, will execute the command. // If not valid, will wait until the valid input entered. // Else allow user to terminate the application.

:: ConvertVoiceToText Class // OVERVIEW : This class provides a number of procedures that are // useful for voice recognition and convert it into text. // REQUIRES : Valid voice input, dictionary and grammar. // Voice input that matches with the set of dictionary and grammar // database. // EFFECTS : If voice input is valid, will convert it into text. // Otherwise wait until the valid input entered or allow user to // terminate the application.

:: RunCommand Class // OVERVIEW : This class provides procedures for execute String // input and display application on the screen monitor according the // types of Operating System either Windows or Linux. // REQUIRES : String to execute the command. // Example command : Run Paint, to run on Windows platform. // EFFECTS : Execute command to display on the screen based on // types of Operating System.

:: Methodology ::

User 0.0 VoiceCommand Voice Signal Display Application :: Context Diagram

:: Flow Diagram

:: Use Case of the System

:: Class Diagram of the System Feature ExecutionFeature Classification Convert voice to text sphinx /search and match Recording User voice instruction Voice Recognizer /send speech record Feature

:: Sequence Diagram

:: Group Structure LeaderTask Responsibilities Virakwan A/P Hai Kelian Tasks assignment for each members Specify system requirements Produce system specification Team membersTask Responsibilities Kamal Harmoni Bin Kamal Ariff Develop Coding -Develop VoiceCommand class Mohd Fazudli Bin Saad Expending acoustic model -Dictionary class -Grammar class Anis Eliani Binti Abd. RahmanDevelop Coding -Develop RunCommand class

:: Conclusion Using the Sphinx 4.0 integrate with Java platform will able to develop the application that provide function for human to interact with personal computer via voice. In order to implement an application that can execute at least three (3) commands on Windows or Linux operating system, we identify two (2) main classes that will develop in this study which are ConvertVoiceToText class and RunCommand class. These two (2) classes proposed to identify the voice input from user and finally execute the command to run the application on the screen.

:: References Austin. J, (__). The Computer Listens Up. Atariarchives.org. Retrieved : Mac 2, 2010, from : Meir, D., & Zamir, Y. (2007). Mini Project : Saya Speech Recognition. Ben- Gurion University : Department of Computer Science. Sphinx Technologies Inc. (2009). Sphinx. Retrieved : Mac 2, 2010, from :

..thank you