CS4710 Senior Project1 Awnalisa McCarty Tim Hollist J.R. Burningham CS4710 SENIOR PROJECT December 6, 2002

CS4710 Senior Project2 H : The Digital Pet

CS4710 Senior Project3 Overview  Goals: 1.JStamp 2. Voice Extreme 3.CMUcam 4.Sonar JStamp VoiceExtreme CMUCam Sonar

CS4710 Senior Project4 Overview (Cont) Commercial Possibilities:  Enormous market potential for young children.  Entertainment: With improving technology, the general populous is looking for new and interesting toys to interact with.  Aibo: Sony’s electronic dog is the first “affordable” digital pet.

CS4710 Senior Project5 Project Details Functional Partition:

CS4710 Senior Project6 Project Details (Cont) Original Project Objectives: 1.Determine capabilities of JStamp 2.To use CMUcam well enough to drive to (or away) from a specific color. 3. To get VoiceExtreme chip to work with all the words we wanted so that we could talk to ‘H’ and have it respond non-repetitively. 4. Get Sonar module to work in conjunction with the camera. 5.Get Chipcorder to work, which would allow for numerous random responses and a real “personality.”

CS4710 Senior Project7 Project Details (Cont) Software Flow Chart (Java):

CS4710 Senior Project8 Project Details (Cont) Problems Encountered: 1.Lack of legos. 2.Voice Extreme microphone problems. 3.Speaker Independent vs. Speaker Dependent vocabularies 4.Learning curve for Voice Extreme tools 5.J2ME Threads 6.Chipcorder 7.JStamp

CS4710 Senior Project9 Project Results  Machine Vision: We can track most different colors as long as they are a fairly bright color.  Sonar: 1.We can use the sonar to act as a front sensor to know when we are too close to something and should stop. 2. ‘H’ can use sonar to follow a large, slow moving object, like a person, around. 3. Integration of sonar during color tracking.

CS4710 Senior Project10 Project Results  Voice Extreme 1.Merged speaker independent vocabularies with speaker dependent ones. 2. Communication with JStamp over serial port. 3. Playing math game  Improvements: 1.Implement ChipCorder to give “H” more personality. 2.Improve Vision and sonar

CS4710 Senior Project11  Achievements: 1.Team Work Conclusions 2. Gained valuable experience in embedded Java programming. 3. Integration of different hardware components and communication between them. 4. Code Documentation 5. Experience researching information and problems on our own

CS4710 Senior Project12 Conclusions (Cont)  Regrets: 1.Contact Voice Extreme company (Sensory) earlier. 2. Spend less time on small problems 3. Started with the Voice Extreme from the beginning

CS4710 Senior Project13 Demonstration Voice Commands 1.Back up 2.Go Forward 3.Left 4.Right 5.Stop 6.Main Menu 1.Ball 2.Attack 3.Present 4.Math 5.“Hey H” 7.Activate 8.Panic

CS4710 Senior Project14 QUESTIONS??  Team Work and Information:  Project Website:  Javadocs:  Java Code:  Voice Extreme Code: