1. Speech Graffiti Tutorial MovieLine version Fall 03

2. What is Speech Graffiti? SPEECH GRAFFITI is a special way of speaking that makes it faster for you to exchange information with a computer that understands your speech. Speech Graffiti is easy to learn This tutorial will teach you how This tutorial uses a movie information system as an example, and afterwards you should be able to use any Speech Graffiti application. Let's get started!

3. Phrases With Speech Graffiti, you provide information to the system as if you were filling in a form. Say you're wondering what time Titanic is playing at the Manor theater on Tuesday…. On a form, you'd have to fill in this information: With Speech Graffiti, you speak this information in PHRASES just as if you were filling out a form: one phrase for each piece of information The phrases always sound like this: movie is Titanic, theater is the Manor, day is Tuesday

4. Phrases With Speech Graffiti, you provide information to the system as if you were filling in a form. Say you're wondering what time Titanic is playing at the Manor theater on Tuesday…. On a form, you'd have to fill in this information: See the pattern? With Speech Graffiti, you speak this information in PHRASES just as if you were filling out a form: one phrase for each piece of information The phrases always sound like this: movie is Titanic, theater is the Manor, day is Tuesday

5. Phrases With Speech Graffiti, you provide information to the system as if you were filling in a form. Say you're wondering what time Titanic is playing at the Manor theater on Tuesday…. On a form, you'd have to fill in this information: See the pattern? You always give the type of thing you're talking about… With Speech Graffiti, you speak this information in PHRASES just as if you were filling out a form: one phrase for each piece of information The phrases always sound like this: movie is Titanic, theater is the manor, day is Tuesday

6. Phrases With Speech Graffiti, you provide information to the system as if you were filling in a form. Say you're wondering what time Titanic is playing at the Manor theater on Tuesday…. On a form, you'd have to fill in this information: See the pattern? You always give the type of thing you're talking about… then say is … With Speech Graffiti, you speak this information in PHRASES just as if you were filling out a form: one phrase for each piece of information The phrases always sound like this: movie is Titanic, theater is the manor, day is Tuesday

7. Phrases With Speech Graffiti, you provide information to the system as if you were filling in a form. Say you're wondering what time Titanic is playing at the Manor theater on Tuesday…. On a form, you'd have to fill in this information: See the pattern? You always give the type of thing you're talking about… then say is… then state the value you want to specify for that field. With Speech Graffiti, you speak this information in PHRASES just as if you were filling out a form: one phrase for each piece of information The phrases always sound like this: movie is Titanic, theater is the manor, day is Tuesday

8. Other applications As you just learned, input might look like this in a movie application movie is Titanic, theater is the Manor, day is Tuesday But Speech Graffiti works with many different applications For instance, in a flight information system, you might say airline is USAirways, flight number is 28, departure city is Los Angeles So you can see that although the vocabulary is different, the structure is the same

9. Confirmation The Speech Graffiti system will always confirm what it thought it heard you say movie is Titanic Titanic theater is the Manor, date is Tuesday the Cinemagic Manor theater, Tuesday If anything goes wrong, you can start over by saying start over start over

10. Practice: phrases How would you make Speech Graffiti phrases with the following information? 1. Showcase East theater 2. on Sunday 3. comedies

11. Practice: phrases How would you make Speech Graffiti phrases with the following information? 1. Showcase East theater 2. on Sunday 3. comedies theater is Showcase East

12. Practice: phrases How would you make Speech Graffiti phrases with the following information? 1. Showcase East theater 2. on Sunday 3. comedies theater is Showcase East day is Sunday

13. Practice: phrases How would you make Speech Graffiti phrases with the following information? 1. Showcase East theater 2. on Sunday 3. comedies theater is Showcase East day is Sunday genre is comedy

14. If things go wrong If the system doesn’t understand a phrase, it won’t confirm it, and it will also play this sound to alert you that it missed something. Then you can simply repeat the missing phrase, like this: theater is Showcase East, genre is thriller theater is Showcase East Showcase Cinemas Pittsburgh East...thriller ! !

15. after 7 pm Sometimes the system confirms the wrong information If this happens, you can erase your whole last utterance by saying scratch that, and then re-entering the erased info: If things go wrong theater is the Manor, show time is after 7pm scratch that scratched Cinemagic Manor Theater, after 10 pm theater is the Manor Cinemagic Manor Theater show time is after 7pm

16. Regent Square theater If you ever find yourself wondering what information the system has successfully understood and retained from your query, you can just ask where was I? Where was I? movie is Titanic Titanic where was I? movie is Titanic, show time is before 10 pm theater is Regent Square theater is Regent Square, show time is before 10 pm …before 10 pm !

17. Review So now you know how to give information in Speech Graffiti phrases… theater is the Manor How to recover from problems start over scratch that How to find out what the system has stored where was I? But you don't want to just give info to the system – you want to get info from it That's the next thing you'll learn…

18. To get information, ask a what?-question Asking questions theater is the Manor, movie is Titanic Cinemagic Manor Theater, Titanic what are the show times? 3 show times: 5:25pm, 8:10pm, 11:30pm

19. To get information, ask a what?-question Asking questions So you just say… theater is the Manor, movie is Titanic Cinemagic Manor Theater, Titanic what are the show times? 3 show times: 5:25pm, 8:10pm, 11:30pm

20. To get information, ask a what?-question Asking questions So you just say… what are (or what is)… theater is the Manor, movie is Titanic Cinemagic Manor Theater, Titanic what are the show times? 3 show times: 5:25pm, 8:10pm, 11:30pm

21. To get information, ask a what?-question Asking questions So you just say… what are (or what is) and then the thing you want to know about theater is the Manor, movie is Titanic Cinemagic Manor Theater, Titanic what are the show times ? 3 show times: 5:25pm, 8:10pm, 11:30pm

22. To get information, ask a what?-question Asking questions So you just say… what are (or what is) and then the thing you want to know about As another example, you could ask what is the rating? theater is the Manor, movie is Titanic Cinemagic Manor Theater, Titanic what are the show times? 3 show times: 5:25pm, 8:10pm, 11:30pm

23. Other applications As with specifying phrases, when you ask questions in other Speech Graffiti systems, the vocabulary is different but the structure is the same airline is United, flight number is 1123, arrival city is Las Vegas, what is the arrival time?

24. more For general Speech Graffiti help, just say help Speech Graffiti can also let you know what kinds of things you can talk about in the system you're using just say options Getting help options show times are after 10 pm, genre options you can specify or ask about title, theater, show time … comedy, drama, or you can ask, what is the genre? genre can be action, adventure,animation …

25. The Speech Graffiti system plays this sound that you saw in the last slide when it is telling you about a long list Whenever you hear this sound, you can say more to hear the next chunk of the list When you're browsing a list, you can also navigate through the list by saying next – gives you the next single item previous – gives you the previous chunk first – goes back to the first item in the list last – skips ahead to the last item in the list repeat Lists …

26. Practice: questions & help How would do the following in Speech Graffiti? 1. find out which movies are playing at the Manor theater 2. find out all the neighborhoods you can ask about 3. hear the next chunk of a list

27. Practice: questions & help How would do the following in Speech Graffiti? 1. find out which movies are playing at the Manor theater 2. find out all the neighborhoods you can ask about 3. hear the next chunk of a list theater is the Manor, what are the movies?

28. Practice: questions & help How would do the following in Speech Graffiti? 1. find out which movies are playing at the Manor theater 2. find out all the neighborhoods you can ask about 3. hear the next chunk of a list theater is the Manor, what are the movies? neighborhood options

29. Practice: questions & help How would do the following in Speech Graffiti? 1. find out which movies are playing at the Manor theater 2. find out all the neighborhoods you can ask about 3. hear the next chunk of a list theater is the Manor, what are the movies? neighborhood options more

30. Review In Speech Graffiti, you provide information in phrases & ask what-questions to get info theater is the Manor, what are the movies? start over and scratch that help you recover from errors where was I? lets you know what the system knows means the system didn’t understand something you said, and means there are more items in a list ! …

31. Hints When you’re using a new application for the first time, say options to learn what you can talk about with that system Talk to the system in a normal voice Speech Graffiti remembers what you enter until you say start over see example on next slide

32. where was I? theater is Cinemagic Manor theater, what is show time?, title is Titanic Titanic, 5 show times, 1:25pm, 3:50pm, 7:10pm … where was I? theater is Cinemagic Manor theater, what is show time? theater is the Manor, what are the show times? title is Titanic, go ahead Cinemagic Manor theater, 58 show times: 11:50am, noon, 12:05pm … If the system already has a question stored, saying go ahead will re-ask that question

33. Continental flight 1455, departing at 5:45pm, departing from gate D79, arriving at 7:52pm, arriving at gate D2 … In some applications, saying go ahead will give you all the information for the items you provide Instead of asking what is the airline, what is the flight number, what is the departure time, etc. Go ahead, part 2 departure city is Pittsburgh, arrival city is Houston from Pittsburgh, to Houston Intercontinental connection is none, go ahead nonstop flight. 7 matches: Continental flight 655, departing at 6:30am, departing from gate D79, arriving at 8:31am, arriving at gate D2 … more

34. OK – that's all there is to know about Speech Graffiti! Have fun! Ready?