1. Speech Graffiti Tutorial FlightLine version Fall 03

2. What is Speech Graffiti? SPEECH GRAFFITI is a special way of speaking that makes it faster for you to exchange information with a computer that understands your speech. Speech Graffiti is easy to learn This tutorial will teach you how This tutorial uses a flight information system as an example, and afterwards you should be able to use any Speech Graffiti application. Let's get started!

3. With Speech Graffiti, you provide information to the system as if you were filling in a form. Say you're wondering what time USAirways flight 28 leaves Los Angeles…. On a form, you'd have to fill in this information: Phrases With Speech Graffiti, you speak this information in PHRASES just as if you were filling out a form: one phrase for each piece of information The phrases always sound like this: airline is USAirways, flight number is 28, departure city is Los Angeles

4. Phrases See the pattern? With Speech Graffiti, you speak this information in PHRASES just as if you were filling out a form: one phrase for each piece of information The phrases always sound like this: airline is USAirways, flight number is 28, departure city is Los Angeles With Speech Graffiti, you provide information to the system as if you were filling in a form. Say you're wondering what time USAirways flight 28 leaves Los Angeles…. On a form, you'd have to fill in this information:

5. Phrases See the pattern? You always give the type of thing you're talking about… With Speech Graffiti, you speak this information in PHRASES just as if you were filling out a form: one phrase for each piece of information The phrases always sound like this: airline is USAirways, flight number is 28, departure city is Los Angeles With Speech Graffiti, you provide information to the system as if you were filling in a form. Say you're wondering what time USAirways flight 28 leaves Los Angeles…. On a form, you'd have to fill in this information:

6. Phrases See the pattern? You always give the type of thing you're talking about… then say is … With Speech Graffiti, you speak this information in PHRASES just as if you were filling out a form: one phrase for each piece of information The phrases always sound like this: airline is USAirways, flight number is 28, departure city is Los Angeles With Speech Graffiti, you provide information to the system as if you were filling in a form. Say you're wondering what time USAirways flight 28 leaves Los Angeles…. On a form, you'd have to fill in this information:

7. Phrases See the pattern? You always give the type of thing you're talking about… then say is… then state the value you want to specify for that field. With Speech Graffiti, you speak this information in PHRASES just as if you were filling out a form: one phrase for each piece of information The phrases always sound like this: airline is USAirways, flight number is 28, departure city is Los Angeles With Speech Graffiti, you provide information to the system as if you were filling in a form. Say you're wondering what time USAirways flight 28 leaves Los Angeles…. On a form, you'd have to fill in this information:

8. Other applications As you just learned, input might look like this in a flight application airline is USAirways, flight number is 28, departure city is Los Angeles But Speech Graffiti works with many different applications For instance, in a movie info system, you might say movie is Titanic, theater is the Manor, day is Tuesday So you can see that although the vocabulary is different, the structure is the same

9. If things go wrong If the system doesn’t understand a phrase, it won’t confirm it, and it will also play this sound to alert you that it missed something. Then you can simply repeat the missing phrase, like this: airline is USAir, flight number is 630 airline is USAir USAirways...flight 630 ! !

10. flight 1059 Sometimes the system confirms the wrong information If this happens, you can erase your whole last utterance by saying scratch that, and then re-entering the erased info: If things go wrong airline is Northwest, flight number is 1059 scratch that scratched to Atlanta, flight 1059 airline is Northwest Northwest flight number is 1059

11. Delta If you ever find yourself wondering what information the system has successfully understood and retained from your query, you can just ask where was I? Where was I? departure city is Pittsburgh from Pittsburgh where was I? departure city is Pittsburgh, arrival city is Detroit airline is Delta airline is Delta, arrival airport is Detroit …to Detroit !

12. Review So now you know how to give information in Speech Graffiti phrases… airline is United How to recover from problems start over scratch that How to find out what the system has stored where was I? But you don't want to just give info to the system – you want to get info from it That's the next thing you'll learn…

13. To get information, ask a what?-question Asking questions airline is United, flight number is 1123 United, flight 1123 arrival city is Las Vegas, what is the arrival time? to Las Vegas, arriving at 6:29pm

14. To get information, ask a what?-question Asking questions So you just say… airline is United, flight number is 1123 United, flight 1123 arrival city is Las Vegas, what is the arrival time? to Las Vegas, arriving at 6:29pm

15. To get information, ask a what?-question Asking questions So you just say… what is (or what are)… airline is United, flight number is 1123 United, flight 1123 arrival city is Las Vegas, what is the arrival time? to Las Vegas, arriving at 6:29pm

16. To get information, ask a what?-question Asking questions So you just say… what are (or what is) and then the thing you want to know about airline is United, flight number is 1123 United, flight 1123 arrival city is Las Vegas, what is the arrival time ? to Las Vegas, arriving at 6:29pm

17. To get information, ask a what?-question Asking questions So you just say… what is (or what are) and then the thing you want to know about As another example, you could ask what is the departure gate? airline is United, flight number is 1123 United, flight 1123 arrival city is Las Vegas, what is the arrival time? to Las Vegas, arriving at 6:29pm

18. Other applications As with specifying phrases, when you ask questions in other Speech Graffiti systems, the vocabulary is different but the structure is the same theater is the Manor, movie is Titanic, what are the show times?

19. For general Speech Graffiti help, just say help Speech Graffiti can also let you know what kinds of things you can talk about in the system you're using just say options Getting help options you can specify or ask about airline, flight number, departure airport … departure airport can be Atlanta, Chicago O'Hare, Detroit … airline is Delta, departure airport options more Los Angeles, Pittsburgh, or you can ask, what is the departure airport?

20. The Speech Graffiti system plays this sound that you saw in the last slide when it is telling you about a long list Whenever you hear this sound, you can say more to hear the next chunk of the list When you're browsing a list, you can also navigate through the list by saying next – gives you the next single item previous – gives you the previous chunk first – goes back to the first item in the list last – skips ahead to the last item in the list repeat Lists …

21. Practice: questions & help How would do the following in Speech Graffiti? 1. find out which airlines are flying to Las Vegas 2. find out all the airlines you can ask about 3. hear the next chunk of a list

22. How would do the following in Speech Graffiti? 1. find out which airlines are flying to Las Vegas 2. find out all the airlines you can ask about 3. hear the next chunk of a list Practice: questions & help arrival city is Las Vegas, what are the airlines?

23. How would do the following in Speech Graffiti? 1. find out which airlines are flying to Las Vegas 2. find out all the airlines you can ask about 3. hear the next chunk of a list Practice: questions & help arrival city is Las Vegas, what are the airlines? airline options

24. How would do the following in Speech Graffiti? 1. find out which airlines are flying to Las Vegas 2. find out all the airlines you can ask about 3. hear the next chunk of a list Practice: questions & help arrival city is Las Vegas, what are the airlines? airline options more

25. Review In Speech Graffiti, you provide information in phrases & ask what-questions to get info flight number is 102, what is the departure gate? start over and scratch that help you recover from errors where was I? lets you know what the system knows means the system didn’t understand something you said, and means there are more items in a list ! …

26. Hints When you’re using a new application for the first time, say options to learn what you can talk about with that system Talk to the system in a normal voice Speech Graffiti remembers what you enter until you say start over see example on next slide

27. where was I? departure airport is Denver, what is departure time?, airline is USAirways USAirways, 5 departure times, 7:05am, 11:50am, 1:35pm … where was I? departure airport is Denver, what is departure time? departure airport is Denver, what are the departure times? airline is USAir, go ahead from Denver, 97 departure times: 6:00am, 6:10am, 6:13am … If the system already has a question stored, saying go ahead will re-ask that question

28. Continental flight 1455, departing at 5:45pm, departing from gate D79, arriving at 7:52pm, arriving at gate D2 … In some applications, saying go ahead will give you all the information for the items you provide Instead of asking what is the airline, what is the flight number, what is the departure time, etc. Go ahead, part 2 departure city is Pittsburgh, arrival city is Houston from Pittsburgh, to Houston Intercontinental connection is none, go ahead nonstop flight. 7 matches: Continental flight 655, departing at 6:30am, departing from gate D79, arriving at 8:31am, arriving at gate D2 … more

29. OK – that's all there is to know about Speech Graffiti! Have fun! Ready?