1. Listener-Control Navigation of VoiceXML

2. Nuance Speech Analysis 92% of customer service is through phone. 84% of industrialists believe speech better than web.

3. W3C (’02) VoiceXML Forum (’00) Motorola (’98) HP (’98) IBM (’98) Bell/Lucent (’98) AT&T (‘95) History of VoiceXML PML SpeechML TalkML VoxML VoiceXML 1.0VoiceXML 2.0

4. VoiceXML Open standard-language for serving voice/audio documents. VoiceXML is designed for creating audio dialogs that feature. Synthesized speech, Digitized audio, Recognition of spoken and DTMF key input, Recording of spoken input, Telephony and Mixed-Initiative conversations.

5. VoiceXML (Cont’d) VoiceXML allows scripts/CGIs etc. Can take input from the listener via speech(fill out forms like in HTML). Used extensively for automated call handling. Makes info accessible over (cell) phones The next revolution on the Web.

6. Architectural Model

7. Goals of VoiceXML Web development and content delivery into voice response applications. Minimize client/server interactions. Separate code from service logic. Shield the application authors from platform specific details.

8. Voice Browser Software platform running on a network server. It supports the following features. ASR DTMF Recognition grammars Mixed-initiative dialog TTS Voice browser:VoiceXML :: Web browser:HTML

9. Voice Enabling

10. Sample VoiceXML Code <![CDATA[[ [(yes)]{ } [(no)] } ]]]> Would you like to get rich quick? Gotcha. You want to be rich! You don't want to be rich.

11. Problem with VoiceXML Navigation of the voice document. Author has to ask where listener will like to go next. Listener has absolutely no control over navigation. Tedium, Adv.Applications not possible. Analogy: Scroll vs book

12. Solution Allow users to control navigation interactively. Using Voice Anchors.

13. Voice Anchors Permit Speech labels that listeners can place on a dialog. Listener can return to that dialog later by uttering that label. Hard to implement, as free-form speech recognition is not possible. Need to incorporate in the voice browser.

14. Voice Anchors We developed a number of methods for attaching voice anchors. Most practical method: Spelling. Anchor as a whole word. Default anchors Default navigation strategies

15. Initial VXML Converter Augmented VXML Voice browser Creates a DB file Place Anchors Recall Anchor New VXML DB file

16. Our Architecture

17. Cumulative Anchors Different dialogs can be marked with the same label. Recalling the label reads out the corresponding dialogs. Multiple cumulative anchors in a single document. Allows creation of sub documents. Hierarchy of sub documents can be created.

18. Grammar Set of valid expressions. Each dialog references one or more grammars. Nuance Grammar Specification Language (GSL). Inline grammar and Offline grammar. Offline provides the following advantages: Can be generated dynamically (via CGI’s, ASP's). Reused by multiple dialogs or applications. Updated and modified without change in source code. Subgrammars and Form-level grammar.

19. Sample Grammar code <![CDATA[ [ [(skip)]{ } [(previous)]{ } [(place anchor) (call mark) (begin mark)]{ } [(recall mark) (recall anchor) (recall)]{ } ] ]]>

20. Initial VXML Converter Augmented VXML Voice browser Initial HTML Translator Reference to another link in Augmented VXML Get the HTML page

21. Applications Web access through voice. This involves the following sequence of steps HTML -> VXML Translator written in java was already developed. Navigation of VXML

22. Applications Mathematics for visually impaired. This involves the following steps. MathML -> VXML. A translator was developed to convert the MathML documents to VXML documents using the XSLT semantics. Navigation of VXML.

23. Conclusion & Future work Designing default navigation strategies. Unit of division for navigation. Voice Scripting Languages. Example: “repeat chlorine until exit”.