© 2002 – 2007 Versay Solutions, LLC. All rights reserved. Building Fault Tolerant Voice User Interfaces SpeechTEK 2007 Tuesday, August 21 Track B “Getting.

Slides:

Advertisements

Similar presentations

{Customer} Divisions Plan {Date} – {Version} Salesforce.com.

Advertisements

Tuning Jenny Burr August Discussion Topics What is tuning? What is the process of tuning?

MIGRATION MIGR-09. How to Run Your Next Implementation... Don't Let It Run You! Patricia Johnson Senior Systems Consultant Strategic Systems Group, Inc.

Automatic Switchboard Operator Luboš Šmídl, Tomáš Valenta Department of Cybernetics Faculty of Applied Sciences University of West Bohemia in Pilsen.

Chapter 11 user support. Issues –different types of support at different times –implementation and presentation both important –all need careful design.

Convergys Confidential and Proprietary Copyright © 2007 Convergys Corporation To Confirm, or Not to Confirm … That is the Question Kristie Goss Convergys.

You be the Expert! Speech & the End-to-end Customer Experience Lizanne Kaiser, Ph.D. Customer Experience Designer Genesys August 20, 2007, 3:00pm, B104.

Collaborative Customer Relationship Management (CCRM) User Group June 23 rd, 2004.

1 August 9, David Claiborn SLM Tuning: Lessons Learned.

TECHNOLOGY FOR MOBILE ADVERTISING SEARCH & COMMERCE © 2007 Apptera Inc. Optimizing Software Architecture for Voice Search SpeechTek 2007.

Building the Foundation for an Exceptional Caller Experience Tom Smith Sr. Manager, IVR/Speech Product Marketing Verizon Business August 9, 2006.

Alternate Software Development Methodologies

© 2007 Cisco Systems, Inc. All rights reserved.Cisco ConfidentialSpeechTEK August 22, 2007 Presented by Jason Tepper Cisco Contact Center Business.

Voice Guidelines 1© 2013 by Larson Technical Services.

Managing Complexity: 3rd Generation Speech Applications Roberto Pieraccini August 7, 2006.

Final Project Presentation A Spoken Dialog System using the VoiceXML 2.1 platform to automate the ordering process for a pizza restaurant Scott Simpson.

Managing Speech Projects for Maximum Efficiency Christoph Mosing, Vice President of Professional Services, Envox Worldwide.

Classification of Users. 4 What assumptions can be made about target users’ groups in terms of: –expected frequency of use of system –knowledge of task.

Help and Documentation zUser support issues ydifferent types of support at different times yimplementation and presentation both important yall need careful.

Designing Help… Mark Johnson Providing Support Issues –different types of support at different times –implementation and presentation both important.

ITCS 6010 Spoken Language Systems: Architecture. Elements of a Spoken Language System Endpointing Feature extraction Recognition Natural language understanding.

©Ian Sommerville 2000Software Engineering, 6th edition. Chapter 19Slide 1 Verification and Validation l Assuring that a software system meets a user's.

Economics 214 Lecture 2 Mathematical Framework of Economic Analysis Continued.

1 Shaping in Speech Graffiti: results from the initial user study Stefanie Tomko Dialogs on Dialogs meeting 10 February 2006.

1 Software Testing and Quality Assurance Lecture 30 – Testing Systems.

Regular Expressions and Automata Chapter 2. Regular Expressions Standard notation for characterizing text sequences Used in all kinds of text processing.

Alicia Abella AT&T Labs – Research Florham Park, New Jersey

IVR PROCESS. Introduction IVR is a technology that allows a computer to interact with humans through the use of voice and DTMF tones input via keypad.

Listening Methods In-Depth IVR and End to End Call Analytics What is the Real Performance of My Voice Self-Service Solution? Can I compare my IVR Design.

Mobile Multimodal Applications. Dr. Roman Englert, Gregor Glass March 23 rd, 2006.

1 A Practical Rollout & Tuning Strategy Phil Shinn 08/06.

Using Six Sigma to Achieve CMMI Levels 4 and 5

Beyond Usability: Measuring Speech Application Success Silke Witt-Ehsani, PhD VP, VUI Design Center TuVox.

Performance Dashboard

CLEANROOM SOFTWARE ENGINEERING.

CS 501: Software Engineering Fall 1999 Lecture 16 Verification and Validation.

1 © 2005 course technology University Of Palestine Chapter 6 Storyboarding the User’s Experience.

Conversational Applications Workshop Introduction Jim Larson.

1 High Resolution Statistical Natural Language Understanding: Tools, Processes, and Issues. Roberto Pieraccini SpeechCycle

© GyrusLogic, Inc. Improved call completion with Natural Language Processing Peter Trompetter Vice President Global Development

Super-charge Your Speech Application With Cross- Functional Reporting Techniques Bjorn Austraat Director, Solution Delivery TuVox, Inc. August 9 th, 2006.

© 2006 Cisco Systems, Inc. All rights reserved.Cisco ConfidentialPresentation_ID 1 VUI Directory Handler Ben Shanfelder UCBU Software Engineer.

NDIA Systems Engineering Supportability & Interoperability Conference October 2003 Using Six Sigma to Improve Systems Engineering Rick Hefner, Ph.D.

© 2005 course technology1 1 1 University Of Palestine UML for The IT Business Analyst A practical guide to Object Oriented Requirement Gathering Hoard.

PG 1 Caroline V Nelson Speech Solutions Team Technical Lead Nortel Enterprise Multimedia Professional Services August 20, 2007 Success Criteria for Speech.

© 2008 SpeechCycle, Inc. More Than Call Steering Managing Dynamic Contextual Complexity Phillip Hunter VP, Application Design/Development SpeechTek NYC.

1 To Example or Not To Example, That is the Natural Language Question Frederick Parkinson, PhD, Project Manager, User Interface Designer Deborah Rapsinski,

Voice User Interface

Copyright © 2010 Certification Partners, LLC -- All Rights Reserved Perl Specialist.

Bernd Möbius CoE MMCI Saarland University Lecture 7 8 Dec 2010 Unit Selection Synthesis B Möbius Unit selection synthesis Text-to-Speech Synthesis.

Complaints Resolution Framework March What is a Complaints Resolution Framework? The International Standard on complaint handling ISO 1002 directs.

Speech Recognition MIT SMA 5508 Spring 2004 Larry Rudolph (MIT)

Defect resolution  Defect logging  Defect tracking  Consistent defect interpretation and tracking  Timely defect reporting.

Chap#11 What is User Support?

1 © 2003, Cisco Systems, Inc. All rights reserved. CCNP 1 v3.0 Module 1 Overview of Scalable Internetworks.

Formal Methods in SE Software Verification Using Formal Methods By: Qaisar Javaid, Assistant Professor Formal Methods1.

CIS 210 Systems Analysis and Development Week 7 Part II Designing Interfaces and Dialogues,

SEESCOASEESCOA SEESCOA Meeting Activities of LUC 9 May 2003.

Speech Processing 1 Introduction Waldemar Skoberla phone: fax: WWW:

2/12/04 Slide 1 SBC Laboratories User Needs and User Profiling.

Stanford hci group / cs376 u Jeffrey Heer · 19 May 2009 Speech & Multimodal Interfaces.

Agent-Based Dialogue Management Discourse & Dialogue CMSC November 10, 2006.

Introduction to Machine Learning, its potential usage in network area,

Chapter 10 – Software Testing

Mid Term II Review.

Baisc Of Software Testing

Chapter 11 user support.

Proper functionality Good human computer interface Easy to maintain

Executive Project Kickoff

Presentation transcript:

© 2002 – 2007 Versay Solutions, LLC. All rights reserved. Building Fault Tolerant Voice User Interfaces SpeechTEK 2007 Tuesday, August 21 Track B “Getting the VUI Right when Recognition Goes Wrong”

© 2002 – 2007 Versay Solutions, LLC. All rights reserved. Versay Solutions, LLC Daniel Padgett Senior Speech Technology Consultant Jessica Peterson Hicks, Ph.D. Speech Technology Consultant

© 2002 – 2007 Versay Solutions, LLC. All rights reserved. Fault Tolerant Voice User Interfaces Error Prevention Error Resolution

© 2002 – 2007 Versay Solutions, LLC. All rights reserved. Directed Dialog Prompt Design Grammar Coverage

© 2002 – 2007 Versay Solutions, LLC. All rights reserved. Proof of Concept NL Routing Application Natural Language (NL) Main Menu –“How can I help you?” Main Menu Confirmation “Back Off” Menu to support Main Menu failures Disambiguation dialog states Form-filling dialog states

© 2002 – 2007 Versay Solutions, LLC. All rights reserved. Case Study – Back Off Main Menu Initial Prompt –Designed to handle exception cases from Main Menu –Options mapped to core business practices Grammar –Optimally constrained static grammar –5 slots / semantic interpretations

© 2002 – 2007 Versay Solutions, LLC. All rights reserved. Case Study – Back Off Main Menu

© 2002 – 2007 Versay Solutions, LLC. All rights reserved. Case Study – Main Menu Confirmation Initial Prompt –Dynamically constructed –Covered ~100 categories “Okay. [You need to change your address.] Is that right?” Grammar –Optimally constrained static grammar –2 slots / semantic interpretations

© 2002 – 2007 Versay Solutions, LLC. All rights reserved. Case Study – Main Menu Confirmation

© 2002 – 2007 Versay Solutions, LLC. All rights reserved. Robust Interpretation (RI) Statistical Language Models Interpretation Grammars

© 2002 – 2007 Versay Solutions, LLC. All rights reserved. RI – Back Off Main Menu Statistical Language Model –Training set of ~2500 utterances –Test set of ~1000 utterances Interpretation Grammar –8 slots / semantic interpretations

© 2002 – 2007 Versay Solutions, LLC. All rights reserved. RI – Back Off Main Menu

© 2002 – 2007 Versay Solutions, LLC. All rights reserved. RI – Main Menu Confirmation Statistical Language Model –Training set of ~3000 utterances –Test set of ~1000 utterances Interpretation Grammar –20 slots / semantic interpretations –Y, N, N+RoutingCategory, RoutingCategory

© 2002 – 2007 Versay Solutions, LLC. All rights reserved. RI – Main Menu Confirmation

© 2002 – 2007 Versay Solutions, LLC. All rights reserved. Error Prevention - Summary Robust Interpretation for two key states Considerable increases in coverage Significant decreases in no-match rates Minimal False-Accepts

© 2002 – 2007 Versay Solutions, LLC. All rights reserved. Fault Tolerant Voice User Interfaces Error Prevention Error Resolution

© 2002 – 2007 Versay Solutions, LLC. All rights reserved. Error Resolution Dialog State Error Strategy Universal Error Strategy Task-related Error Strategy

© 2002 – 2007 Versay Solutions, LLC. All rights reserved. Established Methods Dialog State Error Handling –Escalating error strategy –No-input and no-match handlers –Implicit DTMF Universal Error Handling –Increment for each no-match, no-input –Transfer when maximum exceeded

© 2002 – 2007 Versay Solutions, LLC. All rights reserved. Dialog State Error Strategy Escalating error handling –Rapid reprompt –Explicit DTMF on penultimate error prompt –Transfer on final error Combination of no-match and no-input handlers

© 2002 – 2007 Versay Solutions, LLC. All rights reserved. Universal Error Strategy Increment / decrement counter Score errors on distinct dimensions –Number –Consecutivity

© 2002 – 2007 Versay Solutions, LLC. All rights reserved. Task-related Error Strategy Determine “sensitivity” level for each call path Allow fewer errors on sensitive paths, more errors on less sensitive paths –Report a Problem = highly sensitive –Monthly Payment = moderately sensitive –Hours of Operation / Location = less sensitive

© 2002 – 2007 Versay Solutions, LLC. All rights reserved. Customer Service Universals Acknowledge Explain Re-prompt

© 2002 – 2007 Versay Solutions, LLC. All rights reserved. Customer Service Universals – Case Study

© 2002 – 2007 Versay Solutions, LLC. All rights reserved. Summary Fault Tolerance means striking the right balance between: Error Prevention Error Resolution

© 2002 – 2007 Versay Solutions, LLC. All rights reserved. Contact Us (888)