PG 1 Caroline V Nelson Speech Solutions Team Technical Lead Nortel Enterprise Multimedia Professional Services August 20, 2007 Success Criteria for Speech.

Slides:



Advertisements
Similar presentations
Connected Health Framework
Advertisements

Telephony Speech Recognition Application Testing Presentation for IEEE SCV Signal Processing Society March 8, 2004 Copyright CoAssure, Inc., 2004.
Tuning Jenny Burr August Discussion Topics What is tuning? What is the process of tuning?
CUSTOMER SERVICE. Customer service is a series of activities designed to enhance the level of customer satisfaction – that is, the feeling that a product.
Ensuring Quality Support by Measuring Quality of Responses Mike Myers Director – Help Desk Operations Robin Rea Process Services Project Manager CompuCom.
DIREC TV Look Whos Talking Michael Uhlenkamp Call Center Technology Manager Speech to Increase Revenue & Decrease Costs (D103),
HP Quality Center Overview.
Planning Ahead for Optimal Contact Center Deployment Phil Odence, VP Contact Center Business, Empirix.
TECHNOLOGY FOR MOBILE ADVERTISING SEARCH & COMMERCE © 2007 Apptera Inc. Optimizing Software Architecture for Voice Search SpeechTek 2007.
… … …… Best Practices To.
1 Profit from usage data analytics: Recent trends in gathering and analyzing IVR usage data Vasudeva Akula, Convergys Corporation 08/08/2006.
Leveraging a Multi-dimensional View of the Customer Experience to Optimize Speech Lori Etheridge Sr. Director Convergys Consulting Services.
Building the Foundation for an Exceptional Caller Experience Tom Smith Sr. Manager, IVR/Speech Product Marketing Verizon Business August 9, 2006.
© 2007 Cisco Systems, Inc. All rights reserved.Cisco ConfidentialSpeechTEK August 22, 2007 Presented by Jason Tepper Cisco Contact Center Business.
Convergys Confidential and Proprietary Copyright © 2007 Convergys Corporation Meeting Business Goals with Speech Speech & Self-Service Strategy.
Managing Complexity: 3rd Generation Speech Applications Roberto Pieraccini August 7, 2006.
SPEECH DRIVES CRM Ease of Use Reliability, Accuracy and Completeness On-the-spot, on-the-go, any phone, even while walking and driving Brian Gebert Shunra.
Managing Speech Projects for Maximum Efficiency Christoph Mosing, Vice President of Professional Services, Envox Worldwide.
Packaged Call Routing and Service Creation Leveraging SOA Will Becchina, Nortel Multimedia Applications Business Development 8/9/06.
John Quirk VP Enterprise Services PSC Group, LLC.
ITIL A Team GALIP Presentation A. Silverman, N. Elovitz, L. Johnson, M. Saxena, W. Zhao.
Performance Measurement and Strategic Information Management
Overview of CompassLearning Odyssey. CompassLearning and Palm Beach Schools CompassLearning is partnering with the Palm Beach.
Copyright © 2004 by South-Western, a division of Thomson Learning, Inc. All rights reserved. Developed by Cool Pictures and MultiMedia Presentations Copyright.
Performance Planning Presented by: Mike Dougherty AVP for Human Resources.
Listening Methods In-Depth IVR and End to End Call Analytics What is the Real Performance of My Voice Self-Service Solution? Can I compare my IVR Design.
1 A Practical Rollout & Tuning Strategy Phil Shinn 08/06.
© 2009 Netezza, Inc. All rights reservedConfidential August 29, 2015 Page 1 Netezza Customer Support.
a Service Oriented Architecture
1 Requirements Analysis and Design Engineering Southern Methodist University CSE 7313.
ICELW, New York, June PROJECT USABILITY : SCHMOOSABILITY …what does it matter?
Beyond Usability: Measuring Speech Application Success Silke Witt-Ehsani, PhD VP, VUI Design Center TuVox.
SpeechCycle Confidential Confidential 1 Optimizing Natural Language Interfaces: No Data Like More Data SpeechTEK New York, 2007 Jonathan Bloom & Roberto.
Message Technologies, Inc. Measuring Success for Hosted Speech Applications Presented by: Laura Grahame Technical Manager.
THE MANAGEMENT AND CONTROL OF QUALITY, 5e, © 2002 South-Western/Thomson Learning TM 1 Chapter 8 Performance Measurement and Strategic Information Management.
Convergys Confidential and Proprietary Automating Redelivery for the USPS Kristie Goss Convergys Corporation
Designing Speech Applications for Older Demographics Caroline Leathem 8 th August 2006.
© GyrusLogic, Inc. Improved call completion with Natural Language Processing Peter Trompetter Vice President Global Development
VUI: Tuning the VUI, Not Tuning The Parameters Alex Massie, Director of Business Solutions, ClickFox Tuesday, August 8, 2006.
Improving Customer Loyalty: Analyzing Your Customer Interactions
This information is confidential and proprietary to Lawson ® and cannot be reproduced without permission. Reducing Resolution Time with Advanced Electronic.
Super-charge Your Speech Application With Cross- Functional Reporting Techniques Bjorn Austraat Director, Solution Delivery TuVox, Inc. August 9 th, 2006.
Speech at CIGNA Beth Lira August 7,2006. Divider page title goes here.
Connecticut Computer Measurement Group 2015 Spring Meeting 5 Ingredients to Executing Application Performance Management on.
Avoiding the Pitfalls of Speech Application Rollouts Through Testing and Production Management Rob Edmondson, Senior Field Engineer Empirix, Inc.
Speech and the Health Care Professional Community Maureen Cusanelli August 7, 2006.
© 2008 SpeechCycle, Inc. More Than Call Steering Managing Dynamic Contextual Complexity Phillip Hunter VP, Application Design/Development SpeechTek NYC.
PG 1. PG 2 Improving Speech Applications with Usability Surveys How does Nortel measure the ‘Usability Pulse’ of Self Service? Judith Sherwood Sales Engineer.
Tuning Your Application: The Job’s Not Done at Deployment Monday, February 3, 2003 Developing Applications: It’s Not Just the Dialog.
ERP Implementation Fundamentals Richard Byrom Oracle Consultant, Speaker and Author
Copyright 2003 – Cedar Enterprise Solutions, Inc. All rights reserved. Business Process Redesign & Innovation University of Maryland, University College.
Enable self-service – users make requests on demand Standardize and deliver Templates, workflows, processes and a common CDMB enable automation The Service.
Information, Analysis, and Knowledge Management in the Baldrige Criteria Examines how an organization selects, gathers, analyzes, manages, and improves.
Integration integration of all the information flowing through a company – financial and accounting, human resource information, supply chain information,
Data Warehousing 101 Howard Sherman Director – Business Intelligence xwave.
Speech Processing 1 Introduction Waldemar Skoberla phone: fax: WWW:
Simplifying IT, Empowering Business.
IBM Control Desk Enabling the Enterprise App Store –
GSA IT Strategic Plan 2009 – 2011 August 2007 US General Services Administration 1.
MEASURING BPM SOFTWARE ROI AND ITS BENEFITS IN RISK MANAGEMENT PROCESS AUTOMATION Contact us at | Web : | Tel: 1.
Why Database Management is Important for Well-Performing Companies.
Intuit Support Number for QuickBooks
Garmin cycling devices map support service Call for
Are You having trouble with Brother Printer here is the quick solution for all the Errors in Brother Printer let us know call to connect.
 Independent technical support service provider  World Class Service  Experienced technicians  Quick solutions.
If Are You having Any CCTV installation Issues? Here is the quick solution for every Errors in CCTV installation to connect with Our Technician.
 Independent technical support service provider  World Class Service  Experienced technicians  Quick solutions.
Nigel G. Ward, Anais G. Rivera, Karen Ward, David G. Novick
Data in Businesses Slide 7.
Agenda The current Windows XP and Windows XP Desktop situation
Presentation transcript:

PG 1 Caroline V Nelson Speech Solutions Team Technical Lead Nortel Enterprise Multimedia Professional Services August 20, 2007 Success Criteria for Speech Applications

NORTEL CONFIDENTIAL PG 2 Zen and the Art of Speech Applications >We all want to deploy “successful” speech systems >But what exactly is the definition of “success”? >That depends on who you ask…

NORTEL CONFIDENTIAL PG 3 “Success” depends on who you ask… Three different perspectives: Purchasing Customer Speech Scientist End User (Caller)

NORTEL CONFIDENTIAL PG 4 Speech Scientist (designs/develops the app) >The Micro View: Recognition Accuracy In/Out of Grammar Utterances Per-state “success” (retries, etc) Host database interaction Caller transactions (tasks across multiple dialog states)

NORTEL CONFIDENTIAL PG 5 “Micro” can’t see the forest for the trees… >The recognition accuracy numbers look great! (but there’s a very high rate of callers speaking out-of- grammar…) >The overall speech numbers look nice! (but broken out into states shows a hotspot down the flow path…) >The speech is working like a charm! (but the back-end host is experiencing some serious issues…)

NORTEL CONFIDENTIAL PG 6 End Use Caller (calls into the app) >The “Middle-Management” View: Task Completion Quick Easy “usability”

NORTEL CONFIDENTIAL PG 7 Now that we have the foundation… >Need speech scientist metrics to achieve caller goals Callers prompted to speak in- grammar Utterances recognized Error recovery through effective strategies Reliable back-end host data >Caller “task” start & end points must be defined and agreed upon in advance to be properly logged. >But if it’s awkward and cumbersome to use… Which is why we do usability testing – right?

NORTEL CONFIDENTIAL PG 8 Customer (purchases the app for business) >The Macro View: Self-service call containment Cost reduction Customer (caller) satisfaction = loyalty/retention >In the end it’s all about the bottom line $$$

NORTEL CONFIDENTIAL PG 9 Comparison is Key to “Macro” >Usability testing for caller satisfaction Benchmarking against “industry standards” >Need metrics from previous system (dtmf?) for comparison To demonstrate level of improvement >If no previous system… Then each self service completed task is automation gain Compare automation level against benchmarks per industry

NORTEL CONFIDENTIAL PG 10 It’s all connected… Macro Micro Mid-level >Recognition accuracy >In/Out of Grammar >State success (retries, etc) >Reliable host data >Task completion >Quick and easy >“Usability” >Customer satisfaction >Self-service automation >Call containment >Bottom line $$$

NORTEL CONFIDENTIAL PG 11 Be careful what you measure… >…because what you measure is what you’ll get. >Metrics need to be identified, agreed upon and planned in advance – including any comparison measures.