1. Spontaneous Voice Driven Interaction with Avatars: Discriminating Alerting and Referential Contexts of Sentinel Words
The Problem
The Solution
e-WUW: Technology with increased accuracy of One (1) error per 23,635 words!
Humans can not spontaneously interact with computers using their voice.
Human-Machine Interaction (Press-to-talk):
Optimistic Word Accuracy Rate is 99%
State-of-the-Art Speech Recognition:
words per minute:
Spontaneous Speech:
One (1) error in less than a minute.
Spontaneous Voice Only Hands-Free Computer Interaction is not possible!
No Hands-Free Interface:
e-WUW Recognizer
Text-to-Speech
Dictation System
Command and Control
Application Dependent Actions
Hi Neytiri!
“Jake!” … 1 1 2 2 3 3 PI
PhD 3
Student
PhD 2
PhD 1
Co-PI
Research Approach
Research Team + Expenses:
Dr. Kepuska (PI), Dr. Carstens (Co-PI) + 3 PhD’s: $293, $109,047 (Tuition) + $ 29,000 (Misc)
3 Years Total (including FIT’s MTDC): $509,808 or $169,935/year
Data Collection & Analysis
Data collection from movie DVD’s (Human-to-Human): to be made publically available.
Wizard-of-Oz and using PowerPoint Commander (Human-Machine)
Prosodic Research & Modeling
Research & Develop Models from Prosodic Features for Sentinel Word Context Discrimination
White Paper Documenting the Work.
Integration & Develop-ment
Integration of e-WUW with Windows OS
Speech Centric Interface to Windows OS using Sentinel Word Recognition
Time Table
5/10/2019
Dr. V. Këpuska