1. CS 2610 Project Presentation Presented By- Zuha Agha and Tazin Afrin
Real-time Public Speech Delivery & Pronunciation Feedback using Vibration Interfaces
CS 2610 Project Presentation
Presented By-
Zuha Agha and Tazin Afrin

2. Outline
Problem Statement
Project Proposal
Demo
User Study

3. Problem Statement
“Can vibration based interfaces provide real-time feedback on public speech delivery and pronunciation in an effective and nonintrusive way? ”

4. Project Proposal
Assist public speech delivery by providing real-time feedback
Vibration based notification interface via smartphones
Minimal distraction for both the speaker and the audience

5. Project Phases Offline Feedback Online Feedback Evaluation & Analysis
Use speech recognizer to transcribe audio offline
Determine pronunciation quality from transcribed output
Display pronunciation mistakes with corrections on smartphone
Online Feedback
Set up smartphone and computer server communication
Process audio input online and compute loudness over a window of stream
Send vibrations to smart phone for real-time speed feedback periodically - short vibration means you are talking too soft and long vibration means too loud
Evaluation & Analysis
Design user evaluation survey
Recruit participants (8)
Get participants input to determine usefulness of our feedback system
Have human judges determine correctness of our feedback system
Statistical Analysis

6. PROJECT PROGRESS DEMO

7. Screenshots of the App
At first we set up the range for loudness. Too low range is x1 to x2. Normal range is y1 to y2 and Too high range is z1 or above DB ?
For Too Low it vibrates for X seconds and for Too High it vibrates for Z seconds. At START it starts listening and at STOP it stops listening.
After stop is shows how many times it got LOW / HIGH signal.

8. Screenshots of the App

9. User Study

10. User Study 8 participants Feedback System Fill up a survey
3 female
5 male
Feedback System
Vibration only - Read from printed copy (2 trials)
Vibration + Visual Feedback – Read from device screen (2 trials)
Fill up a survey
At the end we counted number of Low pitch or High pitch warnings.

11. Learning Curve
As we can see only in 4 trial the users learned the system. Will the users also say the same in the survey ? Will see

12. Survey Question (Ratings 1 to 5)
How much helpful was the system for your public speaking ?
How much did your quality of speaking improved during the demo ?
Did the application help you to vary the volume of speaking ?
Did you feel distracted during speaking ?
How much easy is the feedback system to follow ?
Will you use it in future for public speaking ?
Which system between the two (Vibration only vs Visual+Vibration) did you find more useful ?

13. Survey Questions Example

14. Survey Statistics

15. Comparison between the two feedback type

16. Thank you
Questions ?