1. Speech Database/Tool System And Preliminary Accent study.
Dr. Charles Tappert a.k.a (Project Manager)
Arthur Phidd, DPS a.k.a (The Client)
Padmashree Thimmappa
Shankar Vijayakumar
Richard Sauther
May 6th 2005
11/12/2018

2. Overview
Create a tool & database for collecting speech samples and data mining processing.
Ability to record new voice files.
Upload these files on to the server.
Retrieve these files when needed.
Play the files.
Analyze the files using Pronunciation Affinity Matrix (PAM) to determine the possible accent.
Analyze the files for further research using available Speech Filing System (SFS) to decompose spectrograms into data elements for data mining.
11/12/2018

3. Specification of Spectrographic Tools
Ability to perform spectral analysis of the speech signal.
Segment a portion of signal from the background noise.
Ability to view and store various voice data and functionality for research purposes.
Spectrographic tool that provides access to the actual numerical data (e.g., the energy in a particular frequency band in a particular time interval) that can be processed later in an application.
11/12/2018

4. Human Computer Interaction
User fills in the demographic information.
He can upload his voice file.
He can play back any voice file stored in the database as indicated by the drop down list.
He can hear the voice file and choose values for certain key words in the voice file for various accents.
The best chosen accent is recognized and displayed.
Voice owner information is displayed for comparison.
For further analysis of voice file, he can download the Speech Filing system installer, install it and run the voice file to get various types of spectrograms and other voice data.
11/12/2018

5. Choices are “Academic” or
Screen shots
Participation form
Choices are “Academic” or
“Natural”.
11/12/2018

6. Once submitted…
11/12/2018

7. Classification using Pronunciation Affinity Matrix (PAM)
In the various Asian dialects
“T” & “TH” are commonly
Pronunced as “D”
Vowel preceeding “ry” ending
is typically dropped.
The letter “V” is a “B”
Pronunciation in Spanish
11/12/2018

8. Accent determined with reference to values chosen
File upload index
11/12/2018

9. Analyze voice files using SFS
11/12/2018

10. Spectrogram generated using Speech Filing System.
11/12/2018

11. Actual Voice data retrieved from the spectrogram
11/12/2018

12. Smooth Fundamental Frequency track
11/12/2018

13. Noise Analysis data
11/12/2018

14. Users of this Application
This application will be mainly used for experimental research in areas such as :
1.Speech Recognition and Accent determination.
2.Voice Biometric Studies.
3.Speaker Authentication applications.
11/12/2018

15. Research Next Steps
Build up a sizeable corpus of voice samples across the four pronunciation nationalities in the PAM matrix.
Identify examiners that come from the same cross section of nationalities found in PAM
Perform more identification exams to validate the effectiveness of the selected words/phrase
Create a data-mart of the numerical equivalent of the spectrograms of each voice sample in the corpus.
Select a data mining classification algorithm to effectively classify the accents. (maybe focus on the correlation between energy levels, specific words, and accents or stress patterns and accents)
11/12/2018

16. Thank you!
11/12/2018