Acousteen Herman J.M. Steeneken Subjective Intelligibility Assessment Dr. Herman J.M. Steeneken.

Slides:

Advertisements

Similar presentations

Acousteen, Herman Steeneken 1 Past, Present and Future of STI Herman J. M. Steeneken (

Advertisements

Acousteen Herman J.M. Steeneken Standardization of the Speech Transmission Index Herman J.M. Steeneken Former convenor: ISO TC159/SC5/WG3, CEN TC 122/WG8.

The perception of dialect Julia Fischer-Weppler HS Speaker Characteristics Venice International University

1 1 Slide MGS 8150 Causal Model – extra Dr. Subhashish (Sub) Samaddar Georgia State University J. Mack Robinson College of Business Executive Education.

Advanced Speech Enhancement in Noisy Environments

AN ACOUSTIC PROFILE OF SPEECH EFFICIENCY R.J.J.H. van Son, Barbertje M. Streefkerk, and Louis C.W. Pols Institute of Phonetic Sciences / ACLC University.

Analysis and Synthesis of Shouted Speech Tuomo Raitio Jouni Pohjalainen Manu Airaksinen Paavo Alku Antti Suni Martti Vainio.

1 E-Model & MOS Speaker: Cheng-lin Tsai Adviser: Quincy Wu Date:2009/07/02.

Speech Communications Chapter 7. Speech Communications  The Nature of Speech    Criteria for Evaluating Speech    Components of Speech Communication.

Oct. 18, 2000 Subjective Tests Results Yi Liang Degradation Category Rating of Scaled Speech Three short network traces with different jitter statistics.

Analyzing quantitative data – section III Week 10 Lecture 1.

1 New Technique for Improving Speech Intelligibility for the Hearing Impaired Miriam Furst-Yust School of Electrical Engineering Tel Aviv University.

GABRIELLA RUIZ LING 620 OHIO UNIVERSITY Cross-language perceptual assimilation of French and German front rounded vowels by novice American listeners and.

Lecture 13: Factorial ANOVA 1 Laura McAvinue School of Psychology Trinity College Dublin.

A PRESENTATION BY SHAMALEE DESHPANDE

Review of the paper entitled “The development of a phonetically balanced word recognition test in the Ilocano language” written by Renita Sagon, Doctor.

8th and 9th June 2004 Mainz, Germany Workshop on Wideband Speech Quality in Terminals and Networks: Assessment and Prediction 1 Vincent Barriac, Jean-Yves.

Objective and Subjective Degradations of Transcoded Voice for Heterogeneous Radio Networks Interoperability Ľubica Blašková 1, Jan Holub 1, Michael Street.

Building High Quality Databases for Minority Languages such as Galician F. Campillo, D. Braga, A.B. Mourín, Carmen García-Mateo, P. Silva, M. Sales Dias,

Chapter 12 Inferential Statistics Gay, Mills, and Airasian

Understanding Research Results

Speech Communications (Chapter 7) Prepared by: Ahmed M. El-Sherbeeny, PhD 1.

Human Capabilities Part - B. Speech Communications (Chapter 7) Prepared by: Ahmed M. El-Sherbeeny, PhD 1.

IIT Bombay ICA 2004, Kyoto, Japan, April 4 - 9, 2004   Introdn HNM Methodology Results Conclusions IntrodnHNM MethodologyResults.

TTS Evaluation Julia Hirschberg CS TTS Evaluation Intelligibility Tests Mean Opinion Scores Preference Tests 9/7/20152 Speech and Language Processing.

Class Meeting #11 Data Analysis. Types of Statistics Descriptive Statistics used to describe things, frequently groups of people.  Central Tendency 

Nasal endings of Taiwan Mandarin: Production, perception, and linguistic change Student : Shu-Ping Huang ID No. : NA3C0004 Professor : Dr. Chung Chienjer.

SPECTRO-TEMPORAL POST-SMOOTHING IN NMF BASED SINGLE-CHANNEL SOURCE SEPARATION Emad M. Grais and Hakan Erdogan Sabanci University, Istanbul, Turkey  Single-channel.

Chapter 7 SPEECH COMMUNICATIONS

METHODOLOGY INTRODUCTION ACKNOWLEDGEMENTS LITERATURE Low frequency information via a hearing aid has been shown to increase speech intelligibility in noise.

Chapter 3.2 Speech Communication Human Performance Engineering Robert W. Bailey, Ph.D. Third Edition.

Experimentation Duration is the most significant feature with around 40% correlation. Experimentation Duration is the most significant feature with around.

Business Intelligence and Decision Modeling Week 11 Predictive Modeling (2) Logistic Regression.

NORTEL NETWORKS CONFIDENTIAL 2 Evaluaton of Objective Quality Estimators: Methods used with Voice Models & Implications for Video Testing Leigh Thorpe.

Experimentation Duration is the most significant feature with around 40% correlation. Experimentation Duration is the most significant feature with around.

From last time …. ASR System Architecture Pronunciation Lexicon Signal Processing Probability Estimator Decoder Recognized Words “zero” “three” “two”

A Study of Taiwanese High School Students' Production and Perception Performance in English Non-High Front Vowels Graduate Student: Wan-chun Tseng Advisor:

P. N. Kulkarni, P. C. Pandey, and D. S. Jangamashetti / DSP 2009, Santorini, 5-7 July DSP 2009 (Santorini, Greece. 5-7 July 2009), Session: S4P,

7-Speech Quality Assessment Quality Levels Subjective Tests Objective Tests IntelligibilityNaturalness.

Katherine Morrow, Sarah Williams, and Chang Liu Department of Communication Sciences and Disorders The University of Texas at Austin, Austin, TX

Two-Way (Independent) ANOVA. PSYC 6130A, PROF. J. ELDER 2 Two-Way ANOVA “Two-Way” means groups are defined by 2 independent variables. These IVs are typically.

Experimentation Duration is the most significant feature with around 40% correlation. Experimentation Duration is the most significant feature with around.

1 6-Speech Quality Assessment Quality Levels IntelligibilityNaturalness Subjective Tests Objective Tests.

Predicting the Intelligibility of Cochlear-implant Vocoded Speech from Objective Quality Measure(1) Department of Electrical Engineering, The University.

7-Speech Quality Assessment Quality Levels Subjective Tests Objective Tests IntelligibilityNaturalness.

A. R. Jayan, P. C. Pandey, EE Dept., IIT Bombay 1 Abstract Perception of speech under adverse listening conditions may be improved by processing it to.

ASSESSING SEARCH TERM STRENGTH IN SPOKEN TERM DETECTION Amir Harati and Joseph Picone Institute for Signal and Information Processing, Temple University.

Predicting Speech Intelligibility Where we were… Model of speech intelligibility Good prediction of Greenberg’s bands Data.

Quantitative methods and R – (2) LING115 December 2, 2009.

Educational Research Inferential Statistics Chapter th Chapter 12- 8th Gay and Airasian.

Dr.Rehab F.M. Gwada. Measures of Central Tendency the average or a typical, middle observed value of a variable in a data set. There are three commonly.

Madhulika Pannuri Intelligent Electronic Systems Human and Systems Engineering Department of Electrical and Computer Engineering Correlation Dimension.

Statistics and probability Dr. Khaled Ismael Almghari Phone No:

Speech Audiometry Lecture 8.

Stand alone system. Team members PC dependent Speech recognition.

4aPPa32. How Susceptibility To Noise Varies Across Speech Frequencies

Product Reliability Measuring

Speech Level Measures Dr. Herman J.M. Steeneken.

King Saud University College of Engineering IE – 341: “Human Factors Engineering” Fall – 2016 (1st Sem H) Human Capabilities Part – C. Speech.

Masking for SRT Crosshearing suspected when SRTTE – IA ≥ Best BCNTE

Introduction to Statistics

Basic Statistical Terms

A Review in Quality Measures for Halftoned Images

Giovanni M. Di Liberto, James A. O’Sullivan, Edmund C. Lalor

Speech Perception (acoustic cues)

15.1 The Role of Statistics in the Research Process

Practice As part of a program to reducing smoking, a national organization ran an advertising campaign to convince people to quit or reduce their smoking.

Speech Communications

COPYRIGHT © All rights reserved by Sound acoustics Germany

Presentation transcript:

Acousteen Herman J.M. Steeneken Subjective Intelligibility Assessment Dr. Herman J.M. Steeneken

Acousteen Herman J.M. Steeneken 2 Signal-to-Noise ratio !!!

Acousteen Herman J.M. Steeneken 3 Research Questions Intelligibility versus Quality assessment Evaluation of a system or application Ranking of the performance of a number of systems Diagnostic assessment Prediction of system performance during design

Acousteen Herman J.M. Steeneken 4 Assessment Methods Subjective assessment with subjects (speakers and listeners): representative, limited reproduction, non diagnostic, laborious Objective assessment based on physical properties (measurements): reproducible, diagnostic, fast Prediction of system performance: design tool

Acousteen Herman J.M. Steeneken 5 SUBJECTIVE INTELLIGIBILITY

Acousteen Herman J.M. Steeneken 6 Subjective Intelligibility methods Phoneme level (nonsense words, rhyme words, consonants, vowels) Word level (meaningful words, nonsense words, phonetically balanced PB, equally balanced Eqb) Sentence level (Mean Opinion Score MOS, Speech Reception Threshold SRT)

Acousteen Herman J.M. Steeneken 7 Methodology I Response categories: Open response (e.g., nonsense words) Closed response (Rhyme tests, e.g., MRT, DRT) Scaling (MOS, five point scale: excellent - bad) Ranking (e.g., pair-wise comparison)

Acousteen Herman J.M. Steeneken 8 Methodology II Test design: Words embedded in carrier phrase Reference conditions (e.g. MNRU, …) Speakers (gender, number, non-native, …) Listeners ( number of speaker-listener pairs) Learning effects

Acousteen Herman J.M. Steeneken 9 Listening test with four subjects

Acousteen Herman J.M. Steeneken 10

Acousteen Herman J.M. Steeneken 11 Embedded CVC words: versta des over en nu fijs uit het woord zek einde noteer lal punt “Semi random”combination of: 17 initial consonants 15 vowels 11 final consonants

Acousteen Herman J.M. Steeneken 12 Methodology III Scoring, data analysis: Phone-word scores Confusion matrices Effective gain (e.g. effective SNR) Statistics (Anova, scaling, multiple regression,...)

Acousteen Herman J.M. Steeneken 13 Relation Consonants-Vowels

Acousteen Herman J.M. Steeneken 14 How to calculate average word scores Subject responses may require to use the median

Acousteen Herman J.M. Steeneken 15 Example relation MOS-CVC

Acousteen Herman J.M. Steeneken 16 Relation between methods and Qualification

Acousteen Herman J.M. Steeneken 17 Test-retest variability Cronbach α based on split of speaker- listener pairs

Acousteen Herman J.M. Steeneken 18 Common Intelligibility scale (IEC60849) After Barnett and Knight 1994 CIS not linear with SNR = STI  = ALcons x = AI  = PB words (256 words)  = Short Sentences = PB words (1000 words)  = 1000 syllables Barnett and Knight (1995)

Acousteen Herman J.M. Steeneken 19 CVC scores (%) of realistic conditions malefemale Wide band Telephone band White noise SNR 0 dB Speech noise SNR +3 dB Speech noise SNR -3 dB

Acousteen Herman J.M. Steeneken 20 Example of consonant confusions pbfvmnRw p b f v m n R w

Acousteen Herman J.M. Steeneken 21 Two dimensional display of confusions

Acousteen Herman J.M. Steeneken 22 Introduction of phoneme specific frequency weighting Four groups of phonemes (SAMPA notation: Fricatives (f, s, v, z) Plosives (b, d, x, p, t, k) Vowel-like consonants (m, n, l, R, j, w, …) Vowels (aa, a, ee, e, o, oo, u, uu, au, …)

Acousteen Herman J.M. Steeneken 23 Phoneme group specific spectra

Acousteen Herman J.M. Steeneken 24 Phoneme group specific spectra

Acousteen Herman J.M. Steeneken 25 Frequency weighting (fricatives)

Acousteen Herman J.M. Steeneken 26 Frequency weighting (plosives)

Acousteen Herman J.M. Steeneken 27 Frequency weighting (vowel-like cons)

Acousteen Herman J.M. Steeneken 28 Frequency weightings (vowels)

Acousteen Herman J.M. Steeneken 29 Frequency weightings (CVC words)

Acousteen Herman J.M. Steeneken 30 Prediction of (CVC) word score by a weighted combination of phoneme group probabilities (DUTCH) C i = fric plo Cvo V = V (no weighting) C f = fric plo Cvo CVC score = C i * V * C f * 100 %

Acousteen Herman J.M. Steeneken 31 CVC-word prediction (male) S.d.= 4.11% Male speech

Acousteen Herman J.M. Steeneken 32 CVC-word prediction (female) S.d. = 3.63% Female speech

Acousteen Herman J.M. Steeneken 33 ISO: Ergonomics – Assessment of speech communication (ISO 9921 DIS)

Acousteen Herman J.M. Steeneken 34 Qualification table