Speech perception Relating features of hearing to the perception of speech.

Slides:

Advertisements

Similar presentations

Acoustic/Prosodic Features

Advertisements

Tom Lentz (slides Ivana Brasileiro)

Chapter 12: Speech and Music Perception

Sounds that “move” Diphthongs, glides and liquids.

Acoustic Characteristics of Consonants

Human Speech Recognition Julia Hirschberg CS4706 (thanks to John-Paul Hosum for some slides)

Physical modeling of speech XV Pacific Voice Conference PVSF-PIXAR Brad Story Dept. of Speech, Language and Hearing Sciences University of Arizona.

Coarticulation Analysis of Dysarthric Speech Xiaochuan Niu, advised by Jan van Santen.

Speech Science XII Speech Perception (acoustic cues) Version

Suprasegmentals The term suprasegmental refers to those properties of an utterance which aren't properties of any single segment. The following are usually.

Mandarin Chinese Speech Recognition. Mandarin Chinese Tonal language (inflection matters!) Tonal language (inflection matters!) 1 st tone – High, constant.

Basic Spectrogram Lab 8. Spectrograms §Spectrograph: Produces visible patterns of acoustic energy called spectrograms §Spectrographic Analysis: l Acoustic.

The Human Voice. I. Speech production 1. The vocal organs

Speech Perception Overview of Questions Can computers perceive speech as well as humans? Does each word that we hear have a unique pattern associated.

Introduction to Acoustics Words contain sequences of sounds Each sound (phone) is produced by sending signals from the brain to the vocal articulators.

Vocal Emotion Recognition with Cochlear Implants Xin Luo, Qian-Jie Fu, John J. Galvin III Presentation By Archie Archibong.

CIED 4013: Capstone Course for Foreign Language Licensure Language Sounds Chapter Three Dr. Freddie A. Bowles.

Voice source characterisation Gerrit Bloothooft UiL-OTS Utrecht University.

SPEECH PERCEPTION The Speech Stimulus Perceiving Phonemes Top-Down Processing Is Speech Special?

Introduction to Speech Production Lecture 1. Phonetics and Phonology Phonetics: The physical manifestation of language in sound waves. –How sounds are.

What is Phonetics? Short answer: The study of speech sounds in all their aspects. Phonetics is about describing speech. (Note: phonetics ¹ phonics) Phonetic.

Sound and Speech. The vocal tract Figures from Graddol et al.

Relationship between perception of spectral ripple and speech recognition in cochlear implant and vocoder listeners L.M. Litvak, A.J. Spahr, A.A. Saoji,

Sound source segregation (determination)

Physics 1251 The Science and Technology of Musical Sound Unit 3 Session 31 MWF The Fundamentals of the Human Voice Unit 3 Session 31 MWF The Fundamentals.

Speech Perception. Phoneme - a basic unit of a speech sound that distinguishes one word from another Phonemes do not have meaning on their own but they.

CSD 5400 REHABILITATION PROCEDURES FOR THE HARD OF HEARING Auditory Perception of Speech and the Consequences of Hearing Loss.

Chapter 7 SPEECH COMMUNICATIONS

1 Speech Perception 3/30/00. 2 Speech Perception How do we perceive speech? –Multifaceted process –Not fully understood –Models & theories attempt to.

Speech Perception1 Fricatives and Affricates We will be looking at acoustic cues in terms of … –Manner –Place –voicing.

Adaptive Design of Speech Sound Systems Randy Diehl In collaboration with Bjőrn Lindblom, Carl Creeger, Lori Holt, and Andrew Lotto.

1 Auditory, tactile, and vestibular sensory systems n Perceptually relevant characteristics of sound n The receptor system: The ear n Basic sensory characteristics.

Speech Science Fall 2009 Oct 28, Outline Acoustical characteristics of Nasal Speech Sounds Stop Consonants Fricatives Affricates.

Mr Background Noise and Miss Speech Perception in: by Elvira Perez and Georg Meyer.

Connected speech processes Coarticulation Suprasegmentals.

Say “blink” For each segment (phoneme) write a script using terms of the basic articulators that will say “blink.” Consider breathing, voicing, and controlling.

Speech Perception 4/4/00.

Authors: Sriram Ganapathy, Samuel Thomas, and Hynek Hermansky Temporal envelope compensation for robust phoneme recognition using modulation spectrum.

Frequency, Pitch, Tone and Length October 16, 2013 Thanks to Chilin Shih for making some of these lecture materials available.

3308 First Language acquisition Acquisition of sounds Perception Sook Whan Cho Fall, 2012.

Sensation & Perception

Artificial Intelligence 2004 Speech & Natural Language Processing Speech Recognition acoustic signal as input conversion into written words Natural.

Takeshi SAITOU 1, Masataka GOTO 1, Masashi UNOKI 2 and Masato AKAGI 2 1 National Institute of Advanced Industrial Science and Technology (AIST) 2 Japan.

Temporal masking of spectrally reduced speech: psychoacoustical experiments and links with ASR Frédéric Berthommier and Angélique Grosgeorges ICP 46 av.

IIT Bombay 14 th National Conference on Communications, 1-3 Feb. 2008, IIT Bombay, Mumbai, India 1/27 Intro.Intro.

Introduction to Digital Speech Processing Presented by Dr. Allam Mousa 1 An Najah National University SP_1_intro.

Unit 5 Phonetics and Phonology. Phonetics Sounds produced by the human speech organs are called the “phonic/auditory medium” Phonetics is the study of.

Phonetics, part III: Suprasegmentals October 19, 2012.

Introduction to psycho-acoustics: Some basic auditory attributes For audio demonstrations, click on any loudspeaker icons you see....

Speech Perception.

THE SOUNDS OF LANGUAGE the study of inventory and structure of the sounds of language.  Human can produce any number of sounds including those we never.

IIT Bombay 17 th National Conference on Communications, Jan. 2011, Bangalore, India Sp Pr. 1, P3 1/21 Detection of Burst Onset Landmarks in Speech.

A. R. Jayan, P. C. Pandey, EE Dept., IIT Bombay 1 Abstract Perception of speech under adverse listening conditions may be improved by processing it to.

Speech Perception Chris Plack

P105 Lecture #27 visuals 20 March 2013.

Suprasegmental Properties of Speech Robert A. Prosek, Ph.D. CSD 301 Robert A. Prosek, Ph.D. CSD 301.

Phonetics, part III: Suprasegmentals October 18, 2010.

Speech in the DHH Classroom A new perspective. Speech in the DHH Bilingual Classroom Important to look beyond the traditional view of speech Think of.

The Human Voice. 1. The vocal organs

P105 Lecture #26 visuals 18 March 2013.

Speech recognition with amplitude and frequency modulations: Implications for cochlear implant design Fan-Gang Zeng Kaibao Nie Ginger Stickney Ying-Yee.

Phonetics Lauren Dobbs.

The Human Voice. 1. The vocal organs

Speech Perception.

Voice source characterisation

Remember me? The number of times this happens in 1 second determines the frequency of the sound wave.

Speech Perception (acoustic cues)

Artificial Intelligence 2004 Speech & Natural Language Processing

Speech Communications

Eugeniusz Cyran KUL, Lublin

Presentation transcript:

Speech perception Relating features of hearing to the perception of speech

The bottom line The auditory system encodes the properties of sound that are essential to recognizing speech, but it’s a lot more complicated than that.

Production

Acoustics

Vowels

Consonants Laughter can soothe and heal

Place and manner of articulation

Speech cues

Important acoustic features

Envelope v. Spectral Information

Fine structure: Voicing

Fine structure: Intonation contour Marianna made the marmalade.

Fine structure: Tone split white swing defeat mother high level hemp rising horse falling- rising scold falling

Redundancy leads to robust perception Frequency (Hz) Amplitude (dB) Hz bandwidth Amplitude (dB) Hz 4 Hz 64 Hz Interrupted Filtered

Variability in acoustics: Co-articulation

Variability in acoustics: Speaker Winnfield, LAVancouver, BCBrooklyn, NY

Variability in acoustics: Top-down influences another thing coming OR another think coming?

Multisensory integration

Conclusions Speech is produced by spectral and temporal modifications (by articulators) of a vibrating source (vocal folds). The amplitude spectrum and the envelope of sound carry much of the information in speech. The fine structure contributes to pitch-related aspects of speech. Sound associated with a phoneme is influenced by preceding and following phonemes, by the speaker, and by many other factors. Speech is highly resistant to corruption and interference. Acoustic and semantic context important in speech recognition. Speech is a multisensory phenomenon.