Localising multiple sounds. Phenomenology Different sounds localised appropriately The whole of a sound is localised appropriately …even when cues mangled.

Slides:

Advertisements

Similar presentations

Auditory Localisation

Advertisements

Hearing relative phases for two harmonic components D. Timothy Ives 1, H. Martin Reimann 2, Ralph van Dinther 1 and Roy D. Patterson 1 1. Introduction.

Auditory scene analysis 2

Frequency selectivity of the auditory system. Frequency selectivity Important for aspects of auditory perception such as, pitch, loudness, timbre, melody,

Binaural Hearing Or now hear this! Upcoming Talk: Isabelle Peretz Musical & Non-musical Brains Nov. 12 noon + Lunch Rm 2068B South Building.

Periodicity and Pitch Importance of fine structure representation in hearing.

CS 551/651: Structure of Spoken Language Lecture 11: Overview of Sound Perception, Part II John-Paul Hosom Fall 2010.

Harmonic Series and Spectrograms 220 Hz (A3) Why do they sound different? Instrument 1 Instrument 2Sine Wave.

Hearing Detection Loudness Localization Scene Analysis Music Speech.

Localizing Sounds. When we perceive a sound, we often simultaneously perceive the location of that sound. Even new born infants orient their eyes toward.

Chapter 6: Masking. Masking Masking: a process in which the threshold of one sound (signal) is raised by the presentation of another sound (masker). Masking.

Auditory Scene Analysis (ASA). Auditory Demonstrations Albert S. Bregman / Pierre A. Ahad “Demonstration of Auditory Scene Analysis, The perceptual Organisation.

Source Localization in Complex Listening Situations: Selection of Binaural Cues Based on Interaural Coherence Christof Faller Mobile Terminals Division,

cells in cochlear nucleus

All you have is a pair of instruments (basilar membranes) that measure air pressure fluctuations over time Localization.

Exam and Assignment Dates Midterm 1 Feb 3 rd and 4 th Midterm 2 March 9 th and 10 th Final April 20 th and 21 st Idea journal assignment is due on last.

The Science of Sound Chapter 8

Source Segregation Chris Darwin Experimental Psychology University of Sussex.

Reading Assignment! We’ll discuss the chapter by Gregory in your book on Friday of next week.

Hearing & Deafness (4) Pitch Perception 1. Pitch of pure tones 2. Pitch of complex tones.

Auditory Objects of Attention Chris Darwin University of Sussex With thanks to : Rob Hukin (RA) Nick Hill (DPhil) Gustav Kuhn (3° year proj) MRC.

There are several clues you could use: 1.arrival time 2.phase lag (waves are out of sync) 3.sound shadow (intensity difference)- sound is louder at ear.

Hearing & Deafness (3) Auditory Localisation

AUDITORY PERCEPTION Pitch Perception Localization Auditory Scene Analysis.

Auditory Scene Analysis Chris Darwin Need for sound segregation Ears receive mixture of sounds We hear each sound source as having its own appropriate.

Spectral centroid 6 harmonics: f0 = 100Hz E.g. 1: Amplitudes: 6; 5.75; 4; 3.2; 2; 1 [(100*6)+(200*5.75)+(300*4)+(400*3.2)+(500*2 )+(600*1)] / = 265.6Hz.

Sound source segregation (determination)

There are several clues you could use: 1.arrival time 2.phase lag (waves are out of sync) 3.sound shadow (intensity difference)- sound is louder at ear.

Speech Segregation Based on Sound Localization DeLiang Wang & Nicoleta Roman The Ohio State University, U.S.A. Guy J. Brown University of Sheffield, U.K.

COMBINATION TONES The Science of Sound Chapter 8 MUSICAL ACOUSTICS.

Beats = Some Graphs Recall what a single frequency tone sounds like Play on Sound Generator A=440 Hz. The Graph:

Acoustics/Psychoacoustics Huber Ch. 2 Sound and Hearing.

Applied Psychoacoustics Lecture: Binaural Hearing Jonas Braasch Jens Blauert.

Hearing: auditory coding mechanisms. Harmonics/ Fundamentals ● Recall: most tones are complex tones, consisting of multiple pure tones ● The lowest frequency.

1 Loudness and Pitch Be sure to complete the loudness and pitch interactive tutorial at … chophysics/pitch/loudnesspitch.html.

Sounds in a reverberant room can interfere with the direct sound source. The normal hearing (NH) auditory system has a mechanism by which the echoes, or.

Localization of Auditory Stimulus in the Presence of an Auditory Cue By Albert Ler.

Systems (filters) Non-periodic signal has continuous spectrum Sampling in one domain implies periodicity in another domain time frequency Periodic sampled.

How Can You Localize Sound? Ponder this: –Imagine digging two trenches in the sand beside a lake so that water can flow into them. Now imagine hanging.

‘Missing Data’ speech recognition in reverberant conditions using binaural interaction Sue Harding, Jon Barker and Guy J. Brown Speech and Hearing Research.

Hearing Research Center

Pitch perception in auditory scenes 2 Papers on pitch perception… of a single sound source of more than one sound source LOTS - too many? Almost none.

Human Detection and Localization of Sounds in Complex Environments W.M. Hartmann Physics - Astronomy Michigan State University QRTV, UN/ECE/WP-29 Washington,

Hearing: Physiology and Psychoacoustics 9. The Function of Hearing The basics Nature of sound Anatomy and physiology of the auditory system How we perceive.

Listeners weighting of cues for lateral angle: The duplex theory of sound localization revisited E. A. MacPherson & J. C. Middlebrooks (2002) HST. 723.

Hearing Detection Loudness Localization Scene Analysis Music Speech.

SPHSC 462 HEARING DEVELOPMENT Overview Review of Hearing Science Introduction.

PSYC Auditory Science Spatial Hearing Chris Plack.

Basic Acoustics. Sound – your ears’ response to vibrations in the air. Sound waves are three dimensional traveling in all directions. Think of dropping.

Fletcher’s band-widening experiment (1940)

Fletcher’s band-widening experiment (1940) Present a pure tone in the presence of a broadband noise. Present a pure tone in the presence of a broadband.

Physics Acoustics for Musicians selected slides, March 5, 2002 Loudness at different frequencies Critical band Masking The ear Neurological response.

SPATIAL HEARING Ability to locate the direction of a sound. Ability to locate the direction of a sound. Localization: In free field Localization: In free.

Franssen illusion within large rooms John W. Worley AudioGroup, WCL Department of Electrical and Computer Engineering University of Patras, Greece

Jonas Braasch Architectural Acoustics Group Communication Acoustics and Aural Architecture Research Laboratory (C A 3 R L) Rensselaer Polytechnic Institute,

Auditory Perception 1 Streaming 400 vs. 504 Hz 400 vs. 566 Hz 400 vs. 635 Hz 400 vs. 713 Hz A 400-Hz tone (tone A) is alternated with a tone of a higher.

Auditory Localization in Rooms: Acoustic Analysis and Behavior

Fletcher’s band-widening experiment (1940)

PSYCHOACOUSTICS A branch of psychophysics

Precedence-based speech segregation in a virtual auditory environment

A map of periodicity orthogonal to frequency representation in the cat auditory cortex. Gerald Langner, Ben Godde, and Hubert R. Dinse Examples of auditory.

For a periodic complex sound

Volume 62, Issue 1, Pages (April 2009)

CHAPTER 10 Auditory Sensitivity.

Volume 62, Issue 1, Pages (April 2009)

Localizing Sounds.

Uses of filters To remove unwanted components in a signal

Auditory Demonstrations

3 primary cues for auditory localization: Interaural time difference (ITD) Interaural intensity difference Directional transfer function.

Localization behavior in ITD-alone condition and head turn analysis.

Presentation transcript:

Localising multiple sounds

Phenomenology Different sounds localised appropriately The whole of a sound is localised appropriately …even when cues mangled by reverberation, so information in any one frequency region is unreliable.

Grouping Which frequency components belong to which sound? Low-level cues –Onset time –Harmonicity Schemata

Phase Ambiguity 500 Hz: period = 2ms R leads by 1.5 msL leads by 0.5 ms LLR cross-correlation peaks at +0.5ms and -1.5ms auditory system weighted toone closest to zero 500-Hz pure tone leading in Right ear by 1.5 ms Heard on Left side

Disambiguating phase- ambiguity Narrowband noise at 500 Hz with ITD of 1.5 ms (3/4 cycle) heard at lagging side. Increasing noise bandwidth changes location to the leading side. Explained by across-frequency consistency of ITD. (Jeffress, Trahiotis & Stern)

Resolving phase ambiguity 500 Hz: period = 2ms L lags by 1.5 msor L leads by 0.5 ms ? Delay of cross-correlator ms Frequency of auditory filter Hz Cross-correlation peaks for noise delayed in one ear by 1.5 ms 300 Hz: period = 3.3ms R RLLR Actual delay Left ear actually lags by 1.5 ms L lags by 1.5 msor L leads by 1.8 ms ? R

Segregation by onset-time Frequency (Hz) Duration (ms) 0400 Duration (ms) SynchronousAsynchronous ITD: ± 1.5 ms (3/4 cycle at 500 Hz)

Segregated tone changes location Onset Asynchrony (ms) Pointer IID (dB) Pure Complex RL

Segregation by mistuning Frequency (Hz) Duration (ms) 0400 Duration (ms) In tuneMistuned

Mistuned tone changes location

Interim Summary ITD ineffective for simultaneous segregation Integration of ITD across frequency influenced by grouping cues Question: Can attention be directed on the basis of ITD to grouped objects?