3-D Sound and Spatial Audio MUS_TECH 348. Are IID and ITD sufficient for localization? No, consider the “Cone of Confusion”

Slides:



Advertisements
Similar presentations
Frequency response adaptation in binaural hearing David Griesinger Cambridge MA USA
Advertisements

Frequency response adaptation in binaural hearing
Auditory Localisation
Sound Localization Superior Olivary Complex. Localization: Limits of Performance Absolute localization: localization of sound without a reference. Humans:
Evaluation of Dummy-Head HRTFs in the Horizontal Plane based on the Peak-Valley Structure in One-degree Spatial Resolution Wersényi György SZÉCHENYI ISTVÁN.
Psychoacoustics Perception of Direction AUD202 Audio and Acoustics Theory.
Binaural Hearing Or now hear this! Upcoming Talk: Isabelle Peretz Musical & Non-musical Brains Nov. 12 noon + Lunch Rm 2068B South Building.
Spatial Perception of Audio J. D. (jj) Johnston Neural Audio Corporation.
Learning the cues associated with non-individualised HRTFs John Worley and Jonas Braasch Binaural and Spatial Hearing Group.
3-D Sound and Spatial Audio MUS_TECH 348. Psychology of Spatial Hearing There are acoustic events that take place in the environment. These can give rise.
Extracting the pinna spectral notches Vikas C. Raykar | Ramani Duraiswami University of Maryland, CollegePark B. Yegnanaryana Indian Institute of Technology,
Hearing Detection Loudness Localization Scene Analysis Music Speech.
3-D Sound and Spatial Audio MUS_TECH 348. Wightman & Kistler (1989) Headphone simulation of free-field listening I. Stimulus synthesis II. Psychophysical.
Localizing Sounds. When we perceive a sound, we often simultaneously perceive the location of that sound. Even new born infants orient their eyes toward.
AUDITORY LOCALIZATION Lynn E. Cook, AuD Occupational Audiologist NNMC, Bethesda, MD.
Improvement of Audibility for Multi Speakers with the Head Related Transfer Function Takanori Nishino †, Kazuhiro Uchida, Naoya Inoue, Kazuya Takeda and.
Development of sound localization
Localization cues with bilateral cochlear implants Bernhard U. Seeber and Hugo Fastl (2007) Maria Andrey Berezina HST.723 April 8 th, 2009.
Hearing & Deafness (3) Auditory Localisation
Visually-induced auditory spatial adaptation in monkeys and humans Norbert Kopčo, I-Fan Lin, Barbara Shinn-Cunningham, Jennifer Groh Center for Cognitive.
STUDIOS AND LISTENING ROOMS
Spectral centroid 6 harmonics: f0 = 100Hz E.g. 1: Amplitudes: 6; 5.75; 4; 3.2; 2; 1 [(100*6)+(200*5.75)+(300*4)+(400*3.2)+(500*2 )+(600*1)] / = 265.6Hz.
Speech Segregation Based on Sound Localization DeLiang Wang & Nicoleta Roman The Ohio State University, U.S.A. Guy J. Brown University of Sheffield, U.K.
On the Preprocessing and Postprocessing of HRTF Individualization Based on Sparse Representation of Anthropometric Features Jianjun HE, Woon-Seng Gan,
The Auditory System Dr. Kline FSU. What is the physical stimulus for audition? Sound- vibrations of the molecules in a medium like air. The hearing spectrum.
The auditory system Romain Brette Romain Brette Ecole Normale Supérieure.
SOUND IN THE WORLD AROUND US. OVERVIEW OF QUESTIONS What makes it possible to tell where a sound is coming from in space? When we are listening to a number.
Applied Psychoacoustics Lecture: Binaural Hearing Jonas Braasch Jens Blauert.
42nd IEEE Conference on Decision and Control, Dec 9-12, 2003
Virtual Worlds: Audio and Other Senses. VR Worlds: Output Overview Visual Displays: –Visual depth cues –Properties –Kinds: monitor, projection, head-based,
3-D Sound and Spatial Audio MUS_TECH 348. Main Types of Errors Front-back reversals Angle error Some Experimental Results Most front-back errors are front-to-back.
Chapter 12: Auditory Localization and Organization
THE MANIFOLDS OF SPATIAL HEARING Ramani Duraiswami | Vikas C. Raykar Perceptual Interfaces and Reality Lab University of Maryland, College park.
Audio for Telepresence and Virtual Reality Colin S. Harrison.
 Space… the sonic frontier. Perception of Direction  Spatial/Binaural Localization  Capability of the two ears to localize a sound source within an.
Audio Systems Survey of Methods for Modelling Sound Propagation in Interactive Virtual Environments Ben Tagger Andriana Machaira.
How Can You Localize Sound? Ponder this: –Imagine digging two trenches in the sand beside a lake so that water can flow into them. Now imagine hanging.
Simulation of small head-movements on a Virtual Audio Display using headphone playback and HRTF synthesis Wersényi György SZÉCHENYI ISTVÁN UNIVERSITY,
3-D Sound and Spatial Audio MUS_TECH 348. Physical Modeling Problem: Can we model the physical acoustics of the directional hearing system and thereby.
L INKWITZ L AB S e n s i b l e R e p r o d u c t i o n & R e c o r d i n g o f A u d i t o r y S c e n e s Hearing Spatial Detail in Stereo Recordings.
Jens Blauert, Bochum Binaural Hearing and Human Sound Localization.
Spatial and Spectral Properties of the Dummy-Head During Measurements in the Head-Shadow Area based on HRTF Evaluation Wersényi György SZÉCHENYI ISTVÁN.
Hearing Research Center
This research was supported by Delphi Automotive Systems
3-D Sound and Spatial Audio
Auditory & tactile displays EGR 412 Human Factors Engineering ISE
Fundamentals of Sensation and Perception THE AUDITORY BRAIN AND PERCEIVING AUDITORY SCENE ERIK CHEVRIER OCTOBER 13 TH, 2015.
Listeners weighting of cues for lateral angle: The duplex theory of sound localization revisited E. A. MacPherson & J. C. Middlebrooks (2002) HST. 723.
Ch 121 Sensation & Perception Ch. 12: Sound Localization © Takashi Yamauchi (Dept. of Psychology, Texas A&M University) Main topics Auditory localization.
On the improvement of virtual localization in vertical directions using HRTF synthesis and additional filtering Wersényi György SZÉCHENYI ISTVÁN UNIVERSITY,
Hearing in Distance Or Where is that sound? Today: Isabelle Peretz Musical & Non-musical Brains Nov. 12 noon + Lunch Rm 2068B South Building.
On the manifolds of spatial hearing
Development of Sound Localization 2 How do the neural mechanisms subserving sound localization develop?
PSYC Auditory Science Spatial Hearing Chris Plack.
3-D Sound and Spatial Audio MUS_TECH 348. Environmental Acoustics, Perception and Audio Processing: Envelopment.
Fletcher’s band-widening experiment (1940)
The owl Ecology and behavior
SPATIAL HEARING Ability to locate the direction of a sound. Ability to locate the direction of a sound. Localization: In free field Localization: In free.
Fundamentals of Sensation and Perception
3-D Sound and Spatial Audio MUS_TECH 348. What do these terms mean? Both terms are very general. “3-D sound” usually implies the perception of point sources.
Sound Localization and Binaural Hearing
Auditory Localization in Rooms: Acoustic Analysis and Behavior
PSYCHOACOUSTICS A branch of psychophysics
Spatial Audio - Spatial Sphere Demo Explained
Localizing Sounds.
Using HRTFs for virtual sound source positioning Lecture Example
3 primary cues for auditory localization: Interaural time difference (ITD) Interaural intensity difference Directional transfer function.
3-D Sound and Spatial Audio
Week 13: Neurobiology of Hearing Part 2
Lecture 4. Human Factors : Psychological and Cognitive Issues (II)
Presentation transcript:

3-D Sound and Spatial Audio MUS_TECH 348

Are IID and ITD sufficient for localization? No, consider the “Cone of Confusion”

Dominant Cue: Dynamic Head Movement How do listeners resolve the “Cone of Confusion”? Wallach, H "The Role of Head Movements and Vestibular and Visual Cues in Sound Localization" Journal of Experimental Psychology 27(4):

In the absence of head movement? Frequency-dependent interaural differences in time and intensity (HRTFs) Frequency-dependent level differences dominate at high frequencies Frequency-dependent time differences dominate at low frequencies And,...

But even with HRTFs, what acoustic information are people using? Interaural Magnitude Difference? Interaural Time Difference?

On-going time differences in high frequencies affect localization (temporal envelopes) Blauert, 1982

Low-frequency interaural time differences dominant localization judgments When different kinds of directional information (IID, ITD, pinna cues) are contradictory: For broadband sounds: subjects’ judgments tend to follow ITD. For high-pass sounds (without significant low-frequency information): subjects’ judgments tend to follow IID and pinna cues Wightman and Kistler 1992 “The dominant role of low-frequency interaural time differences in sound localization”

behind over front Listeners appear to give preference to particular frequency bands 1/3-octave noise in median plane: Blauert 1974

Summary of directional bands v = front, h = behind, o = above

Roffler and Butler 1968 Directional bands may be mapped in a more continuous and systematic way

For sounds that are to the side, the contralateral ear appears to be the dominant one Humanski and Butler 1988 Nakamura, Mano, and Martens 2002

Other Questions: How accurately do we localize sound? (“Spatial accuity” / “Spatial Blur”) How well do we localize with other people’s ears? (“Individual Differences”)

In what regions of the horizontal plane do we have the greatest directional acuity?

In what regions of the median plane do we have the greatest directional acuity? Why would there be such a difference in comparison to the horizontal plane?

In what range of distance judgments do we have the greatest acuity?

“Individual Differences” Individuals generally localize better with their own HRTFs than with those of others Some individuals have HRTFs that are superior and these HRTFs can sometimes improve the localization of others In order for one individual’s HRTFs to work for another, the head sizes must be approximately the same, and Localization can be achieved with synthetic directional transfer functions whose details differ from measured HRTFs

And, is it one ear or two? People with asymmetric hearing loss can still localize! Are people using ITD and IID when available, but HRTF cues are processed monaurally?

How well are we able to localize with only one ear? What does this tell us?

Monaural Listening Humanski & Butler 1985 “The influence of monaural spectral cues on binaural localization” JASA 77:1.

Subjects make judgements on the basis of the frequency band only!