3-D Sound and Spatial Audio MUS_TECH 348. Physical Modeling Problem: Can we model the physical acoustics of the directional hearing system and thereby.

Slides:



Advertisements
Similar presentations
Auditory Localisation
Advertisements

High frequency annular arrays can provide very good resolution in ultrasound bio-microscopy Numerical simulation of their imaging patterns is essential.
Evaluation of Dummy-Head HRTFs in the Horizontal Plane based on the Peak-Valley Structure in One-degree Spatial Resolution Wersényi György SZÉCHENYI ISTVÁN.
Foundations of Medical Ultrasonic Imaging
Binaural Hearing Or now hear this! Upcoming Talk: Isabelle Peretz Musical & Non-musical Brains Nov. 12 noon + Lunch Rm 2068B South Building.
Spatial Perception of Audio J. D. (jj) Johnston Neural Audio Corporation.
3-D Sound and Spatial Audio MUS_TECH 348. Psychology of Spatial Hearing There are acoustic events that take place in the environment. These can give rise.
Extracting the pinna spectral notches Vikas C. Raykar | Ramani Duraiswami University of Maryland, CollegePark B. Yegnanaryana Indian Institute of Technology,
Hearing Detection Loudness Localization Scene Analysis Music Speech.
3-D Sound and Spatial Audio MUS_TECH 348. Wightman & Kistler (1989) Headphone simulation of free-field listening I. Stimulus synthesis II. Psychophysical.
Localizing Sounds. When we perceive a sound, we often simultaneously perceive the location of that sound. Even new born infants orient their eyes toward.
Improvement of Audibility for Multi Speakers with the Head Related Transfer Function Takanori Nishino †, Kazuhiro Uchida, Naoya Inoue, Kazuya Takeda and.
Source Localization in Complex Listening Situations: Selection of Binaural Cues Based on Interaural Coherence Christof Faller Mobile Terminals Division,
All you have is a pair of instruments (basilar membranes) that measure air pressure fluctuations over time Localization.
Exam and Assignment Dates Midterm 1 Feb 3 rd and 4 th Midterm 2 March 9 th and 10 th Final April 20 th and 21 st Idea journal assignment is due on last.
Sound How are sounds Classified? How are sounds produced? How are sounds different? How are sounds measured? How fast does sound move?
1© Manhattan Press (H.K.) Ltd. Loudness, pitch and quality Intensity level and loudness Intensity level and loudness 11.2 Properties of sound.
3-D Spatialization and Localization and Simulated Surround Sound with Headphones Lucas O’Neil Brendan Cassidy.
Sound Transmission and Echolocation Sound transmission –Sound properties –Attenuation Echolocation –Decoding information from echos.
Hearing & Deafness (3) Auditory Localisation
AUDITORY PERCEPTION Pitch Perception Localization Auditory Scene Analysis.
Spectral centroid 6 harmonics: f0 = 100Hz E.g. 1: Amplitudes: 6; 5.75; 4; 3.2; 2; 1 [(100*6)+(200*5.75)+(300*4)+(400*3.2)+(500*2 )+(600*1)] / = 265.6Hz.
Harmonics and Overtones Waveforms / Wave Interaction Phase Concepts / Comb Filtering Beat Frequencies / Noise AUD202 Audio and Acoustics Theory.
There are several clues you could use: 1.arrival time 2.phase lag (waves are out of sync) 3.sound shadow (intensity difference)- sound is louder at ear.
3-D Sound and Spatial Audio MUS_TECH 348. What are Some Options for Creating DTFs?
Frequency Coding And Auditory Space Perception. Three primary dimensions of sensations associated with sounds with periodic waveforms Pitch, loudness.
Speech Segregation Based on Sound Localization DeLiang Wang & Nicoleta Roman The Ohio State University, U.S.A. Guy J. Brown University of Sheffield, U.K.
Supervisor: Dr Richard So Speaker: Brian Ngan
Puzzler 1 Imagine that you have three boxes, one containing two black marbles, one containing two white marbles, and the third, one black marble and one.
Acoustics/Psychoacoustics Huber Ch. 2 Sound and Hearing.
Improved 3D Sound Delivered to Headphones Using Wavelets By Ozlem KALINLI EE-Systems University of Southern California December 4, 2003.
LINKWITZ LAB What are the On-axis & Off-axis
Applied Psychoacoustics Lecture: Binaural Hearing Jonas Braasch Jens Blauert.
Hearing Chapter 5. Range of Hearing Sound intensity (pressure) range runs from watts to 50 watts. Frequency range is 20 Hz to 20,000 Hz, or a ratio.
Virtual Worlds: Audio and Other Senses. VR Worlds: Output Overview Visual Displays: –Visual depth cues –Properties –Kinds: monitor, projection, head-based,
3-D Sound and Spatial Audio MUS_TECH 348. Main Types of Errors Front-back reversals Angle error Some Experimental Results Most front-back errors are front-to-back.
Chapter 5: Normal Hearing. Objectives (1) Define threshold and minimum auditory sensitivity The normal hearing range for humans Define minimum audible.
Waves. Examples –Water waves –Sound waves –Light waves –Radio waves –microwaves.
Chapter 17 Sound Waves: part two HW 2 (problems): 17.22, 17.35, 17.48, 17.58, 17.64, 34.4, 34.7, Due Friday, Sept. 11.
1© Manhattan Press (H.K.) Ltd Radar speed trap.
THE MANIFOLDS OF SPATIAL HEARING Ramani Duraiswami | Vikas C. Raykar Perceptual Interfaces and Reality Lab University of Maryland, College park.
 Space… the sonic frontier. Perception of Direction  Spatial/Binaural Localization  Capability of the two ears to localize a sound source within an.
Audio Systems Survey of Methods for Modelling Sound Propagation in Interactive Virtual Environments Ben Tagger Andriana Machaira.
How Can You Localize Sound? Ponder this: –Imagine digging two trenches in the sand beside a lake so that water can flow into them. Now imagine hanging.
L INKWITZ L AB S e n s i b l e R e p r o d u c t i o n & R e c o r d i n g o f A u d i t o r y S c e n e s Hearing Spatial Detail in Stereo Recordings.
Spatial and Spectral Properties of the Dummy-Head During Measurements in the Head-Shadow Area based on HRTF Evaluation Wersényi György SZÉCHENYI ISTVÁN.
Human Detection and Localization of Sounds in Complex Environments W.M. Hartmann Physics - Astronomy Michigan State University QRTV, UN/ECE/WP-29 Washington,
Waves Mechanical Electromagnetic Medium Transfer of … Pulse Periodic Perpendicular Parallel.
The Traveling Wave. Reminder 2 Frequency Amplitude Frequency Phase Frequency domain Time domain (time) waveform Amplitude spectrum.
Hearing Detection Loudness Localization Scene Analysis Music Speech.
3-D Sound and Spatial Audio MUS_TECH 348. Are IID and ITD sufficient for localization? No, consider the “Cone of Confusion”
On the manifolds of spatial hearing
Development of Sound Localization 2 How do the neural mechanisms subserving sound localization develop?
PSYC Auditory Science Spatial Hearing Chris Plack.
3-D Sound and Spatial Audio MUS_TECH 348. Environmental Acoustics, Perception and Audio Processing: Envelopment.
Fletcher’s band-widening experiment (1940)
Sound Reception Types of ears Extraction of information –Direction –Frequency –Amplitude Comparative survey of animal ears.
SPATIAL HEARING Ability to locate the direction of a sound. Ability to locate the direction of a sound. Localization: In free field Localization: In free.
Chapter 17 Sound Waves 17.1 Pressure variation in Sound Waves 17.2 speed of Sound Waves 17.3 Intensity of Periodic Sound Waves 17.4 The Doppler Effect.
Fundamentals of Sensation and Perception
Sound Transmission Signal degradation in frequency and time domains Boundary effects and density gradients Noise Ranging Signal optimization.
3-D Sound and Spatial Audio MUS_TECH 348. What do these terms mean? Both terms are very general. “3-D sound” usually implies the perception of point sources.
T F d O ε α E Φ R R cos(Φ) R sin(Φ) α=f(E, Φ) ε=g(E, Φ) Figure 7-1.
Sound Localization and Binaural Hearing
Auditory Localization in Rooms: Acoustic Analysis and Behavior
Chapter 17 Sound Waves.
AP Physics Review Waves and Sound.
Hearing Spatial Detail
Localizing Sounds.
3 primary cues for auditory localization: Interaural time difference (ITD) Interaural intensity difference Directional transfer function.
Presentation transcript:

3-D Sound and Spatial Audio MUS_TECH 348

Physical Modeling Problem: Can we model the physical acoustics of the directional hearing system and thereby understand the relationship between the physical system and the HRTF?

Consider the head as a Sphere Predictions of sound intensity and phase can be verified with acoustic measurements. Francis Wiener “ Sound Diffraction by Rigid Sphere and Circular Cylinders (1947) Measurement are expressed relative to 1/3 < ka < 10, where a is the radius of the sphere and k is the wave number.

Consider the head as a Sphere Francis Wiener “ Sound Diffraction by Rigid Sphere and Circular Cylinders (1947) Comparison of predictions and measurements. Sound pressure

Head as a Sphere One verified prediction is that there will be a ‘bright spot’ in the back of the sphere. Sound pressure ka = 0.5, 1ka = 2, 3ka = 4, 5 ka = 8, 10ka = 6,7

Head as a Sphere Rayleigh diffraction transfer function predicts ripples in magnitude and group delay. magnitude group delay

Head as a Sphere “Creeping waves” are created at shadow zone boundaries. Anthony J. Rudgers, Acoustic Pulses Scattered by a Rigid Sphere Immersed in a Fluid (1968) Plane waveshadow zone creeping wave Speed is less than usual speed of sound, 97% for high frequencies Amplitude decreases exponentially radius=a

Changes with distance Richard Duda and William Martens, Range- dependence of the HRTF for a Spherical Head (1997) The plane wave assumption breaks down when sources are close to sphere. ILD = interaural level difference predicted on basis of sphere with ears set back 10-degrees p is normalized distance relative to sphere radius

Correlation with Dummy Head George Kuhn, Model for the interaural time differences in the azimuthal plane (1977) and Towards a Model for Sound Localization (1982) ITD below 500 Hz is independent of frequency 3 (head radius/ speed of sound) sin  ITD above 3000 Hz is independent of frequency 2 (head radius/ speed of sound) sin  Minimum ITD appear around 1,500 Hz Between the low and high frequency regions there is a considerable difference between phase delay and group delay Compare predictions with measures done with dummy head.

George Kuhn, Model for the interaural time differences in the azimuthal plane (1977) High frequency delays are 2/3 of low frequency delays.

Phase Delay     phase delay = -  (  )  unwrap phase ()() msec 

Group Delay     group delay = - d  (  )  d  unwrap phase ()() msec 

Phase Delay and Group Delay Measures phase delay and group delay differ. The more difficult question is in what way does the auditory system responds to delay.

Asymmetries of head and pinna John Middlebrooks, Directional sensitivity of sound-pressure in the human ear canal (1989) Sound pressure Small features of the head such as the nose and pinna are clearly in play above 4 kHz

Asymmetries of head and pinna John Middlebrooks, Directional dependence of interaural envelope delays (1990) Envelope delay is more appropriate for sound above 4 kHz due to what we know about how the auditory system detects delays.

Modeling the Pinna Filter Notches in the HRTF are the result of delayed energy. Can we model the source? delay + + filter f f Comb filter Pinna filter

Modeling the Torso Algazi, Duda and Thompson, “The use of Head- and-Torso Models for Improved Spatial Sound Synthesis (2002) This is an example of using a model to create better directional hearing cues.

Modeling the Torso Algazi, Duda and Thompson, “The use of Head- and-Torso Models for Improved Spatial Sound Synthesis (2002) Frontal plane (response below 5 kHz) Simulated time response.

Modeling the Torso Algazi, Duda and Thompson, “The use of Head- and-Torso Models for Improved Spatial Sound Synthesis (2002) Model can be implemented computationally.

Alternative Approaches Yuvi Kahana, et. Al, Numerical Modelling of the Transfer Functions of a Dummy-Head and of the External Ear (1999) Sound pressure at 2 KHz with sound source at 45- degrees in azimuth and 45- degrees in elevation.

Alternative Approaches Yuvi Kahana, et. Al, Numerical Modelling of the Transfer Functions of a Dummy-Head and of the External Ear (1999) Three snapshots of time domain simulation with wave up to 6.4 kHz.

We still lack a comprehensive model of the physical acoustics of the directional hearing system.