3-D Sound and Spatial Audio MUS_TECH 348. What do these terms mean? Both terms are very general. “3-D sound” usually implies the perception of point sources.

Slides:



Advertisements
Similar presentations
Auditory Localisation
Advertisements

Evaluation of Dummy-Head HRTFs in the Horizontal Plane based on the Peak-Valley Structure in One-degree Spatial Resolution Wersényi György SZÉCHENYI ISTVÁN.
Psychoacoustics Perception of Direction AUD202 Audio and Acoustics Theory.
1 3D sound reproduction with “OPSODIS” and its commercial applications Takashi Takeuchi, PhD Chief Technical Officer OPSODIS Limited Institute of Sound.
Binaural Hearing Or now hear this! Upcoming Talk: Isabelle Peretz Musical & Non-musical Brains Nov. 12 noon + Lunch Rm 2068B South Building.
Spatial Perception of Audio J. D. (jj) Johnston Neural Audio Corporation.
1 Media Processing – Audio Part Dr Wenwu Wang Centre for Vision Speech and Signal Processing Department of Electronic Engineering
SWE 423: Multimedia Systems Chapter 3: Audio Technology (2)
3-D Sound and Spatial Audio MUS_TECH 348. Psychology of Spatial Hearing There are acoustic events that take place in the environment. These can give rise.
Extracting the pinna spectral notches Vikas C. Raykar | Ramani Duraiswami University of Maryland, CollegePark B. Yegnanaryana Indian Institute of Technology,
Hearing Detection Loudness Localization Scene Analysis Music Speech.
3-D Sound and Spatial Audio MUS_TECH 348. Wightman & Kistler (1989) Headphone simulation of free-field listening I. Stimulus synthesis II. Psychophysical.
Localizing Sounds. When we perceive a sound, we often simultaneously perceive the location of that sound. Even new born infants orient their eyes toward.
AUDITORY LOCALIZATION Lynn E. Cook, AuD Occupational Audiologist NNMC, Bethesda, MD.
Back to Stereo: Stereo Imaging and Mic Techniques Huber, Ch. 4 Eargle, Ch. 11, 12.
3-D Sound and Spatial Audio MUS_TECH 348. Cathedral / Concert Hall / Theater Sound Altar / Stage / Screen Spiritual / Emotional World Subjective Music.
All you have is a pair of instruments (basilar membranes) that measure air pressure fluctuations over time Localization.
1 Introduction to MPEG Surround 韓志岡 2/9/ Outline Background – Motivation – Perception of sound in space Pricicple of MPEG Surround – Downmixing.
3-D Spatialization and Localization and Simulated Surround Sound with Headphones Lucas O’Neil Brendan Cassidy.
1 Multimedia Systems 1 Dr Paul Newbury School of Engineering and Information Technology ENGG II - 3A11 Ext: 2615.
Hearing & Deafness (3) Auditory Localisation
AUDITORY PERCEPTION Pitch Perception Localization Auditory Scene Analysis.
STUDIOS AND LISTENING ROOMS
Spectral centroid 6 harmonics: f0 = 100Hz E.g. 1: Amplitudes: 6; 5.75; 4; 3.2; 2; 1 [(100*6)+(200*5.75)+(300*4)+(400*3.2)+(500*2 )+(600*1)] / = 265.6Hz.
There are several clues you could use: 1.arrival time 2.phase lag (waves are out of sync) 3.sound shadow (intensity difference)- sound is louder at ear.
Binaural Sound Localization and Filtering By: Dan Hauer Advisor: Dr. Brian D. Huggins 6 December 2005.
3-D Sound and Spatial Audio MUS_TECH 348. Multi-Loudspeaker Reproduction: Surround Sound.
Audio in VEs Ruth Aylett. Use of audio in VEs n Important but still under-utilised channel for HCI including virtual environments. n Speech recognition.
Binaural Sonification of Disparity Maps Alfonso Alba, Carlos Zubieta, Edgar Arce Facultad de Ciencias Universidad Autónoma de San Luis Potosí.
Puzzler 1 Imagine that you have three boxes, one containing two black marbles, one containing two white marbles, and the third, one black marble and one.
Acoustics/Psychoacoustics Huber Ch. 2 Sound and Hearing.
The Auditory System Dr. Kline FSU. What is the physical stimulus for audition? Sound- vibrations of the molecules in a medium like air. The hearing spectrum.
Improved 3D Sound Delivered to Headphones Using Wavelets By Ozlem KALINLI EE-Systems University of Southern California December 4, 2003.
SOUND IN THE WORLD AROUND US. OVERVIEW OF QUESTIONS What makes it possible to tell where a sound is coming from in space? When we are listening to a number.
Issac Garcia-Munoz Senior Thesis Electrical Engineering Advisor: Pietro Perona.
Virtual Worlds: Audio and Other Senses. VR Worlds: Output Overview Visual Displays: –Visual depth cues –Properties –Kinds: monitor, projection, head-based,
Rumsey Chapter 16 Day 3. Overview  Stereo = 2.0 (two discreet channels)  THREE-DIMENSIONAL, even though only two channels  Stereo listening is affected.
3-D Sound and Spatial Audio MUS_TECH 348. Main Types of Errors Front-back reversals Angle error Some Experimental Results Most front-back errors are front-to-back.
Audio for Telepresence and Virtual Reality Colin S. Harrison.
Developing a model to explain and stimulate the perception of sounds in three dimensions David Kraljevich and Chris Dove.
 Space… the sonic frontier. Perception of Direction  Spatial/Binaural Localization  Capability of the two ears to localize a sound source within an.
Audio Systems Survey of Methods for Modelling Sound Propagation in Interactive Virtual Environments Ben Tagger Andriana Machaira.
How Can You Localize Sound? Ponder this: –Imagine digging two trenches in the sand beside a lake so that water can flow into them. Now imagine hanging.
‘Missing Data’ speech recognition in reverberant conditions using binaural interaction Sue Harding, Jon Barker and Guy J. Brown Speech and Hearing Research.
3-D Sound and Spatial Audio MUS_TECH 348. Physical Modeling Problem: Can we model the physical acoustics of the directional hearing system and thereby.
L INKWITZ L AB S e n s i b l e R e p r o d u c t i o n & R e c o r d i n g o f A u d i t o r y S c e n e s Hearing Spatial Detail in Stereo Recordings.
Jens Blauert, Bochum Binaural Hearing and Human Sound Localization.
Spatial and Spectral Properties of the Dummy-Head During Measurements in the Head-Shadow Area based on HRTF Evaluation Wersényi György SZÉCHENYI ISTVÁN.
This research was supported by Delphi Automotive Systems
3-D Sound and Spatial Audio
3-D Sound and Spatial Audio MUS_TECH 348. Stereo Loudspeaker Reproduction.
Immersive Displays The other senses…. 1962… Classic Human Sensory Systems Sight (Visual) Hearing (Aural) Touch (Tactile) Smell (Olfactory) Taste (Gustatory)
3-D Sound and Spatial Audio MUS_TECH 348. Are IID and ITD sufficient for localization? No, consider the “Cone of Confusion”
On the manifolds of spatial hearing
Development of Sound Localization 2 How do the neural mechanisms subserving sound localization develop?
PSYC Auditory Science Spatial Hearing Chris Plack.
3-D Sound and Spatial Audio MUS_TECH 348. Environmental Acoustics, Perception and Audio Processing: Envelopment.
Fletcher’s band-widening experiment (1940)
SPATIAL HEARING Ability to locate the direction of a sound. Ability to locate the direction of a sound. Localization: In free field Localization: In free.
Emotional response to sound Influence of spatial determinants Master’s Thesis in the Master’s programme in Sound and Vibration Fredrik Hagman Presented.
Sound Localization and Binaural Hearing
Auditory Localization in Rooms: Acoustic Analysis and Behavior
PSYCHOACOUSTICS A branch of psychophysics
What is stereophony? Stereos = solid (having dimensions: length width, height) Phonics = study of sound stereophony (stereo) is an aural illusion – a.
Spatial Audio - Spatial Sphere Demo Explained
3D sound reproduction with “OPSODIS” and its commercial applications
Hearing Spatial Detail
Localizing Sounds.
3 primary cues for auditory localization: Interaural time difference (ITD) Interaural intensity difference Directional transfer function.
3-D Sound and Spatial Audio
Presentation transcript:

3-D Sound and Spatial Audio MUS_TECH 348

What do these terms mean? Both terms are very general. “3-D sound” usually implies the perception of point sources in 3-D space (could also be 2-D plane) whether the audio reproduction is accomplished with loudspeakers or headphones. “Spatial audio” is broader, more inclusive in scope and includes the possibility of environmental sound, multi- loudspeaker systems, etc.

Other important terms, Mono/Monophonic: an audio system or device with one channel of audio information; usually reproduced from a single loudspeaker. Stereo/Stereophonic: an audio system or device with two channels of information; usually reproduced from two loudspeakers or headphones. The term usually implies that the listener can perceive sound images along a line between the loudspeakers or headphone transducers. Surround Sound: the term encompasses a variety of audio systems or devices that utilize four or more channels of audio information typically reproduced with four or more loudspeakers. Like stereo, it is usually implies that the listener can perceive sound images between the loudspeakers. Binaural: two-channel audio system or device that utilizes the spatial hearing cues of everyday life and provides the listener with the perception of three dimensions. The term often implies that the listener uses headphones.

More terms, Direct and Indirect sound

Early Reflections: part of the indirect sound that reaches the listener first and can be decomposed into discrete sound reflections. Reverberation: part of the indirect sound that follows early reflections and is made up of a continuous, dense blend of reflections.

2D planes intersecting the head

Horizontal Plane Azimuth Angle

3D Coordinates

Head orientation: Yaw, pitch and roll.

Parts of the ear.

Physical Acoustics and Directional Hearing

IID = Interaural Intensity Difference ITD = Interaural Time Difference Frequency Domain: HRTF = Head-Related Transfer Function Time Domain: Impulse Response impulse Ipsilateral ear is closer to the sound source. Contralateral ear is further from the sound source.

Consider the wavelengths! Frequency (Hz)Wavelength ft ft ft in in in in in Wavelength = speed of sound / frequency = 1130 ft/sec / frequency

What are the components of the acoustic system? Shoulders and Torso (150Hz – 3kHz reflection) Head (150Hz and up) Pinna (3.5kHz and up reflection) Conchae (2-5kHz resonance) Ear Canal (3kHz and 9kHz resonance) Each responds differently depending on its size

Pinna Cues

Composite of the complete acoustic system is captured in a Head-Related Transfer Function (HRTF) Phase is typically too hard to look at.

Individual Differences