3-D Sound and Spatial Audio MUS_TECH 348. What are Some Options for Creating DTFs?

Slides:



Advertisements
Similar presentations
Computer Vision Lecture 7: The Fourier Transform
Advertisements

3-D Computational Vision CSc Image Processing II - Fourier Transform.
Frequency modulation and circuits
1 3D sound reproduction with “OPSODIS” and its commercial applications Takashi Takeuchi, PhD Chief Technical Officer OPSODIS Limited Institute of Sound.
Binaural Hearing Or now hear this! Upcoming Talk: Isabelle Peretz Musical & Non-musical Brains Nov. 12 noon + Lunch Rm 2068B South Building.
Spatial Perception of Audio J. D. (jj) Johnston Neural Audio Corporation.
SWE 423: Multimedia Systems Chapter 3: Audio Technology (2)
Physics Waves Lecture Notes Download
1 Two waves passing through the same region will superimpose - e.g. the displacements simply add Two pulses travelling in opposite directions will pass.
Extracting the pinna spectral notches Vikas C. Raykar | Ramani Duraiswami University of Maryland, CollegePark B. Yegnanaryana Indian Institute of Technology,
Interference of Sound Waves
3-D Sound and Spatial Audio MUS_TECH 348. Wightman & Kistler (1989) Headphone simulation of free-field listening I. Stimulus synthesis II. Psychophysical.
Multimedia communications EG 371Dr Matt Roach Multimedia Communications EG 371 and EE 348 Dr Matt Roach Lecture 6 Image processing (filters)
Back to Stereo: Stereo Imaging and Mic Techniques Huber, Ch. 4 Eargle, Ch. 11, 12.
3-D Sound and Spatial Audio MUS_TECH 348. Cathedral / Concert Hall / Theater Sound Altar / Stage / Screen Spiritual / Emotional World Subjective Music.
For any given time series, g(t), the Fourier spectrum is: FOURIER SPECTRUM: Time Domain (TD)-Frequency-Domain (FD) and vice- versa Dr. Sinan Akkar Strong.
IVA. Electromagnetic Waves and Optics
CSCE 641 Computer Graphics: Image Sampling and Reconstruction Jinxiang Chai.
CSCE 641 Computer Graphics: Image Sampling and Reconstruction Jinxiang Chai.
Sound Physics 202 Professor Vogel (Professor Carkner’s notes, ed) Lecture 7.
Signals Processing Second Meeting. Fourier's theorem: Analysis Fourier analysis is the process of analyzing periodic non-sinusoidal waveforms in order.
1 The Mathematics of Signal Processing - an Innovative Approach Peter Driessen Faculty of Engineering University of Victoria.
AUDITORY PERCEPTION Pitch Perception Localization Auditory Scene Analysis.
1 Two waves passing through the same region will superimpose - e.g. the displacements simply add Two pulses travelling in opposite directions will pass.
STUDIOS AND LISTENING ROOMS
Spectral centroid 6 harmonics: f0 = 100Hz E.g. 1: Amplitudes: 6; 5.75; 4; 3.2; 2; 1 [(100*6)+(200*5.75)+(300*4)+(400*3.2)+(500*2 )+(600*1)] / = 265.6Hz.
Harmonics and Overtones Waveforms / Wave Interaction Phase Concepts / Comb Filtering Beat Frequencies / Noise AUD202 Audio and Acoustics Theory.
Angle Modulation.
3-D Sound and Spatial Audio MUS_TECH 348. Multi-Loudspeaker Reproduction: Surround Sound.
Frequency Coding And Auditory Space Perception. Three primary dimensions of sensations associated with sounds with periodic waveforms Pitch, loudness.
Chapter 25 Nonsinusoidal Waveforms. 2 Waveforms Used in electronics except for sinusoidal Any periodic waveform may be expressed as –Sum of a series of.
Binaural Sonification of Disparity Maps Alfonso Alba, Carlos Zubieta, Edgar Arce Facultad de Ciencias Universidad Autónoma de San Luis Potosí.
ECE 598: The Speech Chain Lecture 5: Room Acoustics; Filters.
1 Computational Vision CSCI 363, Fall 2012 Lecture 10 Spatial Frequency.
LINKWITZ LAB What are the On-axis & Off-axis
Issac Garcia-Munoz Senior Thesis Electrical Engineering Advisor: Pietro Perona.
Transverse or longitudinal waves transport energy from one point to another. Each particle in the medium vibrates or oscillates, and disturbs the neighbouring.
3-D Sound and Spatial Audio MUS_TECH 348. Main Types of Errors Front-back reversals Angle error Some Experimental Results Most front-back errors are front-to-back.
Computer Sound Synthesis 2
09/19/2002 (C) University of Wisconsin 2002, CS 559 Last Time Color Quantization Dithering.
Timo Haapsaari Laboratory of Acoustics and Audio Signal Processing April 10, 2007 Two-Way Acoustic Window using Wave Field Synthesis.
PHSC 1013: Physical Science Waves Lecture Notes Download PDF Document Waves.pdfPowerpoint Slides Waves.pptWaves.pdfWaves.ppt.
3-D Sound and Spatial Audio MUS_TECH 348. Physical Modeling Problem: Can we model the physical acoustics of the directional hearing system and thereby.
L INKWITZ L AB S e n s i b l e R e p r o d u c t i o n & R e c o r d i n g o f A u d i t o r y S c e n e s Hearing Spatial Detail in Stereo Recordings.
Figures for Chapter 14 Binaural and bilateral issues Dillon (2001) Hearing Aids.
3-D Sound and Spatial Audio MUS_TECH 348. Stereo Loudspeaker Reproduction.
Sound and adding waves Interference. Types of Waves Longitudinal –Sound waves –Motion of the medium is parallel to the wave Transverse –Motion of the.
3-D Sound and Spatial Audio MUS_TECH 348. Are IID and ITD sufficient for localization? No, consider the “Cone of Confusion”
On the manifolds of spatial hearing
Waves. Wave Parameters Wavelength ( ) The shortest distance between points where a wave pattern repeats itself. Amplitude (A) The maximum distance an.
3-D Sound and Spatial Audio MUS_TECH 348. Environmental Acoustics, Perception and Audio Processing: Envelopment.
2.9 Beats Source 1 Detector , x Source 2
Fletcher’s band-widening experiment (1940)
Frequency domain analysis and Fourier Transform
SVY207 Lecture 8: The Carrier Phase Observable
Measurement and Instrumentation
3-D Sound and Spatial Audio MUS_TECH 348. What do these terms mean? Both terms are very general. “3-D sound” usually implies the perception of point sources.
Interference.
Precedence-based speech segregation in a virtual auditory environment
CS 591 S1 – Computational Audio – Spring 2017
3D sound reproduction with “OPSODIS” and its commercial applications
CS 591 S1 – Computational Audio -- Spring, 2017
(Road to discuss harmony)
EM Waves, Superposition
Lecture 35 Wave spectrum Fourier series Fourier analysis
Hearing Spatial Detail
Graphs of Sine and Cosine: Sinusoids
Unit 2 Particles and Waves Interference
3-D Sound and Spatial Audio
Time-distance: methods and results
Presentation transcript:

3-D Sound and Spatial Audio MUS_TECH 348

What are Some Options for Creating DTFs?

Pole-Zero Design of Filters 4th-order filters designed to capture the essential features of HRTFs Kendall & Rodgers 1982

Pole-Zero Design of Filters DTFs are created with low computational overhead. Kendall & Rodgers 1982

Pole-Zero Design of Filters Essential features are encoded in look-up tables. Kendall & Rodgers 1982

Pole-Zero Design of a Ensemble of DTFs 8th-order filters interactively designed so that poles and zero migrate smoothly between the specified points. Kendall 1985

Pole-Zero Design of a Ensemble of DTFs Filter response is different but the relative pole and zeros positions have shifted in small amounts. Kendall 1985

Principal Components Analysis and Resynthesis Provides an Analytic Approach to Simplified Filter Design Martens 1987 PCA Analysis produces a reduced set of ‘basis filters’ that capture all of the significant variation in the data.

Principal Components Novel DTFs can be synthesized from a combination of basis filters, each with a different weight. Martens 1987

What are the alternatives to Schroeder Crosstalk Cancellation?

“Head Tracked 3D Audio Using Loudspeakers” Bill Gardner Head tracking with loudspeakers Do crosstalk cancellation below 6kHz Designed for computer systems

“Head Tracked 3D Audio Using Loudspeakers”

Q Sound - Pro Audio Danny Lowe and John Lees “Sound Imaging Process” US Patent 5,046,097 Reduction to Practice Empirical Approach to Design

Q Sound Results of measurements are consolidated in look-up tables.

How does this work? Crosstalk happens!

Sum of two sine waves of the same frequency? It’s a sine wave: sin(2 π f t + Ø 1 ) + sin(2 π f t + Ø 2 ) = 2 cos[0.5 (Ø 1 - Ø 2 )] sin[2 π f t (Ø 1 + Ø 2 )] Constant that changes amplitude Sine wave with different phase

Q-Sound What arrives at the ears is the result of the addition. No crosstalk cancellation!

Q-Sound Advantages/Disadvantages Images not so sensitive to seating position – broader sweet spot Listeners can turn their heads toward the image Works best with loudspeakers close together Difficulty with elevation. Timbre coloration.

Similar Approaches Taken By Cooper-Bauck Auris (Kendall) Using other model-based approaches

Loudspeaker DTFs Based on Perceptual Model What loudspeaker signals were required to produce ‘central spectrum’ and ‘interaural disparity’ for a given direction? Cross talk was incorporated into the computation. The DTFs did not resemble HRTFs. Kendall 1988

Loudspeaker DTFs Based on Perceptual Model Path of sound motion degrades gradually with off-center seating.

General Observations (Given a “good” reproduction environment) What simulated sound locations work most reliably? Horizontal plane

General Observations Frontal plane Distance Central rear What simulated sound locations work most reliably?

Sound Examples