Presentation on theme: "Spatial Perception of Audio vs. The Home Theatre"— Presentation transcript:
1 Spatial Perception of Audio vs. The Home Theatre James D. JohnstonChief Scientist, DTS, Inc.
2 _______________________ FOR THE HOME_______________________CINEMA IS DIFFERENT
3 First, some geometryHome12x19Cinema100x80So what?
4 First, time delay and 1/r^2 falloff for the cinema For someone in the center, 10’ back from the screen, speakers in the center and at +-30 feet from that. (sticking to front speakers for now)The center speaker is delayed by 10 msec.Right and Left are delayed by sqrt(10^2+30^2)= 31 msecDifference in level at arrival is (10/31)^2 or 10dB (to the nearest dB)
5 And for the home theatre Center speaker in middle of room, L and R at +- 4 feet, listener distance 8 feet from centerDelay to center 8 msecDelay to side speakers 9 msecDifference in level of 1dB
6 The Ear’s Tradeoff in terms of interaural energy vs. time delay Up to 1 millisecond or so, the HAS can trade off signal energy for time delay, in terms of imaging and localization. My big example of a home theatre room shows that home theatre is within this bound.N.B. If the listener is farther away, the problem gets even smallerThe many msec and many dB in the cinema offer no chance of the same
7 The worst CaseIn Cinema, one can be easily sitting outside the left or right speaker, leading to a near/far delay of 10 msec for near, and 60 msec for far, and the accompanying (large) falloffIn the Home Theatre, one can find one’s perhaps 10 msec from one speaker, when one is 8 msec from the far speaker. This, and its falloff, is much more acceptable.
8 About that worst caseThe “dialog in center” will save the Cinema dialog.In the home theatre, the delay and gain from center and right (for the left listener) will be of a level that will pull the image back toward the middle of the screen.Yes, it is necessary to have a center speaker in all of this.
9 The goals in cinema Get out the dialog Don’t make the watcher look backEnvelop the watcher/listener in something similar to what’s on the screenThis brings us to the use of back channelsIn cinema, they are presently intended for information that is to be perceived as diffuse, that is to say, without imaging information, and will be some large number of small loudspeakers intended for that purpose, perhaps dipole, bipole or other indirect radiator.;In the home theatre they don’t have to be limited, and will be 2 or 4 speakers. In many cases these will be direct radiators.
10 The goal in home theatre Everything we do in cinemaProvide stable imaging on the couch in front of the TVProvide a sense of envelopment in a small room with a small t60Avoid focus on rear and back speakers
11 In other words, Home Theatre is more demanding The good news is that it is also possible to do a much, much better job in home theatre than it is in cinema, because of the much smaller differences in relative listener vs. speaker position.You can accomplish things in the home that you could not do in the theatre, in regard to surround and imaging.That’s the good news.
12 The Bad News Production and mixing for the home theatre Needs to use all 3 front channels for all front signalsNeeds to mix part of the front into the rear channelsNeeds carefully defined, situationally appropriate to the MOVIE SETTING design of diffusion and reverberation to sides and backYes, sides AND back. That’s how the HAS works.
13 What do we want to get out of multichannel audio? EnjoymentA sense of envelopment, inclusion, and presenceA wide sweet spotHigh tolerance to speaker setup, equipment setup, and playback spaceEase of setup and use
14 What do we hear in a real space? Direct soundCorrelated at the two earsProvides directional cuesThe good news:You get things like stereo imaging and location cues, even when sitting far beyond the critical distance in the room.The bad news:The first arrival from a loudspeaker locates the loudspeaker really, really well. Even when you don’t want it to.
15 Reflected sound Provides hall character Sometimes is correlated, but shouldn’t beDiffuse soundProvides distance cuesProvides envelopmentHelps with front-back disambiguationT60 is typically reasonably high (>2 seconds) but may vary for special circumstancesGood news: This is a means to overlay the listening room venue with the desired venue.Bad news: Direct loudspeakers really don’t help with the diffuse sound field, in fact they can hurt.You can’t overlay a small T60 on a longer one.
16 Good news: These work even when overlaying one space with another. Distance cuesDirect/reverberant ratioFloor reflectionsGood news: These work even when overlaying one space with another.Bad news: Standard 2-channel stereo overwrites some of these cues with its own synthetic cues.
17 Performance and Movie “spaces” Performance usually larger, with larger T60For Performance, will have “pleasant” characterWill be highly diffuseFor movies, will attempt “realism” or “hyper-realism”Still usually larger. Very small scenes, except in Dramas, are unusual.May have unpleasant characteristics appropriate ot the situation. May therefore be diffuse or not.
18 What does a playback space typically add? Highly correlated reverberation on a much shorter timescale (T60 < 2 seconds or so)Bass modes due to the smaller roomBadly spaced and located loudspeakersSometimes not very good onesStacked speakersPoorly designed/placed/nonexistent center speakers
19 How about production methods for home theatre/small rooms Typical pan pottingLeads, in multichannel case, to a very small listening area. All channel direct signals are synchronous, first waveform wins every time.Highly dependent on speaker placement, matchingTime/amplitude panningLeads to a much wider listening areaLess sensitive to speaker placement/matchingMore like what would occur in the intended “simulated reality” spaceAll signals panned to at least 3 channels (for 5.x) with appropriate gain and delay
20 That center channel Fletcher and Snow You must have it to get good distance cuesThis doesn’t work if you don’t have all relevant program in itEasily demonstrated by the interaural mixing effects from +-30 degree speaker placement This was known before It’s time we accept it.Should contain dialog and other soundDialog should also show up in left and right for loudness reinforcement, with appropriate time-delay and amplitude cuesEssential for wide listening areaHelps in overcoming playback environment noise
21 Side and Rear ChannelsYou need side channels to get a sense of envelopment from the sides. The HRTF of the human head pretty much prevents getting this from the backYou need back channels to get sensation from the back. The HRTF problem is the inverse of side channelYes, you can try to “compensate” and then the playback room reverberation offers a contrary cue, and your auditory system figures out that something is wrong.
22 What’s this about time-delay panning? Pan pots are effectively the same as a combination of a tight microphone pattern added to purely coincident microphone placementThis means that even small shifts from the center of the 5.x setup “suck in” to the nearest speaker containing the nearest signal sourceTime delay panning is like a nearly-coincident systemIt allows moving around, and the time alignment of the extra signals from the extra channels reinforces in a way that greatly widens the listening space
23 ReverberationShould have different time character but the same frequency profile (T60 as a function of frequency) in each channel in order to envelopDirect/diffuse ratio can provide wonderful distance cuesEarly reflections, despite the arguments, often add unpleasant colorations to a sound source. I prefer to use time cues instead.N.B. First reflections, or strong side reflection, are appropriate when simulating a “bad” environment, say a cave, aircraft hangar, hallway…
24 Real CaptureCoincident capture leads to ‘must be in the center’ playbackVery wide placement leads to all-envelopment, no-imaging playback. The ear and brain can not make head or tale of the highly decorrelated attacksNearly coincident (.5 to 3 millisecond) capture methods provide time and amplitude cues that provide for wide listening areas and realistic playback of both diffuse and direct sound.
25 LoudspeakersBarring a loudspeaker that has separate direct and diffuse inputs (some exist, but are not in either production or common use) the more independent channels, the better.Bass management makes speakers smaller, but it also impairs the ability to cope with different room and auditory system issues.
26 The point?Consider the auditory system function when you are making multichannel signalsThe “law of the first wavefront” is real. Make sure the correct thing gets to the correct ear at the correct time for the FIRST ARRIVALMake sure your reverberation is diffuseMake sure that you don’t inadvertently create a plane wave by putting sound from only one speaker, unless you want the listener to localize that speakerThe best reverberation in the world, single-channel, from one speaker, is still a direct signal IN THE PLAYBACK ENVIRONMENT. And that will suck the listener right into the speaker.
27 You can decorrelated signals at the two ears in a small room with properly decorrelated outputs from 5 speakers, better 7.This won’t work in a large room, both attenuation and delay due to distance work against youThis only works if you have proper capture or synthesis technique
28 Good news, bad news Bad: Good: You can’t get rid of the reflections in the smaller roomSystem setup in home theatres is often a problem, especially at the low endGood:Earlier arrival from the loudspeakers can help mask or overlay reflections with the desired sensationThe smaller, lower T60 room allows for a much greater range of experiences, and for more verisimilitude for a greater range of auditory scenes.Room correction can often diagnose the worst of the bad setups.
29 In Summary The rules for home theatre are very different The difficulties are differentThe ability to immerse the listener is actually better, but you have to recall the presentation space as well as the auditory scene.