Michael W. Marcellin Regents Professor Department of Electrical and Computer Engineering University of Arizona Tucson, AZ Digital Cinema

2 Digital Cinema Specifications n Digital Cinema Initiatives, LLC (DCI) n Founded by seven Hollywood studios in March 2002 n Disney n Fox n MGM n Paramount n Sony Pictures Entertainment n Universal n Warner Bros. n DCI mission: n “DCI's primary purpose is to establish and document voluntary specifications for an open architecture for digital cinema that ensures a uniform and high level of technical performance, reliability and quality control. DCI will also facilitate the development of business plans and strategies to help spur deployment of digital cinema systems in movie theaters.”

3 DCI (cont.) n System requirements and specifications n Completed July 2005 n Available at n Specifies requirements for Digital Cinema n File format n Color space n Resolution n Compression n Encryption n Etc

4 SMPTE DC28 n DC28 is a Technology Committee of SMPTE n Society of Motion Pictures and Television Engineers n Standardizing Digital Cinema n Creating necessary detailed documents n Ensure interoperability n Content creators/distributors n Projector and server manufacturers n Four study groups n DC28.10 – Mastering n DC28.20 – Distribution n DC28.30 – Exhibition n DC28.40 – Stereoscopic

5 Why Digital Cinema? n Many viewings conducted at Digital Cinema Lab n Side by side butterfly viewing of digital vs. answer prints n Digital quality comparable to answer prints n Digital 2K slightly softer, 4K slightly sharper n Significantly better than distribution prints u Distribution prints suffer generational loss n Digital does not suffer from spatial jitter n Film grain less visible (some say this is a negative) n Digital is “cool”

6 Why Digital Cinema? (cont.) n Workflow issues n Many motion pictures use “digital intermediate” in post-production n Processing done digitally, then (currently) film out n Distribution cost n Film distribution costs roughly $1200 per screen n Initially, savings may finance roll out n Single inventory n Stereoscopic movies n Digital projectors can display 48 frames per second u Polarized glasses u Shuttered glasses

7 Projectors n Two resolutions specified n 2K – 2048 x 1080 n 4K – 4096 x 2160 n Some studios believe 2K is sufficient n Others believe 4K is necessary n Motivated by distinction over home theatre n Two technologies n DLP (Texas Instruments) – mature products exist u Christie u Barco u NEC n LCOS (Sony, NTT) – products for small screens currently exist n Both are micro-display “reflective” technologies

8 Image Data n Two max frame sizes n 2K (2048 x 1080) – 24 or 48 frames per second n 4K (4096 x 2160) – 24 frames per second n Max not required in both dimensions n Accommodates different aspect ratios u 4096 x 1714 – 2.39 u 3996 x 2160 – 1.85 n Pixels are square n 12 bits per pixel per component n X’Y’Z’ color space n Allows for future wide gamut projectors n Expands code space

9 Audio Data n Uncompressed 24 bits per sample (PCM) n 48 Kbps n 96 Kbps n 16 tracks – 8 specified n Far left screen n Far right screen n Center screen n Screen low frequency effect subwoofer n Left wall surround n Right wall surround n Mid left to center screen n Mid right to center screen

10 Security n Compressed image frames individually encrypted n AES – 128 bit key n Preferred system has media block in projector n Decryption and decompression occurs in media block n If media block outside projector, link encryption must be used n Audio encryption optional n Biggest current piracy problem is camcorder n Forensic watermarking will be employed n Watermark insertion in real time at media block n Watermark specific to location and time (accurate to 15 minutes) n Watermark must appear in every five minute segment

11 Distribution n Image frames compressed via JPEG2000 n Compressed image, (uncompressed) audio, captioning, subtitling wrapped via MXF n MXF = SMPTE standard file format n Organized as “reels” n Packing list n Playlist n Digital signature n Distribution is store-and-forward (no streaming) n Physical media delivery in short to medium term

12 JPEG2000 n The latest International Standard for image compression n Selected by DCI for distribution of motion pictures

13 JPEG2000 Compression

14 Component Component Transform: Improves Compression Efficiency n Three components – no subsampling n Typically RGB n X’Y’Z’ for digital cinema (12 bits) n Applied independently to each color pixel n Most energy is in resulting Y component n Cz and Cx are highly compressible n Improves compression efficiency n 2:1 rate improvement for same quality

15 Wavelet Transform: Enables Resolution Scalability n The filtering perspective 1-D Forward Wavelet Transform1-D Inverse Wavelet Transform    

16 2D Transform: An Example

17 Wavelet Transform Example: Two Levels (Three Resolutions) nNote: High frequencies scaled for display

18 Codeblocks and Precincts: Enable Spatial Random Access and Low Memory

19 Bitplane Coding: Enables Quality Scalability and Precise Rate Control n Bitplane coding applied independently to each codeblock n Each bitplane coded in three “coding passes” n Each coding pass has an associated “distortion reduction” and a “compressed length” n “Distortion-rate slope” = figure of merit for a coding pass n Goal of rate allocation n Include coding passes with largest slopes K-1 2 K-2 2 K

20 Codestream Restrictions for Digital Cinema n Each frame compressed as one tile n No chroma subsampling (e.g., 4:4:4) n 12 bits per pixel per component n Codeblock size 32 x 32 n Precinct size 256 x 256 (LL 128 x 128) n “Default” arithmetic coder modes n One quality layer n Progression n 2K: by component n 4K: 2K subbands by component – then, 4K subbands, also by component

21 n No more than 1,041,666 bytes in the 2K portion of any color component of any frame n 200 Mbps n No more than 1,302,083 bytes in any frame (aggregate all three color components) n 250 Mbps ≤ 200 ≤ 250 ≤ 200 Codestream Restrictions (cont.) Only 24 fps discussed here for simplicity

22 Single Layer VBR Encoding n Assume 2k for simplicity --- 4k is similar n Determine desired total bytes for compressed sequence n For each frame in sequence n For each component in frame u Include coding passes with largest slopes until total bytes for component are1,041,666 n Discard coding passes with smallest slopes until total bytes for frame are 1,302,083 n Discard coding passes with smallest slopes (from entire sequence) until total bytes for sequence are as desired

23 Multi-Layer Encoding n May have applications in archiving and/or “enhanced” distribution Layer 0 Layer 1 Layer 2 …

24 Multi-Layer Algorithm n Apply single layer algorithm recursively n Assume two layers for simplicity a) Set constraints for layers 0 and 1 together (e.g., archive quality) b) Set constraints for just layer 0 (e.g., DCI constraints) c) Run single layer algorithm for constraints in a) d) Divide results of c) into two layers n Run single layer algorithm on results of c) using constraints of b) n Selected coding passes go in layer 0 n The remainder go in layer 1

25 Encoding Example n 4k StEM n Constraints for Layer 0 n Peak frame constraint: DCI (250 Mbps) n Peak component constraint: DCI (200 Mbps - 2k portion) n Average rate 150 Mbps n Constraints for Layers 0 and 1 together n Peak frame constraint: 500 Mbps n Peak component constraint: none n Average rate 250 Mbps

26