Visualization with 3D CG 2015 Masaki Hayashi 2015, Autumn Visualization with 3D CG 4K/8K Ultra-High-Resolution Imaging System

Visualization with 3D CG 2015 Content of the lecture 1.Basis of video production 2.4K video equipment 3.8K video equipment go to see 4K real-time CG 4K/8K Ultra High-Resolution Imaging System

Visualization with 3D CG K グラフィックワークステーション Basis of video production

Visualization with 3D CG 2015 Real-time or Offline  Live production Live (online, real-time) Shooting, switching and go →Final video is real-time video stream.  Offline Not live (post-production) Filming and edited →Final video is a rendered one. TV programs (Drama, Variety, Education, Documentary), DVD, Blu-ray, etc. News, Sports, Event, TV conference, etc.

Visualization with 3D CG 2015 Video production 5 Camer a Recorder Switcher Non-linear editing Transmi t Monitor Filming ～ Editing ～ Transmitting Video production is :

Visualization with 3D CG K (Super Hi-Vision) 7680 X 4320 Resolution family in video 4K (QFHD) 3840 X K (HDTV) 1920 X 1080 SD 720 X 480 Quad-Full-HD 16 : 9 Television:4K (QFHD): 3840 X 2160, 16:9 Digital cinema:4K: 4096 X 2160, 17:9 (approx.) 256:135

Visualization with 3D CG 2015 ppi (pixel per inch) 1 inch = 2.54cm (dpi: dot per inch, is for printer) Retina display (iPad Retina) 9.7 inch, 2048x1536 4K display 60 inch, 3840x ppi 264 ppi even a 8K is not enough... Pixel density

Visualization with 3D CG 2015 Frame rate 24p 25p 30p 50i 60i 50p 60p 120p ■Frame frequency (FPS) Temporal (time) resolution => Frame frequency (Hz) => Frame rate => FPS (Frame per second) i: Interlace p: progressive Temporal t standard now

Visualization with 3D CG 2015 Progressive and interlace scanning progressive scan Interlace scan every other line

Visualization with 3D CG 2015 Standard viewing distance = 3H (HDTV) 1.5H (4K) H 3H ~ (immersive sensation, presence point of view) Viewing distance in TV 60-inch monitor ---> H=75cm ---> 1.5H = 112cm

Visualization with 3D CG 2015 Television (Cinema) Two industries Computer Old (1950 ～ ) Mass communication Broadcast Standard is strict Video production is only for professional people Top-down New (1990 ～ ) Tele communication Personal use Standard is loose Internet Video production is for everybody (YouTube etc.) Bottom-up top people top people

Visualization with 3D CG K iMac (21.5-inch) Pixel density 5K iMac (27-inch)

Visualization with 3D CG 2015 iPhone 6S Pixel density HDTV resolution display Built-in 4K video camera

Visualization with 3D CG K グラフィックワークステーション 4K Video Equipment

Visualization with 3D CG 2015 Status of 4K video production 15 4K production has started but not yet done so much. Hollywood uses 4K already but not all. (Off line editing) Japan started 4K broadcast in 2014 (not successful). 4K broadcast was performed for the World Cup, Brazil. Also, maybe in Brazil, Korea, etc. Test live broadcast of 4K soccer game has been done in Japan in order to confirm the feasibility 4K test has been done in Europe, EBU etc. Medical use is under testing in Japan, also in USA. Video conference system needs ultra-high-resolution.

Visualization with 3D CG K Camera overview 16 Many available "Still camera" evolved to 4K movie / "Broadcast HD camera" evolved to 4K Most demand is cinema use, however recently a few for broadcast use. Record the RAW signal and transfer to editing system. Smooth data transfer to the non-linear editing, is very important. Live 4K camera is becoming popular now. Max size of real-time monitoring is still HD. (View finder). This causes a "focusing" problem.

Visualization with 3D CG K camera 17 RED Digital Cinema RED 4K Camera Released "RED ONE" in 2007, cheap Hollywood has been using it Enhancement of the still camera Both Still and Movie are OK Recently, released "EPIK", "SCARLET" replacing "RED ONE" 4K movie(4096×2160, 60p), 5K still Compressed RAW data are recorded Real-time monitor is HD (~ 300,000SEK)

Visualization with 3D CG K Camera 18 CANON 4K/2K output Bayer RAW data is recorded. External debayering 4K movie 4096×2160 QFHD 3840×2160 Real-time monitor is HD Connect to an external debayering recorder for actual use. EOS C500 Digital Cinema 4K Camera

Visualization with 3D CG K Camera 19 Real-time 4K debayering Handy like the HD broadcast camera. Just one cable is enough to operate QFHD 3840×2160 Live 4K output HDTV monitoring AH4413 4K Camera Astrodesign

Visualization with 3D CG K Camera FDR-AX1 Consumer 4K Camera SONY For consumer use Cheap (30,000SEK) QFHD 3840×2160, 60p

Visualization with 3D CG 2015 Recorder overview 21 Many available Record RAW output to HDD, SSD, various Cards Capability of real-time recording of uncompressed video signal, or exclusive to off-line use Several external recorder for EOS C500 are available

Visualization with 3D CG K Recorder 22 Astrodesign SSD （ Solid State Drive ） Record/Play full-spec 4K uncompressed video signal. Capable of recording full-spec 8K by using 4 of this Uncompressed 4K(60p), Max 160 minutes HR-7512-A 4K Record/Play

Visualization with 3D CG K Recorder 23 For Canon "EOS C500" Capable of recording 4K base-band signal Real-time debayering and real-time direct 4K monitoring High speed data transmission Small and light Portable 4K Uncompressed SSD Recorder"HR-7510" Astrodesign

Visualization with 3D CG 2015 Switcher 24 4K M/E (Mixer/Effect, Keyer) is available but few. 4K live production is still not handy yet. Decompose one 4K signal into 4 HDTV lines and process them when real-time is required. There's few real-time 4K digital processing system. (eg. "Pablo" by Quantel, color correction)

Visualization with 3D CG K Switcher 25 Software control or a hardware panel Multi View Monitoring Transitions, Digital Video Effects, Multi Layering, Keyers 6G-SDI Audio Mixer Cheap (20,000SEK) ATEM Production Studio 4K Blackmagic design

Visualization with 3D CG 2015 Non-linear editing 26 Off line editing on PC is done, then to transfer it via network or to burn DVD. Most of the non-linear editing software can handle 4K resolution. Adobe Premiere Pro, Apple Final Cut Pro, Avid Media Composer, Sony Vegas Pro, etc. Editing procedure is matured because of cinema use （ eg. Red one ＋ Premier Pro ） Many have DVD and Blu-Ray authoring function

Visualization with 3D CG 2015 Non-linear editing 27 Abobe High-performance editing workflow Enhanced Mercury Playback Engine using GPU for real-time preview Digital multi-effects Adobe After Effect integration Premier Pro CS6

Visualization with 3D CG 2015 Output 4K video 28 Off-line DVD 、 Blu-ray authoring Rendering JPEG2000 、 MPEG2 、 H264, H265, etc. Real-time HD-SDI X4 ３ G-SDI X2, 6G-SDI X1 DVI X4 （ X2 ） HDMI X4, HDMI2 X1 DisplayPort X2, DisplayPort1.2 X1 Transmit Direct connect to encoder. Compress in H.264 etc. and transmit Pro-use BNC connector

Visualization with 3D CG 2015 Encoder/Decoder 29 Fujitsu 4:2:2 、 10bit 、 H.264 compression p × ２ （ 2 HDTV lines ） 3G-SDI output Capable of 4K transmission with 2 sets IP-9610 HD/SD Codec

Visualization with 3D CG 2015 Monitor 30 Many available Japan, Korea (Toshiba, Sony, Sharp, Astrodesign, Samsung, LG) SDI for pro-use. HDTV input for consumer, up-converting to 4K with special resolution enhancement function. Mostly large, 84 inch, 60 inch. On the other hand, 30 inch for desktop use for cinema, 3840 for broadcast. Support both. 4K Projector Several available DLP 4K Projector for Theater （ BARCO 、 Christie, etc. ） 4096x2160 For consumer, 4K LCD projector, JVC, etc. 3840x2160

Visualization with 3D CG K Monitor 31 Toshiba Large 55 inch QFHD 3840×2160 HDMI X4 Built-in BS/CS digital broadcast receiver Built-in up-converter with resolution enhancement Capable to record full-spec 4K video by attaching breakout box "THD-MBA1" REGZA 55X3 4K Television

Visualization with 3D CG K Monitor 32 Large 56 inch QFHD 3840× bits SDI 、 DVI Professional use DM-3410-A 56inch 10bit 4K Monitor Astrodesign

Visualization with 3D CG K Projector 33 BARCO 社 32 meter screen 4096×2160 Contrast 2000:1 SDI 、 DVI Theater use DP4K-32B 4K DLP Cinema Projector

Visualization with 3D CG 2015 Summary of 4K video production 34 ・ Off-line production is established ・ Cinema production has been done in Hollywood ・ Live production is available but few. ・ Up-conversion of 2K to 4K is often used.

Visualization with 3D CG K Video Production

Visualization with 3D CG 2015 Resolution:7680 × 4320 Aspect ratio: 16:9 Viewing distance: 0.75 H Viewing angle: 100° Frame rate: 120 Hz progressive Bit depth: 12-bit Audio system: 22.2 ch surround sound Sampling rate: 48/96 kHz Bit length: 16/20/24 bit Upper layer: 9 ch Middle layer: 10 ch Lower layer: 3 ch LFE: 2 ch Super Hi-Vision (8K) specifications

Visualization with 3D CG 2015 Super Hi-Vision

Visualization with 3D CG 2015 Status of 8K video production 38 8K real-time production is available (if compared to 4K). The reason is NHK promote it. Public viewing of London Olympic Three live ８ K cameras, switched on the site, transfer un- compressed signal to studio in BBC via optical fiber, recorded in BBC and encode in H.265 and transmit to Japan and US. Practical test of 8K broadcast is scheduled in K non-linear editing systems in Japan (Sapporo, BUG) Event use in NHK Studio Park, real-time 8K production

Visualization with 3D CG K video equipment 39 Camera Recorder Switcher Transmit Monitor (Ikegami) (Hitachi) Recorder HR-7512 SwitcherSR-8422 Color correction VP-8407 Codec (Fujitsu) LCD （ Sharp ） Compact projector （ JVC ） PDP(Panasonic) Telop SC-8206 CCU VP-8404 Made by Astrodesign if not specified SHV Non-linear Editing （ Sapporo BUG ）

Visualization with 3D CG 2015 Summary of Super Hi-Vision (8K) 40 ・ System for both off-line and on-line is developed ・ Small amount of production experience ・ Current target is Tokyo Olympic ・ Needs other application besides video production

Visualization with 3D CG K グラフィックワークステーション Ultra High Resolution 4K/8K Real-time CG

Visualization with 3D CG K Game "Battle Field" Electronic Arts Inc. "Devil May Cry" CAPCOM

Visualization with 3D CG K Game 4K Game has huge impact Generally, 4K （ 2K ） game is not so many due to the production cost However, it is still very good when displaying PC game (for HD) in 4K system Developing "Serious game" is also a key

Visualization with 3D CG K real-time CG system GPU card PC Mouse 60” 4K Monitor DisplayPort ×1 V7900 (AMD) QuadCore Windows 7 Software Unity (Free version) Hardware

Visualization with 3D CG 2015 Let's go to CMLab

Visualization with 3D CG 2015 Target of Ultra-CG 4K/8K Content Museu m Ultra-CG Conventional TV program production Cinema productio n Full-CG Game Event Broadcast Cinema Event Game Simulator

Visualization with 3D CG K Broadcast is scheduled Digital cinema, event, medical use, design review 8K (Super Hi-Vision) NHK plans to start broadcast by 2025 Event use Background #1 Ultra high resolution and high presence Next generation visual media Lack of content

Visualization with 3D CG 2015 ｳﾙﾄﾗ CG ﾌﾟﾛｼﾞｪｸﾄ 高精細・高臨場 感な次世代の映像メディア 2K (Hi-Vision) Used in Virtual Studio, event Few games for HDTV available 4K Used in larg- scale event use but is very limited 8K (Super-Hi-Vision) Does not exist at all Background #2 Real-time CG Unknown area of R&D

Visualization with 3D CG 2015 Ultra-CG Expansion of the 4K and 8K market Proposal of Ultra-CG Real-time CG 4K/8K Tendancy of technology driven Development of camera, recorder, transmitter, display Lack of content High-level CG expression Cinema, game, event, etc. Matured CG technique Programable Shader etc Evolution of GPU nVidia, AMD

Visualization with 3D CG 2015 Requirement of Ultra-CG Ultra high definition modeling Optimization to ultra high-definition CG environment adopted to 4K/8K High accurate rendering and control High performance CG machine 4K/8K video system integration HARDWARE SOFTWARE CONTENT Three areas in a cooperative balance