1. Visualization with 3D CG 2015 Masaki Hayashi 2015, Autumn Visualization with 3D CG 4K/8K Ultra-High-Resolution Imaging System

2. Visualization with 3D CG 2015 Content of the lecture 1.Basis of video production 2.4K video equipment 3.8K video equipment go to see 4K real-time CG 4K/8K Ultra High-Resolution Imaging System

3. Visualization with 3D CG 2015 8K グラフィックワークステーション Basis of video production

4. Visualization with 3D CG 2015 Real-time or Offline  Live production Live (online, real-time) Shooting, switching and go →Final video is real-time video stream.  Offline Not live (post-production) Filming and edited →Final video is a rendered one. TV programs (Drama, Variety, Education, Documentary), DVD, Blu-ray, etc. News, Sports, Event, TV conference, etc.

5. Visualization with 3D CG 2015 Video production 5 Camer a Recorder Switcher Non-linear editing Transmi t Monitor Filming ～ Editing ～ Transmitting Video production is :

6. Visualization with 3D CG 2015 8K (Super Hi-Vision) 7680 X 4320 Resolution family in video 4K (QFHD) 3840 X 2160 2K (HDTV) 1920 X 1080 SD 720 X 480 Quad-Full-HD 16 : 9 Television:4K (QFHD): 3840 X 2160, 16:9 Digital cinema:4K: 4096 X 2160, 17:9 (approx.) 256:135

7. Visualization with 3D CG 2015 ppi (pixel per inch) 1 inch = 2.54cm (dpi: dot per inch, is for printer) Retina display (iPad Retina) 9.7 inch, 2048x1536 4K display 60 inch, 3840x2160 73 ppi 264 ppi even a 8K is not enough... Pixel density

8. Visualization with 3D CG 2015 Frame rate 24p 25p 30p 50i 60i 50p 60p 120p....... ■Frame frequency (FPS) Temporal (time) resolution => Frame frequency (Hz) => Frame rate => FPS (Frame per second) i: Interlace p: progressive Temporal t standard now

9. Visualization with 3D CG 2015 Progressive and interlace scanning progressive scan Interlace scan every other line

10. Visualization with 3D CG 2015 Standard viewing distance = 3H (HDTV) 1.5H (4K) H 3H ~ (immersive sensation, presence point of view) Viewing distance in TV 60-inch monitor ---> H=75cm ---> 1.5H = 112cm

11. Visualization with 3D CG 2015 Television (Cinema) Two industries Computer Old (1950 ～ ) Mass communication Broadcast Standard is strict Video production is only for professional people Top-down New (1990 ～ ) Tele communication Personal use Standard is loose Internet Video production is for everybody (YouTube etc.) Bottom-up top people top people

12. Visualization with 3D CG 2015 4K iMac (21.5-inch) Pixel density 5K iMac (27-inch)

13. Visualization with 3D CG 2015 iPhone 6S Pixel density HDTV resolution display Built-in 4K video camera

14. Visualization with 3D CG 2015 8K グラフィックワークステーション 4K Video Equipment

15. Visualization with 3D CG 2015 Status of 4K video production 15 4K production has started but not yet done so much. Hollywood uses 4K already but not all. (Off line editing) Japan started 4K broadcast in 2014 (not successful). 4K broadcast was performed for the World Cup, Brazil. Also, maybe in Brazil, Korea, etc. Test live broadcast of 4K soccer game has been done in Japan in order to confirm the feasibility 4K test has been done in Europe, EBU etc. Medical use is under testing in Japan, also in USA. Video conference system needs ultra-high-resolution.

16. Visualization with 3D CG 2015 4K Camera overview 16 Many available "Still camera" evolved to 4K movie / "Broadcast HD camera" evolved to 4K Most demand is cinema use, however recently a few for broadcast use. Record the RAW signal and transfer to editing system. Smooth data transfer to the non-linear editing, is very important. Live 4K camera is becoming popular now. Max size of real-time monitoring is still HD. (View finder). This causes a "focusing" problem.

17. Visualization with 3D CG 2015 4K camera 17 RED Digital Cinema RED 4K Camera Released "RED ONE" in 2007, cheap Hollywood has been using it Enhancement of the still camera Both Still and Movie are OK Recently, released "EPIK", "SCARLET" replacing "RED ONE" 4K movie(4096×2160, 60p), 5K still Compressed RAW data are recorded Real-time monitor is HD (~ 300,000SEK)

18. Visualization with 3D CG 2015 4K Camera 18 CANON 4K/2K output Bayer RAW data is recorded. External debayering 4K movie 4096×2160 QFHD 3840×2160 Real-time monitor is HD Connect to an external debayering recorder for actual use. EOS C500 Digital Cinema 4K Camera

19. Visualization with 3D CG 2015 4K Camera 19 Real-time 4K debayering Handy like the HD broadcast camera. Just one cable is enough to operate QFHD 3840×2160 Live 4K output HDTV monitoring AH4413 4K Camera Astrodesign

20. Visualization with 3D CG 2015 4K Camera FDR-AX1 Consumer 4K Camera SONY For consumer use Cheap (30,000SEK) QFHD 3840×2160, 60p

21. Visualization with 3D CG 2015 Recorder overview 21 Many available Record RAW output to HDD, SSD, various Cards Capability of real-time recording of uncompressed video signal, or exclusive to off-line use Several external recorder for EOS C500 are available

22. Visualization with 3D CG 2015 4K Recorder 22 Astrodesign SSD （ Solid State Drive ） Record/Play full-spec 4K uncompressed video signal. Capable of recording full-spec 8K by using 4 of this Uncompressed 4K(60p), Max 160 minutes HR-7512-A 4K Record/Play

23. Visualization with 3D CG 2015 4K Recorder 23 For Canon "EOS C500" Capable of recording 4K base-band signal Real-time debayering and real-time direct 4K monitoring High speed data transmission Small and light Portable 4K Uncompressed SSD Recorder"HR-7510" Astrodesign

24. Visualization with 3D CG 2015 Switcher 24 4K M/E (Mixer/Effect, Keyer) is available but few. 4K live production is still not handy yet. Decompose one 4K signal into 4 HDTV lines and process them when real-time is required. There's few real-time 4K digital processing system. (eg. "Pablo" by Quantel, color correction)

25. Visualization with 3D CG 2015 4K Switcher 25 Software control or a hardware panel Multi View Monitoring Transitions, Digital Video Effects, Multi Layering, Keyers 6G-SDI Audio Mixer Cheap (20,000SEK) ATEM Production Studio 4K Blackmagic design

26. Visualization with 3D CG 2015 Non-linear editing 26 Off line editing on PC is done, then to transfer it via network or to burn DVD. Most of the non-linear editing software can handle 4K resolution. Adobe Premiere Pro, Apple Final Cut Pro, Avid Media Composer, Sony Vegas Pro, etc. Editing procedure is matured because of cinema use （ eg. Red one ＋ Premier Pro ） Many have DVD and Blu-Ray authoring function

27. Visualization with 3D CG 2015 Non-linear editing 27 Abobe High-performance editing workflow Enhanced Mercury Playback Engine using GPU for real-time preview Digital multi-effects Adobe After Effect integration Premier Pro CS6

28. Visualization with 3D CG 2015 Output 4K video 28 Off-line DVD 、 Blu-ray authoring Rendering JPEG2000 、 MPEG2 、 H264, H265, etc. Real-time HD-SDI X4 ３ G-SDI X2, 6G-SDI X1 DVI X4 （ X2 ） HDMI X4, HDMI2 X1 DisplayPort X2, DisplayPort1.2 X1 Transmit Direct connect to encoder. Compress in H.264 etc. and transmit Pro-use BNC connector

29. Visualization with 3D CG 2015 Encoder/Decoder 29 Fujitsu 4:2:2 、 10bit 、 H.264 compression 1080 60p × ２ （ 2 HDTV lines ） 3G-SDI output Capable of 4K transmission with 2 sets IP-9610 HD/SD Codec

30. Visualization with 3D CG 2015 Monitor 30 Many available Japan, Korea (Toshiba, Sony, Sharp, Astrodesign, Samsung, LG) SDI for pro-use. HDTV input for consumer, up-converting to 4K with special resolution enhancement function. Mostly large, 84 inch, 60 inch. On the other hand, 30 inch for desktop use. 4096 for cinema, 3840 for broadcast. Support both. 4K Projector Several available DLP 4K Projector for Theater （ BARCO 、 Christie, etc. ） 4096x2160 For consumer, 4K LCD projector, JVC, etc. 3840x2160

31. Visualization with 3D CG 2015 4K Monitor 31 Toshiba Large 55 inch QFHD 3840×2160 HDMI X4 Built-in BS/CS digital broadcast receiver Built-in up-converter with resolution enhancement Capable to record full-spec 4K video by attaching breakout box "THD-MBA1" REGZA 55X3 4K Television

32. Visualization with 3D CG 2015 4K Monitor 32 Large 56 inch QFHD 3840×2160 10 bits SDI 、 DVI Professional use DM-3410-A 56inch 10bit 4K Monitor Astrodesign

33. Visualization with 3D CG 2015 4K Projector 33 BARCO 社 32 meter screen 4096×2160 Contrast 2000:1 SDI 、 DVI Theater use DP4K-32B 4K DLP Cinema Projector

34. Visualization with 3D CG 2015 Summary of 4K video production 34 ・ Off-line production is established ・ Cinema production has been done in Hollywood ・ Live production is available but few. ・ Up-conversion of 2K to 4K is often used.

35. Visualization with 3D CG 2015 8K Video Production

36. Visualization with 3D CG 2015 Resolution:7680 × 4320 Aspect ratio: 16:9 Viewing distance: 0.75 H Viewing angle: 100° Frame rate: 120 Hz progressive Bit depth: 12-bit Audio system: 22.2 ch surround sound Sampling rate: 48/96 kHz Bit length: 16/20/24 bit Upper layer: 9 ch Middle layer: 10 ch Lower layer: 3 ch LFE: 2 ch Super Hi-Vision (8K) specifications

37. Visualization with 3D CG 2015 Super Hi-Vision

38. Visualization with 3D CG 2015 Status of 8K video production 38 8K real-time production is available (if compared to 4K). The reason is NHK promote it. Public viewing of London Olympic Three live ８ K cameras, switched on the site, transfer un- compressed signal to studio in BBC via optical fiber, recorded in BBC and encode in H.265 and transmit to Japan and US. Practical test of 8K broadcast is scheduled in 2016. 8K non-linear editing systems in Japan (Sapporo, BUG) Event use in NHK Studio Park, real-time 8K production

39. Visualization with 3D CG 2015 8K video equipment 39 Camera Recorder Switcher Transmit Monitor (Ikegami) (Hitachi) Recorder HR-7512 SwitcherSR-8422 Color correction VP-8407 Codec (Fujitsu) LCD （ Sharp ） Compact projector （ JVC ） PDP(Panasonic) Telop SC-8206 CCU VP-8404 Made by Astrodesign if not specified SHV Non-linear Editing （ Sapporo BUG ）

40. Visualization with 3D CG 2015 Summary of Super Hi-Vision (8K) 40 ・ System for both off-line and on-line is developed ・ Small amount of production experience ・ Current target is Tokyo Olympic ・ Needs other application besides video production

41. Visualization with 3D CG 2015 8K グラフィックワークステーション Ultra High Resolution 4K/8K Real-time CG

42. Visualization with 3D CG 2015 4K Game "Battle Field" Electronic Arts Inc. "Devil May Cry" CAPCOM

43. Visualization with 3D CG 2015 4K Game 4K Game has huge impact Generally, 4K （ 2K ） game is not so many due to the production cost However, it is still very good when displaying PC game (for HD) in 4K system Developing "Serious game" is also a key

44. Visualization with 3D CG 2015 4K real-time CG system GPU card PC Mouse 60” 4K Monitor DisplayPort ×1 V7900 (AMD) QuadCore Windows 7 Software Unity (Free version) Hardware

45. Visualization with 3D CG 2015 Let's go to CMLab

46. Visualization with 3D CG 2015 Target of Ultra-CG 4K/8K Content Museu m Ultra-CG Conventional TV program production Cinema productio n Full-CG Game Event Broadcast Cinema Event Game Simulator

47. Visualization with 3D CG 2015 4K Broadcast is scheduled Digital cinema, event, medical use, design review 8K (Super Hi-Vision) NHK plans to start broadcast by 2025 Event use Background #1 Ultra high resolution and high presence Next generation visual media Lack of content

48. Visualization with 3D CG 2015 ｳﾙﾄﾗ CG ﾌﾟﾛｼﾞｪｸﾄ 高精細・高臨場 感な次世代の映像メディア 2K (Hi-Vision) Used in Virtual Studio, event Few games for HDTV available 4K Used in larg- scale event use but is very limited 8K (Super-Hi-Vision) Does not exist at all Background #2 Real-time CG Unknown area of R&D

49. Visualization with 3D CG 2015 Ultra-CG Expansion of the 4K and 8K market Proposal of Ultra-CG Real-time CG 4K/8K Tendancy of technology driven Development of camera, recorder, transmitter, display Lack of content High-level CG expression Cinema, game, event, etc. Matured CG technique Programable Shader etc Evolution of GPU nVidia, AMD

50. Visualization with 3D CG 2015 Requirement of Ultra-CG Ultra high definition modeling Optimization to ultra high-definition CG environment adopted to 4K/8K High accurate rendering and control High performance CG machine 4K/8K video system integration HARDWARE SOFTWARE CONTENT Three areas in a cooperative balance