1. New generation media in research and entertainment Artur Binczewski, Maciej Głowiak, Bartłomiej Idzikowski, Maciej Stroiński, Maciej Stróżyk artur | mac | idzik | stroins | mackostr @man.poznan.pl Terena Networking Conference Vilnius, 2010

2. 1. The Technology

3. History HDTV – the leading technology become from 1990s –Era of Windows 3.0, MS DOS 5.0 (1991) –Introduction of WWW (Tim Berners Lee) and Linux (Linus Torvalds) –486DX2 (1992) –XGA (1024x768 in 256 colors in 1990, 65k colors in 1992) –SVGA (1280x1024 in 1998)

4. Era of Internet and new media

5. Issue HDTV – is not enough for many applications –Digital cinema –Entertainment –Science and visualization Next technology –4K / Quad-HD / SHD –8K / UHD / Super-Hi Vision –More?

6. What is 4K? The technology of displaying and processing high resolution video Resolutions of 8-9 Mpixel (~4K pixels horizontally): –DCI (Digital Cinema Initiatives) 4096x2160 –Quad HD 3840x2160 4K is: 21x SD 10x HD720p 4x HD1080p

7. You can see more details…

8. Or a wider perspective…

9. Standards: Digital Cinema Digital Cinema Initiatives (DCI) –Joint venture of major motion pictures studios –Formed in 2002 to establish a standard architecture for digital cinema –http://www.dcimovies.com/ First standard „Digital Cinema System Specification” established on Jul 2005 (v.1.0) now version 1.2 available –approved resolutions and parameters for digital cinema 2K (2048x1080) @ 24/48 fps 4K (4096x2160) @ 24 fps JPEG2000 compression –max. bit stream for 4K: 250 Mbit/s –max. frame size: 1,3 MB (24 fps), –12 bits per color component, CIE XYZ color space

10. Beyond 4K – 8K and 3D 8K 4K is not enough for many applications, next step is 8K –8192x4320 resolution, ~36 Mpix –UHD – Ultra High Definition or NHK Super-Hi Vision First tests in Japan (NHK) with 8K prototype camera (shown on IBC 2008 and NAB 2009) 4K/8K Stereoscopy Acquisition with two cameras & different angles or 3D stereoscopic animations Displaying 3D content in various techniques Applications: CAD projects, visualisation as well as entertainment (3D cinema, computer games)

11. 4K/8K technology and new networks Stream typeData streamNetwork interface 4K JPEG2000 (DCI)250 Mbit/s1 Gbit/s 4K JPEG2000 (DCI) 3D2x 250 Mbit/s1 Gbit/s 4K uncompressed6 Gbit/s10 Gbit/s 4K uncompressed 3D12 Gbit/s40 Gbit/s Stream typeData streamNetwork interface 8K JPEG20001 Gbit/s10 Gbit/s 8K JPEG2000 3D2x 1 Gbit/s10 Gbit/s 8K uncompressed24 Gbit/s40 Gbit/s 8K uncompressed 3D48 Gbit/s100 Gbit/s

12. HPC application: times of rendering 4K animation movies PC (1 CPU)Cluster 10 CPU Cluster 100 CPU 1 frame5 min37 s4 s 1 second2 h15 min96 s 1 minute120 h15 h1,5 h 1 hour10 months1 month4 days

13. 2. Applications

14. Digital Cinema Distribution Center Location A Cinema room Location B Cinema room Location C Community center Streaming transmission 4K Movie A (4K) Movie B (4K, HD) Movie B (HD) Easy way of content distribution A chance for small cinemas Flexible accounting procedures Different quality of content available (HD, 4K) Copyrights and security Event Location – live streaming from event hall Movie B (4K) Movie A (4K) Movie A storing (4K)

15. 4K applications: telemedicine Live video transmission of complex surgeries to remote team of supporting experts –High resolution and good color mapping of image –Reliable network connection and usually uncompressed codecs Recording of surgeries and medical diagnostic processes for educational purposes –Transmissions during symposiums and conferences –High quality materials for medicine students

16. 4K applications: security and monitoring issue: face recognition in a crowd at airports, train stations and during mass events (e.g. stadiums) Many details on single 4K frame – the powerful source for image processing Useful for police, border services and others security units Constraints: –scalability, –processing

17. 4K applications: CAD/CAM projects –Automotive design Design and digital visualisation of 3D car models Tests of safety, aerodynamics and ergonomic solutions –Architecture and urban planning Design and visualisation of buildings and engineering constructions models Tests of ergonomic and functionality as well as strength and safety of constructions

18. 4K live technology, videoconferencing and broadcasting 4K/8K Public Screening

19. 4K applications: visualisation of scientific processes High resolution images in science: –Physicis – visualisation of research on elementary particles and quantum mechanics –Biochemistry – particles and chemical reactions visualisation, genetics structures visualisation –Meteorology – visualisation of complex weather processes as well as disasters (e.g. tornados, earthquakes) –Astronomy and radioastronomy – presentations of sky maps, stars and planets

21. 3. Initiatives and international cooperation

22. Worldwide initiatives (1) CineGrid –Goal: The international cooperation for high resolution solutions linking: Research centers Supercomputing Centers Regional and national networks Audio-video equipment vendors Motion picture studios –Annual workshops in San Diego –Stimulation of new projects –Close cooperation with movie industry –Focus on networking aspects

23. The worldwide initiatives (2) HPDMnet (The High Performance Digital Media Network) Dynamic allocation of network resources for new media services Utilisation GLIF (Global Lambda Infrastructure Facility) network resources Design and development of dynamic and dedicated connection-oriented services for L0/L1 Infrastructure As a Service (IaaS) – implementation of new idea: –All physical resources available as software objects Project founded by NSF http://www.hpdmnet.net/

24. European initiatives (1) Many European institutions already working on 4K and new media: –University of Amsterdam, and SurfNET, The Netherlands –CESNET and Masaryk University, Czech Rep. –I2CAT, Spain –JANET, UK –KTH, Sweden –NORDUnet, Norway –PSNC, Poland –University of Essex, UK –other …

25. European initiatives (2) Collaboration possible over the GEANT network –Cooperation and testbeds possible in GN3 project New media initiatives or projects: –TF-Media Enable collaboration among European NRENs and universities interested in federated multimedia content management and distribution as well as working on complete workflow for media production, management and distribution services –VISIONAIR (VISION Advanced Infrastructure For Research) – [evaluation] VISIONAIR will create a unique and highly visible European infrastructure that supports high-level visualisation facilities. Europe has many individual facilities, managed in different ways and with very different access rules. Project will integrate these existing facilities and provide open access to the European research community. VISIONAIR will create a world-class research infrastructure that will enable world-leading research.

26. European Initiatives in FP7 1. Call FP7-ICT-2007-1 ICT-2007.1.5: Networked Media –Interoperable multimedia network and service infrastructures –End-to-end systems and application platforms 2. Call FP7-ICT-2009-4 ICT-2009.1.5: Networked Media and 3D –Content aware networks and network aware applications (e.g. games) –3D Media Internet –Immersive media experiences beyond HDTV and electronic cinema 3. Call INFRA-2010-1.1.29: Advanced Digital Visualisation Facilities –A project under this topic should aim at integrating the key virtual reality visualisation facilities, holographic image processing facilities and other computer graphics and animation facilities for advanced visualisation of scientific information

27. 4K demonstrations 12 Nov 2009 –First 4K European fully DCI- compliant live transmission between PSNC and University of Essex through the GEANT Network 31 May – 3 Jun 2010 –TNC 2010 4K Demonstration of JPEG2000 DCI transmission between Colchester and Vilnius through the GEANT Network

28. 4K node in PSNC

29. Summary 4K/8K (3D) technology provides new, high quality visualisation possibilities Chance for scientists to take part in new media and visualisation research projects Infrastructure and media labolatories equipment is required to be significant member of international projects Huge mass events (Olympic Games 2012, EURO 2012, …) could be an inpulse to demonstrate and implement high resolution visualisation systems The need of build pan-European infrastructure and collaboration for new high resolution media

30. Thank you! www.4kvideo.psnc.pl 4kvideo-pcss@lists.man.poznan.pl