1. EE 5359 MULTIMEDIA PROCESSING PROJECT PROPOSAL SPRING 2016 STUDY AND PERFORMANCE ANALYSIS OF HEVC, H.264/AVC AND DIRAC By ASHRITA MANDALAPU 1001096980 ashrita.mandalapu@mavs.uta.edu With Guidance by, Dr.K.R.RAO

2. ACRONYMS AVC: Advanced Video Coding. BBC: British Broadcasting Corporation BD-BR: Bjontegaard Delta Bit rate. BD-PSNR: Bjontegaard Delta Peak Signal to Noise Ratio. CIF: Common Intermediate Format CTB: Coding Tree Block. CTU: Coding Tree Unit. CU: Coding Unit. EBU: European Broadcasting Unit HD: High Definition HDTV: High Definition Television HEVC: High Efficiency Video Coding. HM: HEVC Test Model. ICME: International Conference on Multimedia and Expo IEC: International Electro-technical Commission. ISDB: Integrated Services Digital Broadcasting ISO: International Organization for Standardization. ITU-T: International Telecommunication Union- Telecommunication Standardization Sector.

3. JCT: Joint Collaborative Team. JCT-VC: Joint Collaborative Team on Video Coding. JM: H.264 Test Model. JPEG: Joint Photographic Experts Group. MC: Motion Compensation. ME: Motion Estimation. MPEG: Moving Picture Experts Group. MSE: Mean Square Error. MSU: Moscow State University PB: Prediction Block. PSNR: Peak Signal to Noise Ratio. RTP: Real-time Transport Protocol QCIF: Quarter Common Intermediate Format QF: Quality Factor QP: Quantization Parameter SSIM: Structural Similarity Index. TB: Transform Block. TU: Transform Unit. VCEG: Visual Coding Experts Group. VQMT : Video Quality Measurement Tool

4. OBJECTIVE The objective of this project is to study, implement and compare the video coding standards of HEVC [1], H.264/AVC [2] and Dirac [3]. The analysis is performed in terms of complexity, video quality, bit rates, compression ratio using different performance metrics like MSE, PSNR, BD-BR, BD-PSNR and SSIM [13] [14]. MOTIVATION Many video coding standards are being introduced every year so as to meet the efficiency requirement. This project motivates towards gaining basic knowledge and understanding the video coding standards mentioned above so as to look for further future developments in this area by implementing software tools or codec on these standards.

5. HEVC HEVC is a successor to the H.264/AVC video coding standard. [1] HEVC achieves 2x higher compression compared to H.264/AVC. [1] HEVC will provide a flexible, reliable and robust solution to support the next decade of video. HEVC benefits include 1.Reduce the burden on global networks 2.Easier streaming of HD video to mobile devices 3.Account for advancing screen resolutions (e.g. Ultra-HD)

6. Figure1. Block Diagram of HEVC [17]

7. Figure2. Block diagram of HEVC encoder with built-in decoder (gray shaded region) [5].

8. H.264/AVC H.264/AVC is an efficient video compression technique available today, developed as a result of the collaboration between the ISO/IEC Moving Picture Experts Group and the ITU-T Video Coding Experts Group. It is the most widely used video coding standard [18] for streaming videos, mobile/handheld applications, HDTV broadcasting etc. The H.264 standard supports three sampling patterns for luminance component (Y), red-difference chroma component (C r ) and blue-difference chroma component (C b ) [20].

9. Figure3. Block diagram of AVC Encoder [2]

10. Figure4. Block diagram of AVC decoder [7]

11. DIRAC Dirac is a video compression system [9] developed by the British Broadcasting Corporation (BBC). It utilizes motion compensation and wavelet transforms to provide high-quality video compression for web streaming and HDTV applications [3]. Dirac can compress any size of picture from low resolution QCIF (176 x 144) to HDTV (1920 x 1080). There are two parts in the Dirac development process: (i)a compression specification for the bit stream and decoder, and (ii)software for compression and decompression.

12. Figure5. Block diagram of Dirac encoder [9]

13. Figure6. Block diagram of Dirac decoder [9]

14. PERFORMANCE ANALYSIS Performance analysis in this project can be done using the following: Profiles used: HM 18.6 [15], JM 19.0 [16] and Dirac 0.2.0 [12] Test Sequences: CIF and QCIF formats [19] Quality Metrics: MSE, PSNR, SSIM, BD-BR and BD-PSNR [13] [14] Measurement tool: MSU Video Quality Measurement Tool (VQMT) [21]

15. TEST SEQUENCES Coastguard (300 frames) Container (300 frames) CIF (352×288) and QCIF (176×144) formats [19]

16. REFERENCES [1] G.J. Sullivan et al, “Overview of the high efficiency video coding (HEVC) standard”, IEEE Trans. CSVT, vol. 22, pp.1649-1668, Dec. 2012. [2] T. Wiegand, G. Sullivan, G. Bjontegaard and A. Luthra, “Overview of the H.264/AVC video coding standard,” IEEE Trans. on Circuits and Systems for Video Technology, vol. 13, pp.560-576, July 2003. [3] “The Dirac web page”:http://www.bbc.co.uk/rd/projects/dirac/intro.shtml. [4] G.J. Sullivan et al, “Standardized Extensions of High Efficiency Video Coding (HEVC)”, IEEE Journal of selected topics in Signal Processing, Vol. 7, No. 6, pp. 1001- 1016, Dec. 2013. [5] V. Sze, M. Budagavi and G.J. Sullivan (Editors), “High efficiency video coding: Algorithms and architectures”, Springer 2014. [6] Wenger.S et al. "RFC 3984 : RTP Payload Format for H.264 Video". p. 2."RFC 3984 : RTP Payload Format for H.264 Video" [7] S.K.Kwon, A. Tamhankar and K.R.Rao, “Overview of H.264/MPEG-4 Part 10” J.VCIR, Vol. 17, pp. 186-216, April 2006, Special Issue on “Emerging H.264/AVC video coding standard”. [8] K. R. Rao and D. N. Kim, “Current Video Coding Standards: H.264/AVC, Dirac, AVS China and VC-1,” IEEE 42nd Southeastern symposium on system theory (SSST), pp. 1-8, March 2010. [9] T. Borer, and T. Davies, “Dirac video compression using open technology”, BBC EBU Technical Review, July 2005

17. [10] A. Ravi, and K.R. Rao, “Performance Analysis and Comparison of the Dirac video codec with H.264/MPEG-4 part 10 AVC”, International Journal of Wavelets, Multiresolution and Information Processing (accepted), January 2010. Available: http://www-ee.uta.edu/Dip/Courses/EE5359/index.html http://www-ee.uta.edu/Dip/Courses/EE5359/index.html [11] BBC Research on Dirac: http://www.bbc.co.uk/rd/projects/dirac/index.shtmlhttp://www.bbc.co.uk/rd/projects/dirac/index.shtml [12] Dirac software: http://sourceforge.net/projects/dirac/http://sourceforge.net/projects/dirac/ [13] Z. Wang and A.C. Bovik, “A universal image quality index”, IEEE Signal Processing Letters, Vol.9, pp. 81-84, March 2002. [14] Z. Wang, et al, “Image Quality Assessment: From Error Visibility to Structural Similarity”, IEEE Transactions on Image Processing, vol.13, no.4, pp. 600-612, April 2004. [15] HEVC software: https://hevc.hhi.fraunhofer.de/svn/svn_HEVCSoftware/tags/HM-18.6 [16] AVC software: http://iphome.hhi.de/suehring/tml/download/jml9.0.ziphttp://iphome.hhi.de/suehring/tml/download/jml9.0.zip [17] “Video coding for low bit rate communications,” ITUT, ITU-T Recommendation H.263, ver. 1, 1995. [18] T. Wiegand and G.J. Sullivan, “The picturephone is here. Really,” IEEE Spectrum, vol. 48, pp. 50-54, Sept. 2011. [19] YUV video sequences: http://trace.eas.asu.edu/yuv/ [20] I.E Richardson, “The H.264 advanced video coding standard”, Second Edition, Wiley, 2010 [21] MSU tool: http://compression.ru/video/quality_measure/video_measurement_tool_en.html http://compression.ru/video/quality_measure/video_measurement_tool_en.html

18. Thank you