1. Interim Report – Spring 2014 Course: EE5359 – Multimedia Processing Performance Comparison of HEVC & H.264 using various test sequences Under the guidance of K.R.Rao Submitted by Akula Venkata Harish UTA ID # 1000864859 email Id: venkatahari.akula@mavs.uta.edu

2. Contents Objective About HEVC About H.264 HEVC Intra prediction H.264 Intra prediction Metrics used for the performance comparison Profiles used for the performance comparison Test Sequences Results Acronyms References

3. Objective This project discusses the performance comparison of HEVC and H.264 using various test sequences based on various metrics such as PSNR, SSIM, BD-rates and implementation complexity.

4. About HEVC High Efficiency Video Coding (HEVC) is currently being developed as the latest video coding standard of the ITU-T Video Coding Experts Group and the ISO/IEC Moving Picture Experts Group. [9] The HEVC standard is intended to provide significantly better compression capability than the existing H.264/MPEG-4 AVC standard.[9] HEVC is said to double the data compression ratio compared to H.264/MPEG-4 AVC at the same level of video quality.[9]

5. HEVC Encoder Diagram

6. HEVC Decoder Diagram

7. Subdivision of a CTB into CBs and TBs

8. Subdivision of Picture into Slices and Tiles

9. About H.264 H.264 is a block oriented motion compensation based video compression standard developed by ITU-T Video Coding experts group (VCEG) together with the ISO/IEC JTC1 moving pictures experts group (MPEG). It is best known as being one of the video encoding standards for Blu-ray Discs.[8]

10. H.264 Encoder Block Diagram[7]

11. Salient Features of H.264 [13] Variable block-size motion estimation. It subdivides the frame into non overlapping fixed size blocks. Quarter –pixel accuracy motion estimation. Motion vectors over picture boundaries. Multiple reference frame facility.

12. Metrics to be used for the Performance Comparison Peak Signal to Noise Ratio (PSNR) Structural Similarity Index (SSIM) BD- rates Implementation Complexity

13. Profiles to be used for comparison The following are the profiles used for the comparison of HEVC and H.264 in this project: HM 13.0 main profile[18] JM 18.6 high profile[20]

14. Test Sequences The following test sequences [21] are used for study in the project: KristenAndSara_1280x720_60

15. Test Sequences BQSquare_416x240_60

16. Test Sequences BQMall_832x480_60

17. Test Sequences BasketballDrill_832x480_50.yuv

18. RESULTS KristenAndSara_1280x720_60

19. Bitrate Comparison of HEVC and H.264

20. PSNR Comparison of HEVC and H.264

21. Computational time comparison of HEVC and H.264

22. Further work The performance comparison of HEVC & H.264 is done for one of the test sequence based on various metrics. The performance comparison tests will be performed for three more test sequences and implementation results will be produced in final report using HM 13.0 and JM 18.6.

23. ACRONYMS AI: All Intra AVC: advanced video coding BD-BR: Bjontegaard Delta Bitrate BD-PSNR: Bjontegaard Delta Peak Signal to Noise Ratio CABAC: Context Adaptive Binary Arithmetic Coding CB: Coding Block CfP: Call for proposals CTU: Coding Tree Unit CU: Coding Unit GOP: group of pictures HD: High Definition HM: HEVC Model IEC: International Electro-technical Commission IPTV: Internet Protocol Television

24. ACRONYMS ISO: International Standards Organisation ITU: international telecommunication union JM: H.264 Joint Test Model JTC: Joint Technical Commitee LD: low delay MPEG: Moving Picture Experts Group PSNR: peak signal to noise ratio RA: Random Access SSIM: Structural Similarity Index TB: Transform Block TU: Transform Unit UHD: ultra-high definition VCEG: video coding experts group VGA: Video Graphics Array

25. References [1] ITU-T Q6/16 VCEG and ISO/IEC JTC1/SC29/WG11 MPEG, “Joint Call for Proposals on Video Compression Technology,” Document VCEG- AM91, Kyoto, JP, Jan. 2010. [2] G. J. Sullivan and J.-R. Ohm “Recent Developments in Standardization of High Efficiency Video Coding (HEVC),” SPIE Applications of Digital Image Proc. XXXIII, Proc. SPIE, Vol. 7798, paper 7798-30, Aug. 2010. [3] S. Park, J. Park and B. Jeon, “Report on the evaluation of HM versus JM,” Document JCTVC-D181, Daegu, KR, Jan. 2011. [4] Joint Model 18.0, available for download at http://iphome.hhi.de/suehring/tml/download/. http://iphome.hhi.de/suehring/tml/downlo [5] HEVC Model 13.0, available for download at http://hevc.kw.bbc.co.uk/trac/browser/jctvc-hm/tags/HM-13.0. http://hevc.kw.bbc.co.uk/trac/browser/jctvc-hm/tags/HM-13.0 [6] F. Bossen, “Common test conditions and software reference configurations,” Document JCTVC-F900, Torino, IT, July 2011.

26. References (Continued) [7] [http://cs.haifa.ac.il/~nimrod/Compression/Video/v9-h264-2003] URL for H.264 block Diagram [8] [http://en.wikipedia.org/wiki/H.264/MPEG-4_AVC] URL for H.264 [9] [http://en.wikipedia.org/wiki/High_Efficiency_Video_Coding] URL for HEVC and its encoder and decoder block diagrams [10] [http://en.wikipedia.org/wiki/Peak_signal-to-noise_ratio] URL for PSNR [11] [http://en.wikipedia.org/wiki/SSIM] URL for SSIM [12] X.Li et al, “Rate-complexity-distortion evaluation for hybrid video coding”, IEEE international Conference on Multimedia and Expo (ICME), PP. 685-690, Jul. 2010. [13] NPTEL video: For H.264 and its salient features [http://www.youtube.com/watch?v=f9n-7mgNsNQ ]http://www.youtube.com/watch?v=f9n-7mgNsNQ [14] D.Grois et al, “Performance Comparison of H.265/MPEG-HEVC, VP9, and H.264/MPEG-AVC Encoders”, available on: http://iphome.hhi.de/marpe/download/Performance_HEVC_VP9_X264_PCS_ 2013_preprint.pdf http://iphome.hhi.de/marpe/download/Performance_HEVC_VP9_X264_PCS_ 2013_preprint.pdf

27. References (Continued) [15] G.J.Sullivan et al, “Standarized Extensions of High Efficiency Video Coding (HEVC)”, IEEE Journal of selected topics in Signal Processing, Vol. 7, No. 6, pp. 1001-1016, Dec. 2013 [16] B.Li, G.J.Sullivan, and J.Xu “Compression performance of high efficiency video coding (HEVC) working draft 4”, IEEE ISCAS, pp. 886-889, session B1 L-H, seoul, Korea, May 2012. [17] [http://vcodex.blogspot.com/2013/04/comparing-hevc-and-h264-quality-using.html] URL for qualitative comparison of HEVC and H.264 [18] G.J.Sullivan et al, “Overview of High Efficiency Video Coding (HEVC) Standard” IEEE transactions on circuits and systems for video technology, vol 22, No. 12, pp 1649-1668, Dec. 2012 [19] [http://courses.cs.washington.edu/courses/csep590a/07au/lectures/rahullarge.pdf] URL for the quarter pixel motion estimation [20] G.J.Sullivan et al, “Overview of the H.264/AVC video coding standard” IEEE Circuits and Systems for Video Technology, vol 13, No. 7, pp 560-576, July 2003 [21] Test sequences: ftp://ftp.kw.bbc.co.uk/hevc/hm-11.0-anchors/bitstreams/ftp://ftp.kw.bbc.co.uk/hevc/hm-11.0-anchors/bitstreams/ [22] B.Bross et al, “High Efficiency Video Coding (HEVC) Text specification draft 10” Document JCTVC- L1003, ITU-T/ISO/IEC Joint Collaborative Team on Video Coding (JCT-VC). Mar. 2013 available on http://phenix.it-sudparis.eu/jct/docenduser/current http://phenix.it-sudparis.eu/jct/docenduser/current document.php?id=7243

28. References (Continued) [23] JVT Draft ITU-T recommendation and final draft international standard at joint video specification (ITU-T Rec. H.264-ISO/IEC 14496-10 AVC), march 2003, JVT-G050 available on http://ip.hhi.de/imagecomG1/assets/pdfs/JVT- G050.pdhttp://ip.hhi.de/imagecomG1/assets/pdfs/JVT- G050.pd [24] Special issue on emerging research and standards in next generation video coding, IEEE Transactions on Circuits and Systems for Video Technology (CSVT), vol. 23, pp. 2009-2142, Dec. 2013. [25] IEEE Journal of Selected Topics in Signal Processing, vol. 7, Dec. 2013 [26] K.R.Rao, D.N.Kim and J.J.Huang, “Video Coding Standards H.264/MPEG- 4”, Springer, 2014.