1. - By Naveen Siddaraju naveen.siddaraju@mavs.uta.edu naveen.siddaraju@mavs.uta.edu - Under the guidance of Dr K R Rao Study and comparison of H.264/MPEG4 part10 AVC main profile with AVS P2 Jizhun profile

2. Contents Introduction Brief overview of H.264 Brief overview of AVS China Comparison Results Conclusion Future work

3. Introduction

5. H.264 / MPEG 4 AVC Latest video coding standard Basic design architecture is similar to previous MPEG standards Better compression efficiency

6. Coding structure Picture  slices  MBs  subMBs  blocks  pixels I, P and B slices Derived slices SI and SP

7. Different YUV systems in H.264 [16]

8. Profiles and levels in H.264 Baseline profile Main profile Extended profile High profiles

9. H.264 Profiles – coding parts [1]

10. Intra prediction in H.264 Uses adaptive spatial prediction to reduce spatial redundancy. 4 X 4 luma, 8X8 luma( used in high profile) – 9 modes 16 X 16 luma – 4 modes 4 X 4 chroma - 4 modes

11. H.264 intra prediction modes for 4X4 luma

12. H.264 inter prediction Uses motion estimation and motion compensation (MC). Used to reduce temporal correlation.

13. H.264 encoder [1]

14. H.264 decoder [1]

15. De-blocking filter Is used to reduce the blocking artifacts. Two sources of the blocking arifacts. - 4 X 4 transform - motion compensated prediction since the filter is present in the loop, it prevents the propagation of the blocking artifacts.

16. Entropy coding quantized values and other syntax elements into actual bits. CAVLC and CABAC for quantized coefficients. Exp- Golomb codes for syntax elements which are not coded by CABAC or CAVLC.

17. AVS – China Latest audio video coding standard from China Standardization includes system, audio, video and digital copyright management. Goal – to achieve coding efficiency with reduced complexity.

18. AVS Parts [3]

19. AVS layered data structure [3] for 4:2:0 video sequence

20. AVS video - profiles Jizhun profile (base profile) Jiben profile (basic profile) Shenzhan profile (extended profile) Jiaqiang profile (enhanced profile)

21. AVS P2 encoder [ 24]

22. AVS decoder

23. AVS motion estimation and intra prediction : AVS uses adaptive modes for motion compensation at the picture layer and the macroblock layer. The modes in picture layer are : Forward prediction from the most recent reference frame Forward prediction from the second most recent prediction frame Interpolative prediction between the most recent reference frame and a future reference frame. Intra coding

24. AVS motion estimation and intra prediction (cont..) At the macroblock layer, the modes depend on the picture mode. In Intra pictures, all macroblocks are intra coded. In Predicted pictures, macroblocks may be forward predicted or intra coded. In interpolated pictures, macroblocks may be forward predicted, backward predicted, interpolated or intra coded.

25. Predicted pictures (P – pictures):

26. Interpolated Pictures (B-Pictures):

27. AVS intra prediction [7]

28. Comparison H.264 and AVS video

29. Rate control Block: A rate control algorithm dynamically adjusts encoder parameters to achieve a target bitrate. quantization parameter QP quantization parameter

30. Encoder with and without rate control block

31. Bitrate Vs QP

32. Standards for representing digital video

33. results: H.264 – JM 16.1 used [9] AVS – RM09.01[10]

34. JM 16.1 output

37. AVS ref software output

39. Input sequence : QCIF Foreman [10] : Bitrates Vs psnr

40. Plot: PSNR vs. bit rate

41. Sequence: QCIF car phone [10]

44. CIF: Foreman sequence [10]

47. CIF football sequence [10]

50. 4CIF: sequence ( 704 X 576) [20]

53. Conclusion H.264 always gives better coding efficiency and compression. Advantages of AVS: - Faster encoder - Reduced complexity - reduced costs. Performance difference is mainly due to absence of complex tools such as CABAC and fewer prediction modes.

54. Future work: comparison between other profiles like extended profiles of AVS and AVC. Comparison between h.264 and other codecs like wmv9 (windows media video), RV10 (real video) etc.

55. List of acronyms used

56. Thank you

57. References [1] Soon-kak Kwon et al. “Overview of H.264 / MPEG-4 Part 10 (pp.186-216)”, Special issue on “ Emerging H.264/AVC video coding standard”, J. Visual Communication and Image Representation, vol. 17, pp.183- 552, April 2006. [2] A. Puri et al. “Video coding using the H.264/MPEG-4 AVC compression standard”, Signal Processing: Image Communication, vol.19, pp 793-849, Oct 2004. [3] W. GAO et al. “AVS - The Chinese next-generation video coding standard” NAB, Las Vegas, 2004. [4] X. Wang et.al “Performance comparison of AVS and H.264/AVC video coding standards” J. Comput. Sci. & Technol., Vol.21, No.3, pp.310-314 J, May 2006. [5] L. Yu et al. “An Overview of AVS-Video: tools, performance and complexity”, Visual Communications and Image Processing 2005, Proc. of SPIE, vol. 5960, pp.596021, July 31, 2006. [6] D Chang “MPEG 4, H.264 compression standards” ppt, http://mmlab.snu.ac.kr/http://mmlab.snu.ac.kr/ [7] L. Yu et al. “An area-efficient VLSI architecture for AVS intra frame encoder” Visual Communications and Image Processing 2007, Proc. of SPIE-IS & T Electronic Imaging, SPIE vol. 6508, pp. 650822, Jan. 29, 2007.

58. [8]Introduction to codecs: http://gizmodo.com/5093670/giz-explains-every-video-format-you-need-to- knowhttp://gizmodo.com/5093670/giz-explains-every-video-format-you-need-to- know [9] H.264/AVC JM Software http://bs.hhi.de/~ suehring/tml/download new version of the H.264/AVCreference software http://iphome.hhi.de/suehring/tml/download/.http://iphome.hhi.de/suehring/tml/download/ [10] AVS reference software, ftp://159.226.42.57/public/avs_docs/avs_software. ftp://159.226.42.57/public/avs_docs/avs_software [11] MPEG website: http://www.mpeg.org. http://www.mpeg.org [12]MPEG-1: ISO/IEC JTC1/SC29, Coding of moving pictures and associated audio for digital storage media up to about ARTICLE IN PRESS A. Puri et al. / Signal Processing: Image Communication 19 (2004) 793– 849 847 1.5 Mbit/s, ISO/IEC 11172-2, International Standard, November 1992. [13] MPEG-2: ISO/IEC JTC1/SC29/WG11 and ITU-T, ISO/IEC 13818-2: Information Technology- Generic Coding of Moving Pictures and Associated Audio Information: Video, ISO/IEC and ITU-T,1994. [14] MPEG-4: ISO/IEC JTCI/SC29/WG11, ISO/IEC 14 496:2000-2: Information on Technology-Coding of Audio-Visual Objects-Part 2: Visual, ISO/IEC, 2000.

59. [15] H.264 Standard 2007.pdf, http://ee.uta.edu/Dip/Courses/EE5359/H.264%20Standard2007.pdf http://ee.uta.edu/Dip/Courses/EE5359/H.264%20Standard2007.pdf [17] JVT ”Draft ITU-T recommendation and final draft international standard of joint video specification (ITU-T rec. H.264– ISO/IEC 14496-10 AVC),” March 2003,JVT-G050 available on http://ip.hhi.de/imagecom_G1/assets/pdfs/JVT-G050.pdf. http://ip.hhi.de/imagecom_G1/assets/pdfs/JVT-G050.pdf [18] R. Schäfer, et al, “The emerging H.264/AVC standard”, EBU Technical Review, Jan. 2003. [19] Rate Control and H.264, link: http://www.pixeltools.com/rate_control_paper.html http://www.pixeltools.com/rate_control_paper.html [20] UTA digital image processing course website, link: http://www- ee.uta.edu/dip/Courses/EE5356/ee_5356.htmhttp://www- ee.uta.edu/dip/Courses/EE5356/ee_5356.htm [21] H.264/14496-10 AVC Reference Software Manual link: http://iphome.hhi.de/suehring/tml/JM%20Reference%20Software%20Manual%20%28JVT- AE010%29.pdf http://iphome.hhi.de/suehring/tml/JM%20Reference%20Software%20Manual%20%28JVT- AE010%29.pdf [22] T. Wiegand, et al, “Overview of the H.264/AVC Video Coding Standard” IEEE Trans.Circuits and Systems for Video Technology, vol. 13, pp. 560-576, June 2003.

60. [23] AVS Video Expert Group, “Information Technology – Advanced coding of audio and video – Part 2: Video (AVS1-P2 JQP FCD 1.0),” Audio Video Coding Standard Group of China (AVS), Doc. AVS-N1538, Sep. 2008. [24] Lu Yu et al, “Overview of AVS-video coding standards”, special issue on “Special issue on AVS and its applications” J. Visual Communication and Image Representation, Volume 24, Issue 4, April 2009, Pages 247-262Volume 24, Issue 4