1. Comparison and Performance Analysis of H.264, AVS-China, VC-1 and Dirac - by Jennie G. Abraham EE5359 – Multimedia Processing, Fall 2009 EE Dept., University of Texas at Arlington

2. Disclaimer This is a proposal; to be used as a roadmap toward fulfilling the objectives of the project as part of course requirement for EE5359 – Multimedia Processing, Fall 2009 This powerpoint is not a comprehensive documentation on the subjects and topics mentioned. - Jennie G Abraham

3. Outline  Introduction  Multimedia Network  Home Media Ecosystem  Motivation  Project Detail  Example project elements  Architecture Comparison  Design Level Analysis  Feature Comparison  Algorithmic Comparison  Performance Comparison  Expected Outcomes  Project Timeline  References

4. Introduction What? - Video compression standards  aiming at high quality - Some standards leave the implementation open and only standardize the syntax and the decoder. Optimization beyond the obvious Complexity reduction for implementation Who? - H.264 : ITU-T VCEG together with the ISO/IEC MPEG - AVS China : Audio Video Coding Workgroup of China - VC-1 : developed by Microsoft, released by SMPTE - Dirac : BBC Why? - Different companies, different countries, different application, royalty fees, better algorithms

5. Multimedia Network

6. Home Media Ecosystem A case for seamless integration of video coding standards

7. Motivation Possibly identify new areas of research Exploit redundancies, develop cross platform applications etc. Familiarize with the codecs : H.264, AVS China, VC-1, Dirac Availability of the codecs in MPL @ UTA Lack of comprehensive documentation for these codecs

8. Project Detail Overview of each standard Implementation of each codec Compile and tabulate the developers, timeline of release, royalty/patents Architecture Analysis and Comparison Encoder/Decoder Block Diagram Design Level Analysis and Comparison Profiles levels intended applications for each of the profile/standard Feauture Analysis and Comparison Integer sizes MB sizes Partition sizes Modes Format Algorithmic Element comparison Prediction Motion Vector Precision Transform In Loop filters Entropy coding.. And so on Performance Comparison Bit rate PSNR MSE Compression Complexity ssim Test Sequences Different test sequences Different formats - QCIF/CIF/SD/HDTV Documentation The study and results Codec user manual The project is detailed as follows:

9. Codec Architecture Comparison H.264 CodecAVS China Codec For Example :

10. Design Level Analysis Example of specific coding parts for H.264 profiles

11. Feature Comparison VC-1H.264 8x8, 4x8, 8x4, 4x4 adaptive block transform 8x8, 4x8, 8x4, 4x4 adaptive block transform Frequency-independent de- quantization scalingFrequency-independent de- quantization scaling 4 tap bi-cubic filters for MC4 tap bi-cubic filters for MC Relatively-simple loop filterRelatively-simple loop filter Overlap intra filteringOverlap intra filtering Range reduction/expansionRange reduction/expansion Resolution reduction/expansionResolution reduction/expansion 8x8 and 4x4 adaptive block transform 8x8 and 4x4 adaptive block transform Frequency-dependent de-quantization matrixFrequency-dependent de-quantization matrix Long filters for MCLong filters for MC Complex loop filterComplex loop filter Spatial intra predictionSpatial intra prediction Multi-picture arbitrary-order referencingMulti-picture arbitrary-order referencing Intra PCMIntra PCM Block motion 16-bit integer transforms Bit-exact spec Fading prediction Loop filter For example: Overlap in feature sets is a major reason why many companies are currently integrating both codecs into the same chip.

12. Algorithmic Comparison Example : …. and more of similar comparison Algorithmic Element H.264 (MPEG-4 AVC) SMPTE VC-1 (WMV 9) AVS China Part 2 Dirac Entropy coding CAVLC, CABAC Adaptive VLC 2D variable length coding. Arithmetic coding Transform integer DCT, Hadamard integer DCTDCT Wavelet transform

13. Performance Comparison Simulation with different test sequences Bit Rate Quality PSNR MSE SSIM Compression Ratio Complexity Encoding Time Decoding

14. Expected Outcome The different facet of the project is aimed at bringing out these outcomes…. Familiarity with these standards Simulation of the codecs Modes of Configuration Modification of Parameters Input sequence specifications Analyze the codec output Identify areas of research and unexplored problems Document a resourceful detailed ‘how to’ manual on each reference codec Create a ‘how to’ format to draw on for other softwares available in MPL and future Efficient use of time and re-use of knowledge

15. Timeline IMPLEMENTATION: Project proposal –------------------------------------------------- Oct 1 AVS China Implementation-----------------by Oct 7 Dirac, H.264 –---------------------------------- by Oct 14 VC-1 Implementation ---------------------- by Oct 21 DOCUMENTATION: Tabulation of initial results –------------------------------------ by Oct 28 Interim Report and Presentation ------------------------ Oct 29 Start documentation ---------------------------------- by Oct 31 Submit draft of final report -------------------- Nov 19 Start user manual documentation---- Nov 20 FINAL Final project report and presentation ------------------------- Dec 3

16. References DIRAC REFERENCES: [1] T. Borer, and T. Davies, “Dirac video compression using open technology”, BBC EBU Technical Review, July 2005 [2] BBC Research on Dirac: http://www.bbc.co.uk/rd/projects/dirac/index.shtmlhttp://www.bbc.co.uk/rd/projects/dirac/index.shtml [3] The Dirac web page: http://dirac.sourceforge.nethttp://dirac.sourceforge.net [4] T. Davies, “The Dirac Algorithm”: http://dirac.sourceforge.net/documentation/algorithm/, 2005.http://dirac.sourceforge.net/documentation/algorithm/ [5] Dirac developer support: Overlapped block-based motion compensation: http://dirac.sourceforge.net/documentation/algorithm/algorithm/toc.htm [6] “Dirac Pro to bolster BBC HD links”: http://www.broadcastnow.co.uk/news/multi-platform/news/dirac-pro-to-bolster- bbc-hd-links/1732462.articlehttp://www.broadcastnow.co.uk/news/multi-platform/news/dirac-pro-to-bolster- bbc-hd-links/1732462.article [7] Dirac software and source code: http://diracvideo.org/download/dirac-research/http://diracvideo.org/download/dirac-research/ [8] Dirac video codec - A programmer's guide: http://dirac.sourceforge.net/documentation/code/programmers_guide/toc.htm [9] Daubechies wavelet: http://en.wikipedia.org/wiki/Daubechies_wavelethttp://en.wikipedia.org/wiki/Daubechies_wavelet [10] Daubechies wavelet filter design: http://cnx.org/content/m11159/latest/http://cnx.org/content/m11159/latest/ [11] Dirac developer support: Wavelet transform: http://dirac.sourceforge.net/documentation/algorithm/algorithm/wlt_transform.xht http://dirac.sourceforge.net/documentation/algorithm/algorithm/wlt_transform.xht [12] Dirac developer support: RDO motion estimation metric: http://dirac.sourceforge.net/documentation/algorithm/algorithm/rdo_mot_est.xht

17. H.264 REFERENCES: [13] T.Wiegand, et al “Overview of the H.264/AVC video coding standard”, IEEE Trans. on Circuit and Systems for Video Technology, Vol.13, pp 560-576, July 2003. [14] T. Wiegand and G. J. Sullivan, “The H.264 video coding standard”, IEEE Signal Processing Magazine, vol. 24, pp. 148-153, March 2007. [15] D. Marpe, T. Wiegand and G. J. Sullivan, “The H.264/MPEG-4 AVC standard and its applications”, IEEE Communications Magazine, vol. 44, pp. 134-143, Aug. 2006. [16] S.K.Kwon, A.Tamhankar and K.R.Rao, “Overview of H.264 / MPEG-4 Part 10” J. Visual Communication and Image Representation, Vol 17, pp.186-216, April 2006. [17] A. Puri, X. Chen and A. Luthra, “Video coding using the H.264/MPEG-4 AVC compression standard”, Signal Processing: Image Communication, vol. 19, pp. 793-849, Oct. 2004 [18] H.264 AVC JM software: http://iphome.hhi.de/suehring/tml/http://iphome.hhi.de/suehring/tml/ [19] H.264/MPEG-4 AVC: http://en.wikipedia.org/wiki/H.264http://en.wikipedia.org/wiki/H.264 [20] M.Fieldler, “Implementation of basic H.264/AVC Decoder”, seminar paper at Chemnitz University of Technology, June 2004 [21] H.264 encoder and decoder: http://www.adalta.it/Pages/407/266881_266881.jpghttp://www.adalta.it/Pages/407/266881_266881.jpg [22] R. Schäfer, T. Wiegand and H. Schwarz, “The emerging H.264/AVC standard”, EBU Technical Review, Jan. 2003. [23] H.264 reference software download : http://iphome.hhi.de/suehring/tml/http://iphome.hhi.de/suehring/tml/ [24] D. Marpe, T. Wiegand, and S. Gordon, "H.264/mpeg4-avc fidelity range extensions: tools, profiles, performance, and application areas," in, IEEE International Conference on Image Processing, vol. 1, pp. I- 593-6, 2005. [25] S. Saponara, C. Blanch, K. Denolf, and J. Bormans, "The JVT advanced video coding standard: complexity and performance analysis on a tool-by-tool basis," in Packet Video Workshop, Nantes, France, April 2003.

18. VC-1 REFERENCES: [26] VC-1 technical overview - http://www.microsoft.com/windows/windowsmedia/howto/articles/vc1techoverview.aspx http://www.microsoft.com/windows/windowsmedia/howto/articles/vc1techoverview.aspx [27] Microsoft Windows Media: http://www.microsoft.com/windows/windowsmediahttp://www.microsoft.com/windows/windowsmedia [28] http://en.wikipedia.org/wiki/VC-1http://en.wikipedia.org/wiki/VC-1 [29] Sridhar Srinivasan, et al, “Windows Media Video 9: overview and applications”, Signal Processing: Image Communication, Volume 19, Issue 9, October 2004, Pages 851-875 AVS CHINA REFERENCES: [31] AVS Video Expert Group, “Information technology – Advanced coding of audio and video – Part 2: Video (AVS1-P2 JQP FCD 1.0),” Audio Video Coding Standard Group of China (AVS), Doc. AVS-N1538, Sep. 2008. [32] AVS Video Expert Group, “Information technology – Advanced coding of audio and video – Part 3: Audio,” Audio Video Coding Standard Group of China (AVS), Doc. AVS-N1551, Sep. 2008. [33] Lu Yu et al., “Overview of AVS-Video: Tools, performance and complexity,” SPIE VCIP, vol. 5960, pp. 596021-1~ 596021-12, Beijing, China, July 2005. [34] Liang Fan, Siwei Ma and Feng Wu, “Overview of AVS video standard,” IEEE Int’l Conf. on Multimedia and Expo, ICME '04, vol. 1, pp. 423–426, Taipei, Taiwan, June 2004. [35] Wen Gao et al., “AVS – The Chinese next-generation video coding standard,” National Association of Broadcasters, Las Vegas, 2004. [36] Special issue on 'AVS and its Applications' Signal Processing: Image Communication, vol. 24,pp. 245-344, April 2009. [37] AVS China software : ftp://159.226.42.57/public/avs_doc/avs_softwareftp://159.226.42.57/public/avs_doc/avs_software

19. PERFORMANCE COMPARISON REFERENCES: [38] K. Onthriar, K. K. Loo and Z. Xue, “Performance comparison of emerging Dirac video codec with H.264/AVC”, IEEE International Conference on Digital Telecommunications, Vol. 06, Page: 22, Issue: 29-31, Aug. 2006. [39] X. Wang, D. Zhao "Performance comparison of AVS and H.264/AVC video coding standards" J. of computer science and technology, May 2006, Vol. 21, No. 3, pp. 310-314 [40] Comparison of H.264 and VC-1:http://en.wikipedia.org/wiki/Comparison_of_H.264_and_VC-1http://en.wikipedia.org/wiki/Comparison_of_H.264_and_VC-1 [41] Alejandro A. Ramirez Acosta, et al. "MPEG-4 AVC/H.264 and VC-1 codecs comparison used in IPTV video streaming technology," Electronics, Robotics and Automotive Mechanics Conference, 2008, pp.122-126 [42] Comparison between AVC/H.264, VC-1 and MPEG-2 - http://www.ebu.ch/en/technical/trev/trev_302-sunna.pdfhttp://www.ebu.ch/en/technical/trev/trev_302-sunna.pdf [43] H. Kalva, J.B Lee, “The VC-1 and H.264 video compression standards for broadband video Services”, Springer, 2008 SSIM REFERENCES: [44] Z. Wang, et al “Image quality assessment: From error visibility to structural similarity”, IEEE Trans. on Image Processing, vol. 13, pp. 600-612, Apr. 2004. [45] SSIM index for image quality assessment: http://www.ece.uwaterloo.ca/~z70wang/research/ssim/http://www.ece.uwaterloo.ca/~z70wang/research/ssim/ [46] Z. Wang, et al“Multi-scale structural similarity for image quality assessment,” IEEE Asilomar Conference on Signals, Systems and Computers, Nov. 2003.Multi-scale structural similarity for image quality assessment [47] SSIM: http://en.wikipedia.org/wiki/SSIMhttp://en.wikipedia.org/wiki/SSIM VIDEO TEST SEQUENCES: [48] Video test sequences (YUV 4:2:0): http://trace.eas.asu.edu/yuv/index.htmlhttp://trace.eas.asu.edu/yuv/index.html [49] Video test sequences ITU601: http://www.cipr.rpi.edu/resource/sequences/itu601.html http://www.cipr.rpi.edu/resource/sequences/itu601.html