1. By: Santosh Kumar Muniyappa (1000661813) Guided by: Dr. K. R. Rao Final Report Multimedia Processing (EE 5359)

2. Many H.264 softwares like JM[6](Joint Model), Intel IPP[8](Integrated Performance Primitives), X264[5], FFMpeg [9](Fast Forward Moving Picture Experts Group). The goal of this project is to carry out a performance analysis of the H.264 softwares like JM software, Intel IPP and X264. JM software used here is version 17.2

3. Video coding standard jointly developed by ITU-T Video Coding Experts Group (VCEG) and the ISO/IEC Moving Picture Experts Group (MPEG). Most widely accepted video standard Blu-ray discs, videos from YouTube and iTunes store, Adobe Flash Player, Microsoft silverlight, Outperforms all existing standards by a factor of two

7. Supports both planar and interleaved/packed raw image data (viz., yuv, rgb) Input configuration file (*.cfg) Input file Number of frames to be encoded Frame rate Output frame width and Height Profile, level selection GOP size Bit rate control

8. Supports raw video data (yuv4mpeg or y4m only 4:2:0) Output file format.264,.mkv, mp4 Have to provide the inputs through the command prompt Profile Rate control GOP size Quantization parameter Frame rate on an average, x264 performs 50x faster when compared to JM [7]

9. The encoder assumes that input videodata object contains frame in YUV420 format Encoder does not support frame resizing. Thus input and output frame sizes should be the same. Supports only main and high profiles. Input file is h264.par Source file Number of frames to encode Frame rate

10. A detailed analysis on different profiles and bit rates using QCIF and HDTV video test sequences will be done Performance Comparison: Encoding and decoding times (seconds) Compression ratio Peak to peak signal to noise ratio Structural similarity index metric [12]

11. Video Sequence akiyo_qcif.y4m 3713 KB QCIF format –176 x 144 YUV –4:2:0 Number of frames encoded –100 Profile –baseline, main Quantization parameter–10,28,40,51 Number of reference frames -3

12. akiyo_qcif.y4msintel_720p.y4m

14. Reference Frames

15. Quantization Parameter Structural Similarity Index Metric Peak to Peak Signal to Noise Ratio in dB Total Encoding Times(s) Bit rates(kbps) Compression Ratio 100.996951.086525.4991237.167.367063 280.97138.234248.934229.539.5 400.86129.906183.08871.38123.7667 510.581422.532145.10325.35337.5455

16. Quantization Parameter Structural Similarity Index Metric Peak to Peak Signal to Noise Ratio in dB Total Encoding Times(s) Bit rates(kbps) Compression Ratio 100.997551.83238.4281292.517.058935 280.972238.43135.715204.1444.20238 400.860929.83634.03066.05137.5185 510.390912.7933.08212.76618.8333

17. Video Sequence sintel_720p_100.y4m HDTV 1280×720 Number of frames encoded –100 GOP – IPBPBPBPBPB Quantization parameter–10,28,40,51 Number of reference frames -3

18. Quantization Parameter Structural Similarity Index Metric Peak to Peak Signal to Noise Ratio in dB Total Encoding Times(s)Bit rates(kbps) Compression Ratio 100.998963.1151438.40114044.4423.85827 280.979647.4241394.8492001.91167.3006 400.869237.8341307.674476.25702.8351 510.535410.7161059.323109.253030

24. Video Sequence akiyo_qcif.y4m 3713 KB QCIF format –176 x 144 YUV –4:2:0 Number of frames encoded –100 Profile –baseline, main Quantization parameter–10,28,40,51 Number of reference frames -3

25. Quantization Parameter Structural Similarity Index Metric Peak to Peak Signal to Noise Ratio in dB Total Encoding Times(s) Bit rates(kbps) Compression Ratio 100.99742651.8950.813426.2821.33908 280.97770839.1740.39636.16247.5333 400.904631.6170.3929.78928.25 510.73702325.9140.2715.351237.667

26. Quantization Parameter Structural Similarity Index Metric Peak to Peak Signal to Noise Ratio in dB Total Encoding Times(s) Bit rates(kbps) Compression Ratio 100.99737151.5870.7949288.1531.4661 280.97745639.3020.502930.29285.6154 400.90405531.8140.488911.28742.6 510.72498625.9590.3276.41237.667

27. Video Sequence sintel_720p_100.y4m HDTV 1280×720 Number of frames encoded –100 GOP – IPBPBPBPBPB Quantization parameter–10,28,40,51 Number of reference frames -3

28. Quantization Parameter Structural Similarity Index Metric Peak to Peak Signal to Noise Ratio in dB Total Encoding Times(s) Bit rates(kbps) Compression Ratio 100.99828663.17517.857142865465.5961.30845 280.9933155.4367.849293564510.28655.5288 400.98201842.1284.830917874144.312311.017 510.95980335.1884.63606861450.816492.857

34. Video Sequence akiyo_qcif.y4m 3713 KB QCIF format –176 x 144 YUV –4:2:0 Number of frames encoded –100 Profile –baseline, main Bit Rates(kbps) – 1000, 100, 50, 10 Number of reference frames -3

35. Bit rates(kbps) Structural Similarity Index Metric Peak to Peak Signal to Noise Ratio in dB Total Encoding Times(s) Compression Ratio 10000.996349.86340.668.47 1000.97941.28450.4568.57 500.939235.83970.38137.44 100.655324.61130.35154.37

36. Bit rates(kbps) Structural Similarity Index Metric Peak to Peak Signal to Noise Ratio in dB Total Encoding Times(s) Compression Ratio 10000.996249.16080.699.4 1000.98341.10570.4477.68 500.949235.35620.4138.97 100.65524.61130.39159.6

37. Video Sequence sintel_720p_100.y4m HDTV 1280×720 Number of frames encoded –100 GOP – IPBPBPBPBPB Bit Rates(kbps) – 1000, 100, 50, 10 Number of reference frames -3

38. Bit rates(kbps) Structural Similarity Index Metric Peak to Peak Signal to Noise Ratio in dB Total Encoding Times(s) Compression Ratio 10000.99828661.75511.71366.75 1000.9833155.87014.763317.02 500.94201842.1284.25153.59 100.89980335.1884.175856.63

43. JMX264Intel IPP Bit Rates (kbps) SSIMBit Rates (kbps) SSIMBit Rates (kbps) SSIM 1237.160.9969642.010.99742610000.9963 229.50.97199.080.9777081000.979 71.380.86134.30.9046500.9392 25.350.581415.550.737023100.6553

45. JMX264Intel IPP Bit Rates (kbps) SSIMBit Rates (kbps) SSIMBit Rates (kbps) SSIM 1292.510.9975558.280.99758810000.9962 204.140.972293.30.9798481000.983 66.050.860933.380.909762500.9492 12.760.390914.970.731834100.655

47. JMX264Intel IPP Bit Rates (kbps) SSIMBit Rates (kbps) SSIMBit Rates (kbps) SSIM 14044.440.99895465.590.99828610000.998286 2001.910.9796510.280.993311000.98331 476.250.8692144.310.982018500.942018 109.250.535450.810.959803100.899803

49. JMX264Intel IPP Bit Rates (kbps) PSNR (dB) Bit Rates (kbps) PSNR (dB) Bit Rates (kbps) PSNR (dB) 1237.1651.086642.0152.216100049.8634 229.538.23499.0840.08210041.2845 71.3829.90634.332.1735035.8397 25.3522.53215.5526.251024.6113

51. JMX264Intel IPP Bit Rates (kbps) PSNR (dB) Bit Rates (kbps) PSNR (dB) Bit Rates (kbps) PSNR (dB) 1292.5151.832558.2852.162100049.1608 204.1438.43193.340.11510041.1057 66.0529.83633.3832.2225035.3562 12.7612.7914.9726.1711024.6113

53. JMX264Intel IPP Bit Rates (kbps) PSNR (dB) Bit Rates (kbps) PSNR (dB) Bit Rates (kbps) PSNR (dB) 14044.4463.1155465.5963.175100061.755 2001.9147.424510.2855.43610055.8701 476.2537.834144.3142.1285042.128 109.2510.71650.8135.1881035.188

55. JMX264Intel IPP Bit Rates (kbps) Encoding Time (s) Bit Rates (kbps) Encoding Time (s) Bit Rates (kbps) Encoding Time (s) 1237.16525.499642.010.56401610000.66 229.5248.93499.080.3259981000.45 71.38183.08834.30.197707500.38 25.35145.10315.550.163999100.35

57. JMX264Intel IPP Bit Rates (kbps) Encoding Time (s) Bit Rates (kbps) Encoding Time (s) Bit Rates (kbps) Encoding Time (s) 1292.5138.428558.280.84302810000.69 204.1435.71593.30.3969991000.44 66.0534.0333.380.325998500.4 12.7633.08214.970.281001100.39

59. JMX264Intel IPP Bit Rates (kbps) Encoding Time (s) Bit Rates (kbps) Encoding Time (s) Bit Rates (kbps) Encoding Time (s) 14044.441438.4015465.5917.85714100011.71 2001.911394.849510.287.8492941004.76 476.251307.674144.314.830918504.2 109.251059.32350.814.636069104.17

61. JMX264Intel IPP Bit Rates (kbps) Compression Ratio Bit Rates (kbps) Compression Ratio Bit Rates (kbps) Compression Ratio 1237.167.367063642.0114.1717610008.47 229.539.599.0890.5609810068.57 71.38123.766734.3265.214350137.44 25.35337.545515.55530.428610154.37

63. JMX264Intel IPP Bit Rates (kbps) Compression Ratio Bit Rates (kbps) Compression Ratio Bit Rates (kbps) Compression Ratio 1292.517.058935558.2816.2850910009.4 204.1444.2023893.397.7105310077.68 66.05137.518533.38265.214350138.97 12.76618.833314.97530.428610159.6

65. JMX264Intel IPP Bit Rates (kbps) Compression Ratio Bit Rates (kbps) Compression Ratio Bit Rates (kbps) Compression Ratio 14044.4423.858275465.5961.308451000366.75 2001.91167.3006510.28655.52881003317.02 476.25702.8351144.312311.017505153.59 109.25303050.816492.857105856.63

67. ProfilesBaselineMainHigh SSIMBoth X264 and Intel IPP offer better results than JM PSNRBoth X264 and Intel IPP outperform JM. X264 performs slightly better than Intel IPP. Both X264 and Intel IPP outperform JM. Intel IPP performs slightly better than X264 Encoding Time Both X264 and Intel IPP outperform JM. X264 performs slightly better than Intel IPP. Both X264 and Intel IPP outperform JM. Compression Ratio Both X264 and Intel IPP outperform JM. X264 performs slightly better than Intel IPP. Both X264 and Intel IPP outperform JM. Intel IPP performs slightly better than X264

68. Perform the analysis on different video sequences. Perform the analysis on different video formats viz., 4:2:2, 4:4:4 Perform the analysis on different video resolutions viz., 352x288, 480p, 1080p.

69. 1. I. E. Richardson, “The H.264 advance video compression standard”, 2 nd Edition, Wiley, 2010. 2. T. Wiegand, et al “Overview of the H.264/AVC video coding standard”, IEEE Trans. on circuits and systems for video technology, vol. 13, pp. 560-576, July 2003. 3. D. Marpe, T. Wiegand and G. J. Sullivan, “The H.264/MPEG-4 AVC standard and its applications”, IEEE Communications Magazine, vol. 44, pp. 134-143, Aug. 2006. 4. G. Sullivan, et al “The H.264/AVC Advanced Video Coding Standard: Overview and Introduction to the Fidelity Range Extensions”. Proceedings of SPIE - The International Society for Optical Engineering, vol. 5558, pp. 454-474, Applications of Digital Image Processing XXVII, 2004.

70. 5.GIT repository of X264 - http://git.videolan.org/?p=x264.git;a=summary http://git.videolan.org/?p=x264.git;a=summary 6. JM software – http://iphome.hhi.de/suehring/tml/ 7. L. Merritt et al., “X264: A High Performance H.264/AVC Encoder”. 8. Intel IPP - http://software.intel.com/en- us/articles/intel-integrated-performance-primitives- code-samples/http://software.intel.com/en- us/articles/intel-integrated-performance-primitives- code-samples/ 9. FFmpeg software - http://www.ffmpeg.org/http://www.ffmpeg.org/ 10. Intel IPP Overview - http://software.intel.com/en- us/intel-ipp/http://software.intel.com/en- us/intel-ipp/

71. 11. K. V. S. Swaroop, and K. R Rao, “Performance Analysis and Comparison of JM 15.1 and Intel IPP H.264 Encoder and Decoder”, IEEE 2010 42nd Southeastern Symposium on System Theory (SSST), pp. 371-375, 2010. 12. Z. Wang, A. C. Bovik, H. R. Sheikh and E. P. Simoncelli, "Image quality assessment: From error visibility to structural similarity," IEEE Trans. on Image Processing, vol. 13, no. 4, pp. 600-612, Apr. 2004. Z. WangA. C. BovikH. R. SheikhE. P. SimoncelliImage quality assessment: From error visibility to structural similarity 13. P. N. Tudor, “MPEG-2 video compression”, Electronics \& communication engineering journal, vol. 7, pp. 257-264, 2005. 14. S.Kwon, A. Tamhankar and K.R. Rao, “Overview of H.264 / MPEG-4 Part 10”, J. Visual Communication and Image Representation, vol. 17, pp.186-216, April 2006.

72. Thank you