2. MPEG-1 and MPEG-2 Digital Video Coding Standards Author: Thomas Sikora Presenter: Chaojun Liang

3. Overview Introduction Intra-picture Coding Techniques Inter-picture Coding Techniques

4. What is MPEG? Stands for Moving Picture Expert Group Nickname to a family of International standards used for coding audio-visual information in a digital compressed format. Includes MPEG-1, MPEG-2, and upcoming MPEG-4.

5. MPEG-1 Finalized in 1991 Optimized to work at 352*240, 30 f/s or 352*288, 25f/s Bit-rate is optimized for application of around 1.5 Mb/sec Defined for progressive frames only

6. MPEG-2 Finalized in 1994 Digital television broadcasting Target bit-rate raised to 4-9Mb/sec Main Profile, Main Level –720*480 pixels, 30 frame/sec, 15Mb/sec Main Profile, High Level (HDTV) –1920*1280 pixels, 30 frame/sec, 80Mb/sec

7. MPEG Video Layers

8. Intra Frame Coding Techniques Video Filter DCT Quantizer Run-length Encoding Bitstream Buffer Bit-Rate Control

9. Video Filter Subjective Redundancy –Eyes more sensitive to changes in Luminance, less to variations in Chrominance R G B -> Y Cb Cr Sample Chrominance 2:1 in both directions

10. R G BY Cb Cr Color Space Transform Sample Video Filter

11. Statistical Redundancy

12. Discrete Cosine Transform Closely related to Discrete Fourier Transform Performed on 8*8 block Forward DCT Inverse DCT

13. DCT Basis Patterns

14. Increasing Vertical Frequency (Down) Increase Horizontal Frequency (Right)

15. Variance Distribution of DCT Coefficients

16. DCT Coefficient Quantization Higher frequency -> Larger step size -> more coarsely quantized Force as many of the DCT-Coefficients as possible to zero or near zero

17. Example Coefficients

18. Run-Length Encoding Run-Amplitude PairsBit Stream Variable Length Code Table

19. Inter Frame Coding Techniques Exploit temporal redundancy Use Motion Estimation to eliminate temporal redundancy

20. Picture Types Intra Pictures (I-Pictures) Predicted Pictures (P-Pictures) Bi-directional Pictures (B-Pictures)

21. Intra Pictures Coded with only info in the picture itself Random access points into the compressed data Moderate compress: about 2 bits per coded pixel

22. Predicted Pictures Coded with respect to the nearest previous I-Picture or P-Picture

23. Bi-directional Pictures Use both a past and future picture as a reference.

24. Video Stream Composition Encoder chose frequency and location of I- Pictures Typical display order

25. Video Stream vs Display order

26. Motion Estimation Tree moved down to the right People moved farther to the right than tree Frame 1Frame 2

27. Motion Estimation To adequately represent the change, or the difference, between 2 video frames Frame-wise direct minus not effective Macroblock-wise minus 2-D spatial search for each luminance macroblock

28. Macroblock Matching Frame 1Frame 2

29. Picture 1 Predicted Picture Picture 2 Residual Error Picture

30. Coding of Residual Errors Similar to Intra frame coding Different quantization matrix Motion vectors are also coded