1. The MPEG-4 Fine-Grained Scalable Video Coding Method for Multimedia Streaming Over IP Hayder Radha,Mihaela van der Schaar and Yingwei Chen IEEE TRANSACTIONS ON MULTIMEDIA, VOL.3, NO.1,MARCH 2001

2. Outline Introduction SNR FGS Video Coding Method FGS Coding with Adaptive Quantization Hybrid Temporal-SNR Scalability with an All FGS Structure Conclusions

3. Introduction Video-Coding and Networking Minimal real-time processing and rate control when large number of unicast Highly adaptable to unpredictable bandwidth Low-complexity decoding and low- memory requirements

4. Introduction(2) Able to support both multicast and unicast applications Scalable bitstream must be resilient to packet loss events

5. SNR FGS Video Coding [ R min = R b, R max = R b + R e ]

6. SNR FGS Video Coding(2)

7. SNR FGS Video Coding - encoder Two encoders base layer->motion compensation enhancement layer->fine-granular Each DCT FGS-residual frame consists of N BP bitplanes

8. SNR FGS Video Coding - scanning order

10. Architecture for the SNR FGS Video Coding -decoder

11. SNR FGS Video Coding - performance Compared with traditional SNR scalability video coding

12. SNR FGS Video Coding - performance(2)

13. SNR FGS Video Coding - performance(3)

14. SNR FGS Video Coding - conclusions FGS exploits temporal redundancy only at the base layer FGS is good for high motion sequences such as “movie trailers”,certain commercials and news clips with high-action content

15. SNR FGS Video Coding - conclusions Base-layer could have a major impact on the overall performance of FGS [R 2,R max ] could be significantly better than the average performance over the wider range[R 1,R max ]

16. FGS Coding with Adaptive Quantization FGS-based AQ is achieved through bitplane shifting Selected macroblocks within an FGS enhancement layer frame Selected coefficients within the 8 * 8 blocks

17. Adaptive Quantization- Selective Enhancement

18. Adaptive Quantization- frequency weighting

19. Adaptive Quantization- combine SE with FW

20. Adaptive Quantization-notice SE : macroblock-by-macroblock basis FW : use the same FW matrix Selective enhancement is a relative operation Up-shifting operation does not guarantee that a particular SE macroblock gets scanned earlier(MSB)

21. Adaptive Quantization- evaluation Not improve the rate-distortion performance,but rather to improve the visual quality SE can be used to enhance a particular region FW can reduce some of blockiness, but may softening some of the sharp edges and other finedetails

22. Adaptive Quantization- evaluation(2)

23. Hybrid Temporal-SNR Scalability Temporal scalability : Enhance the motion smoothness of compressed video F = F BL + F EL Provide the flexibility of choosing between temporal scalability and SNR scalability (Users’ performance and real-time bandwidth)

24. all-FGS hybrid temporal-SNR scalability structure

25. Architecture for the all-FGS hybrid temporal-SNR scalability encoder

26. Architecture for the all-FGS hybrid temporal-SNR scalability decoder

27. Performance Evaluation of the Hybrid FGS Scalability Method

29. Conclusions MPEG-4 FGS framework Supporting unicast and multicast Internet video application Adaptive quantization Hybrid temporal-SNR scalability method