Video streaming with SP and SI frames Chuan-Yu Cho In proceeding of VCIP 2005 Eric Setton and Bernd Girod, Information Systems Laboratory, Stanford University, Stanford, CA

2 Outline Introduction to SP/SI Frames SP and SI Frames Encoding Generating SP and SI Frames for Streaming Performance Analysis

3 Introduction to SP/SI Frames P P P SP 1 P P Quality 1 SP 12 (Stored bitstream) P P P SP 2 P P Quality 2 P P P SP 12 P P (Transmitted bitstream) SI (Stored bitstream) P P P SP P P P P P SI P P (Transmitted bitstream) Lost frame

4 SP and SI Frames Encoding SP frame encoder SI and switching SP frame encoder M. Karczewicz and R. Kurceren, “The SP- and SI-frames design for H.264/AVC,” IEEE Trans. on Circuits and Systems for Video Technology, pp. 637–644, July 2003.

5 Generating SP and SI Frames for Streaming GOP structures used for streaming with SP and SI frames and for periodic I frame insertion. Optimal settings for QPSP and QPSP2, for different probabilities of transmitting an SI frame.

6 Rate-distortion performance for different frame types

7 Rate-distortion performance with periodic I frame, SP frame or SI frame insertion Mother & Daughter Foreman

8 Congestion-Rate-Distortion Performance for Varying Loss Rates - Mother & Daughter

9 Congestion-Rate-Distortion Performance for Varying Loss Rates - Foreman

10 Congestion-Rate-Distortion Performance for Varying Propagation Delays - Mother & Daughter

11 Congestion-Rate-Distortion Performance for Varying Propagation Delays - Foreman

12 Conclusions The use of SP and SI frames is beneficial for scenarios where feedback is available from the receiver and the propagation delay is low enough to allow for ACK-based retransmissions.