1. File Format for Scalable Video Coding Outline
SVC Introduction
Review of File Format Basics
SVC File Format
Examples of Use
CMPT 820 – 2008 Summer Presented by Jeff Jiang

2. File Format for Scalable Video Coding SVC Introduction
SVC Scalabilities and the Cube Model
Bit-Stream Representation
Usage and Application Scenarios
SVC High-Level Syntax
CMPT 820 – 2008 Summer Presented by Jeff Jiang

3. SVC Scalabilities and the Cube Model
File Format for Scalable Video Coding SVC Introduction – Scalability & Data Model
SVC Scalabilities and the Cube Model
Temporal, Spatial, and SNR (Fidelity/Quality) scalability
Cube data model
SVC Syntax Elements – PDTQ
Priority-id
Dependency_id
Temporal_id
Quality_id
CMPT 820 – 2008 Summer Presented by Jeff Jiang

4. Flexible Combined Scalability
File Format for Scalable Video Coding SVC Introduction – Bit-Stream Representation
Flexible Combined Scalability
Layered Scalability
CMPT 820 – 2008 Summer Presented by Jeff Jiang

5. Erosion Storage - Surveillance
File Format for Scalable Video Coding SVC Introduction – Usage and Application
Direct File Access
Adaptation Operation
Erosion Storage - Surveillance
CMPT 820 – 2008 Summer Presented by Jeff Jiang

6. File Format for Scalable Video Coding SVC Introduction – SVC High-Level Syntax
CMPT 820 – 2008 Summer Presented by Jeff Jiang

7. File Format for Scalable Video Coding Outline
SVC Introduction
Review of File Format Basics
SVC File Format
Examples of Use
CMPT 820 – 2008 Summer Presented by Jeff Jiang

8. File Format for Scalable Video Coding File Format Review – ISO Base Media File Format
The file structure is object-oriented and can be decomposed into its constituent objects easily
The files have
Logical structure – a set of time parallel tracks, “movie”
Time structure – sequence samples in time
Physical structure – separate logical and time structure data from media data themselves
CMPT 820 – 2008 Summer Presented by Jeff Jiang

9. File Format for Scalable Video Coding File Format Review – ISO Base Media File Format
Tracks alternative to each other – using the same nonzero alternate group number
Special samples:
Synchronization point ( I-frame)
Track sample dependency
Sample groups – used in SVC file format
File type box
The specifications to which the file complies
Permission for a reader
CMPT 820 – 2008 Summer Presented by Jeff Jiang

10. File Format for Scalable Video Coding File Format Review – ISO Base Media File Format
CMPT 820 – 2008 Summer Presented by Jeff Jiang

11. File Format for Scalable Video Coding File Format Review – AVC File Format
A sequence of access unit, each divided into a number of NAL units
CMPT 820 – 2008 Summer Presented by Jeff Jiang

12. File Format for Scalable Video Coding Outline
SVC Introduction
Review of File Format Basics
SVC File Format
Examples of Use
CMPT 820 – 2008 Summer Presented by Jeff Jiang

13. Extractor – Extract subsets that will be often extracted easily
File Format for Scalable Video Coding SVC File Format – Design Principles
Extractor – Extract subsets that will be often extracted easily
Grouped into tiers which contain one or more scalability layers (Sample groups)
Have time-parallel data (Time parallel metadata track)
CMPT 820 – 2008 Summer Presented by Jeff Jiang

14. File Format for Scalable Video Coding SVC File Format – Extractor Tracks
Allow “Cookbook” construction, take the forms of tracks within the alternate group
3 different ways to represent subset
CMPT 820 – 2008 Summer Presented by Jeff Jiang

15. File Format for Scalable Video Coding SVC File Format – Extractor Tracks ‘Continue
CMPT 820 – 2008 Summer Presented by Jeff Jiang

16. File Format for Scalable Video Coding SVC File Format – Sample Groups
Using sample groups
Structure of sample groups
A number of sets of description tables
A number of mapping tables
CMPT 820 – 2008 Summer Presented by Jeff Jiang

17. File Format for Scalable Video Coding SVC File Format – Metadata
Structured as a sequence of file format samples, just like a video track
Each metadata sample is structured as a metadata statement
Empty statement
Group of statements
Sequence of statements
CMPT 820 – 2008 Summer Presented by Jeff Jiang

18. File Format for Scalable Video Coding SVC File Format – Metadata ‘Continue
SEI NALu
Base-layer Slice NALu 1
aggregator NALu 2 containing {
enhancement NALu 2.1,
enhancement NALu 2.2 }
another enhancement NALu 3
some statement about the whole sample
sequenceOfStatements {
empty statement about SEI NALu
groupOfStatements: {
NALu header 1 statement;
some other statement about NALu 1 }
groupOfStatements {
aggregator statement
NALu header 2.1 statement;
NALu header 2.2 statement
another statement about NALu 2.2
some statement about NALu 3
CMPT 820 – 2008 Summer Presented by Jeff Jiang

19. File Format for Scalable Video Coding SVC File Format – AVC Compatibility
AVC compatibility can be divided into two major areas:
File Format Compatibility
Video coding compatibility
Sample-entry name used by SVC track
Avc1 – Define for AVC, use no data extraction, fully back-ward compatible
Avc2 – use data extraction
Svc1 – No AVC compatible
It is recommended to store AVC base layer in a separated AVC base track. SVC enhancement layer data reference the AVC base track
CMPT 820 – 2008 Summer Presented by Jeff Jiang

20. File Format for Scalable Video Coding Outline
SVC Introduction
Review of File Format Basics
SVC File Format
Examples of Use
CMPT 820 – 2008 Summer Presented by Jeff Jiang

21. File Format for Scalable Video Coding Example I – Simple Extractor Tracks
CMPT 820 – 2008 Summer Presented by Jeff Jiang

22. File Format for Scalable Video Coding Example II – Base Track
CMPT 820 – 2008 Summer Presented by Jeff Jiang

23. File Format for Scalable Video Coding Example III – Aggregator Uasge
Including NAL units in an aggregator
Referencing NAL units by an aggregator
CMPT 820 – 2008 Summer Presented by Jeff Jiang

24. File Format for Scalable Video Coding Example IV – Reading Map and Group Information
CMPT 820 – 2008 Summer Presented by Jeff Jiang

25. File Format for Scalable Video Coding Example IV – Reading Map and Group Information
CMPT 820 – 2008 Summer Presented by Jeff Jiang

26. File Format for Scalable Video Coding Example IV – Reading Map and Group Information
Tiers
Tier T0: H.264/AVC base layer (QCIF at 15 fps).
Tier T1: spatial enhancement of T0 to CIF.
Tier T2: temporal enhancement of T1 to 30 fps.
Tier T3: spatial enhancement of T2 to 4CIF (including the MGS enhancement).
Groups
Group G0 Tier T0, primary definition;
Group G1 Tier T0, tier IDR;
Group G2 Tier T1, primary definition;
Group G3 Tier T1, tier IDR;
Group G4 Tier T2, primary definition;
Group G5 Tier T3, primary definition;
Group G6 Tier T3, tier IDR.
CMPT 820 – 2008 Summer Presented by Jeff Jiang

27. File Format for Scalable Video Coding Example IV – Reading Map and Group Information
Maps
Map M0: G1, G3, G3, G6, G6, G5, G5 (as in sample 0);
Map M1: G0, G2, G5, G5 (as in samples 1 and 2);
Map M2: G4, G5, G5 (as in samples 3 and 4).
Samples
Sample 0: M0;
Sample 1: M1;
Sample 2: M1;
Sample 3: M2;
Sample 4: M2.
CMPT 820 – 2008 Summer Presented by Jeff Jiang

28. File Format for Scalable Video Coding Summary
The SVC File Format defines techniques to describe operation points and the resulting grouping of bit stream elements
It describes the bit stream structure and the dependencies exited between bit stream elements
Defines 3 types of scalability assisance
Precomputed scalability assistance
Scalability assistance through tiers (mainly assistance for layered scalability)
Scalability assistance with parallel metadata
CMPT 820 – 2008 Summer Presented by Jeff Jiang