1. Progress & schedule
Presenter : YY
Date : 2014/10/3

2. Outline Multi-resolution DVC goal & application Specification
Proposed architecture
Schedule

3. Multi-resolution DVC …… … Recap Application of multi-resolution DVC
What’s the purpose of conventional
scalable video codec ?
Application of multi-resolution DVC
Deal with high motion scenario by mobile sensors
The weakness of temporal predicted DVC architecture
Viewing from the point of coding efficiency
Assumption
Feedback channel between sensors and server* ……
key WZ
GOP = 4 …

4. Multi-resolution DVC specification
Goal
Even better RD performance than single layer DVC in high motion sequence
SHVC evaluation term EL & EL+BL
BL rate as key rate
EL rate as WZ rate
BL+EL rate compared with overall DVC RD performance
Low power consumption
Prerequisites
Integrate with Hybrid DVC
Coding Mode Selection (CMS) based on temporal residue
As little modification as possible compared with single layer DVC
Reduce HW cost of supporting both single layer & multi layer
Decoder side multi-loop SVC
Less memory, computing ability constraints*
RD performance is presentation of CC(precisely, CMS) is better for interlayer residue or a WZ compression

5. Hybrid DVC encoder …… - Frame setting key WZ + GOP = 4
Coding mode selection based on temporal residue (motion)
low
Skip
camera
DCT
Quantization
CMS
Entropy coding +
WZ bitstream -
Channel coding
Frame Buffer
high
Conventional intra coder
Key bitstream

6. Encoder proposal under considerationWZ
Temporal only residue ……
Frame setting ……
key
Spatial only residue
Skip
Spatial or temporal residue
camera
Coding
structure
selection
DCT
Quantization
CMS
Entropy coding +
WZ bitstream -
Channel coding
Early stage high motion detector
Power off frame buffer or make maximum use of it ?
spatial-residue-dependent mechanism that is similar to original CMS
Conventional intra coder
Key bitstream

7. Correlation noise modeling
Hybrid DVC decoder
Skip WZ
bitstream
Coding mode decode
Entropy coding
Reconstruction &
post processing
WZ frame
Channel coding -
Side Info. refinement
Soft input
computation +
Correlation noise modeling
Side Info. creation
Frame buffer
Key
bitstream
Intra decoder
Key frame

8. Decoder proposal under considerationWZ
bitstream
Skip
Reference frame buffer
Coding
structure
decode
Coding mode decode
Entropy coding
Reconstruction &
post processing +
WZ frame
Channel coding
Key frame buffer -
Side Info. refinement
Soft input
computation +
Correlation noise modeling　　
Side Info. creation
Use General Residual Prediction (GRP) for early stage experiments
Possibly use Generalized Gaussian Distribution (GGD)
Key
bitstream
Intra decoder
Key frame

9. Schedule Short term (~this semester)
SW multi-resolution DVC experiments
SI generation algorithm
GRP, DCT-IF
Offline decoding comparison of temporal setting & spatial setting (CC only)
CN modeling
Coding structure selection algorithm
CMS for spatial setting
Further improvement
ICIP 2015
Long term (~end of second year of master)
HW implementation of the proposed architecture
TCSVT
Long long term
Graduation ? I don’t know

10. Appendix
ELP
Architecture proposals

11. EL Prediction (ELP) survey and adaptation
SCE3 : Inter-layer Prediction in SHVC
ELP technique category
Inter-intra combined prediction
Adaptive predictor compensation (L0072)
Combined inter mode(L0206)
Residual prediction
General Residual Prediction (GRP) (L0078, L0190, L0038, L0100)
Generalized combined and residue prediction (L0074)
GRP with MC at BL resolution (L0104)
GRP with shorter-tap MC filter (L0265)
Prediction in differential domain
Inter prediction based on difference picture (L0136)
RefIdx based differential coding (L0184)
Improving HEVC tool
Base mode with residual prediction (L0103)

12. Architecture survey and adaptation
SMuC proposals
architecture from LG+MTK (K0033)

13. Architecture survey and adaptation
SMuC proposals
architecture from Canon (K0041)

14. Assumption list Feedback channel between server and sensor
Decoder (or server) Less memory, computing ability constraints