Progress & schedule Presenter : YY Date : 2014/10/3

Outline Multi-resolution DVC goal & application Specification Proposed architecture Schedule

Multi-resolution DVC …… … Recap Application of multi-resolution DVC What’s the purpose of conventional scalable video codec ? Application of multi-resolution DVC Deal with high motion scenario by mobile sensors The weakness of temporal predicted DVC architecture Viewing from the point of coding efficiency Assumption Feedback channel between sensors and server* …… key WZ GOP = 4 …

Multi-resolution DVC specification Goal Even better RD performance than single layer DVC in high motion sequence SHVC evaluation term EL & EL+BL BL rate as key rate EL rate as WZ rate BL+EL rate compared with overall DVC RD performance Low power consumption Prerequisites Integrate with Hybrid DVC Coding Mode Selection (CMS) based on temporal residue As little modification as possible compared with single layer DVC Reduce HW cost of supporting both single layer & multi layer Decoder side multi-loop SVC Less memory, computing ability constraints* RD performance is presentation of CC(precisely, CMS) is better for interlayer residue or a WZ compression

Hybrid DVC encoder …… - Frame setting key WZ + GOP = 4 Coding mode selection based on temporal residue (motion) low Skip camera DCT Quantization CMS Entropy coding + WZ bitstream - Channel coding Frame Buffer high Conventional intra coder Key bitstream

Encoder proposal under consideration WZ Temporal only residue …… Frame setting …… key Spatial only residue Skip Spatial or temporal residue camera Coding structure selection DCT Quantization CMS Entropy coding + WZ bitstream - Channel coding Early stage high motion detector Power off frame buffer or make maximum use of it ? spatial-residue-dependent mechanism that is similar to original CMS Conventional intra coder Key bitstream

Correlation noise modeling Hybrid DVC decoder Skip WZ bitstream Coding mode decode Entropy coding Reconstruction & post processing WZ frame Channel coding - Side Info. refinement Soft input computation + Correlation noise modeling Side Info. creation Frame buffer Key bitstream Intra decoder Key frame

Decoder proposal under consideration WZ bitstream Skip Reference frame buffer Coding structure decode Coding mode decode Entropy coding Reconstruction & post processing + WZ frame Channel coding Key frame buffer - Side Info. refinement Soft input computation + Correlation noise modeling　　 Side Info. creation Use General Residual Prediction (GRP) for early stage experiments Possibly use Generalized Gaussian Distribution (GGD) Key bitstream Intra decoder Key frame

Schedule Short term (~this semester) SW multi-resolution DVC experiments SI generation algorithm GRP, DCT-IF Offline decoding comparison of temporal setting & spatial setting (CC only) CN modeling Coding structure selection algorithm CMS for spatial setting Further improvement ICIP 2015 Long term (~end of second year of master) HW implementation of the proposed architecture TCSVT Long long term Graduation ? I don’t know

Appendix ELP Architecture proposals

EL Prediction (ELP) survey and adaptation SCE3 : Inter-layer Prediction in SHVC ELP technique category Inter-intra combined prediction Adaptive predictor compensation (L0072) Combined inter mode(L0206) Residual prediction General Residual Prediction (GRP) (L0078, L0190, L0038, L0100) Generalized combined and residue prediction (L0074) GRP with MC at BL resolution (L0104) GRP with shorter-tap MC filter (L0265) Prediction in differential domain Inter prediction based on difference picture (L0136) RefIdx based differential coding (L0184) Improving HEVC tool Base mode with residual prediction (L0103)

Architecture survey and adaptation SMuC proposals architecture from LG+MTK (K0033)

Architecture survey and adaptation SMuC proposals architecture from Canon (K0041)

Assumption list Feedback channel between server and sensor Decoder (or server) Less memory, computing ability constraints