A New Rate-Complexity-QP Algorithm for HEVC Intra-Picture Rate Control LING TIAN, YIMIN ZHOU, AND XIAOJUN CAO 2014 INTERNATIONAL CONFERENCE ON COMPUTING,

Slides:



Advertisements
Similar presentations
Towards Efficient Wavefront Parallel Encoding of HEVC: Parallelism Analysis and Improvement Keji Chen, Yizhou Duan, Jun Sun, Zongming Guo 2014 IEEE 16th.
Advertisements

-1/20- MPEG 4, H.264 Compression Standards Presented by Dukhyun Chang
Robust Object Tracking via Sparsity-based Collaborative Model
A Highly Parallel Framework for HEVC Coding Unit Partitioning Tree Decision on Many-core Processors Chenggang Yan, Yongdong Zhang, Jizheng Xu, Feng Dai,
Software Architecture of High Efficiency Video Coding for Many-Core Systems with Power- Efficient Workload Balancing Muhammad Usman Karim Khan, Muhammad.
An Early Block Type Decision Method for Intra Prediction in H.264/AVC Jungho Do, Sangkwon Na and Chong-Min Kyung VLSI Systems Lab. Korea Advanced Institute.
Efficient Bit Allocation and CTU level Rate Control for HEVC Picture Coding Symposium, 2013, IEEE Junjun Si, Siwei Ma, Wen Gao Insitute of Digital Media,
1 Adaptive slice-level parallelism for H.264/AVC encoding using pre macroblock mode selection Bongsoo Jung, Byeungwoo Jeon Journal of Visual Communication.
{ Fast Disparity Estimation Using Spatio- temporal Correlation of Disparity Field for Multiview Video Coding Wei Zhu, Xiang Tian, Fan Zhou and Yaowu Chen.
Li Liu, Robert Cohen, Huifang Sun, Anthony Vetro, Xinhua Zhuang BMSB
CABAC Based Bit Estimation for Fast H.264 RD Optimization Decision
SCHOOL OF COMPUTING SCIENCE SIMON FRASER UNIVERSITY CMPT 820 : Error Mitigation Schaar and Chou, Multimedia over IP and Wireless Networks: Compression,
Wei Zhu, Xiang Tian, Fan Zhou and Yaowu Chen IEEE TCE, 2010.
An Error-Resilient GOP Structure for Robust Video Transmission Tao Fang, Lap-Pui Chau Electrical and Electronic Engineering, Nanyan Techonological University.
Improved input-state linearization in video bitrate controllers Noam Korem.
Error Concealment For Fine Granularity Scalable Video Transmission Hua Cai; Guobin Shen; Feng Wu; Shipeng Li; Bing Zeng; Multimedia and Expo, Proceedings.
Efficient Fine Granularity Scalability Using Adaptive Leaky Factor Yunlong Gao and Lap-Pui Chau, Senior Member, IEEE IEEE TRANSACTIONS ON BROADCASTING,
1 A Unified Rate-Distortion Analysis Framework for Transform Coding Student : Ho-Chang Wu Student : Ho-Chang Wu Advisor : Prof. David W. Lin Advisor :
1 An Efficient Mode Decision Algorithm for H.264/AVC Encoding Optimization IEEE TRANSACTION ON MULTIMEDIA Hanli Wang, Student Member, IEEE, Sam Kwong,
Scalable Rate Control for MPEG-4 Video Hung-Ju Lee, Member, IEEE, Tihao Chiang, Senior Member, IEEE, and Ya-Qin Zhang, Fellow, IEEE IEEE TRANSACTIONS ON.
BIN LI, HOUQIAN LI, LI LI, AND JINLEI ZHANG IEEE TRANSACTIONS ON IMAGE PROCESSING, VOL.23, NO.9, SEPTEMBER
BY AMRUTA KULKARNI STUDENT ID : UNDER SUPERVISION OF DR. K.R. RAO Complexity Reduction Algorithm for Intra Mode Selection in H.264/AVC Video.
Complexity Model Based Load- balancing Algorithm For Parallel Tools Of HEVC Yong-Jo Ahn, Tae-Jin Hwang, Dong-Gyu Sim, and Woo-Jin Han 2013 IEEE International.
Xinqiao LiuRate constrained conditional replenishment1 Rate-Constrained Conditional Replenishment with Adaptive Change Detection Xinqiao Liu December 8,
G. Valenzise *, M. Tagliasacchi *, S. Tubaro *, L. Piccarreta Picture Coding Symposium 2007 November 7-9, 2007 – Lisboa, Portugal * Dipartimento di Elettronica.
Liquan Shen Zhi Liu Xinpeng Zhang Wenqiang Zhao Zhaoyang Zhang An Effective CU Size Decision Method for HEVC Encoders IEEE TRANSACTIONS ON MULTIMEDIA,
Online Dictionary Learning for Sparse Coding International Conference on Machine Learning, 2009 Julien Mairal, Francis Bach, Jean Ponce and Guillermo Sapiro.
PROJECT PROPOSAL HEVC DEBLOCKING FILTER AND ITS IMPLIMENTATION RAKESH SAI SRIRAMBHATLA UTA ID: EE 5359 Under the guidance of DR. K. R. RAO.
Kai-Chao Yang Hierarchical Prediction Structures in H.264/AVC.
Rate-distortion modeling of scalable video coders 指導教授:許子衡 教授 學生:王志嘉.
Reducing/Eliminating visual artifacts in HEVC by Deblocking filter By: Harshal Shah Under the guidance of: Dr. K. R. Rao.
By, ( ) Low Complexity Rate Control for VC-1 to H.264 Transcoding.
1 Security and Robustness Enhancement for Image Data Hiding Authors: Ning Liu, Palak Amin, and K. P. Subbalakshmi, Senior Member, IEEE IEEE TRANSACTIONS.
Adaptive Multi-path Prediction for Error Resilient H.264 Coding Xiaosong Zhou, C.-C. Jay Kuo University of Southern California Multimedia Signal Processing.
Low-Power H.264 Video Compression Architecture for Mobile Communication Student: Tai-Jung Huang Advisor: Jar-Ferr Yang Teacher: Jenn-Jier Lien.
Sub pixel motion estimation for Wyner-Ziv side information generation Subrahmanya M V (Under the guidance of Dr. Rao and Dr.Jin-soo Kim)
Adaptive Rate Control for HEVC Visual Communications and Image Processing (VCIP), 2012 IEEE Junjun Si, Siwei Ma, Xinfeng Zhang, Wen Gao 1.
Rate-GOP Based Rate Control for HEVC SHANSHE WANG, SIWEI MA, SHIQI WANG, DEBIN ZHAO, AND WEN GAO IEEE JOURNAL OF SELECTED TOPICS IN SIGNAL PROCESSING,
- By Naveen Siddaraju - Under the guidance of Dr K R Rao Study and comparison between H.264.
Figure 1.a AVS China encoder [3] Video Bit stream.
Marwa Meddeb, Marco Cagnazzo, and B’eatrice Pesquet-Popescu
Study and Optimization of the Deblocking Filter in H.265 and its Advantages over H.264 By: Valay Shah Under the guidance of: Dr. K. R. Rao.
Fast motion estimation and mode decision for H.264 video coding in packet loss environment Li Liu, Xinhua Zhuang Computer Science Department, University.
A Robust Luby Transform Encoding Pattern-Aware Symbol Packetization Algorithm for Video Streaming Over Wireless Network Dongju Lee and Hwangjun Song IEEE.
IEEE Transactions on Consumer Electronics, Vol. 58, No. 2, May 2012 Kyungmin Lim, Seongwan Kim, Jaeho Lee, Daehyun Pak and Sangyoun Lee, Member, IEEE 報告者:劉冠宇.
Implementation, Comparison and Literature Review of Spatio-temporal and Compressed domains Object detection. By Gokul Krishna Srinivasan Submitted to Dr.
An Effective Three-step Search Algorithm for Motion Estimation
Porting of Fast Intra Prediction in HM7.0 to HM9.2
MPEG4 Fine Grained Scalable Multi-Resolution Layered Video Encoding Authors from: University of Georgia Speaker: Chang-Kuan Lin.
Encoding Stored Video for Streaming Applications IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, VOL. 11, NO. 2, FEBRUARY 2001 I.-Ming.
COMPARATIVE STUDY OF HEVC and H.264 INTRA FRAME CODING AND JPEG2000 BY Under the Guidance of Harshdeep Brahmasury Jain Dr. K. R. RAO ID MS Electrical.
Time Optimization of HEVC Encoder over X86 Processors using SIMD Kushal Shah Advisor: Dr. K. R. Rao Spring 2013 Multimedia.
A Frame-Level Rate Control Scheme Based on Texture and Nontexture Rate Models for HEVC IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY,
Efficient Huffman Decoding Aggarwal, M. and Narayan, A., International Conference on Image Processing, vol. 1, pp. 936 – 939, 2000 Presenter :Yu-Cheng.
Implementation and comparison study of H.264 and AVS china EE 5359 Multimedia Processing Spring 2012 Guidance : Prof K R Rao Pavan Kumar Reddy Gajjala.
EE 5359 MULTIMEDIA PROCESSING PROJECT PROPOSAL SPRING 2016 STUDY AND PERFORMANCE ANALYSIS OF HEVC, H.264/AVC AND DIRAC By ASHRITA MANDALAPU
E ARLY TERMINATION FOR TZ SEARCH IN HEVC MOTION ESTIMATION PRESENTED BY: Rajath Shivananda ( ) 1 EE 5359 Multimedia Processing Individual Project.
Complexity varying intra prediction in H.264 Supervisors: Dr. Ofer Hadar, Mr. Evgeny Kaminsky Students: Amit David, Yoav Galon.
Introduction to H.264 / AVC Video Coding Standard Multimedia Systems Sharif University of Technology November 2008.
Yimin Zhou, Hongyu Wang, Ling Tian and Ce Zhu
Adaptive Block Coding Order for Intra Prediction in HEVC
Early termination for tz search in hevc motion estimation
Porting of Fast Intra Prediction in HM7.0 to HM9.2
Study and Optimization of the Deblocking Filter in H
PROJECT PROPOSAL HEVC DEBLOCKING FILTER AND ITS IMPLIMENTATION RAKESH SAI SRIRAMBHATLA UTA ID: EE 5359 Under the guidance of DR. K. R. RAO.
Fast Decision of Block size, Prediction Mode and Intra Block for H
/ Fast block partitioning method in HEVC Intra coding for UHD video /
New Framework of Reversible Data Hiding in Encrypted JPEG Bitstreams
Reduction of blocking artifacts in DCT-coded images
Source: IEEE Transactions on Circuits and Systems,
Presentation transcript:

A New Rate-Complexity-QP Algorithm for HEVC Intra-Picture Rate Control LING TIAN, YIMIN ZHOU, AND XIAOJUN CAO 2014 INTERNATIONAL CONFERENCE ON COMPUTING, NETWORKING AND COMMUNICATIONS, MULTIMEDIA COMPUTING AND COMMUNICATIONS SYMPOSIUM 1

Outline 1.Introduction 2.Related Work (Rate distortion models for rate control) 3.Proposed R-D model for HEVC 4.QP calculation for rate control 5.Experimental Result 6.Conclusion 2

Introduction To take advantage of the limited network bandwidth while maintaining optimized visual quality of video streams, rate control schemes play an indispensable role in video compression and communication. Superabundant bits stream may result in network traffic jam or unexpected frame loss. Over-reduced bits stream may lead to the underutilization of network bandwidth and unnecessary video quality degradation. 3

Introduction(cont.) In this paper, different Rate-Complexity-QP model and a RCQA algorithm is proposed. This algorithm effectively takes the picture content complexity, intra picture rate control and QP into consideration. The algorithm is implemented in HM

Introduction 5

Outline 1.Introduction 2.Related Work (Rate distortion models for rate control) 3.Proposed R-D model for HEVC 4.QP calculation for rate control 5.Experimental Result 6.Conclusion 6

Related Work 7

Related Work (cont.) 1.ρ-domain model 2.Quadratic model After observing the relationship between Qstep and quantization, the equation is modified by [8] ρ is the percentage of zeros among the quantized transform coefficient. 8

Related Work (cont.) intra-picture complexity similar to MAD, may lead to the model error 9

Related Work (cont.) [4] B. Li, H. Li, L. Li, and et al. “Rate Control by Rr-lambda Model for HEVC,” in Joint Collaborative Team on Video Coding (JCT-VC) 11 th Meeting, JCTVC-K0103, Shanghai, China, [6] Z. He, Y.K. Kim and S.K. Mitra, “Low Delay Rate Control for DCT Video Coding via ρ-domain Source Modeling,” IEEE Transactions on Circuits and Systems for Video Technology, vol.11, pp.928–940, [7] T. Chiang and Y. Q. Zhang, “A New Rate Control Scheme Using Quadratic Rate-Distortion Modeling” IEEE Transactions on Circuits System and Video Technology, vol.7, pp , Feb [9] L. Tian, Y. Sun, Y. Zhou, and et al., “Analysis of Quadratic R-D Model in H.264/AVC Video Coding,” 17th IEEE International Conference on Image Processing, pp , China, [10] Y. Zhou, Y. Sun, Z. Feng, and et al., “New Rate-Distortion Modeling and Efficient Rate Control for H. 264/AVC video coding,” Signal Processing: Image Communication, vol. 24, pp ,

Outline 1.Introduction 2.Related Work (Rate distortion models for rate control) 3.Proposed R-D model for HEVC 4.QP calculation for rate control 5.Experimental Result 6.Conclusion 11

Proposed R-D model for HEVC 12

Proposed R-D model for HEVC (cont.) By the relationship mentioned above, four model should be discussed below 1.Linear distortion-quantization (D-Q) model 2.Exponential rate-quantization (R-Q) model 3.Linear rate-complexity (R-C) model 4.Uniform rate-complexity-quantization model 13

Proposed R-D model for HEVC (cont.) 1.Linear distortion-quantization (D-Q) model  By observing Y-axis in Fig.1.a, we can see a linear relationship between D and Q. 14

Proposed R-D model for HEVC (cont.) 2.Exponential rate-quantization (R-Q) model  By observing Y-axis in Fig.1.a, based on the curves shape and the exponential model for H.264 in [9], the model can be as 15

Proposed R-D model for HEVC (cont.) 3.Linear rate-complexity (R-C) model  Using the variation of picture content to determined the complexity of the picture  The author use the average gradient per pixel to denote the picture content complexity 16

Proposed R-D model for HEVC (cont.) 3.Linear rate-complexity (R-C) model  By observing Y-axis in Fig.1.b, based on the dot on the figure, the model can be as 17

Proposed R-D model for HEVC (cont.) 4.Uniform Rate-Complexity-Quantization (RCQ) Model  Since C is independent of Q, we propose a uniform RCQ model to depict the relationships among rate, complexity and quantization 18

Outline 1.Introduction 2.Related Work (Rate distortion models for rate control) 3.Proposed R-D model for HEVC 4.QP calculation for rate control 5.Experimental Result 6.Conclusion 19

QP calculation for rate control To get more efficient and fine-granulate rate control, the authors further derive the total differential of the RCQ model to obtain the incremental QP for the encoding process in HEVC. 1.Total differential of the uniform RCQ model 2.Incremental QP calculation 3.RCQ model update 4.RCQ based rate control algorithm 20

QP calculation for rate control (cont.) 1.Total differential of the uniform RCQ model ( 全微分 dR 為對應於 c 和 q 小變化時 R 變化量的近似值。 ) 21

QP calculation for rate control (cont.) 22

QP calculation for rate control (cont.) 2.Incremental QP calculation  Since the content and motion complexity of the successive pictures have a high correlation, the bitrate difference between two successive pictures can be  Hence, QP value of the current frame can be obtained according to the feedback of rate control buffer 23

QP calculation for rate control (cont.) 24

QP calculation for rate control (cont.) 25

QP calculation for rate control (cont.) 4.RCQ based rate control algorithm 26

Outline 1.Introduction 2.Related Work (Rate distortion models for rate control) 3.Proposed R-D model for HEVC 4.QP calculation for rate control 5.Experimental Result 6.Conclusion 27

Experimental Result The authors implement RCQA to control bit-rate under the platform of HEVC reference software HM 9.1, which is compared with HM 9.1 RC and the normal HM 9.1 fixed QP (FIXQP) rate control schemes. Video sequences are coded in an all intra configuration with high efficiency coding parameters as described in “encoderintra-main.cfg”. 28

Experimental Result (cont.) The proposed RCQ model is implemented in HM 9.1, which is compared with HM 9.1 RC and the normal HM 9.1 fixed QP rate control schemes. 29

Experimental Result (cont.) Table III shows the results of rate control accuracy, which is calculated by |TBR − ABR | /TBR, where TBR is obtained from the FIXQP scheme. 30

Experimental Result (cont.) Fig.3 shows the simulation results of the buffer size during the coding process. The X-axis is the picture index and Y-axis denotes the relative buffer size minus the standard buffer threshold. Buffer occupancy for fixed QP, HM9.1 rate control and RCQA rate control. (a): B : Cactus, target bit rate mbps, initial QP = 22. (b): C : RaceHorsesC, target bit rate 5.106Mbps, initial QP =

Outline 1.Introduction 2.Related Work (Rate distortion models for rate control) 3.Proposed R-D model for HEVC 4.QP calculation for rate control 5.Experimental Result 6.Conclusion 32

Conclusion Pros : 1.This paper has proposed a linear distortion-quantization model, an exponential rate quantization model and a linear rate complexity model, which are integrated into a novel Rate-Complexity-QP (RCQ) model for HEVC intra-picture rate control. 2.Experimental results show that RCQA outperforms the HM 9.1 RC and the normal HM 9.1 fixed QP (FIXQP) rate control schemes. Cons : 1.The proposed method only apply rate control on frame level. 2.The proposed method only deals with “encoderintra-main.cfg” configuration. 33