A TUTORIAL on HEVC K.R. Rao, IEEE Fellow Electrical Engineering Dept

A TUTORIAL on HEVC K.R. Rao, IEEE Fellow Electrical Engineering Dept
University of Texas at Arlington Multimedia Processing Lab,UTA

A TYPICAL VIDEO SEQUENCE
A video is nothing but a sequence of images. Attributes: -Height - Width - Frame Rate - Pixel Values Multimedia Processing Lab,UTA

COMPRESSION STRATEGIES
Multimedia Processing Lab,UTA

NEED FOR COMPRESSION Existing applications and usage scenarios
--IPTV over DSL : Large shift in IPTV eligibility --Facilitated deployment of OTT and multi-screen services --More customers on the same infrastructure: most IP --More archiving facilities Future services --1080p60/50 with bitrates comparable to 1080i --Immersive viewing experience: Ultra-HD ( 4K x 2K, 8K x 4K). -- Premium services (sports, live music, live events,…): home theater, mobile. --High‐Definition Television (HDTV) 1920x1080 -- 30 frames per second (full motion) --8 bits for each three primary colors(RGB)--Total 1.5Gb/sec! -- Cable TV: each cable channel is 6 MHz -- Max data rate of 19.2 Mb/sec -- Reduced to 18 Mb/sec w/audio + control… --Compression ratio must be ~ 80:1! Multimedia Processing Lab,UTA

FUTURE SERVICES and DEMAND
Spatial, Temporal, Visual: Home – Ultra HD (UHD) Mobile – Light-weight HD (720p) 3D and Scalable UHD 60 fps could take 48 Gbps! --> need more effective compression technology beyond H.264/AVC Source: Sharp; Richard Lawler Source: Web Multimedia Processing Lab,UTA

RESEARCH FOCUS AREAS Multimedia Processing Lab,UTA

EXISISTING VIDEO CODECS and TECHNOLOGIES
STANDARD MAIN APPLICATIONS YEAR JPEG,JPEG2000 Image (JPEG), 2000 (JPEG2000) JBIG Fax H.261 Video conferencing 1990 H.262, H.262+ DTV, SDTV 1995, 2000 H.263, H.263+ Videophone 1998,2000 MPEG-1 Video CD 1992 MPEG-2 DTV, SDTV, HDTV, DVD 1995 MPEG-4 Interactive video 2000 MPEG-7 Multimedia content description interface 2001 MPEG-21 Multimedia framework 2002 H.264/ MPEG-4 Part 10 Advance video coding 2003 Fidelity range extensions (high profile), Studio editing, Post processing, Digital cinema August, 2004 Multiview 3D Screen Content Coding 2016 Multimedia Processing Lab,UTA

EXISISTING VIDEO CODECS and TECHNOLOGIES -contd
STANDARD MAIN APPLICATIONS YEAR AVS-China ( IEEE AVS P1857/D1 Draft standard 2013 ) IPTV, Terrestrial digital TV, Satellite broadcast, Video surveillance 2013 VC-1, VC-3 (SMPTE/Microsoft) VC-1 : Internet streaming to HDTV VC-3: Composting, Mastering and Multi-generational use 2006 DIRAC (B.B.C.) Internet streaming to Ultra-high definition TV 2008 DIRAC Pro/ VC-2 Studio and professional use 2009 VP-6, 7, 8 (On2 technologies) Broadcasting 6-2003, , VP-9 (Google) ** On2 technologies was bought by Google in 2010** Next generation open-source video codec RV- 10 (Real Networks) Internet streaming HEVC Main, Main-10, Main intra profile Jan 2013 Scalable, 3D-Extensions, 12 bit, 4:4:4 Format 2014 Multimedia Processing Lab,UTA

NEED for a CODEC SUPERIOR than H.264
An increasing diversity of services, the growing popularity of HD video, and the emergence of beyond HD formats (e.g., 4k×2k or 8k×4k resolution) are creating stronger needs for coding efficiency superior to H.264/MPEG-4 AVC’s [7] capabilities. The need is even stronger when higher resolution is accompanied by stereo or multi-view capture and display. An increased desire for higher quality and resolutions is also arising in mobile applications. Multimedia Processing Lab,UTA

HEVC- OVERVIEW [1][2] HEVC: High Efficiency Video Coding
CONTEXT HEVC: High Efficiency Video Coding ISO Joint standard of ISO-IEC/MPEG and ITU- T/VCEG: JCTVC Successor of H.264/MPEG-4 AVC ITU- H.265 and ISO- MPEG H Part 2 GOALS Achieve a compression gain of 50% over H 264/AVC at the same visual quality x10 complexity max for encoder and x2/3 max for decoder Multimedia Processing Lab,UTA

HEVC-FEATURES [1] The HEVC standard is designed to achieve multiple goals, including improved coding efficiency, ease of transport system integration and data loss resilience, as well as implementation ability using parallel processing architectures. VIDEO CODING LAYER The video coding layer of HEVC employs the same hybrid approach (inter-/intra-picture prediction and 2-D transform coding aided by motion estimation/ compensation) used in all video compression standards since H.261. Multimedia Processing Lab,UTA

HEVC- WHAT’S NEW?? Recursive coding tree structure (64x64 -> 4x4)
Advanced intra prediction(33 Angular directions) DCT based interpolation filter Advanced inter prediction Discrete Sine Transform Deblocking filter Scanning Sample adaptive offset Multimedia Processing Lab,UTA

HEVC-ENCODER [1] Multimedia Processing Lab,UTA

HEVC-DECODER [10] Multimedia Processing Lab,UTA

CODING TREE UNIT and CODING TREE BLOCK (CTB) STRUCTURE
The core of the coding layer in previous standards was the macro block, containing a 16×16 block of luma samples and, in the usual case of 4:2:0 color sampling, two corresponding 8×8 blocks of chroma samples. The analogous structure in HEVC is the coding tree unit (CTU), which has a size selected by the encoder and can be larger than a traditional macro block. The CTU consists of a luma CTB and the corresponding chroma CTBs and syntax elements. The size L×L of a luma CTB can be chosen as L = 16, 32, or 64 samples. Larger CTU sizes typically enables better compression. HEVC then supports a partitioning of the CTBs into smaller blocks using a tree structure and quad tree-like signaling. Multimedia Processing Lab,UTA

CTB PARTITIONING STRUCTURE [11]
Example of CTU, partitioning and processing order when size of CTU is equal 64 × 64 and minimum CU size is equal to 8 × 8 (a) CTU partitioning (b) Corresponding coding tree structure. [11] Multimedia Processing Lab,UTA

CODING UNITS and CODING BLOCKS
The CTU is further partitioned into multiple CUs to adapt to various local characteristics. A quad tree denoted as the coding tree is used to partition the CTU into multiple CUs. 1) Recursive Partitioning from CTU: Let CTU size be 2N×2N where N is one of the values of 32, 16, or 8. The CTU can be a single CU or can be split into four smaller units of equal sizes of N×N, which are nodes of coding tree. If the units are leaf nodes of coding tree, the units become CUs. Otherwise, the CU can be split again into four smaller units when the split size is equal to or larger than the minimum CU size specified in the SPS. This representation results in a recursive structure specified by a coding tree. (SPS: Sequence parameter set) Multimedia Processing Lab,UTA

FLEXIBLE CU PARTITIONING [11]

PREDICTION UNIT (PU) One or more PUs are specified for each CU, which is a leaf node of coding tree, coupled with CU the PU works as a basic representative block for sharing the prediction information. Inside one PU, the same prediction process is applied and the relevant information is transmitted to the decoder on a PU basis. A CU can be split into one, two or four PUs according to the PU splitting type. HEVC defines two splitting shapes for the intra coded CU and eight splitting shapes for inter coded CU. Unlike the CU, the PU may only be split once. Multimedia Processing Lab,UTA

PU SPLITTING TYPES [11] Multimedia Processing Lab,UTA

TRANSFORM UNIT Similar with the PU, one or more TUs are specified for the CU. HEVC allows a residual block to be split into multiple units recursively to form another quad tree which is analogous to the coding tree for the CU [12]. The TU is a basic representative block having residual for applying the integer transform and quantization. For each TU, one integer transform having the same size as the TU is applied to obtain residual transform coefficients. Multimedia Processing Lab,UTA

TRANSFORM TREE and BLOCK PARTITIONING [11]
Examples of transform tree and block partitioning. (a) Transform tree. (b) TU splitting for square- shaped PU. (c) TU splitting for rectangular or asymmetric shaped PU. [11] Multimedia Processing Lab,UTA

HEVC and H.264- BLOCK PARTITIONING COMPARISON

Multimedia Processing Lab,UTA

HEVC- INTRA-PREDICTION
Intra coding in HEVC is considered as an extension of H.264/AVC, as both approaches are based on spatial sample prediction followed by transform coding The basic elements in the HEVC intra coding design include: Quad tree-based coding structure following the HEVC block coding architecture. Angular prediction with 33 prediction directions. Planar prediction to generate smooth sample surfaces Adaptive smoothing of the reference samples. Filtering of the prediction block boundary samples. Prediction size based residual transform. Prediction mode-dependent coefficient scanning. Intra mode coding based on contextual information. Multimedia Processing Lab,UTA

INTRA-ANGULAR PREDICTION MODES
HEVC angular intra prediction modes numbered from 2 to 34 and the associated displacement parameters. H and V are used to indicate the horizontal and vertical directionalities, respectively, while the numeric part of the identifier refers to the pixels’ displacement as 1/32 pixel fractions [13]. Multimedia Processing Lab,UTA

CHROMA INTRA PREDICITON MODES
Quite often structures in the chroma signal follow those of the luma. Taking advantage of this behavior, HEVC introduces a mechanism to indicate the cases when chroma PU utilizes the same prediction mode as the corresponding luma PU. Specification of chroma intra prediction and associated names [13] Multimedia Processing Lab,UTA

INTER-PICTURE PREDICITON
The major changes in the inter prediction of HEVC compared to H.264/AVC are as follows. PB Partitioning Compared to intra picture-predicted CBs, HEVC supports more PB partition shapes for inter picture- predicted CBs. The partitioning modes of PART−2N×2N, PART−2N×N, and PART−N×2N indicate the cases when the CB is not split, split into two equal-size PBs horizontally, and split into two equal- size PBs vertically, respectively. PART−N×N specifies that the CB is split into four equal-size PBs, but this mode is only supported when the CB size is equal to the smallest allowed CB size. In addition, there are four partitioning types that support splitting the CB into two PBs having different sizes: PART−2N×nU, PART−2N×nD, PART−nL×2N, and PART−nR×2N.These types are known as asymmetric motion partitions. Multimedia Processing Lab,UTA

INTERPOLATION-FRACTIONAL PEL
The samples of the PB for an intra-picture-predicted CB are obtained from those of a corresponding block region in the reference picture identified by a reference picture index, which is at a position displaced by the horizontal and vertical components of the motion vector As in H.264/MPEG-4 AVC [7], HEVC [2] supports motion vectors with units of one quarter of the distance between luma samples. For chroma samples, the motion vector accuracy is determined according to the chroma sampling format, which for 4:2:0 sampling results in units of one eighth of the distance between chroma samples. Multimedia Processing Lab,UTA

INTERPOLATION-FRACTIONAL PEL –contd.
The fractional sample interpolation for luma samples in HEVC uses separable application of an eight-tap filter for the half-sample positions and a seven-tap filter for the quarter sample positions. This is in contrast to the process used in H.264/MPEG-4 AVC [7] , which applies a two-stage interpolation process by first generating the values of one or two neighboring samples at half-sample positions using six-tap filtering, rounding the intermediate results, and then averaging two values at integer or half-sample positions. 7 or 8-tap interpolation filter for luma: ¼ Pel 4-tap interpolation filter for chroma: 1/8 Pel Filter coefficients for luma fractional sample interpolation in HEVC. [1] Integer and fractional sample positions for luma interpolation [1] Filter coefficients for chroma sample interpolation in HEVC. [1] Multimedia Processing Lab,UTA

DEBLOCKING FILTER The deblocking filter is applied to all samples adjacent to a PU or TU boundary. HEVC applies the deblocking filter only to the edges that are aligned on an 8×8 sample grid. Deblocking is, therefore, performed on a four- sample part of a block boundary when all of the following three criteria are true: The block boundary is a prediction unit or transform unit boundary. The boundary strength is greater than zero. Variation of signal on both sides of a block boundary is below a specified threshold. Multimedia Processing Lab,UTA

DEBLOCKING FILTER- FLOW CHART [14]
BS>0? Eq. 1 true? Eqs. 2, 3,4 true? --(1) --(2) --(3) --(4) Multimedia Processing Lab,UTA

SAMPLE ADAPTIVE OFFSET –SAO [15]
Applied after deblocking. Add offset to pixels depending on their categorization (band, edge). Two SAO types that satisfy the requirements of low complexity are adopted in HEVC: edge offset (EO) and band offset (BO). SAO syntaxes are restricted to one CTB and can be merged with other CTUs Up to 6 bitrate savings. Multimedia Processing Lab,UTA

TRANSFORM [1] HEVC uses transform coding of the prediction error residual in a similar manner as in prior standards. The residual block is partitioned into multiple square TBs. Herein, the possible transform block sizes are 4×4, 8×8, 16×16 and 32×32. Core transform : Two-dimensional transforms are computed by applying one-dimensional transforms in both the horizontal and vertical directions. The elements of the core transform matrices were derived by approximating scaled discrete cosine transform (DCT) basis functions, under considerations such as limiting the necessary dynamic range for transform computation and maximizing the precision and closeness to orthogonality when the matrix entries are specified as integer values. Mode-dependent alternative transform : For the transform block size of 4×4, an alternative integer transform derived from a discrete sine transform (DST) is applied to the luma residual blocks for intra prediction modes, with the transform matrix Multimedia Processing Lab,UTA

(16x16) INTDCT Multimedia Processing Lab,UTA

(8x8) INTDCT This matrix is obtained by using the first 8 entries of rows 0,2,4,…14 of the (16x16) INTDCT Multimedia Processing Lab,UTA

(4x4) INTDCT This matrix is obtained by using the first 4 entries of rows 0,4,8,…12 of the (16x16) INTDCT Multimedia Processing Lab,UTA

SCALING and QUANTIZATION [1]
Since the rows of the transform matrix are close approximations of values of uniformly-scaled basis functions of the orthonormal DCT, the pre-scaling operation that is incorporated in the dequantization of H.264/MPEG-4 AVC is not needed in HEVC. This avoidance of frequency-specific basis function scaling is useful in reducing the intermediate memory size – especially when considering that the size of the transform can be as large as 32×32. For quantization, HEVC uses essentially the same uniform-reconstruction quantization (URQ) scheme controlled by a quantization parameter (QP) as in H.264/MPEG-4 AVC. Multimedia Processing Lab,UTA

SCALING and QUANTIZATION [1] contd.
The range of the QP values is defined from 0 to 51, and an increase by 6 doubles the quantization step size, such that the mapping of QP values to step sizes is approximately logarithmic. Quantization scaling matrices are also supported. To reduce the memory needed to store frequency-specific scaling values, only quantization matrices of sizes 4×4 and 8×8 are used. For the larger transformations of 16×16 and 32×32 sizes, an 8×8 scaling matrix is sent and is applied by sharing values within 2×2 and 4×4 coefficient groups in frequency sub-spaces – except for values at DC positions, for which distinct values are sent and applied. Multimedia Processing Lab,UTA

CODING[1] HEVC specifies only one entropy coding method, context adaptive binary arithmetic coding (CABAC) rather than two as in H.264/MPEG-4 AVC. The core algorithm of CABAC is unchanged, and the following subsections present several aspects of how it is used in the HEVC design. Context modelling : Appropriate selection of context modelling is known to be a key factor to improve the efficiency of CABAC coding. In HEVC, the splitting depth of the coding tree or transform tree is exploited to derive the context model indices of various syntax elements in addition to the spatially neighboring ones used in H.264/AVC. Adaptive coefficient scanning: Coefficient scanning is performed in 4×4 sub-blocks for all TB sizes. Three coefficient scanning methods, diagonal up-right, horizontal and vertical scans are used. Three coefficient scanning methods in HEVC. (a) Diagonal up-right scan(b) Horizontal scan. (c) Vertical scan. [1] Multimedia Processing Lab,UTA

HEVC- COMPLEXITY ANALYSIS [8]
Complexity of some key modules such as transforms, intra prediction, and motion compensation is higher in HEVC than in H.264/AVC. Complexity of modules such as entropy coding and deblocking is lower in HEVC than in H.264/AVC. The implementation cost of an HEVC decoder is thus not much higher than that of an H.264/AVC decoder, even with the addition of an in-loop filter such as SAO. From an encoder perspective, things look different: HEVC features many more mode combinations as a result of the added flexibility from the quad tree structures and the increase of intra prediction modes. An encoder fully exploiting the capabilities of HEVC is thus expected to be several times more complex than an H.264/AVC encoder. This added complexity does however have a substantial benefit in the expected significant improvement in rate-distortion performance. Multimedia Processing Lab,UTA

HEVC-PERFORMANCE [9] Multimedia Processing Lab,UTA
Comparsion of HEVC with previous video coding standards: For HEVC, the described encoder control is the same as the one implemented in the HM-8.0 reference software. For HEVC, all coding tools specified in the draft HEVC Main Profile are enabled. For the other tested video coding standards, the profiles and coding tools that pro-vide the best coding efficiency for the investigated scenarios were selected. Multimedia Processing Lab,UTA

HEVC-PERFORMANCE -contd

HEVC FUTURE – SCALABILTIY [15,16]
Spatially scalable video coding (SSVC in short) provides an efficient way to deliver one video at different resolutions. Scalable extensions of HEVC have been under discussion since the 7th JCT- VC meeting. The final call for proposals (CfP) was issued jointly by ITU-T/VCEG and ISO/IEC/MPEG in July 2012 after the 10th JCT-VC meeting, and companies and organizations are invited to submit proposals in response to this CfP. The scalable extensions of HEVC have been named SHVC for “Scalable High-efficiency Video Coding”, and its standardization will continue under JCT-VC. The tentative timeline of SHVC is shown as below. --January 2013, Test Model --April 2013, first Working Draft --June 2014, final standard draft HSVC Standardized in 2014 Multimedia Processing Lab,UTA

HEVC FUTURE- 3D EXTENSION [6]
The HEVC extension for 3D video coding supports the coding of multiple views and associated depth data. It adds new coding tools to the HEVC design, which improve the compression capabilities for dependent video views and depth data. The Joint Collaborative Team on 3D Video Coding Extension Development (JCT-3V) has been established to work on 3D video coding extensions of HEVC and other video coding standards. HEVC 3D extension: 2014. Screen Content Coding extension: 2016 Multimedia Processing Lab,UTA

CONCLUSIONS The tutorial presented a detailed description of HEVC – features, complexity issues and performance. HEVC coding tools and its extensions which include scalability and 3D extensions have been explored. HEVC improves the coding efficiency of H.264/AVC high profile and in future, it may become an integral part of high visual quality video applications like future home, mobile, and other consumer applications. With the 12 bit and 4:4:4 format profiles of HEVC, there is even more scope for research. There are plenty of new HEVC and HEVC 3D related research topics for researchers and students. Screen Content Coding extension finalized in 2016 Multimedia Processing Lab,UTA

REFERENCES Multimedia Processing Lab,UTA
[1] G.J. Sullivan; J. Ohm; Woo-Jin Han and T. Wiegand, “Overview of the High Efficiency Video Coding (HEVC) Standard”, IEEE Transactions on Circuits and Systems for Video Technology, Volume: 22, Issue: 12, pp , December [2] HEVC Text Specification Draft 9: : evry.fr/jct/doc_end_user/current_document.php?id=6803 [3] HM Software Repository: [4] 3D Extension Software Repository: [5] Scalable Extension Software Repository: [6] “Test Model under Consideration for HEVC based 3D video coding”, ISO/IEC JTC1/SC29/WG11 MPEG2011/N12559 February 2012, San Jose, CA, USA [7] H.264/AVC reference website - [8] ] F. Bossen, et al, “HEVC complexity and implementation analysis”, IEEE Transactions on Circuits and Systems for Video Technology, Volume: 22, Issue: 12, pp , December [9] J. Ohm, et al, “Comparison of the Coding Efficiency of Video Coding Standards –Including High Efficiency Video Coding (HEVC)”, IEEE Transactions on Circuits and Systems for Video Technology, volume: 22, Issue: 12, pp , December [10] C. M. Fu, et al, “Sample adaptive offset in the HEVC standard,” IEEE Trans. on circuits and Systems for video technology, vol. 22, no. 12, pp , Dec [11] K. Kim, et al, “Block partitioning structure in the HEVC standard,” IEEE Trans. on circuits and systems for video technology, vol. 22, pp , Dec Multimedia Processing Lab,UTA

REFERENCES [12] M. Winken, K. Suhring and T. Wiegand, Video Coding Technology Proposal by Fraunhofer HHI, JCT-VC document A116, 1st JCT-VC Meeting, Apr [13] J. Lainema, et al, “Intra Coding of the HEVC Standard,” IEEE Trans. on circuits and systems for video technology, vol. 22, no. 12, pp , Dec [14] A. Norkin and G. Bjontegaard, “HEVC Deblocking Filter,” IEEE Trans. on Circuits and Systems for Video Technology, vol. 22, pp , Dec [15] ] Z. Shi, X. Sun and F. Wu, ”Spatially scalable video coding for HEVC,”IEEE Trans.CSVT,vol.22,pp ,Dec.2012 [16] Information on Scalable extension of HEVC : vc-scalable-extensions-of-hevc.html [17] Multimedia Processing Lab at UTA: [18] K.R. Rao, D.N. Kim and J.J. Hwang, “Video coding standards: AVS China, H.264/MPEG4-Part 10, HEVC, VP6, DIRAC and VC-1”, Springer [19] JCT-VC documents are publicly available at and [20] Special issue on emerging research and standards in NGVC, IEEE Trans, CSVT, vol. 22, pp ,Dec [21] HEVC MA, P2, IEEE ICIP 2012, poster sessions (several papers), Orlando, Fl, Sept-Oct 2012. Multimedia Processing Lab,UTA

[22] JCT-VC documents are publicly available at http://ftp3. itu
[22] JCT-VC documents are publicly available at and [23] B. Bross et al, “High efficiency video coding (HEVC) text specification draft 8”, JCTVC-J1003, July [24] HEVC Model 9.0, available for download at The latest version available at the time this chapter was prepared is HM-9.0. [25] JVT KTA reference software (Key technical areas) [26] has info on developments in HEVC NGVC – Next generation video coding. [27] B. Bross et al, “High efficiency video coding (HEVC) text specification draft 8”, JCTVC-J1003, July [28] F. Bossen, D. Flynn and K. Suhring (July 2011), “HEVC reference software manual” Online available : v2.zip Multimedia Processing Lab,UTA

Visual Quality [1] P. Hanhart et al, ”Subjective quality evaluation of the upcoming HEVC video compression standard”, SPIE Applications of digital image processing XXXV, vol.8499, paper , Aug.2012 [2] M. Horowitz et al, “Informal subjective quality comparison of video compression performance of the HEVC and H.264/MPEG-4 AVC standards for low delay applications”, SPIE Applications of digital image processing XXXV,vol.8499, paper 8499W-1 thru W-6, Aug.2012 [1] J.-R .Ohm, T. Wiegand and G.J. Sullivan, “Video coding progress: The high efficiency video coding (HEVC) standard and its future extensions”, IEEE ICASSP ,Tutorial,Vancouver,Canada,2013. [2] M. Wien, ”HEVC-coding tools and specifications”, Tutorial, IEEE ICME, San Jose, CA, July 2013. Multimedia Processing Lab,UTA

H. R. Wu and K. R. Rao ,”Digital Video image Quality (Editor)and perceptual coding”, Taylor and Francis (CRC press),2006. JVT REFLECTOR Queries/questions/clarifications etc regarding H.264/H.265 on behalf of; Karsten Suehring The JCT experts reflector is used for discussions related to H.264/AVC. You can subscribe yourself here: For discussions related to HEVC you should use the JCT-VC reflector that can be found here: Multimedia Processing Lab,UTA

HEVC Screen Content Coding Extensions

Standardization by JCT-VC, ITU-T
CfP issued Ja. 2014 7 responses proposed by Qualcomm, ITRI, MediaTek, Huawei, Microsoft, Mitsubishi Electric, Interdigital Documents: Reference software Test sequence Multimedia Processing Lab,UTA

Screen content & features
Mixed/compound content consisting of natural video, text and graphics in the same picture. Features: Applications: wireless displays, graphics, remote desktop, remote gaming, automotive infotainment, cloud computing, distance education No sensor noise Large uniformly ﬂat areas Repeated patterns Highly saturated or a limited number of different colours Numerically identical blocks or regions in a picture. Multimedia Processing Lab,UTA

SCC Encoder J. Xu, R. Joshi, and R.A. Cohen, "Overview of the Emerging HEVC Screen Content Coding Extension," IEEE Trans. on CSVT, vol. 26, no. 1, pp , Jan

SCC Decoder Y.-J. Ahn, et al., "Analysis of Screen Content Coding Based on HEVC," IEIE Trans. on Smart Processing and Computing, vol. 4, no. 4, pp , Aug

Screen Content Coding support in HEVC (1)
HEVC screen content coding extension (HEVC-SCC) is developed based on HEVC ver. 1 and HEVC range extensions (HEVC-RExt) HEVC ver. 1 Focused on camera captured content Screen content often has high contrast and sharp edges Residual Scalar Quantization (RSQ) directly quantized the intra prediction residual, without applying a transform. Base Colors and Index Map (BCIM) took advantage of the observation that the number of unique colors in screen content pictures is usually limited as compared to camera-captured content. RSQ and BCIM could respectively be considered early forms of transform skip, which is part of HEVC version 1 In transform bypass mode transform and quantization steps are bypassed for lossless coding Differential pulse code modulation (DPCM) for sample-based intra prediction were proposed. Dictionary and Lempel-Ziv coding tools (repeated patterns) were shown to be effective at improving coding efﬁciency, especially on pictures containing text and line graphics. Multimedia Processing Lab,UTA

HEVC screen content coding extension (HEVC-SCC) is developed based on HEVC ver. 1 and HEVC range extensions (HEVC-RExt) HEVC ver. 1 Transform Skipping Skipping the transform and quantizing data in the spatial domain Bit-saving brought by the transform skip mode is about 7.5% for typical 4:2:0 screen content . When applied to 4:4:4 screen content, the coding gain for transform skip is much larger, ranging from 5.5% to 34.8%. HEVC version 1 only supports transform skip for 4×4 TUs. Transform Skip Mode (TSM) defines the transform skip in one or both directions on which a transform would be applied under normal conditions. Transform choices enabled by TSM Multimedia Processing Lab,UTA

HEVC screen content coding extension (HEVC-SCC) is developed based on HEVC ver. 1 and HEVC range extensions (HEVC-RExt) HEVC - RExt Improvements to transform skip HEVC-RExt extends transform skip to all TUs, regardless of their size. Enabling transform skip for all TUs has two benefits. One is that the coding efficiency for screen content can be further improved. The other is that encoders have the flexibility to exploit the transform skip mode. Residual differential pulse code modulation (RDPCM) Even after intra prediction, there is still correlation in the residual signal that can be exploited. RDPCM predicts the current residual using its neighboring residual. RDPCM was proposed for intra lossless coding and then extended to lossy and inter coding Cross-component prediction (CCP) CCP was proposed to exploit correlation among color components Luma component is set as the predictor component Two chroma components are predicted separately from the luma component Therefore, there are two α values, one for the Cb or B component, and the other one for the Cr or R component. They are coded into bitstream. Multimedia Processing Lab,UTA

HEVC screen content coding extension (HEVC-SCC) is developed based on HEVC ver. 1 and HEVC range extensions (HEVC-RExt) HEVC - RExt Two RDPCM modes when the intra prediction mode is (a) vertical and (b) horizontal directions CCP using the original luma residual signal S. Lee, I.-K. Kim and C. Kim, "Residual DPCM for HEVC lossless coding," JCTVC-M0079, 13th JCT-VC meeting, Incheon, KR, Apr W.-S. Kim, et al., “Cross-component prediction in HEVC," IEEE Trans. On Circuits and Syst. For Video Tech., (Early Access) Multimedia Processing Lab,UTA

New coding tools for Screen Content in HEVC
Intra Block Copy Palette mode Adaptive Color Transform Adaptive motion vector resolution Multimedia Processing Lab,UTA

SCC – Intra Block Copy (IBC) (1)
Introduced into HEVC-RExt to enable inter-alike motion estimation and compensation New CU mode in addition to the conventional intra and inter modes, referred to as intra block copy (IBC) PUs of CU ﬁnd similar reconstructed blocks within the same picture instead of searching the reference in previously (temporally) reconstructed frame. Carries the block vector and compensation residual to the decoder IBC was proposed in the context of AVC/H.264 natural video coding, but not efficient Multimedia Processing Lab,UTA

Intra Block Vector search Evaluates the rate-distortion (RD) cost of using the IBC mode Performs Local area search Performs a search over the entire picture for certain CU sizes Local block vector search Following modifications are made in SCM test model 5, for local block vector search for IBC mode Step 1: The four best block vectors are selected according to their RD cost. Step 2: Both the luma and chroma components are used in calculation of the SAD for the four best block vectors selected from step 1 Block vector with the minimum RD cost is selected Multimedia Processing Lab,UTA

Global block vector search Global block vector search is performed for 8×8 and 16×16 blocks Fast block vector search Fast search and early termination methods are employed. Fast IBC search is performed after evaluating the RD cost of inter mode, if the residual of inter prediction is not zero. J. Xu, R. Joshi, and R.A. Cohen, "Overview of the Emerging HEVC Screen Content Coding Extension," IEEE Trans. on CSVT, vol. 26, no. 1, pp , Jan Multimedia Processing Lab,UTA

Inter block search Compared to the HEVC Range extensions test model 7, SCM modifies the inter block search in two ways. The inter search is modified to adapt to the characteristics commonly found in screen content sequences The inter block search is extended to the whole picture using hash-based techniques. Hash-based inter search Hash-based search is applied only to 2N×2N blocks. An eighteen bit hash based on original pixels is used The first 2 bits are determined by the block size The remaining 16 bits are determined by the original pixels. Multimedia Processing Lab,UTA

SCC – Palette mode (1) Palette coding is based on Procedure
For screen content, a limited number of distinct color values may exist. Samples in the CU are represented by a small set of representative color values. This set is referred to as the palette. Procedure Palette derivation Coding of the palette entries palette indices Samples 2,0,3 are palette entries to the palette table and sample 4 has an escape color. Multimedia Processing Lab,UTA

SCC – Palette mode (2) N K Palette derivation
A Palette refers to a table consisting of representative color values. Each entry consists of three components (RGB or YCbCr). ESCAPE index indicates that a sample does not belong to the palette. First sample of the block is added to the palette. For subsequent sample, SAD from palette entries is calculated. If SAD is larger than a threshold, the sample is added as a new palette entry. Thus, N color sets reduces to K sets (K ≤ N) N K Multimedia Processing Lab,UTA

SCC – Palette mode (3) Coding Palette Entries
palette table is coded using a combination of prediction from palette entries of previously coded CUs and new palette entries that are explicitly signalled. For each entry, a flag is signalled to specify whether it is reused. The collection of flags is coded by run-length coding & exponential Golomb code of order 0. Palette table is updated after coding CU. J. Xu, R. Joshi, and R.A. Cohen, "Overview of the Emerging HEVC Screen Content Coding Extension," IEEE Trans. on CSVT, vol. 26, no. 1, pp , Jan Multimedia Processing Lab,UTA

SCC – Palette mode (4) Coding Palette Indices
INDEX mode: index is coded by truncated binary code & followed by run value COPY_ABOVE mode: index is copied from the previous row ESCAPE mode: uses the pixel value as it is. The mode index and quantized pixel value are coded. L. Guo, et al., "Color palette for screen content coding," IEEE ICIP, pp , Oct Multimedia Processing Lab,UTA

SCC – Adaptive Color Transform (ACT)
For screen content, many image blocks contain different features For those blocks, coding directly in the RGB color space may be more effective. Encoder Decoder Multimedia Processing Lab,UTA

SCC – Adaptive motion vector resolution (AMVR)
Since screen content has a granularity of one or more samples, it is not necessary to use fractional motion compensation. In HEVC-SCC, a slice-level control is enabled to switch the motion vectors between full-pel and fractional pel resolutions. Savings in bit-rate can be achieved by not signaling the fractional portion of the motion vectors. To decide the MV precision, blocks are classified into C: number of blocks matching with collocated block S: number of blocks not matching with collocated block but belong to smooth region M: Number of blocks not belonging to C or S but can find a matching block by hash value MV precision is determined , for example If CSM_rate < 0.8, use quarter-pel MV Otherwise, use integer-pel MV Multimedia Processing Lab,UTA

Sample-based weighted prediction with directional template matching (SWP-DTM)
a weighted averaging of neighboring pixels for intra-prediction of the current pixel. The predicted pixel is calculated as With the weighted/averaged prediction, sharpness may be lost by averaging effect. Thus, another compromising prediction technique, directional template matching (DTM) has to be introduced, by selecting the minimum SAD patch within the support area. E. Wige, et al., "Sample-based weighted prediction with directional template matching for HEVC lossless coding," IEEE PCS, pp , Dec Multimedia Processing Lab,UTA

Sample-based angular intra prediction with edge prediction (SAP-EP)
In HEVC, the total number of intra prediction modes is 35, including Mode 0 for INTRA_PLANAR, Mode 1 for INTRA_DC, and Mode 2 to 34 for INTRA_ANGULAR. For the case of the PLANAR mode, an edge predictor is proposed: For smooth regions, more efficiency is achieved by taking median values of adjacent five pixels V. Sanchez, "Lossless screen content coding in HEVC based on sample-wise median and edge prediction," IEEE International Conference on Image Processing (ICIP), pp , 2015. Multimedia Processing Lab,UTA

SCC - Implementation Simulations were conducted to evaluate the new coding tools in HEVC-SCC and compare them with HEVC-Rext and H.264/AVC . Test models SCM5.2, HM16.6 and JM19.0 were used for HEVC-SCC, HEVC-RExt and H.264/AVC respectively. 4:4:4 YUV sequences were used 10 frames for each test sequence were used For lossless coding, QP values was set to 0, & for lossy coding, four QPs (22, 27, 32, 37) were applied All the simulations were carried out in All Intra (AI) mode Intel Core 1.7GHz operating on 64-bit was used. S.C. Kodpadi, Evaluation of coding tools for screen content in high efficiency video coding, MS thesis, UTA, Dec Multimedia Processing Lab,UTA

SCC - Implementation Configuration
SCM5.2 (HEVC+SCC) : encoder_intra_main_scc (Lossless- CostMode:lossless, along with several other parameters) HM16.6 (HEVC+RExt): encoder_intra_main_rext JM19.0 (H.264/AVC): HM-like (encoder_JM_Intra_HE) In SCM5.2, each coding tool was disabled one by one to evaluate and analyse how each tool contributes to the performance of the encoder. IBC, PM and ACT were the coding tools. In the following slides we can observe the coding efficiency in terms of bitrate savings of each coding tool and also the comparison between SCC and RExt and between SCC and AVC. S.C. Kodpadi, Evaluation of coding tools for screen content in high efficiency video coding, MS thesis, UTA, Dec Multimedia Processing Lab,UTA

SCC - Results S.C. Kodpadi, Evaluation of coding tools for screen content in high efficiency video coding, MS thesis, UTA, Dec Multimedia Processing Lab,UTA

Comparison of original image (left) and HEVC encoded image (right) Lossless compression ratio 3.11::1 encoded 721 frames in s (2.79 fps), kb/s HEVC Main 8 Multimedia Processing Lab,UTA

Comparison of original image (left) and HEVC encoded image (right) Lossless compression ratio 3.76::1 encoded 210 frames in s (0.11 fps), kb/s HEVC Main 8 Multimedia Processing Lab,UTA

Comparison of original image (left) and HEVC encoded image (right) Intra prediction, Compression ratio 76.9::1 HEVC MSP Multimedia Processing Lab,UTA

Comparison of original image (left) and HEVC encoded image (right) Intra prediction, Compression ratio 61.5::1 HEVC MSP Multimedia Processing Lab,UTA

Comparison of original image (left) and HEVC encoded image (right) Inter prediction, Compression ratio 2.1::1 HEVC Main 10 Multimedia Processing Lab,UTA

[1] D. Flynn, J. Sole and T. Suzuki, High efficiency video coding (HEVC) range extensions text specification, Draft 4, JCT-VC, Retrieved [2] I. E. G. Richardson, H.264 and MPEG-4 video compression: Video coding for Next Generation Multimedia, New York: Wiley, 2003. [3] S. Kodpadi, "Evaluation of coding tools for screen content in High Efficiency Video Coding," Dec Click on courses and then click on EE5359. Scroll down and go to Thesis/Project Title and click on S. Kodpadi. [4] Nagashree Mundgemane N., "Multi-stage prediction scheme for screen content based on HEVC," Masters thesis at University of Texas at Alrington, 2015. [5] H. Yu, et al., "Requirements for an extension of HEVC for coding on screen content," ISO/IEC JTC 1/SC 29/WG 11 Requirements subgroup, Jan [6] J. Xu, R. Joshi, and R.A. Cohen, "Overview of the Emerging HEVC Screen Content Coding Extension," IEEE Trans. on CSVT, vol. 26, no. 1, pp , Jan [7] C. Lan, et al., "Intra and inter coding tools for screen contents," JCTVC-E145, Mar [8] D. Milovanovic and Z. Bojkovic, "Development of mixed screen content coding technology : SCC-HEVC Extensions Framework," Proc. of the 13th Int. Conf. on Data Networks, Communications, Computers (DNCOCO'15), pp , Budapest, Hungary, Dec [9] ISO/IEC JTC1/SC29/WG11 and ITU-T SG16 Q6/16, "Joint Call for Proposals for Coding of Screen Content," 17 Jan [10] H. Yu, et al., "Common conditions for screen content coding tests," JCTVC – U1015-r2, June 2015. [11] ISO/IEC JTC1/SC29/WG11 N14399, "Results of CfP on Screen Content Coding Tools for HEVC," Apr [12] ISO/IEC JTC1/SC29/WG11 N15779, "HEVC Screen Content Coding Test Model 6 (SCM 6)," Oct [13] R. Joshi, et al., "High Efficiency Video Coding (HEVC) Screen Content Coding: Draft 5," JCTVC-V1005, Oct [14] Access to JCT-VC documents, " [Online]. [15] Test sequences for SCC, " [Online]. [16] HEVC SCC Extension Reference Software, " [Online]. [17] HEVC SCC Software reference manual, " [Online]. [18] Y.-J. Ahn, et al., "Analysis of Screen Content Coding Based on HEVC," IEIE Trans. on Smart Processing and Computing, vol. 4, no. 4, pp , Aug [19] W. Zhu, et al., "Hash-Based Block Matching for Screen Content Coding," IEEE Trans. on Multimedia, vol. 17, no. 7, pp , July 2015. [20] X. Xu, et al., "Block Vector Prediction for Intra Block Copying in HEVC Screen Content Coding," IEEE Data Compression Conference (DCC), pp , 2015. Multimedia Processing Lab,UTA

[21] L. Guo, et al., "Color palette for screen content coding," IEEE ICIP, pp , Oct [22] X. Xiu, et al., "Palette-based Coding in the Screen Content Coding Extension of the HEVC Standard," IEEE Data Compression Conference (DCC 2015), pp , April 2015. [23] L. Zhang, et al., "Adaptive Color-Space Transform for HEVC Screen Content Coding," IEEE Data Compression Conference (DCC), pp , 2015. [24] H. S. Malvar, G. J. Sullivan, and S. Srinivasan, "Lifting-based reversible color transformations for image compression," SPIE Applications of Digital Image Processing, vol. 7073, Aug [25] M. Wien, High efficiency video coding: Coding tools and specification, Springer, 2015. [26] Y.-L. Lee, K.-H. Han, and G.J. Sullivan, "Improved lossless intra coding for H.264/MPEG-4 AVC," IEEE Trans. on Image Processing, vol. 15, no. 9, pp , Sept [27] S. Lee, I.-K. Kim and C. Kim, "Residual DPCM for HEVC lossless coding," JCTVC-M0079, 13th JCT-VC meeting, Incheon, KR, Apr [28] K. Kim, J. Jeong, and G, Jeon, "Improved residual DPCM for HEVC lossless coding," 27th SIBGRAPI Conf. on Graphics, Patterns and Images, pp , Aug [29] M. Naccari, et al., "Improving inter prediction in HEVC with residual DPCM for lossless screen content coding," IEEE PCS, pp , San Jose, CA, Dec [30] E. Wige, et al., "Sample-based weighted prediction with directional template matching for HEVC lossless coding," IEEE PCS, pp , Dec [31] V. Sze, M. Budagavi, and G.J. Sullivan, High efficiency video coding (HEVC): Algorithms and architectures, Springer, 2014. [32] M. Zhou, et al, "HEVC lossless coding and improvements," IEEE Trans. Circuits and Systems for Video Tech., vol. 22, no. 12, pp , Dec [33] Y. H. Tan, C. Yeo and Z. Li, "Residual DPCM for lossless coding in HEVC," Proc. IEEE Int. Conf. Acoustics, Speech Signal Processing (ICASSP), pp , May 2013. [34] V. Sanchez, et al., "HEVC-based Lossless Compression of Whole Slide Pathology Images," Proc IEEE Global Conference on Signal and Information Processing (GlobalSIP), pp , Dec [35] V. Sanchez, "Lossless screen content coding in HEVC based on sample-wise median and edge prediction," IEEE International Conference on Image Processing (ICIP), pp , 2015. [36] V. Sanchez, "Fast intra-prediction for lossless coding of screen content in HEVC," 2015 IEEE Global Conference on Signal and Information Processing (GlobalSIP), pp , 2015. [37] B. Li and J. Xu, "A Fast Algorithm for Adaptive Motion Compensation Precision in Screen Content Coding," Data Compression Conference (DCC), pp , 2015. . Multimedia Processing Lab,UTA

[38] B. Li, J. Xu, and F. Wu, "A Unified Framework of Hash-based Matching for Screen Content Coding," IEEE VCIP'14, pp , Dec. 7-10, 2014. [39] M. Zhang, Y. Guo, and H. Bai, "Fast intra partition algorithm for HEVC screen content coding," IEEE Visual Communications and Image Processing Conf., pp , 2014. [40] F. Duanmu, Z. Ma, and Y. Wang, "Fast CU partition decision using machine learning for screen content compression," IEEE Int. Conf. on Image Processing (ICIP), pp , 2015. [41] G. Bjontegaard, "Calculation of average PSNR differences between RD-curves," ITU-T SG 16 Q 6, VCEG-M33, Mar [42] J. Ma and D. Sim,, "Early Termination of Block Vector Search for Fast Encoding of HEVC Screen Content Coding," IEIE Trans. on Smart Processing and Computing, vol. 3, no. 6, pp , Dec [43] D.–K. Kwon and M. Budagavi, "Fast intra block copy (intra BC) search for HEVC Screen Content Coding," IEEE ISCAS, pp. 9-12, June 2014. [44] D. Lee, et al., "Fast transform skip mode decision for HEVC screen content coding," IEEE Int. Symp. on Broadband Multimedia Systems and Broadcasting (BMSB), pp. 1-4, 2015. [45] S.–H. Tsang, Y.–L. Chan and W.–C. Siu, "Fast and Efficient Intra Coding Techniques for Smooth Regions in Screen Content Coding Based on Boundary Prediction Samples," IEEE ICASSP, pp , Brisbane, Australia, Apr [46] Y.-W. Chen, et al., "SCCE3 Test D.1: Single color intra mode for screen content coding," JCTVC of ITU-T SG 16 WP 3 and ISO/IEC JTC1/SC29/WG11, JCTVCR0058, Sapporo, Japan, June-July 2014. [47] X. Zhang, R. A. Cohen and A. Vetro, "Independent Uniform Prediction mode for screen content video coding," IEEE Visual Communications and Image Processing Conference, pp , 7-10 Dec [48] X. Zhang, and R. Cohen, "SCCE3 Test D.2: Independent Uniform Prediction (IUP) Mode," JCT-VC of ITU-T SG 16 WP 3 and ISO/IEC JTC1/SC29/WG11, JCTVC-R0200, Sapporo, Japan, June-July 2014. [49] Z. Wang, et al., "Image quality assessment: From error visibility to structural similarity," IEEE Trans. on Image Processing, vol. 13, no. 4, pp , Apr [50] J. Zhu and N. Wang, "Image quality assessment by visual gradient similarity," in Proceedings of the IEEE Trans. of Image Processing, vol. 21, no. 3, pp , 2012. [51] D. M. Chandler, "Seven challenges in image quality assessment: Past, present, and future research," ISRN Signal Process., vol. 2013, pp. 1-53, 2013. [52] H. Yang, Y. Fang and W. Lin, "Perceptual Quality Assessment of Screen Content Images," IEEE Trans. on Image processing, vol. 24, no. 11, pp , Nov [53] SIQAD(Perceptual Quality Assessment of Screen Content Images), " [Online]. [54] Z. Pan, et al.,, "A low-complexity screen compression scheme for interactive screen sharing," IEEE Trans, Circuits Syst. Video Technol., vol. 23, no. 6, pp , June 2013. [55] S. Wang, et al., "Content-aware layered compound video compression," IEEE ISCAS, pp , 2012. . Multimedia Processing Lab,UTA

[56] A. Risnumawan, et al., "A robust arbitrary text detection system for natural scene images," Expert Systems with Applications, vol. 41, no. 18, pp , Dec [57] S. Wang, et al., "Perceptual screen content image quality assessment and compression," IEEE Int. Conf. on Image Processing (ICIP), pp , 2015. [58] K. Gu, et al., "Screen image quality assessment incorporating structural degradation measurement," IEEE Int. Symp. on Circuits and Systems (ISCAS), pp , 2015[59] S. Shi, et al., "Study on subjective quality assessment of Screen Content Images," IEEE Picture Coding Symposium (PCS), pp , 2015. [60] H. Yang, et al., "Subjective quality assessment of screen content content images," International Workshop on Quality of Multimedia Experience (QoMEX), pp , 2014. [61] T. Lin and P. Hao, "Compound Image Compression for Real-Time Computer Screen Image Transmission," IEEE Trans. on Image Processing, vol. 14, no. 8, pp , Aug [62] S. Minaee and Y. Wang, "Screen content image segmentation using least absolute deviation fitting," IEEE Int. Conf. on Image Processing (ICIP), pp , 2015. [63] Y. Li and G.R. Arce, "A maximum likelihood approach to least absolute deviation regression," EURASIP Journal on Applied Signal Processing, pp , Sept [64] B. Li, et al., "Lambda Domain Rate Control Algorithm for High Efficiency Video Coding," IEEE Trans. on Image Processing, vol. 23, no. 9, p. 3841–3854, Sept [65] T. Chiang and Y.-Q. Zhang, "A new rate control scheme using quadratic rate distortion model," IEEE Trans. on CSVT, vol. 7, no. 1, pp , Jan [66] Y. Guo, et al., "Rate control for screen content coding in HEVC," IEEE Int. Symp. on Circuits and Systems (ISCAS), pp , 2015. [67] W. Xiao, et al., "Weighted rate-distortion optimization for screen content coding," IEEE Trans. on CSVT, 2016 (Early Access). [68] P. Tao, et al., "Improvement of re-sample template matching for lossless screen content video," IEEE International Conference on Multimedia and Expo (ICME), pp. 1-6, 2015. [69] K. Zhang, et al., "Symmetric intra block copy in video coding," IEEE International Symposium on Circuits and Systems (ISCAS), pp , 2015. [70] S.-H. Tsang, Y.-L. Chan, and W.-C. Siu, "Hash based fast local search for Intra Block Copy (IntraBC) mode in HEVC screen content coding," Asia-Pacific Signal and Information Processing Association Annual Summit and Conference (APSIPA), pp , [71] H. Chen, et al., "Improvements on Intra Block Copy in natural content video coding," IEEE International Symposium on Circuits and Systems (ISCAS), pp , 2015. [72] C. Pang, et al., "Intra Block Copy for HEVC Screen Content Coding," IEEE Data Compression Conference (DCC), p. 465, 2015. . Multimedia Processing Lab,UTA

[73] J. Fan, et al., "Inter-frame Correlation Based Quantization Parameter Offset Optimization for Screen Content Video Coding," IEEE International Conference on Multimedia Big Data (BigMM), pp , 2015. [74] L. Zhao, et al., "Pseudo 2D String Matching Technique for High Efficiency Screen Content Coding," IEEE Transactions on Multimedia, vol. 18, no. 3, pp , 2016. [75] V. Sanchez, "Sample-based edge prediction based on gradients for lossless screen content coding in HEVC," IEEE Picture Coding Symposium (PCS), pp , 2015. [76] J.-W. Kang, "Sample selective filter in HEVC intra-prediction for screen content video coding," IET Journals & Magazines, vol. 51, no. 3, p. 236–237, Feb [77] J.-W Kang, "Structured sparse representation of residue in screen content video coding," Electronics Letters, vol. 51, no. 23, pp , 2015. [78] C. Lan, G. Shi, and F. Wu, "Compress compound images in H.264/MPGE-4 AVC by exploiting spatial correlation," IEEE Trans. on Image Processing, vol. 19, no. 4, pp , 2010. [79] S. Wang, et al., "Joint Chroma Downsampling and Upsampling for screen Content Image," IEEE Trans. on CSVT (Early Access).. [80] T. Vermeir, et al., "Guided Chroma Reconstruction for Screen Content Coding," IEEE Trans. on CSVT, vol. 26, no. 10, pp , Oct [81] J.-Y. Kao, et al., "Improved transform skip mode for HEVC screen content coding," Int. Conf. on Image Processing Theory, Tools and Applications (IPTA), pp , 2015. [82] D. Flynn, et al., "Overview of the Range Extensions for the HEVC Standard: Tools, Profiles, and Performance," IEEE Trans. on CSVT, vol. 26, no. 1, pp. 4-19, Jan 2016. [83] F. Zou, et al., "Hash Based Intra String Copy for HEVC Based Screen Content Coding," IEEE ICME, Torino, Italy, June 2015. [84] X. Xu, et al., "Intra Block Copy in HEVC Screen Content Coding Extensions," IEEE J. of Emerging Selected Topics in Circuits and Systems, vol. PP, no. 99, pp. 1-11, 2016. [85] C. C. Chen and W. H. Peng, "Intra Line Copy for HEVC Screen Content Coding," IEEE Trans. on CSVT, vol. PP, no. 99, 2016 (Early Access). [86] S. Wang, et al., "Just Noticeable Difference Estimation for Screen Content Images," IEEE Trans. on Image Processing, vol. 25, no. 8, pp , 2016. [87] H. Zhang, et al., "Fast intra mode decision and block matching for HEVC screen content compression," IEEE ICASSP, pp , 2016. [88] F. Duanmu, et al., "A novel screen content fast transcoding framework based on statistical study and machine learning," IEEE ICIP, pp , 2016. . Multimedia Processing Lab,UTA

[89] C. Chen, et al, "A staircase transform coding scheme for screen content video coding," IEEE ICIP, pp , 2016. [90] K.R. Rao and P.C. Yip, The transform and data compression handbook, CRC Press, 2001. [91]W. –H. Peng et al, “ Overview of screen content video Coding Technologies, standards and Beyond, “ IEEE JETCAS, vol. 6, issue 4, pp , Dec. 2016 Multimedia Processing Lab,UTA

A TUTORIAL on HEVC K.R. Rao, IEEE Fellow Electrical Engineering Dept

Similar presentations

Presentation on theme: "A TUTORIAL on HEVC K.R. Rao, IEEE Fellow Electrical Engineering Dept"— Presentation transcript:

Similar presentations

About project

Feedback

Log in

Auth with social network:

A TUTORIAL on HEVC K.R. Rao, IEEE Fellow Electrical Engineering Dept

Similar presentations

Presentation on theme: "A TUTORIAL on HEVC K.R. Rao, IEEE Fellow Electrical Engineering Dept"— Presentation transcript:

Similar presentations

About project

Feedback