1. Dynamically Parameterized Architectures for Power Aware Video Coding: Motion Estimation and DCT Wayne Burleson (burleson@ecs.umass.edu) Prashant Jain (pjain@ecs.umass.edu) Subramanian Venkatraman (svenkatr@ecs.umass.edu) Dept. of Electrical and Computer Engineering University of Massachusetts Amherst This work was partially supported by NSF-9988238

2. Outline Introduction Video Content Variation Dynamic Parameterization to achieve Power-Aware Video Coding Motion Estimation & DCT On-Going Work

3. Introduction Video Content and processing are non-uniform in space and time. Video processing can gracefully degrade in power constrained environments. Exploits Perceptual tolerance. MPEG-4. High level algorithm changes affect power efficiency the most.

4. Recent Work Configurable FPGA based Architectures [Villasenor ‘95]. Heterogeneous architecture with Programmable Processors [Kneip ‘98]. Heterogeneous Configurable architecture with on-chip low- power FPGA [Zhang ‘00]. FPGAs Slow High power dissipation

5. Adaptive System-On-a-Chip (aSOC) Partially Predefined Configuration Architecture Heterogeneous tiles with Statically scheduled interconnection switches Tiles can be reconfigured internally as well as from an external source uP DSP RISC RAM ME/DCT Core SRAM Switch Switch Memory FPGA Ref. J. Liang et. al., aSOC: A Scalable, Single-Chip Communications Architecture in the Proceedings of the IEEE International Conference on Parallel Architectures and Compilation Techniques, 2000

6. Outline Introduction Video Content Variation Dynamic Parameterization Motion Estimation & DCT On-Going Work

7. Content Variation across sequences

8. Content Variation in Time Horizontal Component of the Motion Vectors

9. Content Variation in Space Background: Not much variation High variation

10. Outline Introduction Content Variation Dynamic Parameterization Motion Estimation & DCT On-Going Work

11. Dynamic Parameterization Functional parameters vary the output of a computation. Architectural parameters allow trade-offs in area, performance, power and reliability. Parameters can be bound at varying stages. Standard Time IP TimeRun-Time Config. Time Compile/ Boot Time Design Time Years…Months…Secs…msecs…  secs…

12. Dynamic Parameter Adjustment System Requirements and Constraints Signal statistics from the Input Signals Algorithm statistics from the post processing of the Input Signals Algorithm Architecture Predictor Archi. Para. Function. Para. Signals Precision, Quality, Compress. Algo. & Archi. Stats. Signal Stats. Area Speed Power Area, Latency, Power Predictor Inputs Predictor Outputs Architectural and Functional Parameters Signal Processing System

13. Functional Parameter Adjustment: Algorithms Full SearchLogarithmic AlgorithmsCompressionFrames encoded/sec (fps) Full Search70:10.2 Logarithmic50:12.76

14. Functional Parameter Adjustment: Search Space Larger search space improves chances of a good match. A Good match Increasing search space is effective up to a point Larger search space increases computations. High Compression bpp Plot for a specific sequence

15. Power versus Search Area Memories – Major contributors to Power dissipation. Algorithms presented reduce memory accesses and computations. Our novel architecture reconfigures to different algorithms with reduced memory accesses and computations, thus saving power.

16. Power Consumption in Video Coding Ref. Peter Kuhn, “Algorithms, Complexity Analysis and VLSI Architectures for MPEG-4 Motion Estimation” Computation (%) ME DCT IDCT VLC, etc.

17. Outline Introduction Content Variation Dynamic Parameterization Motion Estimation & DCT On-Going Work

18. Functional Parameter: Full Search Selects the most representative block from an exhaustive set of candidate blocks within a search window.

19. Functional Parameter: Spiral Search Performs a Spiral Search for the matching block. Algorithm is data dependent during run-time.

20. Functional Parameter : 3-Step Search

21. Functional Parameter: Pel Subsampling 16x16 Pixel Array 4:1 Subsampling2:1 Subsampling

22. Functional Parameter: Half-Pel ME Current and Previous block data can be filtered to Half-Pel resolution. Ref. Peter Kuhn, “Algorithms, Complexity Analysis and VLSI Architectures for MPEG-4 Motion Estimation” A DC B a c b a= (A+B+C+D)/2 b= (B+D)/2 c= (C+D)/2

23. I/O Re-use Current Block Candidate Blocks Candidate blocks differ by a single row of pixels Can reuse the previous rows of pixels Previous rows are stored in FIFOs

24. Matching Criteria The Matching Criteria used is Sum of Absolute Differences (SAD). Ref. Peter Kuhn, “Algorithms, Complexity Analysis and VLSI Architectures for MPEG-4 Motion Estimation”

25. Proposed Architecture for Dynamically Parameterized ME 16x16 PE Array Address Generator Unit SRAM External to PE Array Memory Block Summing Block PE RAM Addresses PE Control 307, 200 bytes/frame storage

26. Architecture: Processing Element (PE) |c-p| Local Control Sum of Absolute Differences Half-Pel FIFO Current Pixel &  256 bytes

27. Outline Introduction Content Variation Dynamic Parameterization Motion Estimation & DCT On-Going Work

28. Discrete Cosine Transform Integral part of any still-image or video compression system. Compute intensive - next only to motion estimation. Amenable to VLSI implementation – “Decomposition” property and “Distributed Arithmetic”.

29. Decomposition Property 1D DCT in matrix notation 2D DCT~ 2 1D DCTs Ref. W.H. Chen at al., “A Fast Computational Algorithm for the Discrete Cosine Transform”, IEEE Trans. Commun.,

30. Distributed Arithmetic A0 A1 A1+A0 A2 A3+A2+A1 A3+A2+A1+A0 + Result X0 0 X0 1 X0 2 X0 3 X1 0 X1 1 X1 2 X1 3 X2 0 X2 1 X2 2 X2 3 X3 0 X3 1 X3 2 X3 3 4 to 16 Address Decoder X2 Bit-serial arithmetic using Read Accumulate Computation (RAC) unit Inner product computation of coefficient vector A and input vector X Facilitates variable- precision processing Ref. T. Xanthopoulos et al., “A Low-Power DCT Core Using Adaptive Bitwidth and Arithmetic Activity Exploiting Signal Correlations and Quantization”, IEEE JSSC 2000

31. Exploiting Content Variation Most Significant Bit Rejection (MSBR) RAC operation disabled in the presence of spatial correlation Row Column Classification (RCC) Reduction in overall arithmetic activity by imposing upper bound on RAC cycles Replication of Arithmetic Units (RAU) Replication of the RAC units – trade-off between Power and Performance

32. Energy Efficiency Comparison Among DCT/IDCT ChipSw-Cap/sample Matsui et al.375 pF Bhattacharya et al.479 pF Kuroda et al.417 pF T. Xanthopoulos et al.128 pF Ref. T. Xanthopoulos et al., “A Low-Power DCT Core Using Adaptive Bitwidth and Arithmetic Activity Exploiting Signal Correlations and Quantization”, IEEE JSSC 2000

33. Architecture of DCT Core Ref. T. Xanthopoulos et al., “A Low-Power DCT Core Using Adaptive Bitwidth and Arithmetic Activity Exploiting Signal Correlations and Quantization”, IEEE JSSC 2000

34. Outline Introduction Video Content Variation Dynamic Parameterization to achieve Power-Aware Video Coding Motion Estimation & DCT On-Going Work

35. Implementations at the RTL, netlist and physical levels. Power estimation at the various levels mentioned above. Techniques for statistically tracking content variation. Full prototyping based on actual video workloads using a logic emulator from IKOS systems, and Extensions to other parameterized multimedia computations (e.g. 3D Graphics, natural and synthetic audio).

36. Conclusions Content variation and Dynamic Parameterization can be used to achieve power aware video coding. Proposed Motion Estimation & DCT architectures to be implemented to achieve the above.

37. Dynamically Parameterized Architectures for Power Aware Video Coding: Motion Estimation and DCT Wayne Burleson (burleson@ecs.umass.edu) Prashant Jain (pjain@ecs.umass.edu) Subramanian Venkatraman (svenkatr@ecs.umass.edu) Dept. of Electrical and Computer Engineering University of Massachusetts Amherst This work was partially supported by NSF-9988238 http://vsp2.ecs.umass.edu/vspg/publication.html