1. Burleson, UMASS1 Adaptive System on a Chip (ASOC): A Backbone for Power-Aware Signal Processing Cores Andrew Laffely, Jian Liang, Russ Tessier and Wayne Burleson Electrical and Computer Engineering University of Massachusetts Amherst {burleson}@ecs.umass.edu This material is based upon work supported by the National Science Foundation under Grant No. 9988238 and SRC Tasks 766 and 1075

2. Burleson/UMASS2 Challenges in Media Processing Increasingly complex, heterogeneous algorithms Variable run-times (e.g. data-dependent iterations) Variable quality Variable power consumption Large data-sets, usually streaming Memory size, ports and latency issues Advancing semiconductor technology (Moore’s Law) Interconnect (on-chip and I/O) Clocking Power (consumption and distribution) Design and Verification

3. Burleson/UMASS3 aSoC: adaptive System on a Chip Tiled SoC architecture DCT VLE MemoryViterbiFIR EncryptControl Motion Estimation and Compensation

4. Burleson/UMASS4 aSoC: adaptive System on a Chip Tiled SoC architecture Supports the use of independently developed heterogeneous cores Pick and place cores which best perform the given application Increase performance Save power Cores may be any number of tiles in size DCT VLE MemoryViterbiFIR EncryptControl Motion Estimation and Compensation

5. Burleson/UMASS5 aSoC: adaptive System on a Chip Tiled SoC architecture Supports the use of independently developed heterogeneous cores Connected with an interconnect mesh Restricted to near neighbor communications Creates pipeline Decreases cycle time DCT VLE MemoryViterbiFIR EncryptControl Motion Estimation and Compensation

6. Burleson/UMASS6 aSoC: adaptive System on a Chip Tiled SoC architecture Supports the use of independently developed heterogeneous cores Connected with an optimized fixed interconnect mesh Using a communication interface (CI) to manage data Network port (Coreport) for each core, I/O queues,handshake Each CI uses a memory and FSM to repetitively process a predefined (static) schedule of communications High-speed 5x5 bidirectional crossbar DCT VLE MemoryViterbiFIR EncryptControl Motion Estimation and Compensation

7. Burleson/UMASS7 Communication Interface Custom design to maximize speed and reduce power Core-ports Crossbar Controller Instruction memory Local frequency and voltage supply Core Core-ports Decoder Local Frequency & Voltage North to South & East Instruction Memory PC Controller North South East West Local Config. North South East West Inputs Outputs Crossbar

8. Burleson/UMASS8 aSoC Implementation and Integration 3000 2500.18  TSMC technology Full custom

9. Burleson/UMASS9 Research Thrusts aSoC Infrastructure 1,3 Communication Interface Interconnect 3 Power Distribution Clock System Power Management Design Technology Compiler 1,3 (Partitioner, Mapper, Placer, Scheduler) Simulator 1 Cores Motion estimation 2,3 Discrete Cosine Transform 2,3 AES Cryptography 3 Huffman Coding Adaptive Viterbi 2,3 3D Graphics 1,2,3 Smart Card 2,3 MP3 ARM DSP Cache 2,3 FPGA MAC 1 PhD Dissertation 2 Masters Thesis 3 Publications

10. Burleson/UMASS10 Voltage Scaling Approach Core-ports Single buffer for each stream to cross clock/voltage barrier between core and interface Reading/Writing success rates indicate core utilization Input blocked: Core too slow Output blocked: Core too fast Controller Interprets core-port success rates to adjust local clock and voltage Interconnect Buffer Input Core-port Output Core-port Core Clock and Supply Controller Local Vdd Local Clock Blocked Processing Pipeline

11. Burleson/UMASS11 Vdd Selection Criteria 0.40.60.811.21.41.61.82 0 2 4 6 8 10 12 Voltage Normalized Delay 0.73 As Vdd decreases delay increases exponentially Use curve to match available clock frequencies to voltages The voltage and frequency change reduces power by 79%, 96%, and 98.7% P =  C(Vdd) 2 f Normalized Core Critical Path Delay vs. Vdd Max Speed 1/4 Speed 1/2 Speed 1/8 Speed 1.16

12. Burleson/UMASS12 Architecture Evaluation (Motion Estimation) Array-based architecture Pipelined ME Parameterized search window size Full search Choose 16x16 or 8x8 windows Reduce power Address Generation Unit Processing Element Array Memory FIFOs

13. Burleson/UMASS13 Power Aware Core Custom motion estimation core Choose search method Full search 960-600mW (bit width and pel sub-sampling) Spiral search 76mW Three step search 25mW Data taken with Synopsys TM Power Compiler at the RTL level

14. Burleson/UMASS14 aSoC Support Multiple streams in and out through dedicated core ports Easy to manage on both sides of the port Schedule configuration streams in with the data Stream A: Input Frame Stream B: Configuration (Choose search mode and size) Stream C: Motion Vectors Motion Estimation Core in1in2out2out1 Stream A Stream B Stream C Coreports

15. Burleson/UMASS15 Reconfigurable Interconnect P-frame I-frame MEMC - +  Input Frame DCT Input Frame DCT

16. Burleson/UMASS16 aSoC Support Lumped ME, MC and Summation into one double core DCT Motion Estimation & Compensation

17. Burleson/UMASS17 aSoC Support: P-Frame Input Frame (Stream A) DCT Motion Estimation & Compensation Difference Frame (Stream B)

18. Burleson/UMASS18 aSoC Support: Schedule Change Input Frame (Stream A) DCT Motion Estimation & Compensation Difference Frame (Stream B) Configuration Streams (C & D)

19. Burleson/UMASS19 aSoC Support: Schedule Change Input Frame (Stream A) DCT Motion Estimation & Compensation Difference Frame (Stream B) Configuration (Streams C) Schedule 1 Schedule 2 PC

20. Burleson/UMASS20 aSoC Support: Schedule Change Input Frame (Stream A) DCT Motion Estimation & Compensation Difference Frame (Stream B) Configuration (Streams C) Schedule 1 Schedule 2 PC

21. Burleson/UMASS21 aSoC Support: Schedule Change Input Frame (Stream A) DCT Motion Estimation & Compensation Configuration (Streams D) Schedule 1 Schedule 2 PC

22. Burleson/UMASS22 aSoC Support: Schedule Change Input Frame (Stream A’) DCT Motion Estimation & Compensation Configuration (Streams D) Schedule 1 Schedule 2 PC

23. Burleson/UMASS23 aSoC Support: I-Frame Input Frame (Stream A’) DCT Motion Estimation & Compensation OFF

24. Burleson/UMASS24 Operating Frequency? Interconnect synchronized H-tree clock distribution Core frequencies depend on critical path Tile provides clock reference Coreport provides asynchronous boundary Dynamic core configuration requires dynamic clock configuration aSoC clock reference provides multiples of interconnect clock (… 4x, 2x, 1x, 0.5x, 0.25x, …) Configured through the tile controller

25. Burleson/UMASS25 Clock Distribution 64 tile aSoC70nm100nm130nm180nm Chip Area(9.24mm) 2 (13.3mm) 2 (17.2mm) 2 (23.8mm) 2 Frequency5 GHz2 GHz1 GHz0.5 GHz Power126 mW240 mW445 mW784 mW Mean Skew41 ps50 ps92 ps70.6 ps Percent Skew21 %10 %9 %4 % Tile Tiled architecture extends life of globally synchronous systems Precise H-tree implementation Load is small and equal at each branch Skew can be reduced by 70% with advanced deskew circuits 1 1 S. Tan et al. “Clock Generation and Distribution for the First IA-64 Microprocessor” IEEE JSSC, Nov. 2000

26. Burleson/UMASS26 Mixed vs. Fixed Core Frequencies Cores not designed with clock gating Core power from Synopsys RTL simulation Interconnect from SPICE Assumes 10 cycle schedule, 4 pixels/word

27. Burleson/UMASS27 Current Density and Clocking Red: fixed worst case clocking Short spikes of high current Green: optimal independent clocking Slow and low Optimal clocking eliminates current spikes (also improved battery life) DeadlineProcess Start ME: Full Search ME: Spiral ME: Three Step Search DCT Time Current

28. Burleson/UMASS28 Power Distribution 64 tile aSoCVhVh V mh V ml VlVl Voltage1.8V1.16V0.73V0.6V Current per Core 110mA25mA13mA7mA Total Power12.1 W1.86 W607 mW269 mW Heterogeneous power-aware cores require multiple power supply voltages Tile structure enables uniform interwoven grid Larger grid for higher current demands Reduced resistance Higher capacitance Gnd VhVh VlVl V ml V mh

29. Burleson/UMASS29 Advanced Signaling Techniques (building on SRC-funded work) Differential current sensingBooster Insertion Multi-level current signaling Phase coding

30. Burleson/UMASS30 Interconnect Characterization: Comparing delay and power of signaling techniques for different tile sizes at 250nm, 180nm, 130nm, 100n (available via web-based tool Network on Chip Interconnect Calculator NOCIC)

31. Burleson/UMASS31 Conclusions Regular Tiled Architecture Task-based parallelism using heterogeneous cores Predictable interconnect Regular core interface, Vdd and clock control, and configuration control Static scheduling High-level global schedule of inter-core communication Accomodates dynamic workloads with queues and local handshakes Demonstration using Motion Estimation and DCT Variable search window and search algorithm provide power/quality tradeoff Power savings using scalable approaches to dynamic clock and power variation Simple clock dividers leveraging existing clock distribution methods Route multiple power supplies to allow rapid switching and avoid overhead of on-chip power regulation

32. Burleson/UMASS32 Ongoing Work Satellite Set-top Box application Developed at Hughes Networks using 7 distinct RISC cores. Compare ASOC with in-house shared memory approach for interconnections. New and more complete wireless and multimedia systems Jpeg2000, mpeg-4, 3d Graphics, … ASOC parameter optimization Tile sizes, bus widths, clocks, VDDs Coping with Core irregularity Size, I/O positions, shapes, bus widths, communication interfaces Interconnect circuit optimization (NoCIC) Leakage Power issues Reliability, Test, Fault-Tolerance and Security Compilation: especially Partitioning, Mapping Prototypes:.18u MOSIS of communication interface, ~25K transistors, verification of interface logic and timing ASOC in Education: Circuits, architecture and core design projects

33. Burleson/UMASS33 Implications (perhaps controversial ) Multi-core architectures will be needed to maintain Moore’s law (interconnect, memory, parallelism) Task-based parallelism may be easier to program, extract and implement than data parallelism (think multi-core rather than instruction level parallelism) Global coarse synchronization provides an approach to hard-real time computing for dynamic workloads (ie video coding). Dynamic Power savings exploiting fine-grain workload variations can be achieved through straightforward clock and power scaling methods. Interconnect standards will be specified by silicon foundries similar to cell libraries and memories

34. Burleson/UMASS34 Design Flow http://vsp2.ecs.umass.edu/vspg/658/TA_Tools/design_flow.html Architecture to Layout Architecture: Block diagram of system and behavioral description Logic: Gate level or schematic description Circuit: Transistor configurations and sizings Layout: Floorplanning, clock and power distribution Tools VerilogXL: behavioral representation VTVT: standard cell library Synopsys: standard cell gate level netlist generation Silicon Ensemble: standard cell netlist to layout Cadence LayoutPlus: schematic and layout design NCSU CDK: design and extraction rules Cadence Layout vs. Schematic: layout verification HSPICE: circuit simulator