We think you have liked this presentation. If you wish to download it, please recommend it to your friends in any social system. Share buttons are a little bit lower. Thank you!
Presentation is loading. Please wait.
Published byCaden Clayburn
Modified over 2 years ago
1 Review of Chapters 3 & 4 Copyright © 2012, Elsevier Inc. All rights reserved.
2 Chapter 3 Review Baseline: simple MIPS 5-stage pipeline IF, ID, EX, MEM, WB How to exploit Instruction-Level Parallelism (ILP) to improve the performance? Pipeline CPI = Ideal pipeline CPI + Structural stalls + Data hazard stalls + Control stalls Copyright © 2012, Elsevier Inc. All rights reserved.
3 Hazards & Stalls Structural Hazards Cause: resource contention Solution: add more resources & better scheduling Control Hazards Cause: branch instructions, change of program flow Solution: loop unrolling, branch prediction, hardware speculation Data Hazards Cause: Dependences True data dependence: property of program: RAW Name dependence: reuse of registers, WAR & WAW Solution: loop unrolling, dynamic scheduling, register renaming, hardware speculation Copyright © 2012, Elsevier Inc. All rights reserved.
4 Ideal CPI Copyright © 2012, Elsevier Inc. All rights reserved. Multiple Issue
5 Loop Unrolling (pp.161) Copyright © 2012, Elsevier Inc. All rights reserved. Finds that the loop iterations were independent Uses different registers to avoid unnecessary constraints (name dependence) Eliminate extra test and branch instructions (control dependence) Interchanges the load and store instructions if possible (utilize time of stalls) Schedule the code: avoid/mitigate stalls while maintaining true data dependence
6 Branch Predication 1-bit or 2-bit predictor: local predicator Uses the past results of the branch itself as an indicator Correlated predictor: global predicator Uses the pass results of correlated branches as an indicator (m,n) predictor: Two-level predicator The number of bits in an (m, n) predictor is 2 m * n * number of prediction entries Tournament predictor: an adaptive one Combining local & global predictor together Select the right predictor for a particular branch Copyright © 2012, Elsevier Inc. All rights reserved.
7 Dynamic Scheduling Hardware rearranges the instruction execution to reduce the stalls while maintaining data flow and exception behaviors. Simple pipeline: In-order issue, in-order execution, in-order completion Dynamic scheduling: In-order issue, out-of-order execution, out-of-order execution Out-of-order execution results in WAR & WAW hazards Out-of-order completion results in unexpected exception behaviors Copyright © 2012, Elsevier Inc. All rights reserved.
8 Dynamic Scheduling Addressing WAW & WAR hazards by out-of- order execution Tomasulos Approach: Register Renaming (Reservation station, Common data bus) Issue, Execute, Write Results Basic structure of Tomasulos algorithm: PP 173 Copyright © 2012, Elsevier Inc. All rights reserved.
9 Dynamic Scheduling Addressing unexpected exception behaviors by out-of-order completion Hardware speculation: Reorder buffer(pass the results, guaranteeing in-order completion) Issue, Execute, Write Results Commit Basic structure of hardware speculation: PP 185 Now: pipeline with dynamic scheduling In-order issue, out-of-order execution, in-order completion Copyright © 2012, Elsevier Inc. All rights reserved.
10 Decreasing the CPI Multiple Issue Statically scheduled superscalar processors VLIW(very long instruction word) processors Dynamically scheduled superscalar processors See a summary table on pp. 194 Copyright © 2012, Elsevier Inc. All rights reserved.
11 Chapter 4 Review SISD (single instruction, single data) architecture Examples in Chapter 3 SIMD (single instruction, multiple data) architecture: exploiting data-level parallelism Vector architecture Multimedia SIMD instruction set extensions Graphics processing units (GPUs) Data Independence Copyright © 2012, Elsevier Inc. All rights reserved.
12 Vector Architecture Primary components: VMIPS Vector registers Vector functional units Vector load/store unit A set of scalar registers Basic structure of a vector architecture (pp. 265) Copyright © 2012, Elsevier Inc. All rights reserved.
13 Vector Architecture Execution time Length of the operand vectors; Structural hazards among the operations; Data dependencies. Convoy The set of vector instructions that could potentially execute together NO structural hazards Chaining: address data dependency in a convoy Chime The unit of time taken to execute one convoy Copyright © 2012, Elsevier Inc. All rights reserved.
14 Vector Architecture Execution time a vector sequence: m convoys, a vector length of n m * n clock cycles Copyright © 2012, Elsevier Inc. All rights reserved.
15 Vector Architecture Executes a single vector faster than one element per clock cycle Multiple Lanes Handles programs where the vector lengths are not the same as the length of the vector register Vector-Length Register: MTC1 VLR, R1 Strip mining: if the vector length is longer than MVL Handles IF statements in vector loops Vector Mask Registers: CVM, POP Supplying bandwidth for vector load/store units Memory Banks: allow multiple independent data accesses Copyright © 2012, Elsevier Inc. All rights reserved.
16 Vector Architecture Handles multidimensional arrays Stride LVWS V1, (R1, R2) SVWS (R1, R2),V1 Handles Sparse Matrices Gather-Scatter LVI V1, (R1, V2) SVI (R1,V2), V1 Programming Vector Architectures: Program structures affecting performance most of them are spent on improving memory accesses, and most of them are modifications to the vector instruction set Copyright © 2012, Elsevier Inc. All rights reserved.
17 SIMD Instruction Set Execution Observation: many media applications operate on narrower data types than the 32-bit processors were optimize for 8 bits represent each of three primary colors 8 bits for transparency Limitation Fix the number of data operands in the opcode Does not offer the more sophisticated addressing modes of vector architectures: stride & gather-scatter Does not offer the mask registers Roofline Visual Performance Model Copyright © 2012, Elsevier Inc. All rights reserved.
18 Copyright © 2012, Elsevier Inc. All rights reserved. SIMD Implementations Implementations: Intel MMX (1996) Eight 8-bit integer ops or four 16-bit integer ops Streaming SIMD Extensions (SSE) (1999) Eight 16-bit integer ops Four 32-bit integer/fp ops or two 64-bit integer/fp ops Advanced Vector Extensions (2010) Four 64-bit integer/fp ops Operands must be consecutive and aligned memory locations Generally designed to accelerate carefully written libraries rather than for compilers Advantages over vector architecture: Cost little to add to the standard ALU and easy to implement Require little extra state easy for context-switch Require little extra memory bandwidth No virtual memory problem of cross-page access and page-fault SIMD Instruction Set Extensions for Multimedia
19 Graphics Processing Units Challenges: Not simply getting good performance on the GPU Coordinating the scheduling of computation on the system processor and the GPU, and the transfer of data between system memory and GPU memory Heterogeneous architecture & computing CPU + GPU Individual memories for CPU & GPU Like a distributed system on a node CUDA or OpenCL languages Programming model is Single Instruction Multiple Thread (SIMT) Copyright © 2012, Elsevier Inc. All rights reserved.
20 Copyright © 2012, Elsevier Inc. All rights reserved. Threads, Blocks, Grids A thread is associated with each data element Threads are organized into blocks Blocks are organized into a grid GPU hardware handles thread management, not applications or OS Graphical Processing Units
21 Copyright © 2012, Elsevier Inc. All rights reserved. NVIDIA GPU Architecture Similarities to vector machines: Works well with data-level parallel problems Scatter-gather transfers Mask registers Large register files Differences: No scalar processor Uses multithreading to hide memory latency Has many functional units, as opposed to a few deeply pipelined units like a vector processor Graphical Processing Units
22 Copyright © 2012, Elsevier Inc. All rights reserved. Terminology Threads of SIMD instructions Each has its own PC Thread scheduler uses scoreboard to dispatch No data dependencies between threads! Keeps track of up to 48 threads of SIMD instructions Hides memory latency Thread block scheduler schedules blocks to SIMD processors Within each SIMD processor: 32 SIMD lanes Wide and shallow compared to vector processors Graphical Processing Units
1 Copyright © 2010, Elsevier Inc. All rights Reserved Chapter 2 Parallel Hardware and Parallel Software An Introduction to Parallel Programming Peter Pacheco.
William Stallings Computer Organization and Architecture 8 th Edition Chapter 14 Instruction Level Parallelism and Superscalar Processors.
1 Copyright © 2012, Elsevier Inc. All rights reserved. Chapter 2 M EMORY H IERARCHY D ESIGN Computer Architecture A Quantitative Approach, Fifth Edition.
Chapter 13 Instruction-Level Parallelism and Superscalar Processors.
Multithreaded Processors. Pipeline Hazards LW r1, 0(r2) LW r5, 12(r1) ADDI r5, r5, #12 SW 12(r1), r5 Each instruction may depend on the next – Without.
Scoreboarding & Tomasulos Approach Bazat pe slide-urile lui Vincent H. Berk.
Intel Redefines GPU: Larrabee Tianhao Tong Liang Wang Runjie Zhang Yuchen Zhou.
Instruction Level Parallelism Taewook Oh. Instruction Level Parallelism Measure of how many of the operations in a computer program can be performed simultaneously.
Multiprocessors Advanced Computers Architecture, UNIT 4 Flynn's classificationVector computersPipelining in Vector computersCrayMultiprocessor interconnectionGeneral.
CMSC 611: Advanced Computer Architecture Tomasulo Some material adapted from Mohamed Younis, UMBC CMSC 611 Spr 2003 course slides Some material adapted.
Graphics on a Stream Processor Peter Djeu March 20, 2003.
Spring 2003CSE P5481 Out-of-Order Execution Several implementations out-of-order completion CDC 6600 with scoreboarding IBM 360/91 with Tomasulos algorithm.
1 CSE 380 Computer Operating Systems Instructor: Insup Lee University of Pennsylvania Fall 2003 Lecture Notes: Multiprocessors (updated version)
Chapter 4 The Processor. Chapter 4 The Processor 2 Introduction CPU performance factors Instruction count Determined by ISA and compiler CPI and Cycle.
CH14 Instruction Level Parallelism and Superscalar Processors CH01 TECH Computer Science Decode and issue more and one instruction at a time Executing.
Chapter 12, William Stallings Computer Organization and Architecture 7 th Edition CPU Structure and Function.
1 Process Description and Control Chapter 2. 2 Process A program in execution An instance of a program running on a computer The entity that can be assigned.
LIBERATING GPGPU PROGRAMMING The Future of is Heterogeneous Benedict R. Gaster AMD Research.
Out-of-Order Execution & Register Renaming Krste Asanovic Laboratory for Computer Science Massachusetts Institute of Technology Asanovic/Devadas Spring.
Silberschatz, Galvin and Gagne ©2009 Operating System Concepts – 8 th Edition, Chapter 8: Main Memory.
Software Pipelined Execution of Stream Programs on GPUs Abhishek Udupa et. al. Indian Institute of Science, Bangalore 2009.
C HAPTER 1 Computer Organization and Architecture.
Larrabee Eric Jogerst Cortlandt Schoonover Francis Tan.
Memory Management Background Swapping Contiguous Memory Allocation Paging Structure of the Page Table Segmentation Example: The Intel Pentium.
Chapter 4 1 Threads Threads are a subdivision of processes Since there is less information associated with a thread than there is info associated with.
In-Order Execution In-order execution does not always give the best performance on superscalar machines. The following example uses in-order execution.
The first-generation Cell Broadband Engine (BE) processor is a multi-core chip comprised of a 64-bit Power Architecture processor core and eight synergistic.
© Krste Asanovic, 2014CS252, Spring 2014, Lecture 16 CS252 Graduate Computer Architecture Spring 2014 Lecture 16: Virtual Machines Krste Asanovic
Shared Memory Consistency CSE 661 – Parallel and Vector Architectures Prof. Muhamed Mudawar Computer Engineering Department King Fahd University of Petroleum.
COMP375 Computer Architecture and Organization Senior Review.
© 2016 SlidePlayer.com Inc. All rights reserved.