Parallel Systems Guy Tel-Zur Lecture 8. Agenda Parallel Programming in Shared Memory - 1. Introduction 2. OpenMP SC12 presentation Students’ Presentations.

Slides:

Advertisements

Similar presentations

Performance Measurement n Assignment? n Timing #include double When() { struct timeval tp; gettimeofday(&tp, NULL); return((double)tp.tv_sec + (double)tp.tv_usec.

Advertisements

Distributed Systems CS

Program Analysis and Tuning The German High Performance Computing Centre for Climate and Earth System Research Panagiotis Adamidis.

Introduction to Parallel Processing Guy Tel-Zur Lecture 8.

Example (1) Two computer systems have been tested using three benchmarks. Using the normalized ratio formula and the following tables below, find which.

Computational Physics Lecture 3 - Admin Dr. Guy Tel-Zur Coral. Picture by Anna Cervova, publicdomainpictures.net.

Computational Physics Dr. Guy Tel-Zur Version :40.

Computational Physics Dr. Guy Tel-Zur Home Assignment Number 2.

Arquitectura de Sistemas Paralelos e Distribuídos Paulo Marques Dep. Eng. Informática – Universidade de Coimbra Ago/ Quantitative.

Parallel & Distributed Computing Fall 2004 Comments About Final.

Computational Physics Home Assignment #3 Dr. Guy Tel-Zur.

CS 584 Lecture 11 l Assignment? l Paper Schedule –10 Students –5 Days –Look at the schedule and me your preference. Quickly.

Computational Physics Lecture 2 - administration Dr. Guy Tel-Zur Old rustic barn. Picture by: by Peter Griffin,

Steve Lantz Computing and Information Science Parallel Performance Week 7 Lecture Notes.

High Performance Communication using MPJ Express 1 Presented by Jawad Manzoor National University of Sciences and Technology, Pakistan 29 June 2015.

CS 240A: Complexity Measures for Parallel Computation.

Cluster Computing Slides by: Kale Law. Cluster Computing Definition Uses Advantages Design Types of Clusters Connection Types Physical Cluster Interconnects.

Computational Physics Dr. Guy Tel-Zur Lecture 7 mohan pmohan p, Forest,

Lecture 37: Chapter 7: Multiprocessors Today’s topic –Introduction to multiprocessors –Parallelism in software –Memory organization –Cache coherence 1.

CMSC 611: Advanced Computer Architecture Performance Some material adapted from Mohamed Younis, UMBC CMSC 611 Spr 2003 course slides Some material adapted.

CS 470/570:Introduction to Parallel and Distributed Computing.

DATA STRUCTURES OPTIMISATION FOR MANY-CORE SYSTEMS Matthew Freeman | Supervisor: Maciej Golebiewski CSIRO Vacation Scholar Program

Scientific Computing Lecture 6 Dr. Guy Tel-Zur Butterfly in Africa by Anna Cervova,

Performance Evaluation of Parallel Processing. Why Performance?

INTEL CONFIDENTIAL Predicting Parallel Performance Introduction to Parallel Programming – Part 10.

04/30/13 Last class: summary, goggles, ices Discrete Structures (CS 173) Derek Hoiem, University of Illinois 1 Image: wordpress.com/2011/11/22/lig.

General Purpose Computing on Graphics Processing Units: Optimization Strategy Henry Au Space and Naval Warfare Center Pacific 09/12/12.

Introduction, background, jargon Jakub Yaghob. Literature T.G.Mattson, B.A.Sanders, B.L.Massingill: Patterns for Parallel Programming, Addison- Wesley,

Course Wrap-Up Miodrag Bolic CEG4136. What was covered Interconnection network topologies and performance Shared-memory architectures Message passing.

Message Passing Computing 1 iCSC2015,Helvi Hartmann, FIAS Message Passing Computing Lecture 1 High Performance Computing Helvi Hartmann FIAS Inverted CERN.

Compiled by Maria Ramila Jimenez

Definitions Speed-up Efficiency Cost Diameter Dilation Deadlock Embedding Scalability Big Oh notation Latency Hiding Termination problem Bernstein’s conditions.

Rethinking Computer Architecture Wen-mei Hwu University of Illinois, Urbana-Champaign Celebrating September 19, 2014.

Scaling Area Under a Curve. Why do parallelism? Speedup – solve a problem faster. Accuracy – solve a problem better. Scaling – solve a bigger problem.

Parallel Systems Lecture 9 Guy Tel-Zur. Today’s agenda Final Presentations status OpenMP continue with SC99 tutorial (from slide 58). SC12 Sorting Algorithms.

CSC 7600 Lecture 28 : Final Exam Review Spring 2010 HIGH PERFORMANCE COMPUTING: MODELS, METHODS, & MEANS FINAL EXAM REVIEW Daniel Kogler, Chirag Dekate.

1 CS/COE0447 Computer Organization & Assembly Language CHAPTER 4 Assessing and Understanding Performance.

Lecture 8: 9/19/2002CS170 Fall CS170 Computer Organization and Architecture I Ayman Abdel-Hamid Department of Computer Science Old Dominion University.

Chapter 1 Performance & Technology Trends Read Sections 1.5, 1.6, and 1.8.

Grid and Cloud Computing ProActive Dr. Guy Tel-Zur.

Nanco: a large HPC cluster for RBNI (Russell Berrie Nanotechnology Institute) Anne Weill – Zrahia Technion,Computer Center October 2008.

Scientific Computing Home Assignment #1 Dr. Guy Tel-Zur.

CSCI-455/552 Introduction to High Performance Computing Lecture 6.

1Thu D. NguyenCS 545: Distributed Systems CS 545: Distributed Systems Spring 2002 Communication Medium Thu D. Nguyen

CSci6702 Parallel Computing Andrew Rau-Chaplin

Scaling Conway’s Game of Life. Why do parallelism? Speedup – solve a problem faster. Accuracy – solve a problem better. Scaling – solve a bigger problem.

Computer Organization Yasser F. O. Mohammad 1. 2 Lecture 1: Introduction Today’s topics:  Why computer organization is important  Logistics  Modern.

Chapter 1 — Computer Abstractions and Technology — 1 Uniprocessor Performance Constrained by power, instruction-level parallelism, memory latency.

Complexity Measures for Parallel Computation. Problem parameters: nindex of problem size pnumber of processors Algorithm parameters: t p running time.

Scientific Computing Lecture 2 - administration Dr. Guy Tel-Zur Old rustic barn. Picture by: by Peter Griffin,

SSU 1 Dr.A.Srinivas PES Institute of Technology Bangalore, India 9 – 20 July 2012.

Processor Level Parallelism 2. How We Got Here Developments in PC CPUs.

Scientific Computing Dr. Guy Tel-Zur Lecture 7 mohan pmohan p, Forest,

Intro to Computer Org. Assessing Performance. What Is Performance? What do we mean when we talk about the “performance” of a CPU?

First INFN International School on Architectures, tools and methodologies for developing efficient large scale scientific computing applications Ce.U.B.

Measuring Performance II and Logic Design

Introduction to Parallel Computing: MPI, OpenMP and Hybrid Programming

Lecture 5 Approaches to Concurrency: The Multiprocessor

Introduction to Parallelism.

EE 193: Parallel Computing

Complexity Measures for Parallel Computation

CMSC 611: Advanced Computer Architecture

Visual Studio Cloud-based Load Testing Performance Testing Made Easy

Introduction to Heterogeneous Parallel Computing

A few words about parallel computing

CMSC 611: Advanced Computer Architecture

Complexity Measures for Parallel Computation

A few words about parallel computing

Assoc. Prof. Marc FRÎNCU, PhD. Habil.

Presentation transcript:

Parallel Systems Guy Tel-Zur Lecture 8

Agenda Parallel Programming in Shared Memory - 1. Introduction 2. OpenMP SC12 presentation Students’ Presentations

Latency Factors in Data Center Reference: Intel's 10 Gigabit Ethernet boost pushes out InfinibandIntel's 10 Gigabit Ethernet boost pushes out Infiniband

Comments about the final presentations Pay attention to: 1.Parallel Computing aspects. For example: speedup, efficiency, scalability, computation to communication ratio, how close your program to Amdahl’s law prediction?, run time vs. problem size. 2.See more instructions in Lecture #1 slides 3.Please hurry! The time is running fast now….

OpenMP OpenMP from Wikipedia מומלץ להסתכל בסימוכין הנוספים באתר הויקיפדיה !

Relevant slides in “SC99 tutorial” Pages: 1-64, 109, , , 143

Q&A שלום גיא. לא ברור לי למה אבל המחשב נתקע לי בכל פעם שאני מריץ איתחול על מטריצה, ממימד 100*100 ומעלה. האם זה סביר ? יש פתרון לכך ? Open DevC++ demos: m_size.c and m_size2.c

Game of Life A clip by Gadi Lahav

More references OpenMP in Visual C++ Quick Reference Card: