Blaise Barney, LLNL ASC Tri-Lab Code Development Tools Workshop Thursday, July 29, 2010 Lawrence Livermore National Laboratory, P. O. Box 808, Livermore,

Slides:

Advertisements

Similar presentations

Introduction to Maven 2.0 An open source build tool for Enterprise Java projects Mahen Goonewardene.

Advertisements

1 Slides presented by Hank Childs at the VACET/SDM workshop at the SDM Center All-Hands Meeting. November 26, 2007 Snoqualmie, Wa Work performed under.

This work was performed under the auspices of the U.S. Department of Energy by Lawrence Livermore National Laboratory under Contract DE-AC52-07NA27344.

® IBM Software Group © 2010 IBM Corporation What’s New in Profiling & Code Coverage RAD V8 April 21, 2011 Kathy Chan

Matt Wolfe LC Development Environment Group Lawrence Livermore National Laboratory Lawrence Livermore National Laboratory, P. O. Box 808, Livermore, CA.

1 Generic logging layer for the distributed computing by Gene Van Buren Valeri Fine Jerome Lauret.

Technical BI Project Lifecycle

Server-Side vs. Client-Side Scripting Languages

Solutions for XML Document Navigation and Delivery Lori Wong and T.R. Girill Customer Services Group Services and Development Division Integrated Computing.

VisIt Software Engineering Infrastructure and Release Process LLNL-PRES Lawrence Livermore National Laboratory, P. O. Box 808, Livermore,

NDT Tools Tutorial: How-To setup your own NDT server Rich Carlson Summer 04 Joint Tech July 19, 2004.

1 of 5 This document is for informational purposes only. MICROSOFT MAKES NO WARRANTIES, EXPRESS OR IMPLIED, IN THIS DOCUMENT. © 2007 Microsoft Corporation.

1 Parallel Performance Analysis with Open|SpeedShop Trilab Tools-Workshop Martin Schulz, LLNL/CASC LLNL-PRES

Blaise Barney, LLNL ASC Tri-Lab Code Development Tools Workshop Thursday, July 29, 2010 Lawrence Livermore National Laboratory, P. O. Box 808, Livermore,

MpiP Evaluation Report Hans Sherburne, Adam Leko UPC Group HCS Research Laboratory University of Florida.

WORK ON CLUSTER HYBRILIT E. Aleksandrov 1, D. Belyakov 1, M. Matveev 1, M. Vala 1,2 1 Joint Institute for nuclear research, LIT, Russia 2 Institute for.

LLNL-PRES-XXXXXX This work was performed under the auspices of the U.S. Department of Energy by Lawrence Livermore National Laboratory under Contract DE-AC52-07NA27344.

Scoring Program Updates & XML upload to the NSRCA web site July 2013.

LLNL-PRES-XXXXXX This work was performed under the auspices of the U.S. Department of Energy by Lawrence Livermore National Laboratory under Contract DE-AC52-07NA27344.

Chapter 11: Introduction to the Visual Basic Environment Spreadsheet-Based Decision Support Systems Prof. Name Position (123) University.

LLNL-PRES-XXXXXX This work was performed under the auspices of the U.S. Department of Energy by Lawrence Livermore National Laboratory under contract DE-AC52-07NA27344.

1 Apache. 2 Module - Apache ♦ Overview This module focuses on configuring and customizing Apache web server. Apache is a commonly used Hypertext Transfer.

Scalable Analysis of Distributed Workflow Traces Daniel K. Gunter and Brian Tierney Distributed Systems Department Lawrence Berkeley National Laboratory.

SC 2012 © LLNL / JSC 1 HPCToolkit / Rice University Performance Analysis through callpath sampling  Designed for low overhead  Hot path analysis  Recovery.

Portable Data Collection Center (PDCC) and the Nominal Response Library (NRL) Tim Ahern.

VAMPIR. Visualization and Analysis of MPI Resources Commercial tool from PALLAS GmbH VAMPIRtrace - MPI profiling library VAMPIR - trace visualization.

WebVizOr: A Fault Detection Visualization Tool for Web Applications Goal: Illustrate and evaluate the uses of WebVizOr, a new tool to aid web application.

Accelerating Scientific Exploration Using Workflow Automation Systems Terence Critchlow (LLNL) Ilkay Altintas (SDSC) Scott Klasky(ORNL) Mladen Vouk (NCSU)

Martin Schulz Center for Applied Scientific Computing Lawrence Livermore National Laboratory Lawrence Livermore National Laboratory, P. O. Box 808, Livermore,

CERN - IT Department CH-1211 Genève 23 Switzerland t DB Development Tools Benthic SQL Developer Application Express WLCG Service Reliability.

Performance Monitoring Tools on TCS Roberto Gomez and Raghu Reddy Pittsburgh Supercomputing Center David O’Neal National Center for Supercomputing Applications.

Matt Wolfe LC Development Environment Group Lawrence Livermore National Laboratory Lawrence Livermore National Laboratory, P. O. Box 808, Livermore, CA.

LLNL-PRES This work was performed under the auspices of the U.S. Department of Energy by Lawrence Livermore National Laboratory under contract DE-AC52-07NA27344.

Lawrence Livermore National Laboratory PREPRO Accomplishments Dermott “Red” Cullen Presented at the Nuclear Criticality Safety Program Technical Conference.

SciDAC SSS Quarterly Report Sandia Labs August 27, 2004 William McLendon Sandia is a multiprogram laboratory operated by Sandia Corporation, a Lockheed.

Lawrence Livermore National Laboratory Pianola: A script-based I/O benchmark Lawrence Livermore National Laboratory, P. O. Box 808, Livermore, CA

ASC Tri-Lab Code Development Tools Workshop Thursday, July 29, 2010 Lawrence Livermore National Laboratory, P. O. Box 808, Livermore, CA This work.

Portable Parallel Performance Tools Shirley Browne, UTK Clay Breshears, CEWES MSRC Jan 27-28, 1998.

Exercise Your your Library ® RefWorks: The Basics October 10, 2006.

Lawrence Livermore National Laboratory Reaction Theory: Year-4 Deliverables Year-5 Plans LLNL-PRES Lawrence Livermore National Laboratory, P. O.

LLNL-PRES-?????? This work was performed under the auspices of the U.S. Department of Energy by Lawrence Livermore National Laboratory under Contract DE-AC52-07NA27344.

LLNL-PRES-?????? This work was performed under the auspices of the U.S. Department of Energy by Lawrence Livermore National Laboratory under Contract DE-AC52-07NA27344.

Debugging parallel programs. Breakpoint debugging Probably the most widely familiar method of debugging programs is breakpoint debugging. In this method,

SDM center Supporting Heterogeneous Data Access in Genomics Terence Critchlow Center for Applied Scientific Computing Lawrence Livermore National Laboratory.

Martin Schulz Center for Applied Scientific Computing Lawrence Livermore National Laboratory ASC STAT Team: Greg Lee, Dong Ahn (LLNL), Dane Gardner (LANL)

Lawrence Livermore National Laboratory Centralized Desktop Management at LLNL A Major Paradigm Shift CDM David Frye This work performed under the auspices.

Tool Visualizations, Metrics, and Profiled Entities Overview [Brief Version] Adam Leko HCS Research Laboratory University of Florida.

Chapter 11: Introduction to VBA Spreadsheet-Based Decision Support Systems Prof. Name Position (123) University Name.

PACS NHSC Data Processing Workshop – Pasadena 10 th - 14 th Sep 2012 HIPE Introduction and Setup for SPIRE David Shupe, NHSC/IPAC on behalf of the SPIRE.

So, You Need to Look at a New Application … Scenarios:  New application development  Analyze/Optimize external application  Suspected bottlenecks First.

Overview of AIMS Hans Sherburne UPC Group HCS Research Laboratory University of Florida Color encoding key: Blue: Information Red: Negative note Green:

INSERT BOOK COVER 1Copyright © 2012 Pearson Education, Inc. Publishing as Prentice Hall. Exploring Getting Started with VBA for Microsoft Office 2010 by.

Bronis R. de Supinski and Jeffrey S. Vetter Center for Applied Scientific Computing August 15, 2000 Umpire: Making MPI Programs Safe.

Lawrence Livermore National Laboratory LLNL-PRES- XXXXXX LLNL-PRES This work was performed under the auspices of the U.S. Department of Energy by.

21 Sep UPC Performance Analysis Tool: Status and Plans Professor Alan D. George, Principal Investigator Mr. Hung-Hsun Su, Sr. Research Assistant.

GA 1 CASC Discovery of Access Patterns to Scientific Simulation Data Ghaleb Abdulla LLNL Center for Applied Scientific Computing.

August 12, 2004 UCRL-PRES Aug Outline l Motivation l About the Applications l Statistics Gathered l Inferences l Future Work.

ESGF-SWT PART 2 ESGF-SWT Members Katharina Berger Nicolas Careton Prashanth Dqarakanath Matthew Harris Georgi Kostov Torsten Rathmann Karl Taylor Frank.

LLNL-PRES-XXXXXX This work was performed under the auspices of the U.S. Department of Energy by Lawrence Livermore National Laboratory under contract DE-AC52-07NA27344.

LLNL-PRES This work was performed under the auspices of the U.S. Department of Energy by Lawrence Livermore National Laboratory under Contract DE-AC52-07NA27344.

WS1-1 ADM730, Workshop 1, September 2005 Copyright  2005 MSC.Software Corporation WORKSHOP 1 INTRODUCTION Open Retracted - Bad Retracted - Good.

Projections - A Step by Step Tutorial By Chee Wai Lee For the 2004 Charm++ Workshop.

: Information Retrieval อาจารย์ ธีภากรณ์ นฤมาณนลิณี

AdaptJ Sookmyung Women’s Univ. PSLAB. 1. 목차 1. Overview 2. Collecting Trace Data using the AdaptJ Agent 2.1 Recording a Trace 3. Analyzing Trace Data.

Introduction to HPC Debugging with Allinea DDT Nick Forrington

SciDAC SSS Quarterly Report Sandia Labs January 25, 2005 William McLendon Sandia is a multiprogram laboratory operated by Sandia Corporation, a Lockheed.

VisIt Project Overview

Lawrence Livermore National Laboratory

Heat Simulations with COMSOL

Health On-Line Patient Education Web Site

Presentation transcript:

Blaise Barney, LLNL ASC Tri-Lab Code Development Tools Workshop Thursday, July 29, 2010 Lawrence Livermore National Laboratory, P. O. Box 808, Livermore, CA This work performed under the auspices of the U.S. Department of Energy by Lawrence Livermore National Laboratory under Contract DE-AC52-07NA27344 mpiP: Lightweight MPI profiling LLNL-PRES

Lawrence Livermore National Laboratory Simple, scalable, portable MPI profiling  How to simplify initial performance analysis Simple, reliable, low learning overhead Focus on important, yet easy to access information  mpiP MPI profiling library provides a portable, direct, low-overhead tool for measuring MPI behavior  To use mpiP: First: "use mpip" re-link with (or pre-load) the mpiP library run the application examine summary or detailed results  text report  GUI browser

Lawrence Livermore National Laboratory How does it work?  MPI calls are intercepted by mpiP wrappers  mpiP wrappers call PMPI functions  All information is task-local  Report generation is done within MPI_Finalize arbitrarily (by all tasks)  Task data can be collected quickly by a single collector task or by using MPI collectives

Lawrence Livermore National Laboratory Usage  First: "use mpip"  Re-link application with mpiP library. Example: -L/usr/local/tools/mpip/lib –lmpiP –lbfd –liberty -lunwind  Run-time insertion srun-mpip or mpirun-mpip script LD_PRELOAD=/usr/local/tools/mpip/lib/libmpiP.so  Run-time parameters set in MPIP environment variable. Some examples: FlagEffectDefault -k [#]Stack trace depth for MPI call sites1 -t [#]MPI time % thresholdNo filtering -cConcise report (omit call site detail)Verbose

Lawrence Livermore National Laboratory  Various report formats Verbose, task-specific information Concise, omits task-specific detail  Modify report output Use MPIP environment variable  Filter MPI call sites  Select concise or verbose format or both  Omit task-specific data How to examine performance data?

Lawrence Livermore National Laboratory How to examine performance data?  Various report sections Per-task MPI use

Lawrence Livermore National Laboratory How to examine performance data?  Various report sections Indexed list of MPI routine call locations

Lawrence Livermore National Laboratory How to examine performance data?  Various report sections Concise, top 20 MPI call sites, by wall clock time

Lawrence Livermore National Laboratory How to examine performance data?  Various report sections Concise, top 20 MPI call sites, by message volume

Lawrence Livermore National Laboratory  Various report sections Verbose, task-specific information, by wall clock time (shown) and message volume (similar, but not shown) How to examine performance data?

Lawrence Livermore National Laboratory How to examine performance data?  View report files using the Tool Gear GUI browser. "use mpipview" then "mpipview mpipoutputfile"

Lawrence Livermore National Laboratory  LLNL “use mpip” first Library in /usr/local/tools/mpip/lib Supported on most production platforms  SNL Module load tools/mpiP /projects/tools_workshop/mpiP Availability

Lawrence Livermore National Laboratory Advanced Topics  MPI_Pcontrol can control mpiP behavior Example C: MPI_Pcontrol(3); MPI_Pcontrol(2); ArgumentEffect 0Disable profiling 1Enable Profiling 2Reset all call site data 3Generate verbose report 4Generate concise report

Lawrence Livermore National Laboratory References  Initially developed by Jeffrey Vetter and Michael McCracken at LLNL  Version 3.2 released, includes RMA support  Other project members Philip Roth (ORNL) Jeffrey Vetter (ORNL)  Tool Gear: John Gyllenhaal (LLNL) & John May (LLNL)  Tool POC : Chris Chambreau  Tool mail list :  Tool web site: