Presentation is loading. Please wait.

Presentation is loading. Please wait.

Allen D. Malony Department of Computer and Information Science Computational Science Institute University of Oregon TAU Performance.

Published by Modified over 8 years ago

Similar presentations

Presentation on theme: "Allen D. Malony Department of Computer and Information Science Computational Science Institute University of Oregon TAU Performance."— Presentation transcript:

1 Allen D. Malony malony@cs.uoregon.edu Department of Computer and Information Science Computational Science Institute University of Oregon TAU Performance DataBase Framework (PerfDBF)

2 APART EuroPar 2002 Workshop2 The TAU Performance DataBase Framework Outline  Motivation for performance databases  TAU performance system  TAU Performanc DataBase Framework  Architecture  XML profile data representation  Example  Performance engineering in software engineering  X-PARE (eXPeriment Alerting and Reporting)  Concluding remarks

3 APART EuroPar 2002 Workshop3 The TAU Performance DataBase Framework Why Performance Databases?  Focus on empirical performance optimization process  Necessary for multi-results performance analysis  Multiple experiments (codes, versions, platforms, …)  Historical performance comparison  Integral component of performance analysis framework  Improved performance analysis architecture design  More flexible and open tool interfaces  Supports extensibility and foreign tool interaction  Performance analysis collaboration  Performance tool sharing  Performance data sharing and knowledge base

4 APART EuroPar 2002 Workshop4 The TAU Performance DataBase Framework Empirical-Based Performance Optimization characterization Performance Tuning Performance Diagnosis Performance Experimentation Performance Observation hypotheses properties Experiment Schemas Experiment Trials observability requirements ? Process

5 APART EuroPar 2002 Workshop5 The TAU Performance DataBase Framework TAU Performance System Framework  Tuning and Analysis Utilities (aka Tools Are Us)  Performance system framework for scalable parallel and distributed high-performance computing  Targets a general complex system computation model  nodes / contexts / threads  Multi-level: system / software / parallelism  Measurement and analysis abstraction  Integrated toolkit for performance instrumentation, measurement, analysis, and visualization  Portable performance profiling/tracing facility  Open software approach

6 APART EuroPar 2002 Workshop6 The TAU Performance DataBase Framework TAU Performance System Architecture EPILOG Paraver

7 APART EuroPar 2002 Workshop7 The TAU Performance DataBase Framework TAU Performance Database Framework Performance analysis programs Performance analysis and query toolkit  profile data only  XML representation  project / experiment / trial PerfDML translators... ORDB PostgreSQL PerfDB Performance data description Raw performance data

8 APART EuroPar 2002 Workshop8 The TAU Performance DataBase Framework PerfDBF Components  Performance Data Meta Language (PerfDML)  Common performance data representation  Performance meta-data description  PerfDML translators to common data representation  Performance DataBase (PerfDB)  Standard database technology (SQL)  Free, robust database software (PostgresSQL)  Commonly available APIs  Performance DataBase Toolkit (PerfDBT)  Commonly used modules for query and analysis  Facility analysis tool development

9 APART EuroPar 2002 Workshop9 The TAU Performance DataBase Framework Common and Extensible Profile Data Format  Goals  Capture data from profile tools in common representation  Implement representation in a standard format  Allow for extension of format for new profile data objects  Base on XML (obvious choice)  Leverage XML tools and APIs  XML parsers, Sun’s Java SDK, …  XML verification systems (DTD and schemas)  Target for profile data translation tools  eXtensibile Stylesheet Language Transformations (XSLT)  Which performance profile data are of interest?  Focus on TAU and consider other profiling tools

10 APART EuroPar 2002 Workshop10 The TAU Performance DataBase Framework Performance Profiling  Performance data about program entities and behaviors  Code regions: functions, loops, basic blocks  Actions or states  Statistics data  Execution time, number of calls, number of FLOPS...  Characterization data  Parallel profiles  Captured per process and/or per thread  Program-level summaries  Profiling tools  prof/gprof, ssrun, uprofile/dpci, cprof/vprof, …

11 APART EuroPar 2002 Workshop11 The TAU Performance DataBase Framework TAU Parallel Performance Profiles

12 APART EuroPar 2002 Workshop12 The TAU Performance DataBase Framework PerfDBF Example  NAS Parallel Benchmark LU  % configure -mpiinc=/usr/include -mpilib=/usr/lib64 -arch=sgi64 -fortran=sgi -SGITIMERS -useropt=-O2 NPB profiled With TAU Standard TAU Output Data TAU XML Format SQL Database Analysis Tool TAU to XML Converter Database Loader

13 APART EuroPar 2002 Workshop13 The TAU Performance DataBase Framework Scalability Analysis Process  Scalability study on LU  % suite.def # of procs -> 1, 2, 4, and 8  % mpirun -np 1 lu.W1  % mpirun -np 2 lu.W2  % mpirun -np 4 lu.W4  % mpirun -np 8 lu.W8  populateDatabase.sh  run Java translator to translate profiles into XML  run Java XML reader to write XML profiles to database  Read times for routines and program from experiments  Calculate scalability metrics

14 APART EuroPar 2002 Workshop14 The TAU Performance DataBase Framework  Raw data output  One processor: "applu ”1152939.096923828125248744666.58300780GROUP="applu“  Four processors: "applu ”1152227.34399414062551691412.177978520GROUP="applu“ "applu " 114596.56811523437551691519.341064450GROUP="applu“ "applu " 114616.83325195312551691377.213134770GROUP="applu" Raw TAU Profile Data name calls exclusive time subs inclusive time profile calls group name

15 APART EuroPar 2002 Workshop15 The TAU Performance DataBase Framework XML Profile Representation  One processor 'applu ' 8 100.0 2.487446665830078E8 0.0 2939.096923828125 1 15 2.487446665830078E8

16 APART EuroPar 2002 Workshop16 The TAU Performance DataBase Framework XML Representation  Four processor mean 'applu ' 12 100.0 5.169148940026855E7 0.0 1044.487548828125 1 14.25 5.1691489E7

17 APART EuroPar 2002 Workshop17 The TAU Performance DataBase Framework Contents of Performance Database

18 APART EuroPar 2002 Workshop18 The TAU Performance DataBase Framework Scalability Analysis Results  Scalability of LU performance experiments  Four trial runs Funname| processors| meanspeedup …. applu| 2| 2.0896117809566 applu| 4| 4.812100975788783 applu| 8| 8.168409581149514 … exact| 2| 1.95853126762839071803 exact| 4| 4.03622321124616535446 exact| 8| 7.193812137750623668346

19 APART EuroPar 2002 Workshop19 The TAU Performance DataBase Framework Current Status and Future  PerfDBF prototype  TAU profile to XML translator  XML to PerfDB populator  PostgresSQL database  Java-based PostgresSQL query module  Use as a layer to support performance analysis tools  Make accessing the Performance Database quicker  Continue development  XML parallel profile representation  Basic specification  Opportunity for APART to define a common format

20 APART EuroPar 2002 Workshop20 The TAU Performance DataBase Framework Performance Tracking and Reporting  Integrated performance measurement allows performance analysis throughout development lifetime  Applied performance engineering in software design and development (software engineering) process  Create “performance portfolio” from regular performance experimentation (couple with software testing)  Use performance knowledge in making key software design decision, prior to major development stages  Use performance benchmarking and regression testing to identify irregularities  Support automatic reporting of “performance bugs”  Enable cross-platform (cross-generation) evaluation

21 APART EuroPar 2002 Workshop21 The TAU Performance DataBase Framework XPARE - eXPeriment Alerting and REporting  Experiment launcher automates measurement / analysis  Configuration and compilation of performance tools  Instrumentation control for Uintah experiment type  Execution of multiple performance experiments  Performance data collection, analysis, and storage  Integrated in Uintah software testing harness  Reporting system conducts performance regression tests  Apply performance difference thresholds (alert ruleset)  Alerts users via email if thresholds have been exceeded  Web alerting setup and full performance data reporting  Historical performance data analysis

22 APART EuroPar 2002 Workshop22 The TAU Performance DataBase Framework XPARE System Architecture Experiment Launch Mail server Performance Database Performance Reporter Comparison Tool Regression Analyzer Alerting Setup Web server

23 APART EuroPar 2002 Workshop23 The TAU Performance DataBase Framework Experiment Results Viewing Selection

24 APART EuroPar 2002 Workshop24 The TAU Performance DataBase Framework Web-Based Experiment Reporting

25 APART EuroPar 2002 Workshop25 The TAU Performance DataBase Framework Web-Based Experiment Reporting (continued)

26 APART EuroPar 2002 Workshop26 The TAU Performance DataBase Framework Alerting Setup

27 APART EuroPar 2002 Workshop27 The TAU Performance DataBase Framework Other Performance Database Projects  HPM Toolkit (DeRose; IBM)  PPerfDB (Karavanic; Portland State University)  HPCView (Mellor-Crummey, Fowler; Rice)  SCALEA (Fahringer, Truong ; University of Vienna)  EXPERT (Mohr, Wolf; Research Center Juelich)

28 APART EuroPar 2002 Workshop28 The TAU Performance DataBase Framework Acknowledgements  University of Oregon  Li Li, Robert Bell, Sameer Shende  University of Utah  Alan Morris, Steve Parker, Dav St. Germain  Department of Energy (DOE), ASCI Academic Strategic Alliances Program (ASAP)  Computational Science Institute, ASCI/ASAP Level 3 projects with LLNL / LANL, University of Oregon http://www.csi.uoregon.edu http://www.csi.uoregon.edu  Center for the Simulation of Accidental Fires and Explosions (C-SAFE), ASCI/ASAP Level 1 center, University of Utah http://www.csafe.utah.edu http://www.csafe.utah.edu

Download ppt "Allen D. Malony Department of Computer and Information Science Computational Science Institute University of Oregon TAU Performance."

Similar presentations

K T A U Kernel Tuning and Analysis Utilities Department of Computer and Information Science Performance Research Laboratory University of Oregon.

K T A U Kernel Tuning and Analysis Utilities Department of Computer and Information Science Performance Research Laboratory University of Oregon.
Dynamic performance measurement control Dynamic event grouping Multiple configurable counters Selective instrumentation Application-Level Performance Access.

Dynamic performance measurement control Dynamic event grouping Multiple configurable counters Selective instrumentation Application-Level Performance Access.
ARCS Data Analysis Software An overview of the ARCS software management plan Michael Aivazis California Institute of Technology ARCS Baseline Review March.

ARCS Data Analysis Software An overview of the ARCS software management plan Michael Aivazis California Institute of Technology ARCS Baseline Review March.
Robert Bell, Allen D. Malony, Sameer Shende Department of Computer and Information Science Computational Science.

Robert Bell, Allen D. Malony, Sameer Shende Department of Computer and Information Science Computational Science.
Sameer Shende Department of Computer and Information Science Neuro Informatics Center University of Oregon Tool Interoperability.

Sameer Shende Department of Computer and Information Science Neuro Informatics Center University of Oregon Tool Interoperability.
Office of Science U.S. Department of Energy Grids and Portals at NERSC Presented by Steve Chan.

Office of Science U.S. Department of Energy Grids and Portals at NERSC Presented by Steve Chan.
DCS Architecture Bob Krzaczek. Key Design Requirement Distilled from the DCS Mission statement and the results of the Conceptual Design Review (June 1999):

DCS Architecture Bob Krzaczek. Key Design Requirement Distilled from the DCS Mission statement and the results of the Conceptual Design Review (June 1999):
Allen D. Malony, Sameer Shende Department of Computer and Information Science Computational Science Institute University.

Allen D. Malony, Sameer Shende Department of Computer and Information Science Computational Science Institute University.
Allen D. Malony Department of Computer and Information Science Computational Science Institute University of Oregon Integrating Performance.

Allen D. Malony Department of Computer and Information Science Computational Science Institute University of Oregon Integrating Performance.
TAU Parallel Performance System DOD UGC 2004 Tutorial Allen D. Malony, Sameer Shende, Robert Bell Univesity of Oregon.

TAU Parallel Performance System DOD UGC 2004 Tutorial Allen D. Malony, Sameer Shende, Robert Bell Univesity of Oregon.
The TAU Performance Technology for Complex Parallel Systems (Performance Analysis Bring Your Own Code Workshop, NRL Washington D.C.) Sameer Shende, Allen.

The TAU Performance Technology for Complex Parallel Systems (Performance Analysis Bring Your Own Code Workshop, NRL Washington D.C.) Sameer Shende, Allen.
Combining Static and Dynamic Data in Code Visualization David Eng Sable Research Group, McGill University PASTE 2002 Charleston, South Carolina November.

Combining Static and Dynamic Data in Code Visualization David Eng Sable Research Group, McGill University PASTE 2002 Charleston, South Carolina November.
Nick Trebon, Alan Morris, Jaideep Ray, Sameer Shende, Allen Malony {ntrebon, amorris, Department of.

Nick Trebon, Alan Morris, Jaideep Ray, Sameer Shende, Allen Malony {ntrebon, amorris, Department of.
On the Integration and Use of OpenMP Performance Tools in the SPEC OMP2001 Benchmarks Bernd Mohr 1, Allen D. Malony 2, Rudi Eigenmann 3 1 Forschungszentrum.

On the Integration and Use of OpenMP Performance Tools in the SPEC OMP2001 Benchmarks Bernd Mohr 1, Allen D. Malony 2, Rudi Eigenmann 3 1 Forschungszentrum.
DANSE Central Services Michael Aivazis Caltech NSF Review May 23, 2008.

DANSE Central Services Michael Aivazis Caltech NSF Review May 23, 2008.
Allen D. Malony, Sameer Shende Department of Computer and Information Science Computational Science Institute University.

Allen D. Malony, Sameer Shende Department of Computer and Information Science Computational Science Institute University.
Workshop on Cyber Infrastructure in Combustion Science April 19-20, 2006 Subrata Bhattacharjee and Christopher Paolini Mechanical.

Workshop on Cyber Infrastructure in Combustion Science April 19-20, 2006 Subrata Bhattacharjee and Christopher Paolini Mechanical.
The TAU Performance System: Advances in Performance Mapping Sameer Shende University of Oregon.

The TAU Performance System: Advances in Performance Mapping Sameer Shende University of Oregon.
©1998-2003, Michael Aivazis DANSE Software Issues Michael Aivazis California Institute of Technology DANSE Software Workshop September 3-8, 2003.

© , Michael Aivazis DANSE Software Issues Michael Aivazis California Institute of Technology DANSE Software Workshop September 3-8, 2003.
An overview of the DANSE software architecture Michael Aivazis Caltech DANSE Kick-Off Meeting Pasadena Aug 15, 2006.

An overview of the DANSE software architecture Michael Aivazis Caltech DANSE Kick-Off Meeting Pasadena Aug 15, 2006.

Similar presentations

Ads by Google