Portions © Intel Corporation | Portions © Hewlett-Packard Corporation * Other brands and names may be claimed as the property of others. Intel, the Intel logo and Itanium is a trademark or registered trademark of Intel Corporation or its subsidiaries in the United States and other countries. Portions © Intel Corporation | Portions © Hewlett-Packard Corporation Yet More HP Caliper: an Update on the Itanium ® HP-UX and Linux Performance Tool 20 September 2005 Speaker: Curt Wohlgemuth Caliper Development Team Hewlett-Packard

Portions © Intel Corporation | Portions © Hewlett-Packard Corporation * Other brands and names may be claimed as the property of others. Intel, the Intel logo and Itanium is a trademark or registered trademark of Intel Corporation or its subsidiaries in the United States and other countries. Portions © Intel Corporation | Portions © Hewlett-Packard Corporation Preface Previous webcasts: An introduction to HP Caliper, what it is, and how to use it. Webcast: September 9, 2003 Slides: An update on HP Caliper for HP-UX and Linux Itanium. Webcast: September 21, 2004 Slides:

3 Intel, the Intel logo and Itanium is a trademark or registered trademark of Intel Corporation or its subsidiaries in the United States and other countries. Portions © Intel Corporation | Portions © Hewlett-Packard Corporation Agenda Quick overview of HP Caliper New Features in Caliper 3.8 Hints, Tips, and Future Directions Summary DSPP Information Q & A

4 Intel, the Intel logo and Itanium is a trademark or registered trademark of Intel Corporation or its subsidiaries in the United States and other countries. Portions © Intel Corporation | Portions © Hewlett-Packard Corporation What is HP Caliper? Per-process or system-wide performance measurement tool, for any Itanium/Itanium2 native applications For both HP-UX and Linux IPF “Swiss Army Knife” - Many different measurements - Common user interface and options - Multiple report formats – text, csv, html Uses Performance Monitor Unit (PMU) hardware and dynamic instrumentation as needed

5 Intel, the Intel logo and Itanium is a trademark or registered trademark of Intel Corporation or its subsidiaries in the United States and other countries. Portions © Intel Corporation | Portions © Hewlett-Packard Corporation Example command lines caliper [options] application [ app-opts ] caliper [options] --scope=kernel e.g.: caliper fprof --html dir_name sweep3d caliper dcache_miss --thread=all --proc=all cc himom.c caliper cpu_metrics --scope=kernel -o out_file --dur 10 caliper scgprof --event-d=all --proc=myproc shell-script

6 Intel, the Intel logo and Itanium is a trademark or registered trademark of Intel Corporation or its subsidiaries in the United States and other countries. Portions © Intel Corporation | Portions © Hewlett-Packard Corporation Measurements Overview: cpu_metrics*, total_cpu Profiles: alat_miss, branch_prediction, dcache_miss, dtlb_miss, fprof, icache_miss, itlb_miss Traces: pmu_trace Coverage: func_cover* Counts: arc_count*, func_count* Call graph: scgprof, cgprof* * not in Linux version Used for: What? Where? Details? (instrumented)

7 Intel, the Intel logo and Itanium is a trademark or registered trademark of Intel Corporation or its subsidiaries in the United States and other countries. Portions © Intel Corporation | Portions © Hewlett-Packard Corporation New feature – Sampled call graphs Provides a flat profile + call graph of applications Call graph in gprof format, collected using sampling - call counts are not exact but are statistically valid - call sites with few calls are not captured Valid for both per-process and system-wide modes Will eventually replace cgprof measurement On HP-UX: - requires 11i V2 (B ) or later - must disable PMU throttling: perfmon_min_lws_period No restrictions on Linux

8 Intel, the Intel logo and Itanium is a trademark or registered trademark of Intel Corporation or its subsidiaries in the United States and other countries. Portions © Intel Corporation | Portions © Hewlett-Packard Corporation New feature – cpu_metrics enhancements Multiple event sets may be specified caliper cpu_metrics --metrics:tlb,cpi,l1dcache More event sets are available, including new overview event set Full event set documentation with --info Live display to terminal window available caliper cpu_metrics --term-display=on... cpu_metrics is only available on HP-UX at present

9 Intel, the Intel logo and Itanium is a trademark or registered trademark of Intel Corporation or its subsidiaries in the United States and other countries. Portions © Intel Corporation | Portions © Hewlett-Packard Corporation Preview feature: Caliper Advisor Rules-based expert system Analyzes database contents for previous runs Recommends future measurements, or tuning actions Example: caliper cpu_metrics -d DB1 caliper fprof -d DB2 caliper dcache_miss -d DB3 caliper advise DB1 DB2 DB3

10 Intel, the Intel logo and Itanium is a trademark or registered trademark of Intel Corporation or its subsidiaries in the United States and other countries. Portions © Intel Corporation | Portions © Hewlett-Packard Corporation New Feature – Memory usage improvements Measures and reports Cell Local Memory (CLM) usage Can be requested along with any measurement Specified with --memory-usage= option Reports - Total system memory usage by cell - Application memory usage by cell - timed and all provide snapshots of process memory usage Works with multi-cell (ccNUMA) and SMP systems Only available on HP-UX (11i V2 or later)

11 Intel, the Intel logo and Itanium is a trademark or registered trademark of Intel Corporation or its subsidiaries in the United States and other countries. Portions © Intel Corporation | Portions © Hewlett-Packard Corporation Database improvements Differencing of measured data now available --join=diff Merging/aggregating measured data now available for multi-process runs Caliper datafile replaced by database directory Future releases will add powerful capabilities using the Caliper database.

12 Intel, the Intel logo and Itanium is a trademark or registered trademark of Intel Corporation or its subsidiaries in the United States and other countries. Portions © Intel Corporation | Portions © Hewlett-Packard Corporation System-wide kernel profiling improvements Measures and reports kernel performance profiles Can measure DLKMs Function details of DLKMs now available On HP-UX: - only available to root user On both Linux and HP-UX: - No other Caliper measurements allowed simultaneously

13 Intel, the Intel logo and Itanium is a trademark or registered trademark of Intel Corporation or its subsidiaries in the United States and other countries. Portions © Intel Corporation | Portions © Hewlett-Packard Corporation Caliper on Itanium Linux Same features as HP-UX version except: - instrumented measurements - OS feature differences Linux 2.6.x kernel (or later) - SUSE Linux Enterprise Server 9 - RedHat Enterprise Linux Debian Linux 3.0 Perfmon 2.0 subsystem (or later) Non-commercial/evaluation, and fully supported versions available, from software.hp.com

14 Intel, the Intel logo and Itanium is a trademark or registered trademark of Intel Corporation or its subsidiaries in the United States and other countries. Portions © Intel Corporation | Portions © Hewlett-Packard Corporation Hints and Tips Use overview metrics (total_cpu, cpu_metrics) first, then profilers (e.g., fprof, dcache_miss) to zero in Save measurement runs in databases for re-reporting Make source code available for source correlated reports Create custom personal/site configuration files for common measurements Use caliper info to list available CPU metrics Quick start guide at ck_start.pdf

15 Intel, the Intel logo and Itanium is a trademark or registered trademark of Intel Corporation or its subsidiaries in the United States and other countries. Portions © Intel Corporation | Portions © Hewlett-Packard Corporation Hints and Tips (cont’d) Extensive shared library usage: --module-include/exclude=… measure only some libraries Multi-threaded applications: --thread=sum-all for aggregrated report --thread=all for per-thread reports Multi-process applications: --process=all measure all processes --process=some:… measure only some processes --process= custom selection of processes

16 Intel, the Intel logo and Itanium is a trademark or registered trademark of Intel Corporation or its subsidiaries in the United States and other countries. Portions © Intel Corporation | Portions © Hewlett-Packard Corporation Future directions Fully featured GUI for collection and display of data Database will hold thousands of process data, fully browsable System-wide mode will correlate data to individual processes, modules, and functions Improvements to HP-UX and Linux kernels for more advanced features

17 Intel, the Intel logo and Itanium is a trademark or registered trademark of Intel Corporation or its subsidiaries in the United States and other countries. Portions © Intel Corporation | Portions © Hewlett-Packard Corporation Summary Itanium execution performance tool Measures production applications System-wide for kernel measurements today, for user- mode applications in the future Wide range of performance metrics available Explore performance data thru various reports Available on HP-UX and Linux