1. ©Copyright 2004, Computer Management Sciences, Inc., Alexandria, VA www.cpexpert.com 1 Introduction to zAAP (zSeries Application Assist Processor) Don Deese Computer Management Sciences, Inc. www.cpexpert.com All trademarks are the property of their respective owners.

2. ©Copyright 2004, Computer Management Sciences, Inc., Alexandria, VA www.cpexpert.com 2 Presentation Outline Overview of zAAP (IFA) Processor Benefits and requirements of zAAP Description of how zAAP works User controls for zAAP processing Performance considerations with zAAP Data available to measure zAAP performance Conclusions and references NOTE: zAAP operates only in a PR/SM environment. All references to central processor or zAAP/IFA processor should be taken to mean logical central processor and logical zAAP/IFA processor.

3. ©Copyright 2004, Computer Management Sciences, Inc., Alexandria, VA www.cpexpert.com 3 What is zAAP (IFA) Processor Special processor available with z890, z990, z9. Called either zAAP or IFA (Integrated Facility for Applications) depending on IBM document. Runs only JAVA work (zAAP-eligible work) under control of JVM. Similar to IFL (Integrated Facility for Linux). Does not increase MSU rating of z890, z990, or z9. Purchase and maintenance cost are significantly lower than with standard central processor.

4. ©Copyright 2004, Computer Management Sciences, Inc., Alexandria, VA www.cpexpert.com 4 PUSAP PU Central processors (CP) CP Special processors ICFIFLIFA Z990 Processor Units – sample definition spare Internal Coupling Facility ICF IFL Integrated Facility for Linux IFA Integrated Facility for Applications PU Unused SAP System Assist Processor Special processors

5. ©Copyright 2004, Computer Management Sciences, Inc., Alexandria, VA www.cpexpert.com 5 PUSAPPU Central processors (CP) CP Z890 Processor Units – sample definition IFA Integrated Facility for Applications SAP System Assist Processor Special processors z890#CP#IFA 61nn11 62nn22 63nn31 64nn40 IFA

6. ©Copyright 2004, Computer Management Sciences, Inc., Alexandria, VA www.cpexpert.com 6 Benefits of zAAP Processors Attractively priced ($125K USD per zAAP engine). IBM zSeries software charges are unaffected (MSU rating is unchanged when zAAP is added). Can run JAVA work on zAAP attached to z890 (zAAP runs at full speed, while z890 CPs can run at potentially much lower sub-capacity speed). Sub-capacity IBM software charges could be reduced. Significantly lower maintenance costs than standard CPs. Up to one zAAP processor per central processor in a CPC.

7. ©Copyright 2004, Computer Management Sciences, Inc., Alexandria, VA www.cpexpert.com 7 Limitations of zAAP processors Available only with z890 and z990 (and above) Only one zAAP per purchased central processor Cannot execute user instructions (other than under control of JVM) Does not processes I/O interrupts With z890/z990, zAAP inherits LPAR attributes from LPAR definition Does not participate in IRD management and retains initial LPAR weight even if WLM changes LPAR weight Does not support WLM soft-capping (meaningless since IFA is not reflected in defined capacity)

8. ©Copyright 2004, Computer Management Sciences, Inc., Alexandria, VA www.cpexpert.com 8 How does zAAP (IFA) work? zAAP-eligible work must be processed in LPAR with one or more normal CPs JVM decides whether JAVA work is zAAP-eligible. JVM notifies z/OS dispatcher that zAAP-eligible work is ready to execute zAAP-eligible work is dispatched to IFA (or to CP). User specifications control whether zAAP-eligible work executes on IFA and on CP, or executes only on IFA. User specifications control whether zAAP-eligible work executes in competition with normal goal work.

9. ©Copyright 2004, Computer Management Sciences, Inc., Alexandria, VA www.cpexpert.com 9 Example flow when JAVA work is executed on IFA

10. ©Copyright 2004, Computer Management Sciences, Inc., Alexandria, VA www.cpexpert.com 10 zAAP External Controls in IEAOPTxx IFACROSSOVER IFAHONORPRIORITY With z/OS V1R6, s pecifies whether zAAP-eligible work can cross over torun on CP as well as on IFA. Meaning and importance changes with z/OS V1R7. Specifies whether zAAP-eligible work and other work will be dispatched to both CP and IFA based on WLM- assigned priority. zAAP-eligible work will always be dispatched on IFA based on WLM-assigned priority. If zAAP-eligible work runs on CP below DISC priority, zAAP-eligible work will be dispatched based on WLM- assigned priority for the zAAP-eligible work.

11. ©Copyright 2004, Computer Management Sciences, Inc., Alexandria, VA www.cpexpert.com 11 X-OVERHON-PRIMeaning YES Dispatch zAAP-eligible work to both CP and IFA, in dispatching priority order. Soft-capping in effect dispatch at priority below discretionary. YESNODispatch zAAP-eligible work to IFA and dispatch to CP below discretionary. NON/ADispatch zAAP-eligible work only to IFA. If no available IFA dispatch to CP at priority below discretionary. zAAP Controls with z/OS V1R6 IFACROSSOVER and IFAHONORPRIORITY But see OA14131 (applies z/OS V1R7 changes)

12. ©Copyright 2004, Computer Management Sciences, Inc., Alexandria, VA www.cpexpert.com 12 zAAP Controls with z/OS V1R7 IFAHONORPRIORITY, AWM, and IFACROSSOVER HON-PRIAWMX-OVERMeaning YES N/ADispatch zAAP-eligible work to both CP and IFA, in dispatching priority order. Soft-capping in effect dispatch to CP at priority below DISC. But see OA13953! YESNOYESDispatch zAAP-eligible work to IFA and dispatch to CP below DISC. YESNO Run zAAP-eligible work on CP only if no IFA in LPAR. NON/AYESDispatch zAAP-eligible work to IFA and dispatch to CP below DISC. NON/ANORun zAAP-eligible work on CP only if no IFA in LPAR. AWM = Alternate Wait State Management

13. ©Copyright 2004, Computer Management Sciences, Inc., Alexandria, VA www.cpexpert.com 13 WORK UNITPRIORITY Goal, not zAAP #5243 Goal, not zAAP #2241 Goal, not zAAP #4239 DISCR, not zAAP #1192 WORK UNITPRIORITY zAAP-eligible #4249 zAAP-eligible #3247 zAAP-eligible #5245 zAAP-eligible #2241 SYSTEM DISPATCH QUEUEIFA DISPATCH QUEUE Sample z/OS Dispatching IFACROSSOVER=YES (with z/OS V1R6) AWM decides IFA needs help (with z/OS V1R7) IFAHONORPRIORITY=YES z/OS Dispatcher selects zAAP-eligible #4 for dispatch, since it is the highest priority. If IFA available, dispatch to IFA. If IFA not available, dispatch to CP.

14. ©Copyright 2004, Computer Management Sciences, Inc., Alexandria, VA www.cpexpert.com 14 WORK UNITPRIORITY Goal, not zAAP #5243 Goal, not zAAP #2241 Goal, not zAAP #4239 DISCR, not zAAP #1192 WORK UNITPRIORITY zAAP-eligible #4178 zAAP-eligible #3176 zAAP-eligible #5174 zAAP-eligible #2172 SYSTEM DISPATCH QUEUEIFA DISPATCH QUEUE Sample z/OS Dispatching IFACROSSOVER=YES IFAHONORPRIORITY=NO If IFA available, z/OS Dispatcher selects zAAP- eligible #4for dispatch, since it is highest priority. z/OS Dispatcher selects zAAP-eligible #4 for dispatch on CP below DISC..

15. ©Copyright 2004, Computer Management Sciences, Inc., Alexandria, VA www.cpexpert.com 15 WORK UNITPRIORITY Goal, not zAAP #5243 Goal, not zAAP #2241 Goal, not zAAP #4239 DISCR, not zAAP #1192 WORK UNITPRIORITY zAAP-eligible #4178 zAAP-eligible #3176 zAAP-eligible #5174 zAAP-eligible #2172 SYSTEM DISPATCH QUEUEIFA DISPATCH QUEUE Sample z/OS Dispatching IFACROSSOVER=NO IFAHONORPRIORITY=NO If IFA available, z/OS Dispatcher selects zAAP- eligible #4for dispatch, since it is highest priority. z/OS Dispatcher will select zAAP-eligible #4 for dispatch on CP only if no IFA in LPAR.

16. ©Copyright 2004, Computer Management Sciences, Inc., Alexandria, VA www.cpexpert.com 16 zAAP Performance considerations z/OS V1R6 and z890/z990 Large number of central processors versus zAAP processors defined to LPAR High Goal Importance of zAAP-eligible work Low Goal Importance of zAAP-eligible work High CPU activity level of central processors With z890/z990, LPAR definitions could conflict with LPAR definitions for other shared special processors in Pool 2. Problem solved with z9 109. PR/SM Logical to Physical processor ratio

17. ©Copyright 2004, Computer Management Sciences, Inc., Alexandria, VA www.cpexpert.com 17 WORK UNITPRIORITY Goal, not zAAP #5243 Goal, not zAAP #2241 Goal, not zAAP #4239 DISCR, not zAAP #1192 WORK UNITPRIORITY zAAP-eligible #4249 zAAP-eligible #3247 zAAP-eligible #5245 zAAP-eligible #2241 SYSTEM DISPATCH QUEUEIFA DISPATCH QUEUE Performance consideration with zAAP, z/OS V1R6 IFACROSSOVER=YES IFAHONORPRIORITY=YES z/OS Dispatcher selects zAAP-eligible #4 for dispatch. If IFA available, dispatch to IFA. If IFA not available, dispatch to CP. With large number of logical CPs, zAAP-eligible work will tend to be done by CPs, rather than by IFA.

18. ©Copyright 2004, Computer Management Sciences, Inc., Alexandria, VA www.cpexpert.com 18 WORK UNITPRIORITY Goal, not zAAP #5243 Goal, not zAAP #2241 Goal, not zAAP #4239 DISCR, not zAAP #1192 WORK UNITPRIORITY zAAP-eligible #4249 zAAP-eligible #3247 zAAP-eligible #5245 zAAP-eligible #2241 SYSTEM DISPATCH QUEUEIFA DISPATCH QUEUE Performance consideration with zAAP, z/OS V1R6 IFACROSSOVER=YES IFAHONORPRIORITY=YES z/OS Dispatcher selects zAAP-eligible #4 for dispatch. If IFA available, dispatch to IFA. If IFA not available, dispatch to CP. With high Goal Importance, zAAP-eligible work will tend to be done by CPs, rather than by IFA.

19. ©Copyright 2004, Computer Management Sciences, Inc., Alexandria, VA www.cpexpert.com 19 WORK UNITPRIORITY Goal, not zAAP #5243 Goal, not zAAP #2241 Goal, not zAAP #4239 DISCR, not zAAP #1192 WORK UNITPRIORITY zAAP-eligible #4237 zAAP-eligible #3235 zAAP-eligible #5233 zAAP-eligible #2231 SYSTEM DISPATCH QUEUEIFA DISPATCH QUEUE Performance consideration with zAAP, z/OS V1R6 IFACROSSOVER=YES IFAHONORPRIORITY=YES z/OS Dispatcher selects zAAP-eligible #4 for dispatch. If IFA available, dispatch to IFA. If IFA not available, dispatch to CP. With low Goal Importance, zAAP-eligible work will tend to be done only by IFAs, which could imply that more zAAP processors are needed than expected.

20. ©Copyright 2004, Computer Management Sciences, Inc., Alexandria, VA www.cpexpert.com 20 WORK UNITPRIORITY Goal, not zAAP #5243 Goal, not zAAP #2241 Goal, not zAAP #4239 DISCR, not zAAP #1192 WORK UNITPRIORITY zAAP-eligible #4178 zAAP-eligible #3176 zAAP-eligible #5174 zAAP-eligible #2172 SYSTEM DISPATCH QUEUEIFA DISPATCH QUEUE Performance consideration with zAAP, z/OS V1R6 IFACROSSOVER=NO IFAHONORPRIORITY=not applicable If IFA available, z/OS Dispatcher on IFA selects zAAP- eligible #4for dispatch. z/OS Dispatcher on CP selects zAAP-eligible #4 for dispatch only after DISCR, not zAAP #1 dispatched. If small number of IFAs defined to LPAR, zAAP- eligible work will tend to be delayed waiting on IFA.

21. ©Copyright 2004, Computer Management Sciences, Inc., Alexandria, VA www.cpexpert.com 21 LPARWEIGHTSHARELCPIFA SYSA505.0%10 SYSB20020.0%20 SYSC20020.0%20 SYSD40040.0%30 SYSE15015.0%21 TOTAL1000100.0%10 LPARWEIGHTSHARELSP%SP LINUX1105.9%111.8% LINUX2105.9%111.8% SYSE15088.2%1176.5% TOTAL170100.0%200.0% LPARWEIGHTSHARELSP%SP LINUX11050.0%1 LINUX21050.0%1 TOTAL20100.0% Central processors (CP) CP Special processors (SP) ICFIFLIFA Before IFA After IFA ( Example only. SYSE cannot really have over 100% as only 1 IFA assigned to SYSE.) Dedicated Performance consideration with zAAP on z890/z990 LPAR Definitions LCP = Logical Central Processor LSP = Logical Special Processor

22. ©Copyright 2004, Computer Management Sciences, Inc., Alexandria, VA www.cpexpert.com 22 Central processors (CP) CP Special processors (SP) ICFIFLIFA Dedicated LPARWEIGHTSHARELSP%SP LINUX17525.0%150% LINUX27525.0%150% SYSE15050.0%1100% TOTAL300100.0%200% LPARWEIGHTSHARELCPIFA SYSA505.0%10 SYSB20020.0%20 SYSC20020.0%20 SYSD40040.0%30 SYSE15015.0%21 TOTAL1000100.0%10 This situation really is no different than when adding any LPAR (except the zAAP part is inherited from the central processor LPAR definition). You must carefully review your weights and resulting shares considering LPARs with zAAPs. Performance consideration with zAAP on z890/z990 LPAR Definitions

23. ©Copyright 2004, Computer Management Sciences, Inc., Alexandria, VA www.cpexpert.com 23 Central processors (CP) CP Special processors (SP) ICFIFLIFA Dedicated LPARWEIGHTSHARELSP%SP LINUX1756.5%119.6% LINUX2756.5%119.6% SYSA504.3%213.0% SYSB20017.4%226.1% SYSC20017.4%252.2% SYSD40034.8%252.2% SYSE15013.0%239.1% TOTAL1150100.0%12 LPARWEIGHTSHARELCPIFA SYSA505.0%12 SYSB20020.0%22 SYSC20020.0%22 SYSD400 40.0% 32 SYSE15015.0%22 TOTAL1000100.0%10 IFA Performance consideration with zAAP on z890/z990 LPAR Definitions

24. ©Copyright 2004, Computer Management Sciences, Inc., Alexandria, VA www.cpexpert.com 24 Central processors (CP) CP Special processors (SP) ICFIFLIFA Dedicated LPARWEIGHTSHARELSP%SP LINUX125016.7%150.0% LINUX225016.7%150.0% SYSA503.3%2 5.0% SYSB20013.3%220.0% SYSC20013.3%240.0% SYSD40026.7%240.0% SYSE15010.0%215.0% TOTAL1500100.0%12 LPARWEIGHTSHARELCPIFA SYSA505.0%12 SYSB20020.0%22 SYSC20020.0%22 SYSD400 40.0% 32 SYSE15015.0%22 TOTAL1000100.0%10 IFA Logical to Physical ratio - 12:3 (4:1) IFL & IFA share comes from same pool Unused IFL capacity can be used for IFA Performance consideration with zAAP on z890/z990 LPAR Definitions

25. ©Copyright 2004, Computer Management Sciences, Inc., Alexandria, VA www.cpexpert.com 25 RMF zAAP performance data TYPE 72Description R723IFAUSamples of zAAP-eligible work using a processor. R723IFCUSamples of zAAP-eligible work executing on a CP. R723IFADSamples of zAAP-eligible work that was delayed, waiting for a processor. R723IFATIFA processor time used by zAAP-eligible work. R723NFFINormalization factor for CP versus IFA speed. R723MFLGIndicators of IFACROSSOVER and IFAHONORPRIORITY specification. R723IFCTIFA processor time spent on normal CPs.

26. ©Copyright 2004, Computer Management Sciences, Inc., Alexandria, VA www.cpexpert.com 26 Conclusions zAAP offering appears to be an excellent way to obtain significantly increased processor capacity at a very attractive price. Sufficient zAAP-eligible work must exist. PR/SM definitions must be carefully reviewed (most problems solved with z9 109). Service class Performance Goals and Goal Importance must be carefully considered. IBM has provided sufficient RMF data for analysts to determine IFA processor capacity requirements and performance problems. OW14131 and OW13953 solve many problems with z/OS V1R6.

27. ©Copyright 2004, Computer Management Sciences, Inc., Alexandria, VA www.cpexpert.com 27 References GM13-0624 – Introducing the new zSeries Application Assist Processor SG24-6310: IBM zSeries 890 Technical Introduction SG24-6947: IBM zSeries 990 Technical Guide SG24-6669: IBM z9 109 Technical Introduction SG24-6386: zSeries Application Assist Processor (zAAP) Implementation SB10-7036-03: zSeries 890 and 990 Processor Resource/Systems Manager Planning Guide SG24-5922: z/OS Intelligent Resource Director z/OS MVS Planning: Workload Management (z/OS V1R6 and z/OS V1R7) MVS Initialization and Tuning Reference (z/OS V1R6 and z/OS V1R7) z/OS Performance: Capacity Planning Considerations for zAAP White Paper z990 and z890 zAAP - What it Can Do for You SHARE - Summer, 2004 MVS SCP Project Session: 2825, Kathy Walsh (IBM Washington Systems Center, Advanced Technical Support)

28. ©Copyright 2004, Computer Management Sciences, Inc., Alexandria, VA www.cpexpert.com 28 References IBM White Paper (WP100489) Mission: zAAP your costs, Running Websphere and Java on the zSeries Application Assist Processor (updated) IBM White Paper (WP100417) z/OS Performance: Capacity Planning Considerations for zAAP Processors IBM EXPO 2005, Session P06 z/OS Performance "HOT" Topics, Kathy Walsh (IBM Washington Systems Center, Advanced Technical Support) IBM EXPO 2005, Session P25 Everything zAAP, Kathy Walsh (IBM Washington Systems Center, Advanced Technical Support) APAR 0A14131 and APAR 0A13953 http://www-1.ibm.com/servers/eserver/zseries/zaap/gettingstarted/

29. ©Copyright 2004, Computer Management Sciences, Inc., Alexandria, VA www.cpexpert.com 29 Introduction to zAAP (zSeries Application Assist Processor) Don Deese Computer Management Sciences, Inc. www.cpexpert.com All trademarks are the property of their respective owners.

30. ©Copyright 2004, Computer Management Sciences, Inc., Alexandria, VA www.cpexpert.com 30 4-WAYMSU 41015 42026 43049 44062 45097 460119 470208 1-WAYMSU 1104 1207 13013 14017 15026 16032 17056 z890 Sub-capacity MSU rating (28 capacity levels) zAAP processor runs at full speed Regardless of capacity rating!