1. SAN Design for IBM i Tape and ProtecTIER
SE166
SAN Design for IBM i Tape and ProtecTIER
Nancy Roper
IBM Americas Advanced Technical Support
This presentation is stored on IBM Techdocs at the following url:
Run it in screenshow mode to see the animation.
Note that there are a few hidden charts.

2. Special Notices
This document was developed for IBM offerings in the United States as of the date of publication. IBM may not make these offerings available in other countries, and the information is subject to change without notice. Consult your local IBM business contact for information on the IBM offerings available in your area.
Information in this document concerning non-IBM products was obtained from the suppliers of these products or other public sources. Questions on the capabilities of non-IBM products should be addressed to the suppliers of those products.
IBM may have patents or pending patent applications covering subject matter in this document. The furnishing of this document does not give you any license to these patents. Send license inquires, in writing, to IBM Director of Licensing, IBM Corporation, New Castle Drive, Armonk, NY USA.
All statements regarding IBM future direction and intent are subject to change or withdrawal without notice, and represent goals and objectives only.
The information contained in this document has not been submitted to any formal IBM test and is provided "AS IS" with no warranties or guarantees either expressed or implied.
All examples cited or described in this document are presented as illustrations of the manner in which some IBM products can be used and the results that may be achieved. Actual environmental costs and performance characteristics will vary depending on individual client configurations and conditions.
IBM Global Financing offerings are provided through IBM Credit Corporation in the United States and other IBM subsidiaries and divisions worldwide to qualified commercial and government clients. Rates are based on a client's credit rating, financing terms, offering type, equipment type and options, and may vary by country. Other restrictions may apply. Rates and offerings are subject to change, extension or withdrawal without notice.
IBM is not responsible for printing errors in this document that result in pricing or information inaccuracies.
All prices shown are IBM's United States suggested list prices and are subject to change without notice; reseller prices may vary.
IBM hardware products are manufactured from new parts, or new and serviceable used parts. Regardless, our warranty terms apply.
Any performance data contained in this document was determined in a controlled environment. Actual results may vary significantly and are dependent on many factors including system hardware configuration and software design and configuration. Some measurements quoted in this document may have been made on development-level systems. There is no guarantee these measurements will be the same on generally-available systems. Some measurements quoted in this document may have been estimated through extrapolation. Users of this document should verify the applicable data for their specific environment.
Revised September 26, 2006

3. Special Notices (Cont.)
The following terms are registered trademarks of International Business Machines Corporation in the United States and/or other countries: AIX, AIX/L, AIX/L (logo), AIX 6 (logo), alphaWorks, AS/400, BladeCenter, Blue Gene, Blue Lightning, C Set++, CICS, CICS/6000, ClusterProven, CT/2, DataHub, DataJoiner, DB2, DEEP BLUE, developerWorks, DirectTalk, Domino, DYNIX, DYNIX/ptx, e business (logo), e(logo)business, e(logo)server, Enterprise Storage Server, ESCON, FlashCopy, GDDM, i5/OS, i5/OS (logo), IBM, IBM (logo), ibm.com, IBM Business Partner (logo), Informix, IntelliStation, IQ-Link, LANStreamer, LoadLeveler, Lotus, Lotus Notes, Lotusphere, Magstar, MediaStreamer, Micro Channel, MQSeries, Net.Data, Netfinity, NetView, Network Station, Notes, NUMA-Q, OpenPower, Operating System/2, Operating System/400, OS/2, OS/390, OS/400, Parallel Sysplex, PartnerLink, PartnerWorld, Passport Advantage, POWERparallel, Power PC 603, Power PC 604, PowerPC, PowerPC (logo), Predictive Failure Analysis, pSeries, PTX, ptx/ADMIN, Quick Place, Rational, RETAIN, RISC System/6000, RS/6000, RT Personal Computer, S/390, Sametime, Scalable POWERparallel Systems, SecureWay, Sequent, ServerProven, SpaceBall, System/390, The Engines of e-business, THINK, Tivoli, Tivoli (logo), Tivoli Management Environment, Tivoli Ready (logo), TME, TotalStorage, TURBOWAYS, VisualAge, WebSphere, xSeries, z/OS, zSeries.
The following terms are trademarks of International Business Machines Corporation in the United States and/or other countries: Advanced Micro-Partitioning, AIX 5L, AIX PVMe, AS/400e, Calibrated Vectored Cooling, Chiphopper, Chipkill, Cloudscape, DataPower, DB2 OLAP Server, DB2 Universal Database, DFDSM, DFSORT, DS4000, DS6000, DS8000, e-business (logo), e-business on demand, EnergyScale, Enterprise Workload Manager, eServer, Express Middleware, Express Portfolio, Express Servers, Express Servers and Storage, General Purpose File System, GigaProcessor, GPFS, HACMP, HACMP/6000, IBM Systems Director Active Energy Manager, IBM TotalStorage Proven, IBMLink, IMS, Intelligent Miner, iSeries, Micro-Partitioning, NUMACenter, On Demand Business logo, POWER, PowerExecutive, PowerVM, PowerVM (logo), Power Architecture, Power Everywhere, Power Family, POWER Hypervisor, Power PC, Power Systems, Power Systems (logo), Power Systems Software, Power Systems Software (logo), PowerPC Architecture, PowerPC 603, PowerPC 603e, PowerPC 604, PowerPC 750, POWER2, POWER2 Architecture, POWER3, POWER4, POWER4+, POWER5, POWER5+, POWER6, POWER6+, pure XML, Quickr, Redbooks, Sequent (logo), SequentLINK, Server Advantage, ServeRAID, Service Director, SmoothStart, SP, System i, System i5, System p, System p5, System Storage, System z, System z9, S/390 Parallel Enterprise Server, Tivoli Enterprise, TME 10, TotalStorage Proven, Ultramedia, VideoCharger, Virtualization Engine, Visualization Data Explorer, Workload Partitions Manager, X-Architecture, z/Architecture, z/9.
A full list of U.S. trademarks owned by IBM may be found at:
The Power Architecture and Power.org wordmarks and the Power and Power.org logos and related marks are trademarks and service marks licensed by Power.org.
UNIX is a registered trademark of The Open Group in the United States, other countries or both.
Linux is a trademark of Linus Torvalds in the United States, other countries or both.
Microsoft, Windows, Windows NT and the Windows logo are registered trademarks of Microsoft Corporation in the United States, other countries or both.
Intel, Itanium, Pentium are registered trademarks and Xeon is a trademark of Intel Corporation or its subsidiaries in the United States, other countries or both.
AMD Opteron is a trademark of Advanced Micro Devices, Inc.
Java and all Java-based trademarks and logos are trademarks of Sun Microsystems, Inc. in the United States, other countries or both.
TPC-C and TPC-H are trademarks of the Transaction Performance Processing Council (TPPC).
SPECint, SPECfp, SPECjbb, SPECweb, SPECjAppServer, SPEC OMP, SPECviewperf, SPECapc, SPEChpc, SPECjvm, SPECmail, SPECimap and SPECsfs are trademarks of the Standard Performance Evaluation Corp (SPEC).
NetBench is a registered trademark of Ziff Davis Media in the United States, other countries or both.
AltiVec is a trademark of Freescale Semiconductor, Inc.
Cell Broadband Engine is a trademark of Sony Computer Entertainment Inc.
InfiniBand, InfiniBand Trade Association and the InfiniBand design marks are trademarks and/or service marks of the InfiniBand Trade Association.
Other company, product and service names may be trademarks or service marks of others.
Revised January 15, 2008

4. Trademarks
The following are trademarks of the International Business Machines Corporation in the United States and/or other countries. For a complete list of IBM Trademarks, see i5/OS, i5/OS logo, AIX, AIX 5L, BladeCenter,Blue Gene, DB2, e-business logo, eServer, IBM, IBM Logo, Infoprint,IntelliStation, iSeries, pSeries, OpenPower, POWER5, POWER5+, Power Architecture, TotalStorage, Websphere, xSeries, z/OS, zSeries
The following are trademarks or registered trademarks of other companies:
Java and all Java based trademarks and logos are trademarks of Sun Microsystems, Inc., in the United States and other countries or both
Microsoft, Windows,Windows NT and the Windows logo are registered trademarks of Microsoft Corporation in the United States, other countries, or both.
Intel, Intel logo, Intel Inside, Intel Inside logo, Intel Centrino, Intel Centrino logo, Celeron, Intel Xeon, Intel SpeedStep, Itanium, and Pentium are trademarks or registered trademarks
of Intel Corporation or its subsidiaries in the United States and other countries.
UNIX is a registered trademark of The Open Group in the United States and other countries or both.
Linux is a trademark of Linus Torvalds in the United States, other countries, or both.
Other company, product, or service names may be trademarks or service marks of others.
NOTES:
Any performance data contained in this document was determined in a controlled environment. Actual results may vary significantly and are dependent on many factors including system hardware configuration and software design and configuration. Some measurements quoted in this document may have been made on development-level systems. There is no guarantee these measurements will be the same on generally-available systems. Users of this document should verify the applicable data for their specific environment.
IBM hardware products are manufactured from new parts, or new and serviceable used parts. Regardless, our warranty terms apply.
Information is provided “AS IS” without warranty of any kind.
All customer examples cited or described in this presentation are presented as illustrations of the manner in which some customers have used IBM products and the results they may have achieved. Actual environmental costs and performance characteristics will vary depending on individual customer configurations and conditions.
This publication was produced in the United States. IBM may not offer the products, services or features discussed in this document in other countries, and the information may be subject to change without notice. Consult your local IBM business contact for information on the product or services available in your area.
All statements regarding IBM's future direction and intent are subject to change or withdrawal without notice, and represent goals and objectives only.
Information about non-IBM products is obtained from the manufacturers of those products or their published announcements. IBM has not tested those products and cannot confirm the performance, compatibility, or any other claims related to non-IBM products. Questions on the capabilities of non-IBM products should be addressed to the suppliers of those products.
Prices are suggested US list prices and are subject to change without notice. Starting price may not include a hard drive, operating system or other features. Contact your IBM representative or Business Partner for the most current pricing in your geography.
Any proposed use of claims in this presentation outside of the United States must be reviewed by local IBM country counsel prior to such use.
The information could include technical inaccuracies or typographical errors. Changes are periodically made to the information herein; these changes will be incorporated in new editions of the publication. IBM may make improvements and/or changes in the product(s) and/or the program(s) described in this publication at any time without notice.
Any references in this information to non-IBM Web sites are provided for convenience only and do not in any manner serve as an endorsement of those Web sites. The
materials at those Web sites are not part of the materials for this IBM product and use of those Web sites is at your own risk.
IBM may have patents or pending patent applications covering subject matter in this document. The furnishing of this document does not give you any license to these patents. Send license inquires, in writing, to IBM Director of Licensing, IBM Corporation, New Castle Drive, Armonk, NY USA.

5. Agenda Designing an IBM i Tape SAN Firm Design Rules
Recommended “Best Practices”
Recap

6. SAN Design Rules and Best Practices

7. SAN Design for IBM i Firm Rules Multipath is not supported for Tape
Maximum Addresses per Tape Fibre adapter
Fc 2765, 5704, 5761 – 16 devices
Fc 5749, 5774, 5735 – 64 devices * 2 ports
Max Drives in Library
32 Drives per TAPMLBxx attached
92 Drives per TAPMLBxx total (IOP’d)
256 Drives per TAPMLBxx total (IOPless)
Prior to V7R1 and Gen 2 IOPless driver, disparate drives must be separated via
Separate tape adapter cards
*or*
Separate tape library partitions
Can’t Pool Drives across IOP’d/IOPless cards
Best Practices
Put tape Adapters alone on an IOP or virtual IOP so they can be reset
Don’t Mix Disk/Tape on a Fibre adapter (eg new IOPless cards)
Plan Ahead for alt-install if using fibre cards with IOP (non-boot)
Design for Performance and Resiliency

8. RULES:
Multipath

9. Multipath – What is it? For Fibre Tape (NOT supported on IBM i)
SAN Switches
Dual-ported Tape Drive
Eg 359x family
For Fibre Disk
(Supported on IBM i)
IBM i
IBM i
SAN Switch
Tape Drives
SAN Switches
External Disk

10. Multipath – Tape Example
IBM i
SAN Switch
Tape Drives
Zone Blue
(Active)
Zone Green
Solution #2
Avoiding a Multipath Situation
Solution #2: Any Tape Drive
Create SAN zones so each drive is only seen down a single path
IBM i
SAN Switches
Dual-ported Tape Drive
Eg 359x family
Zone Blue
(Active)
Zone Green
(Inactive)
Solution #1
Dual Ported Drive with standby zone for quick switchover after failure
Solution #1: Dual-ported Drive
Create two SAN zones
Blue Zone is Active normally
Green zone would be activated if a component of the Blue zone failed
More Popular Method

11. IOP’d and IOPless adapters The Gen 2 IOPless Tape Driver
PRELIM INFO:
IOP’d and IOPless adapters
and
The Gen 2 IOPless Tape Driver

12. IOP and IOPless explained
Other Platforms
Disk HBA
Tape HBA
Comms HBA
IBM i Originally – “IOP’d”
Twinax IOA
Ethernet IOA
Tape IOA
IOP
IOP
HBA – Host Bus Adapter
Summary of IBM i Fibre Adapters
IOP – Input / Output Processor
IOA – Input / Output Adapter
IOP’d
Fc 2765
100 MB/sec 1-port
Fc 5704
200 MB/sec 1-port
Fc 5761
400 MB/sec 1-port
IOPless
Fc 5749
400 MB/sec 2-port PCI-X
Fc 5774
400 MB/sec 2-port PCI-e
Fc 5735
800 MB/sec 2-port PCI-e NPIV
Fc 5273
Low profile 5774
Fc 5276
Low profile 5735
Fc 5708
FCoE PCI-e (NPIV only)
Fc 5729
800 MB/sec 4-port (NPIV only)
IBM i After Merger with AIX – “IOPless”
Twinax IOA
Ethernet IOA
Tape IOA
© 2012 IBM Corporation

13. Gen 2 IOPless Tape Driver
New and Improved
For customers using IOPless SAS and fibre drives
All customers are encouraged to get it
More robust than original IOPless tape driver
How to get it on IBM i 6.1.1:
PTF MF50093 or supercede
Read II14355, II14526, II14584, II14615 for related PTFs etc
How to get it on IBM i 7.1
Included with the base OS
Read Info Center for configuration changes needed at install
Library and drive resource names may change
Control path rules have changed – 2 port fibre card now needs to be able to see a control path drive on each port (see example later)
Control path failover available with IBM i 7.1 and current PTFs
Disparate drives can share a library *and* a fibre card at IBM i 7.1 (see example later)
GET IT !
New
and
Improved
New and Improved
Note: If you have a lot of drives of one type (eg LTO4) in a library such that you need more than 1 fibre card to attach them all, then continue to choose either IOP’d or IOPless fibre cards for them, but not a mixture. This is related to “drive pooling”. See example later
GET IT !
© 2012 IBM Corporation

14. Max Devices per Fibre Tape Adapter
RULES:
Control Paths
and
Max Devices per Fibre Tape Adapter

15. What is a Control Path?
LAN cable for library control commands
3494 Used a Communications Cable for Control Commands
Mount/Eject a tape
Insert/Remove a tape
Show inventory in the tape library
Show which tape is in each drive
etc
SAN cable for Data
SAN cable with control path for Data *and* control commands
All other libraries send the control commands down the Data Cable via the “Control path”
On TS3500 etc, control paths can be set up via the operator panel or the tape library GUI

16. Control Path Rules and Examples
The heavier Line denotes the control path drives in the diagram
Control Path Rules and Examples
Rule: For IOP’d adapters, every IBM i Fibre Tape Adapter must be able to SEE at least 1 tape drive with a control path in every tape library or tape library partition it is attached to, and in every zone
IBM i
SAN
Switch
Tape Library
IBM i
SAN
Switch
2 Tape Libraries or
Tape Library Partitions
IBM i
SAN
Switch
Tape Library
Zone Blue
Zone Green

17. Control Path Rules and Examples
The heavier Line denotes the control path drives in the diagram
Control Path Rules and Examples
Rule #A: For IOPless fibre adapters with the gen 1 IOPless tape driver, use a single control path on one of the ports. The other ports can use it, even if it is in a different zone.
Rule #B: For IOPless fibre adapters with the gen 2 IOPless tape driver, at least 1 tape drive with a control path is needed ON EACH PORT in every tape library or tape library partition it is attached to, and in every zone.
IBM i
Tape Library
Gen 1 IOPless Driver
IBM i
Tape Library
Gen 2 IOPless Driver
Eg #1: Direct Attach:
Note: this change was required in order to support non-homogenous libraries on a single adapter card
Note: The 2-port SAS card follows rule #A, regardless of which tape driver it is using.

18. Control Path Rules and Examples
The heavier Line denotes the control path drives in the diagram
Control Path Rules and Examples
Rule #A: For IOPless fibre adapters with the gen 1 IOPless tape driver, use a single control path on one of the ports. The other ports can use it, even if it is in a different zone.
Rule #B: For IOPless fibre adapters with the gen 2 IOPless tape driver, at least 1 tape drive with a control path is needed ON EACH PORT in every tape library or tape library partition it is attached to, and in every zone.
Eg #2: SAN Attach:
Gen 1 IOPless Driver
Gen 2 IOPless Driver
IBM i
IBM i
Note: this change was required in order to support non-homogenous libraries on a single adapter card
Note: The 2-port SAS card follows rule #A, regardless of which tape driver it is using.
Zone Blue
Zone Green
Zone Blue
Zone Green
SAN
Switch
SAN
Switch
Tape Library
Tape Library
© 2012 IBM Corporation

19. Max Addresses per IBM i Fibre Tape Adapter
Rule: Each IOP’d IBM i Fibre Tape Adapter can use at most 16 addresses.
Each IOPless IBM i Fibre Tape Adapter can use at most 64 addresses per port.
(Tape drives and control paths each use 1 address)
IBM i
15 Drives + 1 Control Path = 16 Addresses
SAN
Switch 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15
Tape Library

20. Max Addresses per IBM i Fibre Tape Adapter
Rule: Each IOP’d IBM i Fibre Tape Adapter can use at most 16 addresses.
Each IOPless IBM i Fibre Tape Adapter can use at most 64 addresses per port.
(Tape drives and control paths each use 1 address)
IBM i
Partitioned Library
14 Drives + 2 Control Paths = 16 Addresses
Note that you can have 1 fewer drives in this case
SAN
Switch 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15
Tape Library

21. Max Addresses per IBM i Fibre Tape Adapter
Rule: Each IOP’d IBM i Fibre Tape Adapter can use at most 16 addresses.
Each IOPless IBM i Fibre Tape Adapter can use at most 64 addresses per port.
(Tape drives and control paths each use 1 address)
Person went crazy with control paths
8 Drives + 8 Control Paths = 16 Addresses
IBM i
Prior to IBM I 7.1, the extra control paths offer no benefit following a drive failure, since you still need to restart on the new control path drive, so you may as well make the control path at that time
SAN
Switch 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15
Tape Library

22. RULES:
Auto-configuration
and
32 Drives per TAPMLBxx

23. TS3500 Autoconfiguration Rules – Example #1
Rule: Every IBM i Fibre Tape Adapter will generate a TAPMLBxx
IBM i will then “pool” all drives of the same type in that library partition and show them in all TAPMLBxx’s with drives of that type in that library partition
WRKMLBSTS
IBM i
TAPMLB01
TAP01
TAP02
TAP03
TAP04
TAP05
TAP06
SAN
Switch 2 3 4 5 6
For detailed information on
the TS3500 auto-config rules, see: 1
Tape Library

24. TS3500 Auto-configuration Rules – Example #2
Rule: Every IBM i Fibre Tape Adapter will generate a TAPMLBxx
IBM i will then “pool” all drives of the same type in that library partition and show them in all TAPMLBxx’s with drives of that type in that library partition
WRKMLBSTS
Control Path Drive
WRKMLBSTS
IBM i
TAPMLB01
TAP01
TAP02
TAP03
TAP04
TAP05
TAP06
TAPMLB02
TAP07
TAP08
TAP09
TAP10
TAP11
TAP12
Control Path Drive 7 8 9 10 11 12
Zone Green
Zone Blue
SAN
Switch 1 2 3 4 5 6
Tape Library

25. TS3500 Auto-configuration Rules – Example #2 - ctd
Rule: Every IBM i Fibre Tape Adapter will generate a TAPMLBxx
IBM i will then “pool” all drives of the same type in that library partition and show them in all TAPMLBxx’s with drives of that type in that library partition
WRKMLBSTS
WRKMLBSTS
System i
TAPMLB01
TAP01
TAP02
TAP03
TAP04
TAP05
TAP06
TAP07
TAP08
TAP09
TAP10
TAP11
TAP12
TAPMLB02
TAP01
TAP02
TAP03
TAP04
TAP05
TAP06
TAP07
TAP08
TAP09
TAP10
TAP11
TAP12
Pooled Drives
Zone Blue
Zone Green
SAN
Switch
Pooled Drives 1 2 3 4 5 6 7 8 9 10 11 12
Tape Library

26. TS3500 Auto-configuration Rules – Example #2 - ctd
Rule: Drives that are going to “pool” must be on one class of adapter card: either IOP’d or IOPless but not a mixture. Different card types in the same class are acceptable (eg fc 5704 and fc 5761 are OK but not fc 5761 and fc 5774)
WRKMLBSTS
IBM i
WRKMLBSTS
IOP’d
IOPless
TAPMLB01
TAP01
TAP02
TAP03
TAP04
TAP05
TAP06
TAP07
TAP08
TAP09
TAP10
TAP11
TAP12
TAPMLB02
TAP01
TAP02
TAP03
TAP04
TAP05
TAP06
TAP07
TAP08
TAP09
TAP10
TAP11
TAP12
Pooled Drives
Zone Blue
Zone Green
SAN
Switch
Pooled Drives 1 2 3 4 5 6 7 8 9 10 11 12
Tape Library

27. Maximum of 32 drives in a TAPMLBxx
Rule: There is a maximum of 32 drives in a logical library (TAPMLBxx)
How to comply?: Create a new Tape Library LPAR if you have more than 32 “like” drives
WRKMLBSTS
WRKMLBSTS
IBM i
TAPMLB02
TAP01
TAP02
. . .
TAP15
TAP16
TAP17
TAP30
TAPMLB01
TAP01
TAP02
. . .
TAP15
TAP16
TAP17
TAP30
Zone Blue
Zone Green
SAN Switch 15 16 30 … … 1
Tape Library

28. Maximum of 32 drives in a TAPMLBxx
Rule: There is a maximum of 32 drives in a logical library (TAPMLBxx)
How?: Create a new Tape Library LPAR if you have more than 32 “like” drives
WRKMLBSTS
WRKMLBSTS
WRKMLBSTS
IBM i
TAPMLB02
TAP01
TAP02
. . .
TAP15
TAP16
TAP17
TAP30
TAP31
TAP32
TAP45
TAPMLB03
TAP01
TAP02
. . .
TAP15
TAP16
TAP17
TAP30
TAP31
TAP32
TAP45
TAPMLB01
TAP01
TAP02
. . .
TAP15
TAP16
TAP17
TAP30
TAP31
TAP32
TAP45 45 31
Zone Purple …
Zone Blue
Zone Green
SAN Switch 15 16 30 … … 1 Oh
Oh!
Tape Library

29. Maximum of 32 drives in a TAPMLBxx - solution
Rule: There is a maximum of 32 drives in a logical library (TAPMLBxx)
How?: Create a new Tape Library LPAR if you have more than 32 “like” drives
WRKMLBSTS
WRKMLBSTS
WRKMLBSTS
IBM i
TAPMLB02
TAP01
TAP02
. . .
TAP15
TAP16
TAP17
TAP30
TAPMLB03
TAP31
TAP32
. . .
TAP45
TAPMLB01
TAP01
TAP02
. . .
TAP15
TAP16
TAP17
TAP30
Zone Blue
Zone Green
Zone Purple
SAN Switch 15 16 30 … … … 1 31 45
Tape Library

30. in a tape library partition
RULES:
Maximum 92 / 256 Drives
in a tape library partition

31. Maximum of 92 / 256 drives in a Library partition
Rule: Each System can see at most 32 drives in 1 tape library due to the 32 drive limit in a TAPMLBxx. If there are multiple attached systems, then there is also a max of 92 total drives (IOP’d) or 256 total drives (IOPless). The reason? When a system queries the tape library for information about its configuration, there is only space to hold information about 92 /256 total drives
IBM i
IBM i
IBM i
IBM i
Oh Oh – More than 92 drives on IOP’d adapters!
SAN Switch
Zone Blue
Zone Green
Zone Purple
Zone Pink … … … … 1 25 26 1 50 51 1 75 76 1
100
Tape Library 1

32. Sharing an Adapter/Library
RULES:
Disparate Tape Drives
Sharing an Adapter/Library

33. Disparate Tape Drives Sharing Adapters / Libraries
Rule: Prior to the Gen 2 Tape Driver, tape drives with different media capabilities need to be in different TAPMLBxx’s
How?: Either (1) Put them in different tape libraries/tape library partitions
Or (2) Put them on different fibre tape adapter cards
IBM i
LTO3
Tape Library
LTO4
SAN Switch
Zone Blue
Zone Green
SAN Switch
IBM i
LTO3
Tape Library
LTO4
IBM i
SAN Switch
LTO3
LTO3
LTO4
LTO4
Tape Library

34. Disparate Tape Drives Sharing Adapters / Libraries
With the gen 2 driver, the scenario at the left of the previous chart is also valid.
In both cases, adding a separate tape library (eg the physical library shown) is valid since it’s a separate library. Be aware of the max # devices on an adapter
Zone Blue
Zone Green
SAN Switch
IBM i
LTO3
Tape Library
LTO4
IBM i
IBM i
SAN Switch
SAN Switch
LTO3
LTO3
LTO4
LTO4
LTO3
LTO3
LTO4
LTO4
Tape Library
Tape Library

35. BEST PRACTICES:
ProtecTIER Zoning

36. Use 1-1 zoning with overlapping zones rather than group zoning
ProtecTIER Zoning
The customer in this example has a TS3500 with LTO4 drives sharing the fibre cards with a ProtecTIER. This was for a POC, hence the unusual layout and drive distribution
ProtecTIER Node A
ProtecTIER Node B
Use 1-1 zoning with overlapping zones rather than group zoning
xx-xxxxx
Xx-xxxxx
7 drives
1 Ctl Pth
xx-xxxxx
Xx-xxxxx
7 drives
1 Ctl Pth
Xx-xxxxx
xx-xxxxx
2 drives
1 Ctl Pth
Xx-xxxxx
2 drives
1 Ctl Pth
Xx-xxxxx
2 drives
1 Ctl Pth
Xx-xxxxx
2 drives
1 Ctl Pth
Xx-xxxxx
2 drives
1 Ctl Pth
Xx-xxxxx
2 drives
1 Ctl Pth
Make plenty of drives and use LUN Masking so each server has its own private drives 1 2 3 1 2 3 1 2 1 2 1 2
5761 C5
C55C66D0
5761 C2
C460FC31
5761 C2 C
5761 C5
C981F25F
5761 C5 C
5761 C5
C666B777
LTO4 4
VTL
8+3
Total Addr 15
LTO4 2
VTL
8+3
Total Addr 13
LTO4 4
VTL
8+3
Total Addr 15
LTO4 2
VTL
8+3
Total Addr 13
LTO4 4
VTL
8+3
Total Addr 15
LTO4 2
VTL
8+3
Total Addr 13
IBM i #1
IBM i #2
IBM i #3 36 36

37. Tape Adapter Alone on an IOP
BEST PRACTICES:
Tape Adapter Alone on an IOP

38. Tape Adapters Alone on an IOP
IOPs can have up to 4 daughter cards
For fibre tape, limit it to 2 adapters per IOP due to bandwidth
BUT consider putting a single fibre adapter ALONE on an IOP because:
Tape IOA
IOP
If the tape adapter is alone, you can reset the IOP without impacting the other cards
On POWER5 generation hardware, a 400 MB/sec fibre card can consume the entire bandwidth of the bus if it’s running full tilt, so 2 tape IOA’s may be too much
On IOPless cards, resetting the virtual IOP doesn’t cause the tape drive to re-scan like resetting a physical IOP does. Instead, go to the HMC and power the tape IOA off/on to do the equivalent of a reset.

39. Plan Ahead for Alt-Install
BEST PRACTICES:
Plan Ahead for Alt-Install

40. Plan Ahead for Alt-Install
To re-load a system from a tape adapter that can’t alt-IPL (eg IOP’d fibre cards), use the alt-install procedure
Boot from LIC CD
Indicate the Drive where the SAVSYS is
Reload
SAVSYS LS
Set this up in advance via a manual IPL so you can choose your drive via serial # vs bus location
Instructions are in chapter 17 of the Backup and Recovery Guide
When you alt-install, you boot to the LIC on your CD, but it’s the LIC on your *SAVSYS tape that is loaded onto your load source drive

41. Don’t mix Disk/Tape on a Fibre Adapter
BEST PRACTICES:
Don’t mix Disk/Tape on a Fibre Adapter

42. Don’t Mix Disk/Tape on a Fibre Adapter
For IOP’d IBM i fibre cards, there are separate cards for disk and tape …
Fibre Tape
Fibre Disk
Gen 1
100 MB/sec
Fc 2765
Fc 2766
Gen 2
200 MB/sec
Fc 5704
Fc 2787
Gen 3
400 MB/sec
Fc 5761
Fc 5760
For IOPless IBM i fibre cards, the same card can be used for disk or tape …
Fibre Tape or Disk
Gen 4
400 MB/sec
Fc 5749 (PCI-X)
Fc 5774 (PCI-e) (etc)
See complete list of IOPless fibre cards earlier in this pitch on the chart entitled “IOP’d and IOPless explained”
BUT …. Plan to use separate cards for disk and tape for more predictable performance
Disk workload is typically small random reads/writes
Tape workload is typically large sequential reads/writes

43. Performance and Resiliency
BEST PRACTICES:
Design for
Performance and Resiliency

44. Hardware Choices for Tape Performance
This chart dates back to POWER5 days. On newer boxes our main problem is older / slower tape adapters and SAN switches
Hardware Choices for Tape Performance
CPU Power
Tape Adapters
5704/5761: 2/4 Gbit fibre
LVD SCSI
Adapter Placement
64 bit slots
High Speed Buses
HSL Placement
Spread across HSLs
Add more HSLs if needed
HSL
User Mix: 1.3 CPUs per tape drive
Large File: 0.5 CPUs per tape drive
Memory
HSL
User Mix: 1 GB per save
Large File: ½ GB per save
Disk
User Mix: 50 arms, 15K RPM
Large File: 40 arms, 15K RPM
On EXP24 disk or newer, 6-12 disk arms are enough to run an LTO3 drive at rated speed

45. Notes – Hardware Choices for Tape Performance
Customer environments that need to run high-end tape drives (eg LTO-3 and TS1120) at the maximum rated speed (eg largefile), should place tape adapter cards in the following slots:
5094/5294 towers – use slots C08/C09
5088/0588 towers – use slots C08/C09
5074/5079 towers – use slots C01-C04 – these are PCI vs PCI-X towers so are not as fast as the others shown here
5078/0578 towers – use slots C01-C04 – these are PCI vs PCI-X towers so are not as fast as the others shown here
Other towers – any 64-bit slot is equally good
If using a 5088/0588 on an i5 system, also add RPQ # so it can run at HSL-2 (RIO-G) speeds
Tape Adapter Card Maximum Bandwidth
Generation 1 – fc 2765 – 100 MB/sec
Generation 2 – fc 5704 – 200 MB/sec
Generation 3 – fc 5761 – 400 MB/sec
Maximum Sustained Rates for Towers (all buses combined)
Recent Towers on 8xx systems – 400 MB/sec total
Recent Towers on Power 5 and above systems – 600 MB/sec total
Maximum Sustained Rates for HSL Loops
HSL loops on 8xx systems – 700 MB/sec full duplex each direction around the loop
HSL2/RIO-G Loops on Power 5 and above systems – 1200 MB/sec full duplex each direction around the loop
Tape adapter cards should be spread across towers and across HSL Loops. In tape-intensive environments, additional HSL loops may be required to provide adequate bandwidth for multiple high-end drives to run simultaneously

46. Balancing Saves Across Tape Adapters
Note: more recent benchmarks show LTO4 running at 250 MB/sec for largefile
Balancing Saves Across Tape Adapters
Fibre Tape Adapter
Maximum Bandwidth
Fc 2765
100 MB/sec
Fc 5704
200 MB/sec
Fc 5761
400 MB/sec
Tape Drive
User Mix
Large File
LTO2
43 MB/sec
100 MB/sec
LTO3
60 MB/sec
140 MB/sec
LTO4
185 MB/sec
(figures are for 15K RPM integrated disk)
3592J
51 MB/sec
104 MB/sec
TS1120
250 MB/sec
TAPMLB01
TAP01
Unprotected
TAP02
TAP03
TAP04
IBM i
SAN Switch
Tape Library
Q1) How many TS1120 User Mix Saves can run across a fc 5761 at once with full performance?
Answer:
6 – 7 Saves
Q2) How many LTO4 Large-File Saves can run across a fc 5761 at once with full performance?
Answer:
If a drive was broken one night, would you be OK?
2 Saves

47. Balancing Saves Across Tape Adapters
Device
Bandwidth
Fc 5761
400 MB/sec
LTO4 Largefile
185 MB/sec
Balancing Saves Across Tape Adapters
TAPMLB01
TAP01
Unprot.
TAP02
TAP03
TAP04
TAPMLB01
TAP01
Unprot.
TAP02
TAP03
TAP04
TAPMLB02
TAP01
Dealloc
TAP02
TAP03
TAP04
IBM i
SAN Switch
Tape Library
IBM i
SAN Switch
Tape Library
Q3) Suppose you needed to run 4 LTO4 largefile saves at once? How would you change your configuration?
Answer:
Q4) If 1 drive was broken one night, would you have the resilience you need?
Answer:

48. Balancing Saves Across Tape Adapters
Device
Bandwidth
Fc 5761
400 MB/sec
LTO4 Largefile
185 MB/sec
Balancing Saves Across Tape Adapters
TAPMLB01
TAP01
Unprot.
TAP02
TAP03
TAP04
TAPMLB01
TAP01
Unprot.
TAP02
TAP03
TAP04
TAPMLB02
TAP01
Dealloc
TAP02
TAP03
TAP04
Q5) How would you use this 5-drive solution for good performance and resilience?
Answer:
IBM i
SAN Switch
Tape Library
IBM i
SAN Switch
Tape Library
System i
SAN Switch
Tape Library
IBM i

49. Balancing Saves Across Tape Adapters
Device
Bandwidth
Fc 5761
400 MB/sec
LTO4 Largefile
185 MB/sec
Balancing Saves Across Tape Adapters
TAPMLB01
TAP01
Unprot.
TAP02
TAP03
DeAllo.
TAP04
TAP05
TAPMLB02
TAP01
Dealloc
TAP02
TAP03
Unprot
TAP04
TAP05
TAPMLB01
TAP01
Unprot.
TAP02
TAP03
TAP04
TAPMLB01
TAP01
Unprot.
TAP02
TAP03
TAP04
TAPMLB02
TAP01
Dealloc
TAP02
TAP03
TAP04
IBM i
SAN Switch
Tape Library
IBM i
SAN Switch
Tape Library
System i
SAN Switch
Tape Library
IBM i
SAN Switch
Tape Library

50. Balancing Saves Across Tape Adapters
Device
Bandwidth
Fc 5761
400 MB/sec
LTO4 Largefile
185 MB/sec
Balancing Saves Across Tape Adapters
Q6) Explain why this 3-adapter solution is slightly more robust?
Answer:
TAPMLB01
TAP01
Unprot.
TAP02
TAP03
TAP04
TAP05
TAPMLB02
TAP01
Dealloc
TAP02
TAP03
TAP04
TAP05
TAPMLB03
TAP01
Dealloc
TAP02
TAP03
TAP04
TAP05
IBM i
SAN Switch
Tape Library
IBM i
SAN Switch
Tape Library
System i
SAN Switch
Tape Library
IBM i

51. Balancing Saves Across Tape Adapters
WRKMLBSTS on System 1
WRKMLBSTS on System 2
TAPMLB01
TAP01
Allocated
TAP02
TAP03
Unprotected
TAP04
TAP05
Deallocated
TAPMLB01
TAP01
Deallocated
TAP02
TAP03
Unprotected
TAP04
TAP05
Allocated
One last trick:
When selecting a drive for a save, IBM i will choose a drive that is “allocated” on this system before it picks a drive that is “unprotected”
Sometimes customers will use the VRYCFG command to adjust the drive allocations prior to submitting a save to influence drive selection. Note: if this save moves to a 2nd tape cartridge, IBM i may pick a different drive for the 2nd tape

52. How can you check how fast your saves are running today? PRTRPTBRM
This is the new PRTRPTBRM *CTLGRPSTAT report
Excellent for:
Monitoring / Analyzing ongoing Backup Performance
Sizing New Tape / ProtecTIER Environments
Once the PTF is loaded, BRMS will start tracking saves: try to apply the PTF several weeks before you need your first reports
Backups that run via Control Group (STRBKUBRM) will have full information
Backups that run via SAVxxxBRM will be bundled in the line labelled *NONE. Adjust the report times to try to isolate each save
Available via the June 2012 BRMS quarterly PTF
June 2012 BRMS PTF
V5R4 SI46335 (Partial Support – see note)
V6R1 SI46339
IBM i 7.1 SI46340
Note: Reports for a V5R4 system must be created on a V6R1 or IBM i 7.1 system that is in the same BRMS network. Use the “From System” parameter

53. SAN Design for IBM i Firm Rules Multipath is not supported for Tape
Maximum Addresses per Tape Fibre adapter
Fc 2765, 5704, 5761 – 16 devices
Fc 5749, 5774, 5735 – 64 devices * 2 ports
Max Drives in Library
32 Drives per TAPMLBxx attached
92 Drives per TAPMLBxx total (IOP’d)
256 Drives per TAPMLBxx total (IOPless)
Prior to V7R1 and Gen 2 IOPless driver, disparate drives must be separated via
Separate tape adapter cards
*or*
Separate tape library partitions
Can’t Pool Drives across IOP’d/IOPless cards
Best Practices
Put tape Adapters alone on an IOP or virtual IOP so they can be reset
Don’t Mix Disk/Tape on a Fibre adapter (eg new IOPless cards)
Plan Ahead for alt-install if using fibre cards with IOP (non-boot)
Design for Performance and Resiliency

54. The End
Thank You!