1. 2014 LENOVO. ALL RIGHTS RESERVED. SAN Fundamentals

2. 2 2014 LENOVO. ALL RIGHTS RESERVED.  Distributed Model of data flow  Direct Attach Storage  SCSI Protocol  SCSI addressing / subaddressing  Fiber Channel  Centralizad Model of data flow  Storage Area Networks  Topologies  Management of SAN  Zoning  ISL  Architecture Agenda

3. 3 2014 LENOVO. ALL RIGHTS RESERVED.  Data is written to, and retrieved from, a disk drive  Typically via local application or server application  Applications / file systems utilize block-level I/O  Send/retrieve data via I/O blocks  Users utilize file-level I/O  Send / retrieve data files 0 1 1 0 1 0 0 1 0 1 0 1 1 1 0 1 0 1 0 0 0 1 Data And Disks

4. 4 2014 LENOVO. ALL RIGHTS RESERVED. Yesterday’s View of Information

5. 5 2014 LENOVO. ALL RIGHTS RESERVED. DAS Device Direct Attached Storage

6. 6 2014 LENOVO. ALL RIGHTS RESERVED.  Storage is directly connected to a single server  SCSI, SAS, iSCSI, Fibre Channel  Block-level I/O  Internal drives  With or without RAID protection  External drives  Storage system  Controller-based RAID engine Direct Attached Storage

7. 7 2014 LENOVO. ALL RIGHTS RESERVED. Motherboard HA External storage system connected via host adapter Controller-based RAID Controllers Application Server External DAS

8. 8 2014 LENOVO. ALL RIGHTS RESERVED.  Connects to Server using SAS or SCSI  Maybe JBOD or RAID Server SCSI or SAS Direct Attached Storage

9. 9 2014 LENOVO. ALL RIGHTS RESERVED.  Issues  Limited distance Server SCSI or SAS Direct Attached Storage

10. 10 2014 LENOVO. ALL RIGHTS RESERVED.  Issues  Limited distance  Limited number of devices (SCSI)  Limited redundancy Server SCSI or SAS Direct Attached Storage

11. 11 2014 LENOVO. ALL RIGHTS RESERVED. The point−to−point topology in DAS Direct Attached Storage

12. 12 2014 LENOVO. ALL RIGHTS RESERVED. External DAS Advantages  Low-cost  Drives are typically included with the server  Immediate utilization  Some data protections Internal DAS Advantages  Better than data stored on clients  Increased availability and performance  RAID protections  Increased features and functionality  Scalability Direct Attached Storage

13. 13 2014 LENOVO. ALL RIGHTS RESERVED. DAS Disadvantages  Each server has its own storage device ($$)  Management is difficult  Reduced Productivity  Expensive to backup  Wasted storage space  Difficult to share data Direct Attached Storage

14. 14 2014 LENOVO. ALL RIGHTS RESERVED. Shared DAS  Storage is directly connected to a single server  SAS, iSCSI, Fibre Channel  Storage system consist of RAID controllers and drive enclosures  RAID engine is controller-based Direct Attached Storage

15. 15 2014 LENOVO. ALL RIGHTS RESERVED. Host Bus Adapter

16. 16 2014 LENOVO. ALL RIGHTS RESERVED. The initiating device is a device that looks for and communicates with target devices. It is commonly referred to as the host bus adapter (HBA), and it resides in the server or client workstation. The significance of the HBA is that it actually is an active device that seeks out its targeted pair to communicate with so as to achieve a file transfer. The HBA has the ability to monitor its path to its targeted pair. If, for some reason, it loses contact with the target, the initiator will switch to an alternate target. In order for this event to occur, one level of redundancy is put in place whereby there are dual initiators, dual switches, and mirrored disks. Host Bus Adapter

17. 17 2014 LENOVO. ALL RIGHTS RESERVED.  Small Computer System Interface (SCSI) SCSI is a protocol for connecting computers with external devices for data management or data protection It defines:  Commands: These are standards that define specific command sets for either all SCSI devices, or for particular types of SCSI devices.  Protocols: These standards formalize the rules by which various devices communicate and share information, allowing different devices to work together. These standards are sometimes said to describe the transport layer of the interface.  Interconnects: These are standards that define specific interface details, such as electrical signaling methods and transfer modes. They are sometimes called physical layer standards as well. What Does SCSI Stand For?

18. 18 2014 LENOVO. ALL RIGHTS RESERVED.  An industry standard I/O Bus  Standard connectors are the same on each device  All devices share a common bus 8-bit data bus 16-bit data bus The SCSI interface….started it all!

19. 19 2014 LENOVO. ALL RIGHTS RESERVED.  Disk Drives  Tape Drives  Removable Media Drives (Zip)  CD-ROM Drives  CD-R/CD-RW Drives  Optical Memory Drives  Media Changers What Types of Devices Use SCSI?

20. 20 2014 LENOVO. ALL RIGHTS RESERVED. Server SAS HBA or SCSI adapter RAID sub-system SCSI or SAS Ethernet to Client workstations Dual Controller RAID with only one controller in use (B not used in this example). This RAID system has four SCSI buses with five drives on each bus. Controller SCSI/SAS Chip Controller SCSI/ SAS Chip initiator target Where do SCSI and SAS fit in?

21. 21 2014 LENOVO. ALL RIGHTS RESERVED.  LUNs are a type of sub-addressing supported by SAS and SCSI  LUNs are selected through the Identify message Host Adapter ID 7 Controller ID 1 Disk Drive LUN 0 Disk Drive LUN 1 Controller ID 2 Disk Drive LUN 0 Disk Drive LUN 1 Logical Unit Number (LUN)

22. 22 2014 LENOVO. ALL RIGHTS RESERVED.  RAID 0: Striped set without parity (Non-Redundant Array). Fastest and most efficient level but offers no fault tolerance  RAID 1: Mirrored set without parity neither striping. Provides fault tolerance from disk errors and failure of all but one of the drives. Increased read performance occurs when using a multi-threaded operating system that supports split seeks, very small performance reduction when writing  RAID 3:Striped set with dedicated parity/Bit interleaved parity. This mechanism provides an improved performance and fault tolerance similar to RAID 5, but with a dedicated parity disk rather than rotated parity stripes.  RAID 5:Striped set with distributed parity. Distributed parity requires all drives but one to be present to operate; drive failure requires replacement, but the array is not destroyed by a single drive failure. Upon drive failure, any subsequent reads can be calculated from the distributed parity such that the drive failure is masked from the end user  RAID 1+0: High performance but requires double the number of drives for mirroring of data.It allocate blocks in stripes along the disks. Redundant Array of Independent Disks

23. 23 2014 LENOVO. ALL RIGHTS RESERVED. SCSISASFibre Channel Cable Distances 3 meters8 metersUp to 10Km DuplexHalfFull Devices12~ 16k with expanders 224 -confirm Throughput320 MB/s3Gb/s*4Gb/s * Up to total 12Gb/s throughput with wide ports SCSI and SAS vs. Fibre Channel

24. 24 2014 LENOVO. ALL RIGHTS RESERVED.  A transport mechanism for multiple protocols  SCSI-3 and SAS  Internet Protocol (IP)  others What is Fibre Channel?

25. 25 2014 LENOVO. ALL RIGHTS RESERVED.  Serial Transmission  Smaller Connectors  Eliminate Skew problems of parallel transmission  High bandwidth  1, 2, 4, 8 and 16 gigabits per second (Gb/s)  Big "B" versus little "b"  Megabit is abbreviated with a lower case b (Mb)  Megabyte is abbreviated with a capital B (MB) Why Fibre Channel?

26. 26 2014 LENOVO. ALL RIGHTS RESERVED.  Scalable  Large number of devices  Greater distance  Transport mechanism for multiple protocols Why Fibre Channel?

27. 27 2014 LENOVO. ALL RIGHTS RESERVED.  Permits Switching  Avoids problems of shared media and shared bandwidth  Allows mixed speeds  Auto-negotiating, can adjust throughput to lower speeds  Transport mechanism for multiple protocols Why Fibre Channel?

28. 28 2014 LENOVO. ALL RIGHTS RESERVED. TopologyNumber of Devices Point to Point2 Arbitrated LoopUp to 127 Switched FabricUp to 16 million Connectivity

29. 29 2014 LENOVO. ALL RIGHTS RESERVED. Processor Memory I/O Bus Computer N_Port0 Bridge TX RX TX Storage subsystem 100 MB/s Full Duplex (Fibre Channel example): 4Gbps + 4Gbps = 8Gbps (theoretical) N_Port1 Point to Point

30. 30 2014 LENOVO. ALL RIGHTS RESERVED. Input to fiberOutput from fiber Multiple path-lengths, or modes, permitted by the fiber smear the shape of the pulse 150 meters Multimode Fibre

31. 31 2014 LENOVO. ALL RIGHTS RESERVED. Single path-length, or mode, imposed by the fiber preserves the shape of the pulse Input to fiberOutput from fiber Single Mode Fibre

32. 32 2014 LENOVO. ALL RIGHTS RESERVED. Server HBA RAID sub-system Fibre Channel Ethernet to Client workstations Dual Controller RAID with only one controller in use (B not used in this example). This RAID system has four SCSI buses with five drives on each bus. Controller SCSI Chip Controller SCSI Chip Basic Configuration

33. 33 2014 LENOVO. ALL RIGHTS RESERVED. Server RAID sub-system HBA Fibre Channel Ethernet to Client workstations Dual independent controllers with automatic fail-over for continuous availability in case one controller or one fiber link fails. HBA Fibre Channel Controller SCSI Chip Controller SCSI Chip Sample SCSI/SAS subsystem Dual Controller Configuration

34. 34 2014 LENOVO. ALL RIGHTS RESERVED. Server HBA FC/SAS Ethernet to Client workstations Dual independent controllers with automatic fail-over for continuous availability in case one controller or one fiber link fails. HBA Controller FC/SAS Fibre and Storage subsystem RAID FC/SAS Dual Controller Configuration

35. 35 2014 LENOVO. ALL RIGHTS RESERVED. Server HBA Fibre Channel Ethernet to Client workstations Dual independent controllers with automatic fail-over for continuous availability in case one controller or one fiber link fails. HBA Fibre Channel Controller Fibre Channel Storage Device RAID Connectivity at SAN

36. 36 2014 LENOVO. ALL RIGHTS RESERVED. Switch NASNAS NASNAS NASNAS RAID A B Storage Area Network (SAN) A B Storage subsystem Servers Network Attached Storage (NAS) Connectivity at SAN

37. 37 2014 LENOVO. ALL RIGHTS RESERVED. Centralizing Information

38. 38 2014 LENOVO. ALL RIGHTS RESERVED. Unused storage capacity may be easily allocated to servers as need. Distributed StorageCentralized Storage Centralizing Information = Value

39. 39 2014 LENOVO. ALL RIGHTS RESERVED. What is a Storage Area Network (SAN)?

40. 40 2014 LENOVO. ALL RIGHTS RESERVED.  A SAN is a specialized, high−speed network attaching servers and storage devices. It is sometimes called "the network behind the servers.“  A SAN allows "any−to−any" connection across the network, using interconnect elements such as routers, gateways, hubs, switches, and directors.  It eliminates the traditional dedicated connection between a server and storage, and the concept that the server effectively "owns and manages" the storage devices.  It also eliminates any restriction to the amount of data that a server can access, currently limited by the number of storage devices, which can be attached to the individual server.  Instead, a SAN introduces the flexibility of networking to enable one server or many heterogeneous servers to share a common storage utility, which may comprise many storage devices, including disk, tape, and optical storage.  The storage utility may be located far from the servers that use it. SAN: Storage Area Network

41. 41 2014 LENOVO. ALL RIGHTS RESERVED.  When an application on the network requests information, the request is handled by a server and the correct blocks of data are returned to the client.  Databases are probably the largest example of block level data access in the data center today. 0 1 1 0 1 0 0 1 0 1 0 1 1 1 0 1 0 1 0 0 0 1 Block Level Access – SAN and DAS

42. 42 2014 LENOVO. ALL RIGHTS RESERVED.  Users work at the file level (ie. Word files, excel spreadsheets. etc) and then the applications we use change these to block level data  Block level must go through the server first Block Data to File

43. 43 2014 LENOVO. ALL RIGHTS RESERVED. External storage system connected to SAN Controller-based RAID Controllers Block-level access Application Server Application Server Application Server Switch 0 1 1 0 1 0 0 1 0 1 0 1 1 1 0 1 0 1 0 0 0 1 Storage Model for SAN

44. 44 2014 LENOVO. ALL RIGHTS RESERVED.  High-bandwidth capable of growing incrementally  Transfers very large blocks of data  Offers storage applications such as backup and remote mirroring without bogging down LAN  Superior performance, reliability and flexible connectivity Advantages of SAN

45. 45 2014 LENOVO. ALL RIGHTS RESERVED. SAN benefits

46. 46 2014 LENOVO. ALL RIGHTS RESERVED. The major features that a well−designed SAN offers include:  High bandwidth—1Gbps to 10Gbps  Disaster recovery plans  Business continuity plan  Manageability  Easy integration  Lower total cost of ownership Well-designed SAN

47. 47 2014 LENOVO. ALL RIGHTS RESERVED.  Infrastructure for easy storage connectivity and growth  Easy management  Performance  “Freedom” -Connecting everywhere every device into the same storage network (SAN) -On Line adding devices Key benefits of a Centralized SAN

48. 48 2014 LENOVO. ALL RIGHTS RESERVED. Fibre Channel Connectivity

49. 49 2014 LENOVO. ALL RIGHTS RESERVED. Logical Topologies

50. 50 2014 LENOVO. ALL RIGHTS RESERVED. Topology 1: Point – to - Point

51. 51 2014 LENOVO. ALL RIGHTS RESERVED. Computer Processor Memory I/O Bus N_Port0 Bridge TX RX TX Drive Enclosure N_Port1 Controller Point to Point Transmit (TX) Receive (RX)

52. 52 2014 LENOVO. ALL RIGHTS RESERVED. Topology 2 : Arbitrated LOOP

53. 53 2014 LENOVO. ALL RIGHTS RESERVED. TX RX NL_port 0 TX RX NL_port 3 RX TX NL_port 1 RX TX NL_port 2 127 Nodes Maximum, Typical 5-30 Fibre Channel-AL Fibre Channel Arbitrated Loop

54. 54 2014 LENOVO. ALL RIGHTS RESERVED. TX RX NL_port 0 TX RX NL_port 3 RX TX NL_port 1 RX TX NL_port 2 127 Nodes Maximum HUB Fibre Channel Arbitrated Loop

55. 55 2014 LENOVO. ALL RIGHTS RESERVED. HUB TX RX NL_port 0 TX RX NL_port 3 RX TX NL_port 1 RX TX NL_port 2 127 Nodes Maximum By pass defective or unused ports Fibre Channel Arbitrated Loop

56. 56 2014 LENOVO. ALL RIGHTS RESERVED. Topology 3: Switched Fabric

57. 57 2014 LENOVO. ALL RIGHTS RESERVED. Fabric TX RX N_port 0 TX RX N_port 1 TX RX N_port 2 TX RX N_port 3 TX RX N_port 4 2 24 = 16 million nodes possible F_port A F_port E F_port D F_port C F_port B Switched Fabric

58. 58 2014 LENOVO. ALL RIGHTS RESERVED. Ethernet hub or switch A B subsystem Server 1 HBA Server 2 HBA Fibre Channel switch Ethernet to client workstations Fully Redundant SAN

59. 59 2014 LENOVO. ALL RIGHTS RESERVED. A B subsystem A Server 1 HBA Server 2 HBA Fibre Channel switch A B subsystem B Adding Capacity

60. 60 2014 LENOVO. ALL RIGHTS RESERVED. A switched SAN

61. 61 2014 LENOVO. ALL RIGHTS RESERVED. SAN Model

62. 62 2014 LENOVO. ALL RIGHTS RESERVED. SAN Infrastructure

63. 63 2014 LENOVO. ALL RIGHTS RESERVED. SAN Components SAN Network

64. 64 2014 LENOVO. ALL RIGHTS RESERVED. SAN Components SAN Servers The server infrastructure is the reason for all SAN solutions. This infrastructure includes  a mix of server platforms such as Windows, UNIX (and its various flavors), and z/OS.  With initiatives such as server consolidation and e−business, the need for SANs will increase, making the importance of storage in the network greater. SAN Storage  The storage infrastructure is the foundation on which information relies, and therefore must support a company's business objectives and business model. In this environment simply deploying more and faster storage devices is not enough.  A SAN infrastructure provides enhanced network availability, data accessibility, and system manageability.  It is important to remember that a good SAN begins with a good design. SAN Interconnects  The first element that must be considered in any SAN implementation is the connectivity of storage and server components typically using Fibre Channel.  It uses special connectivity devices

65. 65 2014 LENOVO. ALL RIGHTS RESERVED. SAN operability

66. 66 2014 LENOVO. ALL RIGHTS RESERVED. Fibre Channel layers

67. 67 2014 LENOVO. ALL RIGHTS RESERVED. SAN Architecture

68. 68 2014 LENOVO. ALL RIGHTS RESERVED. Fabric Channel layers Lower Layers  FC−1 defines encoding schemes. These are used to synchronize data for transmission.  FC−2 defines the framing protocol and flow control. This protocol is self−configuring and  supports point−to−point, arbitrated loop, and switched topologies. Upper Layers Fibre Channel is a transport service that moves data quickly and reliably between nodes. The two upper layers enhance the functionality of Fibre Channel and provide common implementations for interoperability.  FC−3 defines common services for nodes. One defined service is multicast, to deliver one transmission to multiple destinations.  FC−4 defines upper layer protocol mapping. Protocols such as FCP (SCSI), FICON, and IP can be mapped to the Fibre Channel transport service.

69. 69 2014 LENOVO. ALL RIGHTS RESERVED. SAN High Level

70. 70 2014 LENOVO. ALL RIGHTS RESERVED. This is the storage area network:

71. 71 2014 LENOVO. ALL RIGHTS RESERVED. Zoning  It could be considered as a security feature and not just for separating environments.  Zoning could also be used for test and maintenance purposes.  Zoning also introduces the flexibility to manage a switched fabric to meet different user group objectives.  Zoning can be implemented in two ways: -Hardware zoning -Software zoning

72. 72 2014 LENOVO. ALL RIGHTS RESERVED. Zoning  Hardware zoning is based on the physical fabric port number

73. 73 2014 LENOVO. ALL RIGHTS RESERVED. Zoning  Software zoning is implemented by the fabric operating systems within the fabric switches. When using software zoning, the members of the zone can be defined using their WWN and WWPN.

74. 74 2014 LENOVO. ALL RIGHTS RESERVED. ISL Trunking  Trunking is a feature of switches that enables traffic to be distributed across available inter−switch  links (ISLs) while still preserving in−order delivery.

75. 75 2014 LENOVO. ALL RIGHTS RESERVED. Fiber Channel types of ports  E_Port: This is an expansion port. A port is designated an E_Port when it is used as an inter−switch expansion port (ISL) to connect to the E_Port of another switch, to enlarge the switch fabric.  F_Port: This is a fabric port that is not loop capable. It is used to connect an N_Port point−point to a switch.  FL_Port: This is a fabric port that is loop capable. It is used to connect an NL_Port to the switch in a public loop configuration.  G_Port: This is a generic port that can operate as either an E_Port or an F_Port. A port is defined as a G_Port after it is connected but has not received a response to loop initialization or has not yet completed the link initialization procedure with the adjacent Fibre Channel device.

76. 76 2014 LENOVO. ALL RIGHTS RESERVED.  L_Port: This is a loop−capable node or switch port.  U_Port: This is a universal port—a more generic switch port than a G_Port. It can operate as either an E_Port, F_Port, or FL_Port. A port is defined as a U_Port when it is not connectedor has not yet assumed a specific function in the fabric.  N_Port: This is a node port that is not loop capable. It is used to connect an equipment port to the fabric.  NL_Port: This is a node port that is loop capable. It is used to connect an equipment port to the fabric in a loop configuration through an L_Port or FL_Port. Fiber Channel types of ports

77. 77 2014 LENOVO. ALL RIGHTS RESERVED. Types or ports