1. 1 © 2005 Cisco Systems, Inc. All rights reserved. Cisco Public Business Ready Data Center Architecture Cisco Data Center Network Architecture Ivan S Chandra Systems Engineer Manager ivanc@cisco.com

2. 2 © 2005 Cisco Systems, Inc. All rights reserved. Business Ready Data Center Architecture Cisco Public Agenda Data Center Challenges Cisco Data Center Network Architecture Summary Data Center Challenges Cisco Data Center Network Architecture Summary

3. 3 © 2005 Cisco Systems, Inc. All rights reserved. Business Ready Data Center Architecture Cisco Public Data Center Architecture Today— Dedicated Infrastructure Low utilization of compute and storage resources Multiple points of management Inconsistent security policies Too costly to scale APPLICATION 1...N USERS Challenges DEDICATED COMPUTING DEDICATED STORAGE Reference: Cisco Internet Business Solutions Group, 2004 DEDICATED NETWORK

4. 4 © 2005 Cisco Systems, Inc. All rights reserved. Business Ready Data Center Architecture Cisco Public Data Center Architecture Evolving—Dedicated Infrastructure to Service Oriented Infrastructure VIRTUALIZATION Much better utilization Lower administration costs Reduction in assets Increased service availability Faster deployment of new services Benefits Reference: Cisco Internet Business Solutions Group, 2004 INTELLIGENT INFORMATION NETWORK APPLICATION 1...N USERS POOLED COMPUTING POOLED STORAGE

5. 5 © 2005 Cisco Systems, Inc. All rights reserved. Business Ready Data Center Architecture Cisco Public Evolution of the Data Center Infrastructure Phased Approach AUTOMATION Storage Network Compute Dynamic Provisioning and Information Lifecycle Management (ILM) to Enable Business Agility Business Policies On-Demand Service Oriented VIRTUALIZATION StorageNetworkCompute Enterprise Applications Management of Resources Independent of Underlying Physical Infrastructure to Increase Utilization, Efficiency and Flexibility Data Network Server Fabric Network Centralization and Standardization to Lower Costs, Improve Efficiency and Uptime CONSOLIDATION LAN WAN MAN SAN Storage Network Intelligent Information Network HPC Cluster GRID

6. 6 © 2005 Cisco Systems, Inc. All rights reserved. Business Ready Data Center Architecture Cisco Public Agenda Data Center Challenges and Trends Cisco Data Center Network Architecture Summary Data Center Challenges and Trends Cisco Data Center Network Architecture Summary

7. 7 © 2005 Cisco Systems, Inc. All rights reserved. Business Ready Data Center Architecture Cisco Public InstantMessagingUnifiedMessagingMeetingPlace IPCC IP Phone VideoDelivery PLMCRMERP HCMProcurementSCM CollaborationApplications Traditional Architecture / Service Oriented Architecture BusinessApplications NETWORKEDINFRASTRUCTURE LAYER LAYER Compute Network Storage Network Server Fabric Server Switching Storage Switching Data Center Interconnect MDS Family SFS Family Catalyst Family ONS Family Director Fabric Modular Rack Blade Infiniband Switching DWDM, SONET, SDH, FCIP Server Network Virtualization Services StorageClients Data Center BranchCampusTeleworkerWAN/MAN Enterprise Edge Places in the Network Places in the Network Cisco Data Center Network Architecture Framework INTERACTIVESERVICES LAYER LAYER Infrastructure Management Services Management Advanced Analytics and Decision Support Infrastructure Enhancing Services Compute Services Storage Fabric Services Security Services Application Networking Services Virtualization, Replication, Virtual Fabrics RDMA, Low Latency Clustering Firewalls, Intrusion Protection, Security Agents Application Delivery Services WAAS, App Acceleration, Optimization, Security and Server Offload Adaptive Management Services Network Infrastructure Virtualization ServicesVirtualization Application Networking Services Infrastructure Enhancing Services

8. 8 © 2005 Cisco Systems, Inc. All rights reserved. Business Ready Data Center Architecture Cisco Public Data Center Services Where? DATA CENTER INTERCONNECT SONET/SDH xWDM Metro Ethernet FCIP SFS 7000 MDS 9500 AVS WAAS Firewall ServicesDDOS Guard Intrusion Prevention EMBEDDED SECURITY SERVICES Secure Virtual Fabrics STORAGE SWITCHING High Performance Compute (HPC) Clusters Catalyst ONS 15000 Internet MPLS VPN IPSEC/SSL VPN Storage & Tape Arrays Blade Servers UNIX/NT Servers Mainframes EMBEDDED APPLICATION NETWORK SERVICES Server Load Balancing SSL Off-load Application Message Services Application Control Engine EMPLOYEE / PARTNER / CUSTOMER ACCESS NETWORK SERVER SWITCHING Enterprise Applications Fibre Channel FICON Infiniband GE / 10GE Management and Provisioning Framework Fabric Assisted Applications Data Replication Services Storage Virtualization EMBEDDED STORAGE SERVICES Fabric Hosted Applications SERVER FABRIC

9. 9 © 2005 Cisco Systems, Inc. All rights reserved. Business Ready Data Center Architecture Cisco Public DC Network Topology Layers Server Virtualization V Remote DMA Services Virtual I/O Clustering Services Compute Fabric Services Fabric Gateway Services Fabric Routing Services Data Replication Svcs Storage Virtualization Virtual Fabrics (VSANs) Fabric Gateway Services Content Caching SSL Offloading Firewall Services Intrusion Detection Server Balancing Network Analysis VPN Termination File Caching DOS Protection Server FarmsServer Clusters Storage/Tape Farms Core Aggregation Access Edge Core

10. 10 © 2005 Cisco Systems, Inc. All rights reserved. Business Ready Data Center Architecture Cisco Public DC Server Network Server Virtualization V Remote DMA Services Virtual I/O Clustering Services Compute Fabric Services Fabric Gateway Services Fabric Routing Services Data Replication Svcs Storage Virtualization Virtual Fabrics (VSANs) Fabric Gateway Services Content Caching SSL Offloading Firewall Services Intrusion Detection Server Balancing Network Analysis VPN Termination File Caching DOS Protection Server FarmsServer Clusters Storage/Tape Farms Edge Core Layers Core Aggregation Access

11. 11 © 2005 Cisco Systems, Inc. All rights reserved. Business Ready Data Center Architecture Cisco Public DC Access Layer Layer 2, Layer 3 Server & Mainframe Connectivity L2 and L3 requirements Dual and single attached High performance, low latency L2 switching Mix of oversubscription requirements Many uplink options STP processing for configured VLANs only Utilizes services in the Aggregation Layer L3 Access Blade Chassis w/integrated switch Blade Chassis w/pass thru Mainframe w/OSA L2 w/clustering & NIC teaming Enterprise Core DC Aggregation DC Core DC Access

12. 12 © 2005 Cisco Systems, Inc. All rights reserved. Business Ready Data Center Architecture Cisco Public DC Aggregation Layer Providing Critical Point for Control and Application Services Aggregates traffic to DC core Large STP Processing load Aggregates advanced application and security functions Maintains connection and session state for redundancy Layer 4-7 services: FW, SLB, SSL, IDS High flexibility and Economies of Scale L3 Access Blade Chassis w/integrated switch Blade Chassis w/pass thru Mainframe w/OSA L2 w/clustering & NIC teaming Enterprise Core DC Access Service Modules

13. 13 © 2005 Cisco Systems, Inc. All rights reserved. Business Ready Data Center Architecture Cisco Public DC Aggregation Layer Server to Server Communications Path The Aggregation module may provide the primary communication path for server to server traffic Non traditional traffic emerging Driving lower oversubscription and 10GE uplinks Servers now ship with PCI-X NIC’s and GE Plan bandwidth for future server true capacity Access What types of server to server traffic will exist? Multi-tier interaction, Backup,Replication, Cluster Messaging, storage over ip Aggregation DC Core

14. 14 © 2005 Cisco Systems, Inc. All rights reserved. Business Ready Data Center Architecture Cisco Public DC Core Layer High speed switching fabric for Aggregation Modules Interconnects AGG Modules Isolates failure domains Scales large STP diameters Improves 10GE scaling Plan & build DC core up front N x 100 Servers Agg Module1 Agg Module2 DC Core Aggregation GE/10GE Access Enterprise Core

15. 15 © 2005 Cisco Systems, Inc. All rights reserved. Business Ready Data Center Architecture Cisco Public Service Integration and Virtualization Evolving towards Virtual Network Services DedicatedSharedVirtualized Cust 1 Cust 2 Cust N … Cust 1 High CapEx & OpEx Cust 2 Cust 1 Cust 2 Cust N … Concerns for privacy & security Physical Resource Service context Quasi Virtualized Cust 1 Cust 2 Cust N … Virtual Network Service

16. 16 © 2005 Cisco Systems, Inc. All rights reserved. Business Ready Data Center Architecture Cisco Public DC Consolidated Infrastructure Integration & V irtualization Core Server Load Balancing Content Caching Stateful Firewalls High Density Multilayer LAN Switch Core Server Load Balancing Content Caching Stateful Firewalls High Density Multilayer LAN Switch IPS farm

17. 17 © 2005 Cisco Systems, Inc. All rights reserved. Business Ready Data Center Architecture Cisco Public DC Storage Network Server Virtualization V Remote DMA Services Virtual I/O Clustering Services Compute Fabric Services Fabric Gateway Services Fabric Routing Services Data Replication Svcs Storage Virtualization Virtual Fabrics (VSANs) Fabric Gateway Services Content Caching SSL Offloading Firewall Services Intrusion Detection Server Balancing Network Analysis VPN Termination File Caching DOS Protection Server FarmsServer Clusters Storage/Tape Farms Core Aggregation Access Layers Edge Core

18. 18 © 2005 Cisco Systems, Inc. All rights reserved. Business Ready Data Center Architecture Cisco Public Direct Attach Storage Direct Attached Storage (DAS) Storage is captive ‘behind’ the server, limited mobility Limited scalability due to limited devices No storage sharing possible Costly to scale; complex to manage FC Clients Direct Attached Storage Application Servers Win2kLinuxUnix Tape FC Linux Win2k SCSI LAN

19. 19 © 2005 Cisco Systems, Inc. All rights reserved. Business Ready Data Center Architecture Cisco Public Storage Area Network Storage is accessed at a block-level via SCSI protocol High performance interconnect providing high I/O throughput Lower TCO relative to direct attached storage, storage can be shared Limited vendor interoperability Complex management Separation of Storage from the Server Storage Area Network (SAN) Database Servers Block Storage Devices Fibre Channel SAN Clients LAN

20. 20 © 2005 Cisco Systems, Inc. All rights reserved. Business Ready Data Center Architecture Cisco Public Virtual SAN (VSAN) A Virtual SAN (VSAN) provides a method to allocate ports within a physical fabric to create virtual fabrics Analogous to VLANs in Ethernet Virtual fabrics created from larger cost- effective redundant physical fabric Reduces wasted ports of island approach Fabric events are isolated per VSAN – maintains isolation for HA Hardware-based isolation - traffic is explicitly tagged across inter-switch links with VSAN membership info Statistics can be gathered per VSAN Cisco MDS 9000 Family with VSAN Service Physical SAN islands are virtualized onto common SAN infrastructure

21. 21 © 2005 Cisco Systems, Inc. All rights reserved. Business Ready Data Center Architecture Cisco Public DC Interconnect Data Center Core Aggregation Access Core Access Servers Storage SONET/SDH Network DWDM Network Campus Core IBM Metro Ethernet DC Interconnect WAN GE IBM GDPS 1/2 Gb FC/FICON

22. 22 © 2005 Cisco Systems, Inc. All rights reserved. Business Ready Data Center Architecture Cisco Public Server Fabric Edge Core Server Virtualization V Remote DMA Services Virtual I/O Clustering Services Compute Fabric Services Fabric Gateway Services Fabric Routing Services Data Replication Svcs Storage Virtualization Virtual Fabrics (VSANs) Fabric Gateway Services Content Caching SSL Offloading Firewall Services Intrusion Detection Server Balancing Network Analysis VPN Termination File Caching DOS Protection Server FarmsServer Clusters Storage/Tape Farms Layers Core Aggregation Access

23. 23 © 2005 Cisco Systems, Inc. All rights reserved. Business Ready Data Center Architecture Cisco Public Server Switches Requirements being addressed Virtualization (I/O, Storage, and CPU)  Shared Resources Across Entire Cluster  Routing, Aggregation, Load Balancing  App/OS to CPU provisioning High Performance Server-to-Server Interconnect  RDMA  High Bandwidth  Low Latency  InfiniBand today; PCI-Express and /or 10GigE when ready Policy-Based Dynamic Resource Mapping Performance and Control

24. 24 © 2005 Cisco Systems, Inc. All rights reserved. Business Ready Data Center Architecture Cisco Public Server Switch Applications Why Are Performance and Control Important? Server Clustering  High Performance Computing (HPC)  “Enterprise-Class” HPC  Database Scalability Utility or Grid Computing  Application Provisioning  Server Re-purposing  Server Migration Applications I/O Virtualization  I/O Consolidation  I/O Aggregation  Server Consolidation

25. 25 © 2005 Cisco Systems, Inc. All rights reserved. Business Ready Data Center Architecture Cisco Public Today’s Enterprise Service Provisioning A Scale-Out Example SysAdmin racks new server Loads O/S and Applications NetOps connects Ethernet cabling, configures VLAN/Port Config SLB Admin Adds Server to Pool SecOps checks security policy, expands FW Port Range NetOps ensures Branch connectivity/ Routable Subnet StorageOps configures LUN, maps to Server StorageOps provisions disk volume and resources Assume you just want to add one server to a web-farm… The challenge is one of ‘coordination delays’. This type of simple scale-out of an existing serve often takes enterprises 90- days. New service turn-ups, after the application has been developed, often take 180+ days. VFrame is designed to eliminate these delays and automate the provisioning of services

26. 26 © 2005 Cisco Systems, Inc. All rights reserved. Business Ready Data Center Architecture Cisco Public CSM Load Balancer Servers VFrame identifies right App / OS Image From storage VFrame translates policies to actions and passes to infrastructure Data Center Automation Vframe Data Center 1.0 Catalyst 6500 SAN FWSM Firewall Administrator MDS 9500 Campus/ WAN/VPN Data Center Policy Application: SAP Performance Security Availability Image Accounting Define application services and pass policy to VFrame VFrame™ VFrame picks server with right criteria to run application and boots server VFrame gives new server right VLAN and LUN info so it can find/be found by right clients and storage VFrame provisions security policies to FWSM VFrame provisions CSM to add new server to load balancing pool Application Service Provisioned! NAS

27. 27 © 2005 Cisco Systems, Inc. All rights reserved. Business Ready Data Center Architecture Cisco Public Agenda Data Center Challenges and Trends Cisco Data Center Network Architecture Summary Data Center Challenges and Trends Cisco Data Center Network Architecture Summary

28. 28 © 2005 Cisco Systems, Inc. All rights reserved. Business Ready Data Center Architecture Cisco Public Data Center Networking Action Plan Decide on the end-state data center: What should the data center be in five years? Identify main immediate challenges and initiatives: Consolidation, business continuance, virtualization, on-demand, etc. Develop data center networking strategy: Data center and network stakeholders engage Supports data center short- to long-term goals and initiatives Engage with Cisco and partners: Plan, design, deploy, implement, operate and optimize

29. 29 © 2005 Cisco Systems, Inc. All rights reserved. Business Ready Data Center Architecture Cisco Public