Extended ServiceGuard/Oracle 9iRAC a high availability cluster solution with DWDM and Dark Fiber Mai Cutler HP Oracle Alliance Lab Sandy Gruver HP Oracle Advanced Technology Center Stefan Pommerenk Cluster and Parallel Storage Technology/Oracle

Why “stretch” RAC cluster…………. what are the business drivers Review of 9iRAC architecture……… short review of RAC on HPUX What is DWDM and Dark Fiber?…... Use Joe’s ideas and pictures Architecture used for the tests……… include mention of other partners - ATT and Nortel? Description of tests and results…….. Oracle tests…………………………………………………….. I/O tests………………………………………………………… Failover tests…………………………………………………… ?? Other testing - aka Bob Sauers suggestions (in support of customer-LCH)…………………………………………………. Agenda Sandy Mai Sandy

Why “stretch” RAC cluster Review of 9iRAC architecture What is DWDM and Dark Fiber? Architecture used for the tests Description of tests and results Agenda

Why a “stretch” RAC cluster? what are the business drivers A need for a single RAC solution which can span an extended distance (up to 100km) This solution: Is simpler than maintaining a standby – Disaster site is “built-in” to the solution Provides data protection in case of a local disaster Allows having a single RAC database spanning two geographically distant sites Ensures no data loss in case of a failure at one site

Single Oracle Database HP Server Log files DB System files Rollback files Temp files Control files Data files Index files Raw Device and File System Files Archive Redo Logs Review of 9iRAC architecture on HP-UX Single Instance Oracle

HP Server Redo Log files Instance A DB System file(s) Rollback/ Undo files Temp files Control files Data files Index files Redo Log files Instance B Raw Devices System A System B Archive Redo Logs Instance B Oracle Real Application Cluster Database Archive Redo Logs Instance A Per instance mirrored Review of 9iRAC architecture on HP-UX Oracle 9iRAC

Global Cache Service USER SGA Node 1, Instance A USER USER DBWRLGWR DatabaseBufferCache Redo Log Buffers LCK0 Data USER SGA Node 2, Instance B USER USER DBWRLGWR DatabaseBufferCache Redo Log Buffers LCK0 Redo Control 9i Cache Fusion Review of 9iRAC architecture on HP-UX Cache services

Dense Wavelength Division Multiplexing – Optoelectronic technology – Single optical fiber – Simultaneous transmission of signals – Wavelength of incoming signals changed – Similar to radio or TV broadcasting What is DWDM and Dark Fiber DWDM

What is DWDM Wavelength Converter Wavelength Converter Ch 2 Wavelength Converter Ch 3 Ch 1 Ch 3Ch 2Ch 1 ESCON 100BaseFX Wavelength Converter Wavelength Converter Ch 2 Wavelength Converter Ch 3 Ch 1 ESCON Fibre Channel 100BaseFX Passive Optical Multiplexer Passive Optical Multiplexer Fibre Channel 1300 nm Dark fiber

– fiber optic cable – sold by telecom provider – has no light or signal (is “dark”) until customer puts a signal on it. Commonly today, telecom providers sell dark fiber over DWDM What is DWDM and Dark Fiber Dark Fiber

Common Carrier Dark Fiber LOCAL CPU SITE A REMOTE CPU SITE B What is DWDM and Dark Fiber Classic Dark Fiber

Common Carrier Dark Fiber LOCAL CPU SITE A REMOTE CPU SITE B DWDM Device What is DWDM and Dark Fiber Dark Fiber with DWDM

Original tests * Extended Distance Clusters (new name) allows distances up to 100 km using DWDM technology * Dense Wave Division Multiplexing (DWDM) technology provides the capability to extend the Fibre Channel link distance. * Network and disk communication sharing DWDM links. * Two and three site configurations. * VERITAS VxVM or CVM mirroring (supported up to 100 km) * Quorum Server, arbitrator nodes or dual cluster locks for arbitration. * Extended Distance ServiceGuard eRAC cluster configurations of 2 or 4 nodes using VERITAS CVM, for distances of up to 10 km Current tests * Extended Distance ServiceGuard eRAC cluster configurations of 2 nodes using VERITAS CVM, for distances of up to 100 km Previous testing Extended ServiceGuard Cluster with DWDM

Architecture used for the tests Local ServiceGuard Cluster with 9iRAC nova101 nova102 FibreChannel VA7410 FibreChannel GiGEthernet

Architecture used for the tests Extended ServiceGuard Cluster and 9i RAC with DWDM 100Km Fibre Nortel OPTera Network Nortel OPTera Network nova101 nova102 FibreChannel VA Km Fibre 100KM VA7410 FibreChannel GigEthernet

2 rp7410s (8 CPUs, 32GB RAM) 2 Tachyon XL2 FibreChannel HBAs. 4 ULTRA SCSI internal disks(73GB) 4 Fibre-based GB Ethernet interfaces HP-UX B and September 2002 bundle ServiceGuard A ServiceGuard Extension A Veritas VxVM 3.5 Veritas CVM 3.5 Oracle with RAC option, UDP/IPC Description of tests Test Configuration

CR-Test micro-level benchmark. TPCC-like workload. I/O performance tests Failover Tests Description of tests Test Scenarios

More information