Presentation on theme: "11 Zero Downtime with Oracle GoldenGate Paul Steffensen."— Presentation transcript:
11 Zero Downtime with Oracle GoldenGate Paul Steffensen
2 Wide Awake and Zero Downtime! Meet Swaroup Anand who lives in Bangalore http://www.dailymail.co.uk/health/article-1250507/Eyes-Wide-Open-Patient-open-heart-surgery-awake.html
3 CX and the Disappearing Batch window The Customer Experience Revolution Source: Dr. Elizabeth B. N. Sanders 1992 Masters Paper
4 Increasing expectation of application availability Ever increasing data volumes The Disappearing Batch Window So much data, so little time
5 Paul Steffensen Problem solver and pragmatic DBA 25+ years as an Oracle DBA NZs only certified GoldenGate Implementation Specialist Director and Senior Consultant, Enterprise IT Ltd Linkedin: nz.linkedin.com/in/uptimedba
6 100% Kiwi owned – Est. 2005 Strong Oracle background Services – Cloud Services – Database – Facilities Management – Linux and Solaris Enterprise IT
7 How does Enterprise IT do IT? I.T. right first time Culture Are we adding value? drives our culture Consistency in communications and way we operate Service Focus Build Trusted Advisor Partnerships with Clients Developing a Thought Leadership Position in our Sector High Professional Standards Best Practice standards and procedures, ITIL
9 What is Oracle GoldenGate? Oracles strategic solution for real time data integration. What does that mean?
10 Where did GoldenGate come from? GoldenGate Software Inc. founded in 1995 The need to improve operating performance in a global 24x7 environment has led to the need for data integration to support real- time and high availability capabilities.. Hasan Rizvi, senior vice president Oracle Fusion Middleware Product Development in 2009.
11 What makes GoldenGate so good? Performance Low Latency Low Impact Flexibility Open, Modular Architecture Heterogeneous Reliability Transactional Integrity Resilient Whats all the fuss about.
12 Unidirectional Query Offloading or Upgrades/Migrations Bi-Directional Live Standby or Active-Active Peer-to-Peer Load Balancing, Multi-Master Broadcast Data Distribution Integration/Consolidation Data Warehouse Cascading Data Marts What can GoldenGate do?
13 What can GoldenGate be used for? Log Based, Real- Time Change Data Capture Heterogeneous Source Systems Legacy Systems Java Message Bus EDW ODS Disaster Recovery, Data Protection Zero Downtime Migration and Upgrades Operational Reporting & Query Offloading Real-time BI Standby (Open & Active) Reporting Database Data Warehouse GoldenGate ETL Event Driven Architecture, SOA Enterprise Data Synchronization Distribution New Database JMS Queue
14 Where can I run GoldenGate? Operating Systems Linux Solaris v11 Windows 2000, 2003, XP HP-NonStop HP-UX IBM z Series IBM AIX v7.1 IBM i Series Databases Oracle (from 8i) DB2 Microsoft SQL Server Sybase ASE Teradata MySQL v 5.5 JMS message queues Enscribe Postgres (delivery) SQL/MX
15 Source Database Target Database Trail files: Stages and queues data for routing and can be encrypted. Source Trail Files Capture: Committed changes are captured (and can be filtered) as they occur by reading the transaction logs. DB Log Capture Pump Pump: Distribute data for routing to one or multiple targets. Delivery: Applies data with transaction integrity, transforming the data as required. Target Trail Files Delivery DB Client Library Route: Data can be compressed and encrypted for routing to targets. TCP /IP LAN / WAN / Internet TCP /IP LAN / WAN / Internet DB Log Capture Delivery DB Client Library Pump Bi-directional How does GoldenGate work? Diagram courtesy Oracle Corporation
16 How Do I Manage it? Management Pack for GoldenGate Oracle GoldenGate Monitor for monitoring GoldenGate implementations. Includes a plugin for Enterprise Manager 12c Oracle GoldenGate Director for managing GoldenGate components.
17 How Do I Know Its Working? Oracle Veridata High speed, low impact comparison solution
18 New Features in the latest Version 11gR2 (22.214.171.124.5) Integrated Capture Improved Conflict Detection and Resolution Globalization Security and Performance Manageability and Monitoring Additional platforms/databases Support for new Oracle applications
19 Conflict Detection and Resolution What happens if a row that was inserted in the Customers table already exists in the target database? In the event of a new Customer record already existing in the target database, overwrite that record with the data from the source table. MAP source.customers, target.customers, RESOLVECONFLICT(INSERTROWEXISTS, DEFAULT, OVERWRITE);
21 Our Clients Problem Major player in NZ but small player in the World Forrester Research has identified that Commoditisation has stripped away most sources of differentiation and Customer Experience is what is left Brand value a priority and client constantly measuring Cx for eg with Net Promoter Score (NPS) BUT...... Providing a robust and reliable service to its customers
22 Our Clients Problem Hardware lacked HA ability and limited DR capability Older software versions lacked functionality Ability to provide a robust and reliable service to its customers was at risk Priority 1 and 2 applications demanded little or no downtime
23 Enterprise ITs Problem To perform a cross platform migration and upgrade Very limited downtime allowed 350+ Gb of data to move in less than half an hour We had to do 4 days of work in 30 minutes!
24 Our Professions Challenge There is now a real business requirement to maintain application service levels during operations on applications and their supporting infrastructure that would in the past have meant a system outage.
25 Why we used Oracle GoldenGate? Heterogeneous, cross-platform, cross-version Performance: Real time, Sub second latency Efficient: Non-intrusive, Low impact Flexible Robust Reliable At the time, no other viable alternative
26 Our problem solving strategy Needed a solution for more than this application Documented generic procedure that could be handed over to implementation teams for other applications K.I.S.S.
27 Migration Implications Source PlatformTarget Platform Solaris8 (Sparc)Linux 2.6 (Intel) Single Instance Oracle RDBMSOracle 4 node RAC Cluster Oracle 9i (126.96.36.199)Oracle 10gR2 (10.2.0.5) 7 bit character set (US7ASCII)Multi-byte Unicode character set Standalone databaseConsolidated database Everything Changes yet Nothing Changes
28 The Solution Design Implement GoldenGate to capture changes made in the source database Use Export / Import to perform the initial load of the new database Use GoldenGate to update the new database and keep it synced Perform switchover at a chosen time in a controlled fashion
29 Sunday 6 th November 2011 10:00pm to 11:00pm 10:00Shut down application 10:05GoldenGate switchover to the new database 10:10Perform audit counts between old and new 10:20Start up application for testing 11:00Make application available to the public The Solution Implementation Time in the Operating Theatre
30 A Great Result Clients challenge was to increase the robustness of their service to its customers Enterprise ITs challenge was to make this happen with little or no impact to the service it was improving Oracle GoldenGate provided the solution
31 Increased service availability during the operation Increased HA and DR position Absolutely no issues post-migration Performance and reliability improvements Return on Investment Getting bang for your buck
32 DIY scripts Active Data Guard Oracle Streams Dbvisit Replicate GoldenGate Alternatives? Is there anything else that will do the job?
33 GoldenGate Resources Oracles GoldenGate Home Page http://www.oracle.com/us/products/middleware/data-integration/goldengate/overview/index.htm GoldenGate Forum https://forums.oracle.com/forums/forum.jspa?forumID=860 Oracles My Support Community Page https://communities.oracle.com/portal/server.pt/community/goldengate%2C_streams_and_distributed_database/410 Oracle Documentation and Books http://www.oracle.com/technetwork/middleware/goldengate/documentation/index.html Linkedin http://www.linkedin.com/groups?gid=1784310 Many Blogs Lots of information out there