Presentation on theme: "With you Today Application, GIA Director, Global Databases and"— Presentation transcript:
1 Deployment of Exalogic And Exadata Increases Business Efficiency A success story at GIA
2 With you Today Application, GIA Director, Global Databases and Krish LakshminTCSArchitect, Engineered SystemsSaroj DashSystems, TCSDelivery Lead, EngineeredSoumendra Dash
3 Agenda About GIA & TCS Business & Technology Goals Business Benefits 1Business & Technology Goals23Business Benefits4Features of Engineered Systems used5Technology LandscapeAssessment Report including the recommendations for future Exadata strategy for Grainger including processes & tools such as Precise & Cronacle, etc.High Level Migration approach and timelinePost-migration support planRecommendations, if any on DB architecture design and setup plans, DR/BCP/Failover design, backup & recovery, load balancing etc.Summary of assumptions, risks, and dependenciesCapacity and Availability Planning recommendationsMonitoring, Support, & Maintenance procedures related to the migration and ongoing support for an Exadata environmentChallenges & Best Practices6Q & A7
4 About GIA and TCS About GIA and TCS Established in 1931, GIA is the world’s foremost authority on diamonds, colored stones, and pearls. A public benefit, nonprofit institute, GIA is the leading source of knowledge, standards, and education in gems and jewelry Industry.TATA Consultancy Services Limited (TCSL) is a multinational information technology (IT) service, consulting and business solutions company headquartered in India. It is a subsidiary of TATA group. TCS is a leader in the global marketplace and among the top 10 IT services provider in the world.
5 Understanding Global GIA’s IT needs GIA is a global Institution having nine Grading Laboratories around the globe. Its major computing needs are supported by two major production data centers and two DR data centers.GIA’s Grading Data is very global as it is created , distributed and shared among all its labs to support various grading services for the global customer base. A combination of high OLTP plus resource heavy back end processing supported by a detailed workflow engine.GIA’s global customers demand fast stone turnaround time as trade operates with very low profit margin among its supply chain. High turnaround time is understandably unacceptable.One of GIA’s missions is to empower trade and general public alike with as much grading data as possible in a timely fashion for making informed decisions.Finally, Diamonds are forever and hence data archival is out of question. We need to keep all our data from day one.
6 NGGS Initiative Goals for NGGS Scalable and efficient Next Generation Grading System (NGGS) to help GIA service its growing customer base with quicker turnaround time and to address ongoing application performance issues.Highly Scalable platform with less or no interruption of service to support rapidly growing global expansion.Performance. Performance for high throughput for both internal and external users.Platform Consolidation and Standardization.Address Itanium end of life support issue from Oracle.Highly available architecture like ExaData to address Business Continuity / Downtime / Stability issues .
7 Selection of ExaData and ExaLogic and Timeline We compared and deliberated on different hardware platforms like IBM, HP and Oracle. No comparable hardware were available to match the configurations and features of ExaData and ExaLogic.We ran and tested our database copy in Oracle’s Engineered Systems lab in Santa Clara for performance of our most used queries and processes.Very impressive performance numbers just out of the box with no tuning of any sort.Implementation Timeline.Engineered System was Implemented in Carlsbad during July, 2013 timefreameEngineered System was implemented in Mumbai during Nov, 2013 timeframe.DR Databases in NY and Hong Kong was implemented using ODA in early 2014.Upgraded to Quarter Rack from 1/8 ExaData in July, 2014.Upgraded to Quarter Rack from 1/8 ExaLogic in August 2014Both the upgrades (scalability feature) went without any hiccup.
8 West Disaster Recovery East Disaster Recovery GIA Data Centers.New York,West Disaster RecoveryHong KongEast Disaster RecoveryCarlsbadWest Data centerMumbaiEast Data Center
11 A Paradigm shift in Data Integration and availability today at GIA ExaData helped us enable and integrate our live grading service data with many customers using web services APIs 24x7 .Large customers today run their customer portals accessing data from our database live.We integrate 80-90% of our data with all our customers as part of our mission to help trade and public with all the data that they need to be well informed.Due to our old hardware constraints we were quite restricted on how much of API service data we can enable in fear of production performance 24x7.From 2-4 customers in the past, today we serve close to 300 customers using web services without impacting production performance.Business expanded their operation hours from one shift to three shifts which is in all practical purposes a 24x7 operation around the globe.Struggled with balancing performance and data availability during backup and other database maintenance window.In Exadata, now business runs 24x7 with no impact on its performance while we carry out all database maintenance activities like backups, stat collection and merge activities behind the scenes.Additional reporting and compliance databases for business operations.
12 Top Five -1- Business Benefits Performance improved 30x without any change to Query or Process.We can run records query against any size stone without restriction.Performance in Records Query.An integrated and critical process step in the grading workflow.Each stone data is compared against archived data (~ 160 Million) for stone identification and fraud detection at multiple steps. Poor Query/database performance resulting in long grading delays.
13 Top Five -2- Business Benefits Service Interruptions. Very Frequent Application Java run-time Error and Restart of Application JVM and Service Interruptions.Upgrade to ExaLogic from x86 based Platform.Not a single instance of java run-time Application error or JVM restart ever since we upgraded to ExaLogic.No more unable allocate memory error.
14 Top Five-3- Business Benefits Data Consolidation between databases.A SQL Merge Process of about 200G every four hours.Process time reduced to 30 minutes from 8 hours between databases.This helped us service our global customers with improved current stone status, order additional services, reorder services and Workflow status etc.Limits on how many stones we can transfer and merge between databases were removed.
15 Top Five -4- Business Benefits Server Consolidations.ExaData for Database Servers Consolidation and ExaLogic for Application Servers Consolidation.Consolidated three database servers into one ExaData System (1/8 of a Rack).Consolidated Nine Application Servers into one ExaLogic System (1/8 of a Rack)By End of 2014 we would have consolidated all our ERP Databases into this single box. A single box will cater to all of GIA’s production database needs.
16 Top Five -5- Business Benefits Backup and Maintenance, 24x7 Business OperationLonger backup time and maintenance window was impacting 24x7 business operation requirement, application and database performance.RMAN Backup time reduced from 5 hours to 30 minutes.Export Backup time reduced from 6 hours to less than one hour.Statistics collection gets completed in 10 minutes from 6-8 hoursAdditional reporting and compliance databases for data mining and intelligence.Business operations continues without any impact from these activities.RMAN Backup time reduced from 5 hours to 30 minutes.Export Backup time reduced from 6 hours to less than one hour.Statistics collection gets completed in 10 minutes from 6-8 hours
17 Features of ExaData and ExaLogic used in GIA Grid Link Database ConnectionFast connection failoverRuntime connection load balancingSCAN Address“WriteBack” Flash Cache TechnologyIn release , FlashCache is “WriteThrough” by defaultSmart Flash cache provides the enhanced read and writes performance.Exadata storage software version is the minimum version required allowing writes to go into Smart Flash cache.This means database writes first will happen on Flash Cache and database will gives acknowledgement.Storage Cell Software writes them back onto hard diskUse of ZFS Storage over InfiniBand NetworkDatabase Backup completes 10X fasterUse of SDP InfiniBand Listener in ExaDataHigh throughputPerformance
18 Features of ExaData and ExaLogic used in GIA Use of ZFS Storage for Database BackupZFS Storage SnapshotDatabase as a Service( DBaaS) initiative in GIAMulti-tenancy Features as part of GIA Roadmap.
19 User Experience on ExaData and ExaLogic Response timeRecords Query30X betterBackup time10X betterBatch Transfers4X better3X3:36:31 sec300 min10000 Stones2400 Stones30 min0:06:15 sec
20 Current Architecture for Business Continuity Building CBuilding AExaDataExaLogicExaLogicExaDataThe same ZFS Storage mounted on other ExaDataCross CabledArchive Logs written to ZFS StorageStandby ExaData is used for Business Continuity.Business Continuity and Disaster Recovery are different for GIA.
21 Current Architecture for Disaster Recovery CarlsbadNew YorkExaDataExaLogicOracle DatabaseAppliance (ODA)Cross CabledData GuardStandby DatabaseLog ShippingODA (Oracle Database Appliance) is used for Disaster Recovery.Business Continuity and Disaster Recovery are different for GIA.
22 Key ActivitiesDatabase Migration (Linux-Itanium) to Oracle Exadata (Linux).Application Migration (Oracle Application Server) to Exalogic.Install and Configure Exalogic server.Database upgrade from 10g ( ) to 11g ( ).Setup Backup and Recovery using ZFS storgae.Setup Oracle DataGuard.Performance Tuning.
27 Approach & Methodology for Migration Logical ApproachPhysical ApproachCreating New Tablespace on Oracle Exadata Storage ServerOracle Logic StandbyOracle Streams and Oracle Data PumpOracle Data PumpASM RedundancyPhysical Standby DatabaseRecovery ManagerTransportable DatabaseTransportable TablespaceTCS RecommendationTCS chooses Logical Approach - Oracle data pump. This strategy has following pros and cons:This is simpler solution because data is not changing during migration but it incurs more downtime.No need to upgrade the source database.Platform migration is supported.Oracle data pump provides the network import feature that eliminates the need to stage outside of the database. When using this feature with large partitioned tables, investigate using the QUERY parameter manually separate the data being imported across several jobs so that all available computing capacity can be leveraged.
28 Snap clone – Sun ZFS Storage – GIA Roadmap Activities :Clone the production source (standby database) to a file system a NAS/ZFSCancel the Managed RecoveryTake a snapshot of the mounted database in NAS/ZFSClone the Database from the Snapshot using NAS clone featureMount the Cloned database to the target serverCreate the database using the Clone file system for One InstanceUsing the same SnapshotBusiness Benefit :Huge Storage SavingsClone time Savings
29 DBaaS Setup and Enable – GIA Roadmap Define Roles and UsersPlug-ins Required to Enable Database as a Service (DBaaS)Defining Roles and Assigning UsersEM_CLOUD_ADMINISTRATOREM_SSA_ADMINISTRATOREM_SSA_USERProvision Database Software on PaaSCreate Container Database (12c)Configure Oracle ListenerRegister & Manage Storage ServersSetup the Database Cloud Self Service PortalUse DBaaS to Provision Databases:Snap CloneRMAN BackupDBCA TemplatePDBsMetering and Charge backSuper AdministratorInstall Management Agent on Unmanaged HostsCloud AdministratorConfigure Privilege Delegation SettingSuper AdministratorConfigure the Software LibraryCloud AdministratorSet Up Provisioning CredentialsCloud AdministratorPerformed by Self Service AdministratorProvision Oracle Database SoftwareConfigure the ListenerRMAN BackupDBCA TemplateSchema as a ServicePDB as a ServiceSnap CloneRegister Storage ServerCreate Container DatabaseCreate DatabaseEnd
30 Challenges & Best Practices Typical ChallengesBest PracticesJAR Compatibility Issues (ADF, commons etc.)JVM compatibility Issues (jrockit v/s Sun)Heap Parameter tuning (more memory required especially due to 64 bit)http parameter tuning (session time out, client connections)Code specific issues due to changing library JAR (WebLogic parser is strict parser, hence java scripts needs to be revisited, required code change)Application specific parameter (weblogic.xml, weblogi-application.xml for session parameters, file size, filters, mime type etc.)Analyze existing AWR reports to isolate the critical tables and queriesimport using sorted order based on the AWR analysisWrite back flash cache to absorb random readsSDP listener between exadata and exalogicNFS over infiniband for high speed connectivity for Backups as well as imports.RAC gridlink for RAC aware connectivityWeblogic clustering to be explored for even better session availability and resilience.Message: Aiding customer’s business agility & efficienciesDomain Understanding – We have already stepped into the world of specialization, where technology knowledge alone can’t suffice to provide the solutions that today’s businesses need. TCS Entsol Oracle pools in and deploys people from various industry backgrounds and deploys them with a direct mapping. Therefore, a person belonging to the investment banking sector would have a better hang of front, middle and back office operations, with respect to the uninitiated. In the publishing industry, our people have reasonable understanding of subscriptions, Royalty, Digitization to name a fewCX: We have wide capabilities across CX solution stack of commerce, loyalty & marketing, service & support, integrated sales & marketing. We have 900+ CX consultants; 40+ Customers; 80+ Engagements. CX deployment for large European Bank for Service & Support; Multichannel sales and call center enablement for large pharmacy US retailer on ATG Platform; Large Omni-channel transformation for leading home improvement retailerConsulting – F&A from Lawson to EBS (McGraw Hill); Feasibility & Solution Blue printing (Standard Life); For a large publishing company, we did a ‘Business systems assessment’ leveraging our consulting methodology to define and build a cost effective, scalable Enterprise Platform that could support emerging revenue models, enabling the rapid transition from print to digital.Industry Solutions – Reverse Logistics (Manufacturing), ORBIT (Manufacturing); Mapset (Hi-Tech)