CERN IT Department CH-1211 Geneva 23 Switzerland www.cern.ch/i t Eva Dafonte Perez IT-DB Database Replication, Backup and Archiving.

Slides:

Advertisements

Similar presentations

Replication solutions for Oracle database 11g Zbigniew Baranowski.

Advertisements

CERN IT Department CH-1211 Geneva 23 Switzerland t Emil Pilecki, IT-DB Standby configuration clean up and standardization.

Oracle Data Guard Ensuring Disaster Recovery for Enterprise Data

CERN IT Department CH-1211 Geneva 23 Switzerland t Marcin Blaszczyk, IT-DB Atlas standby database tests February.

CERN - IT Department CH-1211 Genève 23 Switzerland t Transportable Tablespaces for Scalable Re-Instantiation Eva Dafonte Pérez.

RLS Production Services Maria Girone PPARC-LCG, CERN LCG-POOL and IT-DB Physics Services 10 th GridPP Meeting, CERN, 3 rd June What is the RLS -

CERN - IT Department CH-1211 Genève 23 Switzerland t Relational Databases for the LHC Computing Grid The LCG Distributed Database Deployment.

Replication Technologies at WLCG Lorena Lobato Pardavila CERN IT Department – DB Group JINR/CERN Grid and Management Information Systems, Dubna (Russia)

Backup The flip side of recovery. Types of Failures Transaction failure –Transaction must be aborted System failure –Hardware or software problem resulting.

CERN - IT Department CH-1211 Genève 23 Switzerland t Oracle and Streams Diagnostics and Monitoring Eva Dafonte Pérez Florbela Tique Aires.

Database Backup and Recovery

CERN - IT Department CH-1211 Genève 23 Switzerland t STREAMS Resynchronization Scenarios and Tests LCG 3D CERN September 2006.

CERN IT Department CH-1211 Genève 23 Switzerland t Recovery Exercise Wrap-up Jacek Wojcieszuk, CERN IT-DM Distributed Database Operations.

Agenda  Overview  Configuring the database for basic Backup and Recovery  Backing up your database  Restore and Recovery Operations  Managing your.

Computing Facilities CERN IT Department CH-1211 Geneva 23 Switzerland t CF CERN Business Continuity Overview Wayne Salter HEPiX April 2012.

CERN IT Department CH-1211 Geneva 23 Switzerland t T0 report WLCG operations Workshop Barcelona, 07/07/2014 Maite Barroso, CERN IT.

CERN IT Department CH-1211 Genève 23 Switzerland t Data Protection with Oracle Data Guard Jacek Wojcieszuk, CERN/IT-DM Distributed Database.

CERN - IT Department CH-1211 Genève 23 Switzerland t Partitioning in COOL Andrea Valassi (CERN IT-DM) R. Basset (CERN IT-DM) Distributed.

13 Copyright © Oracle Corporation, All rights reserved. RMAN Complete Recovery.

CERN IT Department CH-1211 Geneva 23 Switzerland t Experience with NetApp at CERN IT/DB Giacomo Tenaglia on behalf of Eric Grancher Ruben.

CERN - IT Department CH-1211 Genève 23 Switzerland t The High Performance Archiver for the LHC Experiments Manuel Gonzalez Berges CERN, Geneva.

SRUTHI NAGULAVANCHA CIS 764, FALL 2008 Department of Computing and Information Sciences (CIS) Kansas State University -1- Back up & Recovery Strategies.

© ViSolve.com All rights reserved. Privacy Statement April Oracle Disaster Recovery Implementation A Non-Technical Overview.

Backup & Recovery Backup and Recovery Strategies on Windows Server 2003.

CERN IT Department CH-1211 Geneva 23 Switzerland t The Experiment Dashboard ISGC th April 2008 Pablo Saiz, Julia Andreeva, Benjamin.

CERN - IT Department CH-1211 Genève 23 Switzerland t Tier0 database extensions and multi-core/64 bit studies Maria Girone, CERN IT-PSS LCG.

11g(R1/R2) Data guard Enhancements Suresh Gandhi

WLCG Service Report ~~~ WLCG Management Board, 27 th October

CERN IT Department CH-1211 Genève 23 Switzerland t EIS section review of recent activities Harry Renshall Andrea Sciabà IT-GS group meeting.

ORACLE GOLDENGATE AT CERN

1 Data Guard. 2 Data Guard Reasons for Deployment  Site Failures  Power failure  Air conditioning failure  Flooding  Fire  Storm damage  Hurricane.

Databases E. Leonardi, P. Valente. Conditions DB Conditions=Dynamic parameters non-event time-varying Conditions database (CondDB) General definition:

CERN IT Department CH-1211 Genève 23 Switzerland t Castor development status Alberto Pace LCG-LHCC Referees Meeting, May 5 th, 2008 DRAFT.

CERN IT Department CH-1211 Genève 23 Switzerland t Internet Services Overlook of Messaging.

CERN - IT Department CH-1211 Genève 23 Switzerland t Oracle Real Application Clusters (RAC) Techniques for implementing & running robust.

Marcin Blaszczyk, Zbigniew Baranowski – CERN Outline Overview & Architecture Use Cases for Our experience with ADG and lessons learned Conclusions.

CERN-IT Oracle Database Physics Services Maria Girone, IT-DB 13 December 2004.

Peter Chochula ALICE Offline Week, October 04,2005 External access to the ALICE DCS archives.

CERN IT Department CH-1211 Genève 23 Switzerland t Possible Service Upgrade Jacek Wojcieszuk, CERN/IT-DM Distributed Database Operations.

CERN Database Services for the LHC Computing Grid Maria Girone, CERN.

Data & Storage Services CERN IT Department CH-1211 Genève 23 Switzerland t DSS Castor incident (and follow up) Alberto Pace.

CERN IT Department CH-1211 Genève 23 Switzerland t DM Database Monitoring Tools Database Developers' Workshop CERN, July 8 th, 2008 Dawid.

CERN - IT Department CH-1211 Genève 23 Switzerland t High Availability Databases based on Oracle 10g RAC on Linux WLCG Tier2 Tutorials, CERN,

CERN IT Department CH-1211 Genève 23 Switzerland t Streams Service Review and Outlook Distributed Database Workshop PIC, 20th April 2009.

Database Competence Centre openlab Major Review Meeting nd February 2012 Maaike Limper Zbigniew Baranowski Luigi Gallerani Mariusz Piorkowski Anton.

CERN IT Department CH-1211 Genève 23 Switzerland t Streams Service Review Distributed Database Workshop CERN, 27 th November 2009 Eva Dafonte.

CERN IT Department CH-1211 Genève 23 Switzerland t Experiment Operations Simone Campana.

CERN IT Department CH-1211 Geneva 23 Switzerland t WLCG Operation Coordination Luca Canali (for IT-DB) Oracle Upgrades.

Computing Facilities CERN IT Department CH-1211 Geneva 23 Switzerland t CF CF Monitoring: Lemon, LAS, SLS I.Fedorko(IT/CF) IT-Monitoring.

CERN IT Department CH-1211 Genève 23 Switzerland 1 Active Data Guard Svetozár Kapusta Distributed Database Operations Workshop November.

Maria Girone CERN - IT Tier0 plans and security and backup policy proposals Maria Girone, CERN IT-PSS.

CERN IT Department CH-1211 Genève 23 Switzerland t COOL Performance Tests ATLAS Conditions Database example Romain Basset, IT-DM October.

CNAF Database Service Barbara Martelli CNAF-INFN Elisabetta Vilucchi CNAF-INFN Simone Dalla Fina INFN-Padua.

Status of tests in the LCG 3D database testbed Eva Dafonte Pérez LCG Database Deployment and Persistency Workshop.

WLCG critical services update Andrea Sciabà WLCG operations coordination meeting December 18, 2014.

CERN IT Department CH-1211 Geneva 23 Switzerland t Distributed Database Operations Workshop November 17 th, 2010 Przemyslaw Radowiecki CERN.

CERN IT Department CH-1211 Geneva 23 Switzerland t Distributed Database Operations Workshop CERN, 17th November 2010 Dawid Wójcik Streams.

CERN IT Department CH-1211 Genève 23 Switzerland t CCRC’08 Review from a DM perspective Alberto Pace (With slides from T.Bell, F.Donno, D.Duelmann,

CERN - IT Department CH-1211 Genève 23 Switzerland t Service Level & Responsibilities Dirk Düllmann LCG 3D Database Workshop September,

CERN IT Department CH-1211 Genève 23 Switzerland t Using Data Guard for hardware migration UKOUG RAC & HA SIG, Feb 2008 Miguel Anjo, CERN.

INFN Tier1/Tier2 Cloud WorkshopCNAF, 22 November 2006 Conditions Database Services How to implement the local replicas at Tier1 and Tier2 sites Andrea.

Eric Grancher CERN IT department Overview of Database Technologies Computing and Astroparticle Physics 2 nd ASPERA Workshop /1.

Maria Girone, CERN – IT, Data Management Group

Backup & Recovery of Physics Databases

Evolution of Data(base) Replication Technologies for WLCG

Database Services at CERN Status Update

STREAMS failover and resynchronization

Oracle Streams Performance

CERN DB Services: Status, Activities, Announcements

Presentation transcript:

CERN IT Department CH-1211 Geneva 23 Switzerland t Eva Dafonte Perez IT-DB Database Replication, Backup and Archiving

CERN IT Department CH-1211 Geneva 23 Switzerland t Overview Current status, medium-term and future plans for Data replication Backup solutions Archiving Database Replication, Backup and Archiving - 2

CERN IT Department CH-1211 Geneva 23 Switzerland t Data Replication current status Using Oracle Streams –Normal setup between online and offline databases –Downstream database setup between offline and Tier1 sites databases –ALICE, ATLAS, CMS, LHCb and COMPASS –Different sets of data: Conditions, PVSS, LFC, muon calibration and AMI –Main concerns: Sensible to ”human errors/actions” and database load Resynchronization procedures Database Replication, Backup and Archiving - 3

CERN IT Department CH-1211 Geneva 23 Switzerland t Data Replication current status ATLAS Conditions, PVSS, Muon Calibration and AMI ATLAS Conditions, PVSS, Muon Calibration and AMI LHCb Conditions and LFC LHCb Conditions and LFC ALICE & COMPASS PVSS ALICE & COMPASS PVSS CMS Conditions and PVSS CMS Conditions and PVSS

CERN IT Department CH-1211 Geneva 23 Switzerland t Data Replication plans for 2012 Several technologies tested –Streams 11g –Golden Gate –Active Data Guard (ADG) Database Replication, Backup and Archiving - 5

CERN IT Department CH-1211 Geneva 23 Switzerland t Data Replication plans for 2012 Streams replacement with ADG for CMS and ALICE No changes (Streams 11g) for ATLAS, LHCb and COMPASS 6 ONLINE DATABASE OFFLINE DATABASE ONLINE STANDBY OFFLINE STANDBY STREAMS Conditions + PVSS ACTIVE ONLINE STANDBY Conditions and PVSS reader sessions Other OFFLINE reader sessions Conditions and PVSS reader sessions ONLINE DATABASE CMSALICE OFFLINE DATABASE STREAMS PVSS ONLINE STANDBY ACTIVE ONLINE STANDBY PVSS reader sessions PVSS reader sessions

CERN IT Department CH-1211 Geneva 23 Switzerland t Data Replication future move to ADG all replication setups between online and offline sites: decision will depend on –Replication technologies evolution –Experience gained Database Replication, Backup and Archiving - 7

CERN IT Department CH-1211 Geneva 23 Switzerland t Backup current status Home made solution, based on Oracle RMAN Nowadays relying on IBM Tivoli (tape) –Performance issues –Best effort service (no HA solution) Automatic test of DB recoveries Standby databases –Disaster recovery –Asynchronous transport mode (no influence on primary database performance) –Allows to recover from human errors (within the existing lag – few hours) Database Replication, Backup and Archiving - 8

CERN IT Department CH-1211 Geneva 23 Switzerland t Backup plans for 2012 Moving backup and recovery management to an unified tool inside the group Replace on-disc database copies by snapshots (new hw) Starting evaluation of a disc based solution for backup sets repository –Replacement of Tivoli –File-system backups to tape Move backups to run on standby databases –Offload primary databases Database Replication, Backup and Archiving - 9

CERN IT Department CH-1211 Geneva 23 Switzerland t Archiving current status and future plans Goal: avoid that DB growth impact manageability and performance Archive databases available for ATLAS and CMS Joint work with experiments/development to identify and prepare the applications –Partitioning + indexes –Separate tablespaces per period (quarter, year, …) Extension to other applications/databases Database Replication, Backup and Archiving - 10

CERN IT Department CH-1211 Geneva 23 Switzerland t Questions?