CNAF Database Service Barbara Martelli CNAF-INFN Elisabetta Vilucchi CNAF-INFN Simone Dalla Fina INFN-Padua.

Slides:



Advertisements
Similar presentations
ITEC474 INTRODUCTION.
Advertisements

IWR Ideen werden Realität Forschungszentrum Karlsruhe in der Helmholtz-Gemeinschaft Institut für Wissenschaftliches Rechnen Status of Database Services.
Copyright GeneGo CONFIDENTIAL »« MetaCore TM (System requirements and installation) Systems Biology for Drug Discovery.
High Availability Group 08: Võ Đức Vĩnh Nguyễn Quang Vũ
Oracle Clustering and Replication Technologies CCR Workshop - Otranto Barbara Martelli Gianluca Peco.
1 Recovery and Backup RMAN TIER 1 Experience, status and questions. Meeting at CNAF June of 2007, Bologna, Italy Carlos Fernando Gamboa, BNL Gordon.
VMware vCenter Server Module 4.
1 RAL Status and Plans Carmine Cioffi Database Administrator and Developer 3D Workshop, CERN, November 2009.
BNL Oracle database services status and future plans Carlos Fernando Gamboa RACF Facility Brookhaven National Laboratory, US Distributed Database Operations.
Manage & Configure SQL Database on the Cloud Haishi Bai Technical Evangelist Microsoft.
CERN IT Department CH-1211 Genève 23 Switzerland t Next generation of virtual infrastructure with Hyper-V Michal Kwiatek, Juraj Sucik, Rafal.
Castor F2F Meeting Barbara Martelli Castor Database CNAF.
Edinburgh Site Report 1 July 2004 Steve Thorn Particle Physics Experiments Group.
Client Management. Introduction In a typical organization there are a lot of client machines used for day to day operations Client management is a necessary.

Bob Thome, Senior Director of Product Management, Oracle SIMPLIFYING YOUR HIGH AVAILABILITY DATABASE.
ScotGrid: a Prototype Tier-2 Centre – Steve Thorn, Edinburgh University SCOTGRID: A PROTOTYPE TIER-2 CENTRE Steve Thorn Authors: A. Earl, P. Clark, S.
Fermilab Oct 17, 2005Database Services at LCG Tier sites - FNAL1 FNAL Site Update By Anil Kumar & Julie Trumbo CD/CSS/DSG FNAL LCG Database.
ASGC 1 ASGC Site Status 3D CERN. ASGC 2 Outlines Current activity Hardware and software specifications Configuration issues and experience.
October, Scientific Linux INFN/Trieste B.Gobbo – Compass R.Gomezel - T.Macorini - L.Strizzolo INFN - Trieste.
RLS Tier-1 Deployment James Casey, PPARC-LCG Fellow, CERN 10 th GridPP Meeting, CERN, 3 rd June 2004.
CERN - IT Department CH-1211 Genève 23 Switzerland t Tier0 database extensions and multi-core/64 bit studies Maria Girone, CERN IT-PSS LCG.
1 24x7 support status and plans at PIC Gonzalo Merino WLCG MB
Daniela Anzellotti Alessandro De Salvo Barbara Martelli Lorenzo Rinaldi.
Batch Scheduling at LeSC with Sun Grid Engine David McBride Systems Programmer London e-Science Centre Department of Computing, Imperial College.
Module 10: Maintaining High-Availability. Overview Introduction to Availability Increasing Availability Using Failover Clustering Standby Servers and.
DB Installation and Care Carmine Cioffi Database Administrator and Developer ICAT Developer Workshop, The Cosener's House August
21 st October 2002BaBar Computing – Stephen J. Gowdy 1 Of 25 BaBar Computing Stephen J. Gowdy BaBar Computing Coordinator SLAC 21 st October 2002 Second.
CCRC’08 Weekly Update Jamie Shiers ~~~ LCG MB, 1 st April 2008.
LFC Replication Tests LCG 3D Workshop Barbara Martelli.
Summary of the status and plans of FTS and LFC back-end database installations at Tier-1 Sites Gordon D. Brown Rutherford Appleton Laboratory WLCG Workshop.
CERN - IT Department CH-1211 Genève 23 Switzerland t Oracle Real Application Clusters (RAC) Techniques for implementing & running robust.
CERN-IT Oracle Database Physics Services Maria Girone, IT-DB 13 December 2004.
CERN Database Services for the LHC Computing Grid Maria Girone, CERN.
1 D0 Taking Stock By Anil Kumar CD/LSCS/DBI/DBA June 11, 2007.
December 26, 2015 RHIC/USATLAS Grid Computing Facility Overview Dantong Yu Brookhaven National Lab.
CERN Computer Centre Tier SC4 Planning FZK October 20 th 2005 CERN.ch.
CERN - IT Department CH-1211 Genève 23 Switzerland t High Availability Databases based on Oracle 10g RAC on Linux WLCG Tier2 Tutorials, CERN,
High Availability Technologies for Tier2 Services June 16 th 2006 Tim Bell CERN IT/FIO/TSI.
Michelle Malcher PepsiCo Session # For the DBA Manager – Understanding Oracle and DBAs.
CASTOR CNAF TIER1 SITE REPORT Geneve CERN June 2005 Ricci Pier Paolo
BNL Oracle database services status and future plans Carlos Fernando Gamboa, John DeStefano, Dantong Yu Grid Group, RACF Facility Brookhaven National Lab,
Maria Girone CERN - IT Tier0 plans and security and backup policy proposals Maria Girone, CERN IT-PSS.
PIC port d’informació científica DateText1 November 2009 (Elena Planas) PIC Site review.
15-Feb-02Steve Traylen, RAL WP6 Test Bed Report1 RAL/UK WP6 Test Bed Report Steve Traylen, WP6 PPGRID/RAL, UK
Database CNAF Barbara Martelli Rome, April 4 st 2006.
PIC port d’informació científica Luis Diaz (PIC) ‏ Databases services at PIC: review and plans.
BNL dCache Status and Plan CHEP07: September 2-7, 2007 Zhenping (Jane) Liu for the BNL RACF Storage Group.
Replicazione e QoS nella gestione di database grid-oriented Barbara Martelli INFN - CNAF.
Introduction to Core Database Concepts Getting started with Databases and Structure Query Language (SQL)
10/18/01Linux Reconstruction Farms at Fermilab 1 Steven C. Timm--Fermilab.
Oracle 10g database installation kit  A bundle of scripts which allows to install Oracle 10g database server on a single node: Useful for both experienced.
Storage & Database Team Activity Report INFN CNAF,
CNAF - 24 September 2004 EGEE SA-1 SPACI Activity Italo Epicoco.
Bernd Panzer-Steindel CERN/IT/ADC1 Medium Term Issues for the Data Challenges.
Oracle Clustering and Replication Technologies UK Metadata Workshop - Oxford Barbara Martelli Gianluca Peco.
Calgary Oracle User Group
Power Systems with POWER8 Technical Sales Skills V1
status, usage and perspectives
Jean-Philippe Baud, IT-GD, CERN November 2007
High Availability Linux (HA Linux)
LCG 3D Distributed Deployment of Databases
Lead SQL BankofAmerica Blog: SQLHarry.com
Database Services at CERN Status Update
UK GridPP Tier-1/A Centre at CLRC
NGS Oracle Service.
Scalable Database Services for Physics: Oracle 10g RAC on Linux
Introduction of Week 6 Assignment Discussion
Scalable Database Services for Physics: Oracle 10g RAC on Linux
Presentation transcript:

CNAF Database Service Barbara Martelli CNAF-INFN Elisabetta Vilucchi CNAF-INFN Simone Dalla Fina INFN-Padua

2 Overview Present Database Service Organization CNAF Database Experience CNAF – Tier1’s HW Resources Plans for the Near Future CNAF Contribution to LCG 3D Project Summary

3 Present Database Service Organization For each experiment, one person is responsible for installing, maintaining and monitoring all experiment specific applications and services. LCG local group is responsible for installing, maintaining and monitoring all LCG applications and services. A few Tier1 generic databases are maintained by Database group. Database group is composed by 4 people, 3 onsite and one (Simone Dalla Fina) collaborates from Padua.

4 CNAF Database Group Experience MySql PostgresSQL Oracle 9i and Oracle 10g High Availability environment built on RedHat Enterprise Cluster Suite. Entity-Relationship schema writing.

5 MySql Experience As almost database based applications on LCG software rely on MySql, CNAF LCG local support group has experienced installation, administration and tuning of MySql databases. Experience in development of MySql based applications (e.g. VOMS), exploiting innoDB tables and one-way replication.

6 PostgreSQL Experience CNAF Hardware resources database built on PostgreSQL. Developed an application which contains information about all HW resources and performs automatic configuration of switches, DNS and DHCP servers needed for farms installation. Daily tasks such as backups and vacuum are performed with cron jobs. During down time due to RDBMS upgrades, patches installation and application upgrades, a secondary database is used, this is not a replica database, it’s updated “by hands” restoring the last primary database dump

7 Oracle 9i Experience CASTOR application, based on Oracle 9i, is running in production environment at CNAF. Database group is involved in installation and maintenance tasks. Backups - Weekly Hot Backup of the entire database - Daily full export and Castor tables export - Legato NetWorker module for Oracle (which exploits with RMAN) backup on Tape Library STK180 (LTO/9840)

8 Oracle 9i Experience (contd) Collaboration with CERN in Oracle based RLS component testing. Installation of Oracle and Oracle Application Server through CERN installation toolkits. Installed 2 biprocessor (PIII 2,4 GHz) with RedHat Advanced Server 2.1 and: – Oracle 9i single instance for the RLS database backend, Oracle datafiles reside on a SAN partition (RAID 5) on the first machine – Oracle 9i Application Server single instance for the RLS application on the second machine

9 High Availability experience Deployment of an high available Oracle service on top of RedHat ES 3.0 cluster. 2 PIII 2,4 GHz with shared storage in failover configuration. Oracle 9i is configured as cluster service. The stand-by machine can be the primary node for another service.

10 Oracle 10g Experience We have recently tried the installation of new release of Oracle 10g. Testbed composed by 2 machines at CNAF – Dual Intel Xeon 2,4 GHz, HyperThreading enabled, 512 MB RAM, two 60 GB disks, with Scientific Linux 1 machine at Padua-INFN – Dual PIII 1,3 GHz, 1GB RAM, two 60 GB disks, with Scientific Linux Done the set up of one way replication between the machines at CNAF.

11 CNAF Hardware Resources At present we have available 4 machines on site: – Two dual PIII 2,4 GHz, 512 MB RAM with two 60 GB disks – Two dual Intel Xeon 2,4 GHz with HyperThreading, 512 MB RAM with two 60 GB disks One machine at INFN-Padua – Dual PIII 1,3 GHz, 1GB RAM, two 60 GB disks Possibility to connect to our SAN to enlarge storage and share it with other servers Gigabit interfaces on all machines Possibility to add new hardware in the future, if needed

12 Plans for the Near Future Necessary to create a production environment which has to be high available, fault tolerant and responsive. At the same time we need to centralize the administration of some databases which are now scattered on many different servers, this increase the administration time and the probability of mistakes. The simplest solution is the creation of a RedHat cluster of DB servers, in high availability configuration, each one being the primary server for one different DB instance.

13 CNAF Contribution to LCG 3D Project CNAF can give the following type of contribution: – Database support: (install bug fix patch, security patch upgrade/migrate, day to day database administration activity). – System support: (install, bug fix patch, security patch, upgrade/migrate, day to day system administration activity) – Research and test activities on Streams replication and RAC environment. – Support other sites on activities such installation of databases, ER schemata writing, and daily administration.

14 CNAF Contribution to LCG 3D Project By now, services can be guaranteed on working days and working hours. One way to ensure a 24x7 service, could be shifts with other sites. In the future, we expect to follow the growth of applications needs increasing our effort and possibly the number of people involved in the database group.

15 Summary CNAF database group has experience on many RDBMS like MySql, PostgreSQL, Oracle. Experience also on high availability cluster configurations. We are moving our databases to a centralized, high available, fault tolerant configuration, in order to rationalize hardware and human resources. We have a lot of interest in exploring replication and cluster tools and techniques in the Oracle environment.

16 Contacts Barbara Martelli Elisabetta Vilucchi Simone Dalla Fina Pier Paolo Ricci