Presentation is loading. Please wait.

Presentation is loading. Please wait.

Storage & Database Team Activity Report INFN CNAF, 22-12-2004.

Similar presentations


Presentation on theme: "Storage & Database Team Activity Report INFN CNAF, 22-12-2004."— Presentation transcript:

1 Storage & Database Team Activity Report INFN CNAF, 22-12-2004

2 Storage and Database Team Team composition - P.P. Ricci, G. Lore, E. Vilucchi, S. Zani, B. Martelli Tasks –CASTOR HSM system - HW/SW installation and maintenance, gridftp and SRM access service P.P. Ricci, G. Lore, E. Vilucchi + 1 person at CERN dev-team (February 2004) Total: ~1 FTE at CNAF, needed at least 2 –DISK (SAN,NAS) - HW/SW installation and maintenance, remote (gridSE) and local (rfiod/nfs/GPFS) access service, clustered/parallel filesystem tests P.P. Ricci, G. Lore, E. Vilucchi, S. Zani Total: ~1.5 FTE needed at least 3 –DB (Oracle for Castor & RLS test, Main Tier 1 Hardware db) B. Martelli, E. Vilucchi, P.P. Ricci Total: ~1 FTE needed at least 2 Required at least 3 more FTE staff people (1 for each topic!)

3 CASTOR issues (1) At present STK library with 6XLTO2 and 2X9940B drives –1200 x 200GB LTO-2 tapes => 240TB (used only 15%!) –680 x 200GB 9940B tapes => 136TB (free) –Upgrade with other N. 4 9940B drives and 2500 x 200GB tapes (500TB) not before 2nd half of 2005 In general CASTOR performances (as other HSM software) increase with clever pre-staging of files (ideally ~ 90%) LTO-2 drives not usable in a real production environment with present CASTOR release –hangs on locate/fskip occur every 50-100 not-sequencial reading operations or checksum and not terminated tape (RDONLY) every 50/100GB data written (also STK assistance is needed) –Usable only with medium filesize of 20 MB or more –Good reliability on optimized (sequential or prestaged) operations –Fixes with CASTOR v.2 (Q2 2005) ? CERN and PIC NEVER reported HW problems with 9940B drives during last year data-challenges.

4 CASTOR issues (2) Better choose the media according to the type of files written to CASTOR. Trigger (with experiment coordination) a temporary increase of the staging area disk buffer and an optimized sequencial parallel stage-in of data. –Access to data over rfio or grid tools on CASTOR –high probability to find the file directly on disk (see LHCB). So we strongly encourage the LHC experiments the use of our Castor tape resource and suggest to the other experiments (BABAR,CDF,VIRGO,AMS,MAGIC) the possibility to have a local backup copy of their disk storage also on our LTO-2 tapes using Castor. This could help in case of disk data loss/corruption.

5 Database present Status Database backend in production at Tier1: –Oracle (CASTOR) - P.P.Ricci, E. Vilucchi –PostgreSQL (Tier1’s HW resources database) - B. Martelli Partecipation in LCG 3D project –B. Martelli, E. Vilucchi (~ 1 FTE) –2 Oracle 10g servers for replication tests with CERN –R&D on Oracle Streams Replication –Support on Oracle 10g DB server installation

6 Database 2005 activity LCG 3D project (B. Martelli, E. Vilucchi) –CNAF joining test bed: 2005 Q1 –Begin of production phase at CNAF: 2005 Q3 –Setup of a RedHat Cluster running Oracle 10g in failover configuration: 2005 Q3 (+ P.P. Ricci) CASTOR –Oracle database migration to 10g: 2005 Q1-Q2 (B. Martelli, E. Vilucchi, P.P. Ricci) –Setup of an Oracle Real Application Cluster for CASTOR: 2005 Q3 (B. Martelli, E. Vilucchi, P.P. Ricci) Deployment of Tier1’s storage resources database in production environment (B. Martelli) INFN administration database replica at CNAF –environment setup 2005 Q1-Q2 –deployment in production environment: 2005 Q2-Q3


Download ppt "Storage & Database Team Activity Report INFN CNAF, 22-12-2004."

Similar presentations


Ads by Google