1. LCG 3D Distributed Deployment of Databases
Barbara Martelli

2. INFN-GRID Technical Board 16/02/2005
LCG 3D Project Goals
Define an LCG distributed database service allowing LCG applications to
find relevant database back-ends
authenticate
use the provided data in a consistent location independent way
Avoid the costly parallel development of
data distribution
backup procedures
high availability mechanisms
in each grid site in order to limit the support costs.
INFN-GRID Technical Board 16/02/2005

3. INFN-GRID Technical Board 16/02/2005
Why LCG 3D
LCG provides an infrastructure for distributed access to file based data and data replication
Physics applications (and Grid services) require a similar infrastructure for data stored in relational databases
Need for some standardisation as part of LCG
Need to bring service providers (site technology experts) closer to database users/developers to define a LCG database service for the upcoming data challenges in 2005
INFN-GRID Technical Board 16/02/2005

4. Database Service Structure
Different requirements and service capabilities for different Tiers
Database Backbone (Tier1 <-> Tier1)
High volume, often complete replication of RDBMS data
Can expect good, but not continuous network connection to other T1 sites
Symmetric, possibly multi-master replication
Large scale central database service, local dba team
Tier1 <->Tier2
Medium volume, sliced extraction of data
Asymmetric, possibly only uni-directional replication
Part time administration (shared with fabric administration)
Tier1/2 <->Tier4 (Laptop extraction)
Support fully disconnected operation
Low volume, sliced extraction from T1/T2
Need a catalog of implementation/distribution technologies
Each addressing parts of the problem
But all together forming a consistent distribution model
INFN-GRID Technical Board 16/02/2005

5. M M O O M O M T0 T3/4 T1- db back bone T2 - local db cache
- autonomous
T3/4
T1- db back bone
- all data replicated
- reliable service
T2 - local db cache
-subset data
-only local service O M O M
Oracle Streams
Cross vendor extract
MySQL Files
Proxy Cache

6. INFN-GRID Technical Board 16/02/2005
Project Structure
WP1 - Data Inventory and Distribution Requirements
Define a complete inventory of RDBMS data and applications foreseen by the experiment computing models
Feed back to the software development process the proposed distribution model
WP2 - Database Service Definition and Implementation
represent the service infrastructure of the particular site
contribute to the definition of a common database and distribution service which is provided to worker node and grid service applications
WP3 - Evaluation Tasks
define an evaluation plan for a particular technology which is used to implement part of the 3d distribution infrastructure
setup a prototype system for the particular technology and compare the prototype performance with the requirements delivered by the WP1
summarise the outcome of a evaluation in a short technology evaluation document
INFN-GRID Technical Board 16/02/2005

7. INFN-GRID Technical Board 16/02/2005
CNAF Contribute to 3D
Personnel
Barbara Martelli
Elisabetta Vilucchi
Simone Dalla Fina (INFN - PD)
HW resources
4 machines (2 dual PIII 2,4 GHz, 512 MB RAM with two 60 GB disks, 2 dual Intel Xeon 2,4 GHz with HyperThreading, 512 MB RAM with two 60 GB disks)
1TB storage accessible via SAN
One machine at INFN-Padua (Dual PIII 1,3 GHz, 1GB RAM, two 60 GB disks)
INFN-GRID Technical Board 16/02/2005

8. CNAF Planned Activities Q1
CNAF is in the first set of sites which will join 3D testbed (before the end of March)
Install and test Oracle 10g
Initial setup and distribution tests using Oracle Streams technology
Setup Oracle Enterprise Manager for testbed and evaluate suitability for shared administration in WAN
INFN-GRID Technical Board 16/02/2005

9. CNAF Planned Activities Q2
Introduce new applications into 3D testbed
Distribute applications and workload as defined by experiments
Run distributed tests and test data distribution as required by experiments
Test of RAC setup
INFN-GRID Technical Board 16/02/2005

10. CNAF Planned Activities Q3
Final version of 3D service definition and service implementation documents
Installation of T1 production setup
Need the testbed to stay available for ongoing integration
INFN-GRID Technical Board 16/02/2005

11. CNAF Planned Activities Q4
Starting production deployment of distributed service
According to experiment deployment plans
INFN-GRID Technical Board 16/02/2005

12. INFN-GRID Technical Board 16/02/2005
Contacts and Links
Barbara Martelli
Elisabetta Vilucchi
Simone Dalla Fina
INFN-GRID Technical Board 16/02/2005