Presentation is loading. Please wait.

Presentation is loading. Please wait.

Plateforme de Calcul pour les Sciences du Vivant SRB & gLite V. Breton.

Similar presentations


Presentation on theme: "Plateforme de Calcul pour les Sciences du Vivant SRB & gLite V. Breton."— Presentation transcript:

1 Plateforme de Calcul pour les Sciences du Vivant SRB & gLite V. Breton

2 Plateforme de Calcul pour les Sciences du Vivant Introduction Goal: evaluation of existing technologies for data and tools integration and deployment –Data and tools integration should be addressed using web services –Grid middlewares are dealing with workload and data management relevant to data and tools deployment First foreseen middlewares –DEISA middleware (workload and data management) –SRB on BIRN (data management) –LCG2 and gLite on EGEE (workload and data management)

3 Plateforme de Calcul pour les Sciences du Vivant SRB: context SRB is a middleware developed by San Diego Supercomputing Center SRB is used on a large scale american project in the biomedical field: Biomedical Informatics Research Network –Federation of databases storing brain medical images Within the framework of BIRN, SRB is possibly deployed on several sites in Europe (Spain ?, UK ?)

4 Plateforme de Calcul pour les Sciences du Vivant What is SRB ? SRB is about virtualization of storage resources: the SRB client sees all the storage elements as one single storage resource

5 Plateforme de Calcul pour les Sciences du Vivant SRB potential interest for Embrace SRB strong points –A reliable middleware benefitting from developments for more than 10 years –A middleware used already at a large scale for distributed medical data storage SRB weak points –Middleware providing limited functionalities (absence of workload management) –Only anonymized information are stored –Interoperability with other middlewares ? Expertise on SRB within Embrace –CNB, Univ. Manchester nodes of BIRN ? –LPC will use SRB to deploy an MRI platform for rare disease diagnosis Need volunteers to further dig into SRB middleware

6 Plateforme de Calcul pour les Sciences du Vivant EGEE Two middlewares –LCG2 currently deployed on the infrastructure –gLite currently under deployment on preproduction service Main features –LCG2 has demonstrated robustness for grid computing, but lacks data management features –gLIte opens new perpectives in terms of data management and security but is just in its infancy

7 Plateforme de Calcul pour les Sciences du Vivant gLite Services Grid Access Service API Access Services Job Provenance Job Management Services Computing Element Workload Management Package Manager Metadata Catalog Data Services Storage Element Data Management File & Replica Catalog Authorization Security Services Authentication Auditing Information & Monitoring Information & Monitoring Services Application Monitoring Site Proxy Accounting JRA3 UK CERN IT/CZ

8 Plateforme de Calcul pour les Sciences du Vivant gLite Services for Release 1 Software stack and origin (simplified) Computing Element –Gatekeeper (Globus) –Condor-C (Condor) –CE Monitor (EGEE) –Local batch system (PBS, LSF, Condor) Workload Management –WMS (EDG) –Logging and bookkeeping (EDG) –Condor-C (Condor) Storage Element –File Transfer/Placement (EGEE) –glite-I/O (AliEn) –GridFTP (Globus) –SRM: Castor (CERN), dCache (FNAL, DESY), other SRMs Catalog –File and Replica Catalog (EGEE) –Metadata Catalog (EGEE) Information and Monitoring –R-GMA (EDG) Security –VOMS (DataTAG, EDG) –GSI (Globus) –Authentication for C and Java based (web) services (EDG)

9 Plateforme de Calcul pour les Sciences du Vivant Main Differences to LCG-2 Workload Management System works in push and pull mode Computing Element moving towards a VO based scheduler guarding the jobs of the VO (reduces load on GRAM) Distributed and re-factored file & replica catalogs Secure catalogs (based on user DN; VOMS certificates being integrated) Scheduled data transfers SRM based storage Information Services: R-GMA with improved API and registry replication Prototypes of additional services –Grid Access Service (GAS) –Package manager –DGAS based accounting system –Job provenance service Move towards Web Services

10 Plateforme de Calcul pour les Sciences du Vivant How to proceed ? Encourage WP3 members (particularly test cases) to deploy applications on their local/national infrastructure and report on their experience –From the list of partners, the main middlewares should be tested:  LPC: EGEE( LCG2,gLite), SRB  SIB: Swiss BioGrid  Uppsala: Nordugrid  Cineca: DEISA  CSC: Nordugrid  CMBI: Need for common evaluation criteria


Download ppt "Plateforme de Calcul pour les Sciences du Vivant SRB & gLite V. Breton."

Similar presentations


Ads by Google