Presentation is loading. Please wait.

Presentation is loading. Please wait.

Repositories, Workspaces Workshop organized by MPI PL, RZG, SARA, FZJ Date: 20. - 21. September 2010 9:00 ~25 participants from Finland, France, Germany,

Similar presentations


Presentation on theme: "Repositories, Workspaces Workshop organized by MPI PL, RZG, SARA, FZJ Date: 20. - 21. September 2010 9:00 ~25 participants from Finland, France, Germany,"— Presentation transcript:

1 Repositories, Workspaces Workshop organized by MPI PL, RZG, SARA, FZJ Date: September :00 ~25 participants from Finland, France, Germany, Italy, Netherlands, US

2 1.RZG 2.practical information 3.workshop agenda/intention Welcome!

3 Foto: Artur Gerngross, Fa. FOTAG LRZ IPP MPQ MPE MPA RZG Science Campus Garching near Munich Repositories/Workspaces Workshop, Johannes Reetz 3

4 IPP is one of the largest fusion research centers worldwide, an associate of the European Fusion Program and the ITER organization MPI for Plasma Physics (IPP) W7-X Stellerator experiment ASDEX Upgrade Tokamak experiment ITER Tokamak experiment Fusion Research at the

5 5 RZG computer hall Repositories/Workspaces Workshop, Johannes Reetz 5

6 1969:IBM360/911979: Cray /1998:Cray T3E/ :IBM /2003 IBM p690/ NEC SX-5/3C seit May 2008 IBM p575 Power6 seit Sep 2007 IBM BG/P Supercomputing at RZG since 1962 and HPC application support Repositories/Workspaces Workshop, Johannes Reetz 6

7 Cluster-Hosting more than 20 Linux-Cluster from 15 Max Planck Institutes Repositories/Workspaces Workshop, Johannes Reetz 7 FHI Berlin 36TF (SUN) (Prof. Scheffler) 384 Knoten á 8 Cores (3072 cores), 4 Racks MPI für Physik Komplexer Systeme, Dresden 18 TF (SUN) (Prof. Moessner) ca 192 Knoten, 2 Racks (1536 cores) MPI für Astrophysik 18 TF (Prof. Asplund) ca 192 Knoten, 2 Racks (1300 cores) MPI für Astronomie Heidelberg18 TF circa 192 Knoten, 2 Racks (1008 cores) MPI für Biochemie 18 TF (HP) circa 192 Knoten, 2 Racks MPI für Chemie Mainz 4.5 TF (IBM) (Prof. Lelieveld) ca 48 Knoten, 0.5 Racks MPI für Anthropologie Leipzig und MPI für Züchtungsforschung Köln (Prof. Paboo, Prof. Schulze-Lefert) grosses shared-memory System IPP Garching 16 TF 2 cluster, 1600 cores MPQ 336 cores weitere Systeme für: MPE,CPFS,EVA, Biochemie

8 Repositories/Workspaces Workshop, Johannes Reetz 8 experiment and observational data simulations data backup data archive data 1389 TB (18%) 484 TB (6%) 2205 TB (29%) 890 TB (11%) 2518 TB (33%) 2nd copy Total 7486 TB (100%) Stand RZG tape robot Sept Capacity 14 – 40 PB (LTO3,4,5) RZG data services: Backup/Archive, long-term archive present data in the TSM/HSM storage system

9 RZG data services: long-term archive data security, availability, reliability Mirroring archive data mutually between RZG and LRZ Repositories/Workspaces Workshop, Johannes Reetz 9 experiment data Tape Archive RZG Tape Archive LRZ AFS (+ OSD) GPFS 1 + TSM-HSM HPC Simulations data Backup/Archive Data TSM Backup/Archive Servers GPFS 2 + TSM-HSM

10 Repositories/Workspaces Workshop, Johannes Reetz 10 Status : 7.5 PB RZG data services: growth of data in the long-term archive

11 Repositories/Workspaces Workshop, Johannes Reetz 11 → Computer Centre of the Max Planck Society and IPP → High Performance Computing → HPC application support and visualisation → Compute-Cluster Hosting for Max Planck Institutes and Projekts → Experiment data aquisition → European und national Projects (DEISA, ELPA, ISAR, Atlas/Tier2, …..) → Data services: file systems, storage systems, backup/archiving, long-term archiving (50yr lifetime warranty for Max Planck Institutes) RZG profile

12 Repositories/Workspaces Workshop, Johannes Reetz Repositories and ReplicationTitle 9.00Johannes Reetz (RZG)Welcome and Intention 9.15Peter Wittenburg (MPI)Architecture Issues and Overview 9.45Larry Lannom (CNRI)Abstract CNRI Model 10.45Coffee break 11.15Alex Wade (MS)Business Approaches 12.15Malte Dreyer (MPDL)Generic API Principles 13.00Lunch BreakIPP Cantina 14.00John Kennedy (RZG)Data Repositories within DEISA 14.30Kenneth Galluppi (NOAA)Federating climate, water and weather data repositories 15.30Willem Elbers (MPI)Replix project – motivation, goals, results 16.00Coffee break 16.15Jean-Yves Nief (IN2P3)Generic policy rules and principles 17.15Daan Broeder (MPI)API Data Grids-Repositories 18.00End 19:30Joint Dinner Pizzaria “La Pergola” Münchner Str. 4, at U6 station „Garching Zentrum“ Workspaces and Web Services 9.00Peter WittenburgWrap up and Discussion of previous day 10.00Maurice Bouwhuis, Marc vd Sanden, Daan Broeder (SARA, MPI) Workspaces in CLARIN NL 10.30Morris Riedel (FZJ)Workspaces – Concept and functional aspects 11.00Coffee break 11.30Johannes Reetz, John Kennedy (RZG)Workspaces – requirements and operational aspects 12.00Thomas Zastrow, Erhard Hinrichs (U Tübingen) WebLicht Application and Workspace Requirements 12.45Lunch Break 13.45Mike Papazoglou (U Tilburg)Generic Workflow Frameworks for WebServices 14.45Peter WittenburgWrap up and Discussion 16.00End

13 13 Practical Information 1.WLAN available either via eduroam or free access (ssid: “D2 GAST”). 2.Please write your name, institution ( address) on the list of participants. 3.Transport from IPP to the Munich airport: please write your name and departure time on the transport request form. We will try to arrange a transportation with IPP transportation service. 4.We will have lunch at the cantina of the Max-Planck-Institut for Plasmaphysics, just 150m distance from the seminar room. Lunch to be paid directly. 5.Evening dinner takes place on Monday 7:30pm at the Pizzeria “La Pergola”, Münchner Str. 4 in Garching (http://www.lapergola-garching.de). You find the menu (in german only) under garching.de/pespeise.htmhttp://www.lapergola- garching.de/pespeise.htm Repositories/Workspaces Workshop, Johannes Reetz 13

14 Repositories/Workspaces Workshop, Johannes Reetz Repositories and ReplicationTitle 9.00Johannes Reetz (RZG)Welcome and Intention 9.15Peter Wittenburg (MPI)Architecture Issues and Overview 9.45Larry Lannom (CNRI)Abstract CNRI Model 10.45Coffee break 11.15Alex Wade (MS)Business Approaches 12.15Malte Dreyer (MPDL)Generic API Principles 13.00Lunch BreakIPP Cantina 14.00John Kennedy (RZG)Data Repositories within DEISA 14.30Kenneth Galluppi (NOAA)Federating climate, water and weather data repositories 15.30Willem Elbers (MPI)Replix project – motivation, goals, results 16.00Coffee break 16.15Jean-Yves Nief (IN2P3)Generic policy rules and principles 17.15Daan Broeder (MPI)API Data Grids-Repositories 18.00End 19:30Joint Dinner Pizzaria “La Pergola” Münchner Str. 4, at U6 station „Garching Zentrum“ Workspaces and Web Services 9.00Peter WittenburgWrap up and Discussion of previous day 10.00Maurice Bouwhuis, Marc vd Sanden, Daan Broeder (SARA, MPI) Workspaces in CLARIN NL 10.30Morris Riedel (FZJ)Workspaces – Concept and functional aspects 11.00Coffee break 11.30Johannes Reetz, John Kennedy (RZG)Workspaces – requirements and operational aspects 12.00Thomas Zastrow, Erhard Hinrichs (U Tübingen) WebLicht Application and Workspace Requirements 12.45Lunch Break 13.45Mike Papazoglou (U Tilburg)Generic Workflow Frameworks for WebServices 14.45Peter WittenburgWrap up and Discussion 16.00End

15 15 Intention of the Workshop Repositories/Workspaces Workshop, Johannes Reetz 15 •How diverse is the landscape of repository systems and are there mature architectural solutions emerging? •how can the repositories from diverse landscapes be federated and are there suitable layers and APIs available? •how can safe replication be done in such diverse landscapes? •is it a useful approach to control activities in federated repositories by declarative policy rules and if so what are typical policies? •what do we need user workspaces for and what characteristics to they have in a distributed environment? •what are the requirements with respect to workspaces from the perspective of distributed processing chains driven by community applications? •are there generic frameworks for the execution of distributed processing chains and the deployment of web services?


Download ppt "Repositories, Workspaces Workshop organized by MPI PL, RZG, SARA, FZJ Date: 20. - 21. September 2010 9:00 ~25 participants from Finland, France, Germany,"

Similar presentations


Ads by Google