Presentation is loading. Please wait.

Presentation is loading. Please wait.

Die Kooperation von Forschungszentrum Karlsruhe GmbH und Universität Karlsruhe (TH) D-Grid Marcel Kunze Steinbuch Centre for Computing (SCC)

Similar presentations


Presentation on theme: "Die Kooperation von Forschungszentrum Karlsruhe GmbH und Universität Karlsruhe (TH) D-Grid Marcel Kunze Steinbuch Centre for Computing (SCC)"— Presentation transcript:

1 Die Kooperation von Forschungszentrum Karlsruhe GmbH und Universität Karlsruhe (TH) D-Grid Marcel Kunze Steinbuch Centre for Computing (SCC)

2 KIT - Die Kooperation von Forschungszentrum Karlsruhe GmbH und Universität Karlsruhe (TH) 2 | M.Kunze | NORDUnet2008 | The Three Waves of D-Grid The Research Wave The Industry Wave The Consumer Wave Technology, Prototypes Grid-Enabled Products Commodity Virtual Organizations Enterprise Solutions IT Utility, Web2.0 Standards Interoperability Integration OGF, IETF, OASIS OGF, IETF, OASIS Legal, Ethical, Political Orgs Finally, Grids will disappear

3 KIT - Die Kooperation von Forschungszentrum Karlsruhe GmbH und Universität Karlsruhe (TH) 3 | M.Kunze | NORDUnet2008 | Building a national e-Infrastructure for research and industry 01/2003: Pre-D-Grid Working Groups Recommendation to Government 09/2005: D-Grid-1: early adopters, Research Grids 07/2007: D-Grid-2: new communities, Service Grids 04/2008: D-Grid-3: Service Grids for research and industry D-Grid-1: 25 MEuro > 100 Orgs > 200 researchers D-Grid-2: 35 MEuro > 100 addl Orgs > 200 addl researchers and industry D-Grid-3: Call expected in the comíng weeks (~20 MEuro) D-Grid in a Nutshell

4 KIT - Die Kooperation von Forschungszentrum Karlsruhe GmbH und Universität Karlsruhe (TH) 4 | M.Kunze | NORDUnet2008 | D-Grid-1 Generic Grid Middleware and Grid Services Integration Project Astro-Grid C3-Grid HEP-Grid IN-Grid MediGrid ONTOVERSE WIKINGER WISENT Textgrid Im Wissensnetz User-friendly Access Layer, Portals

5 KIT - Die Kooperation von Forschungszentrum Karlsruhe GmbH und Universität Karlsruhe (TH) 5 | M.Kunze | NORDUnet2008 | D-Grid-1, -2, -3 Generic Grid Middleware and Grid Services Integration Project Astro-Grid C3-Grid HEP-Grid IN-Grid MediGrid ONTOVERSE WIKINGER WISENT Textgrid Im Wissensnetz Knowledge Management Business Services, SLAs, SOA Integration, Virtualization User-friendly Access Layer, Portals

6 KIT - Die Kooperation von Forschungszentrum Karlsruhe GmbH und Universität Karlsruhe (TH) 6 | M.Kunze | NORDUnet2008 | D-Grid in 2010 Generic Grid Middleware and Grid Services Astro-Grid C3-Grid HEP-Grid IN-Grid MediGrid ONTOVERSE WIKINGER WISENT Textgrid Im Wissensnetz Services Level Agreements Virtual Competence Centers for Resources, Middleware,Support, Training, Knowledge User-friendly Access Layer, Portals Business Services, SLAs, SOA Integration, Virtualization

7 KIT - Die Kooperation von Forschungszentrum Karlsruhe GmbH und Universität Karlsruhe (TH) 7 | M.Kunze | NORDUnet2008 | Nutzer Application Development and User Access GAT API Data/ Software Resources in D-Grid High-level Grid Services Basic Grid Services Distributed Data Archive User Network Infrastructur LCG/gLite Globus Accounting Billing User/VO-Mngt Scheduling Workflow Management Data management Security Plug-In UNICORE Distributed Compute Resources GridSphere Monitoring D-Grid Middleware

8 KIT - Die Kooperation von Forschungszentrum Karlsruhe GmbH und Universität Karlsruhe (TH) 8 | M.Kunze | NORDUnet2008 | Current D-Grid Infrastructure (~ Cores, 5 PB Storage) Universität Marburg Universität Wuppertal Universität Siegen FZK Karlsruhe Fraunhofer SCAI DKRZ Hamburg FZJ Jülich Zuse-Institut Berlin Universität Dortmund RRZN Hannover LRZ München HLRS Stuttgart Universität Köln DESY Hamburg Universität Freiburg ZIH Dresden Universität Leipzig GWDG Göttingen ARI Heidelberg

9 KIT - Die Kooperation von Forschungszentrum Karlsruhe GmbH und Universität Karlsruhe (TH) 9 | M.Kunze | NORDUnet2008 | HEP-Grid: p-p collisions at LHC at CERN Crossing rate 40 MHz Event Rates: ~10 9 Hz Max LV1 Trigger 100 kHz Event size ~1 Mbyte Readout network 1 Terabit/s Filter Farm ~10 7 Si2K Trigger levels 2 Online rejection % (100 Hz from 50 MHz) System dead time ~ % Event Selection: ~1/10 13 Crossing rate 40 MHz Event Rates: ~10 9 Hz Max LV1 Trigger 100 kHz Event size ~1 Mbyte Readout network 1 Terabit/s Filter Farm ~10 7 Si2K Trigger levels 2 Online rejection % (100 Hz from 50 MHz) System dead time ~ % Event Selection: ~1/10 13 Event rate Discovery rate Luminosity Low 2x10 33 cm -2 s -1 High cm -2 s -1 Data analysis: ~1PB/year Level 1 Trigger Rate to tape

10 KIT - Die Kooperation von Forschungszentrum Karlsruhe GmbH und Universität Karlsruhe (TH) 10 | M.Kunze | NORDUnet2008 | AstroGrid

11 KIT - Die Kooperation von Forschungszentrum Karlsruhe GmbH und Universität Karlsruhe (TH) 11 | M.Kunze | NORDUnet2008 | Climate research moves towards new levels of complexity: Stepping from Climate (=Atmosphere+Ocean) to Earth System Modelling Earth system model wishlist: Higher spatial and temporal resolution Quality: Improved subsystem models Atmospheric chemistry (ozone, sulfates,..) Bio-geochemistry (Carbon cycle, ecosystem dynamics,..) Increased Computational demand factor: O( ) C3 Grid: Collaborative Climate Community Data and Processing Grid

12 KIT - Die Kooperation von Forschungszentrum Karlsruhe GmbH und Universität Karlsruhe (TH) 12 | M.Kunze | NORDUnet2008 | Gridspezifische Entwicklungen Integration project Cooperation and business models InGrid: Virtual Prototyping & Modeling in Industry MoldingMetal Forming Fluid Processes Groundwater Transportation Knowledge-based support for engineering-specific decision support Support for engineering- specific Workflows Distributed simulations-based product & process optimization Methods and models for solving engineering problems in Grids Fluid-Structur/ Magneto-Hydro- dynamic Interaction Security and trust models Grid-specific developments AP 2 AP 3AP 4

13 KIT - Die Kooperation von Forschungszentrum Karlsruhe GmbH und Universität Karlsruhe (TH) 13 | M.Kunze | NORDUnet2008 | Raw Data Metadata Molecule Homogenization Target data Metadata Population Metadata Patient Metadata Illness Metadata Organ/Tissue Metadata Cell Search, Find, Select Access Control Correlate, Process, Analyze Resulting Data Presentation Final Result MediGrid: Mapping of Characteristics, Features, Raw Data, etc

14 KIT - Die Kooperation von Forschungszentrum Karlsruhe GmbH und Universität Karlsruhe (TH) 14 | M.Kunze | NORDUnet2008 | TextGrid Modular Platform for distributed cooperative scientific text processing for the humanities Workbench for Publishing, Text Processing, Text Retrieval, Linking, and Workflow Focus of TextGrid is on: - Quantity: Full text instead excerpts, text and pictures - Speed of reprography: stability of text, volatility of medium - Precision: Maximum requirements on correctness - Availability: international open standards

15 Seite 15 WISENT, Knowledge Network for Energy Meteorology Charakterisation of energy fluctuation from solar and wind energy Results through interdisciplinary collaboration (Meteorology) Transformation of wind and solar energy (physics) Flexible distributed systems (computer science)

16 KIT - Die Kooperation von Forschungszentrum Karlsruhe GmbH und Universität Karlsruhe (TH) 16 | M.Kunze | NORDUnet2008 | D-Grid-2, Start June 2007 Horizontal Service Grids: professional Service Providers for heterogeneous user groups in research and industry Vertical Community Service Grids using existing D-Grid infrastructure and services, supported by Service Providers D-Grid extensions, based on a D-Grid 1 gap analysis - Tools for operating a professional grid service - Adding business layer on top of D-Grid infrastructure - Pilot service phase with service providers and customers

17 KIT - Die Kooperation von Forschungszentrum Karlsruhe GmbH und Universität Karlsruhe (TH) 17 | M.Kunze | NORDUnet2008 | D-Grid-2 Projects BauVOGrid: Grid-based platform for VOs in the Construction industry FinGrid: Financial Business Grid: A service grid architecture for the financial service industry AeroGrid: Grid-based collaboration among Aerospace research & industry ProGrid: Automotive: Cooperative product design and development in simulation and production data management BIS-Grid: Grid-based Enterprise Information Systems, integration & orchestration in commercial IT systems Biz2Grid: Enterprise Grids; Acct, Pricing, Billing, Metaschedlg; ERP/SAP PartnerGrid: Cooperation in industrial VOs (SME, supplier, svc providers) GDI-Grid: Geographical Data infrastructure for providing and processing data and simulation for catastrophes, noise, and navigation F&L-Grid: Grid-based IT services for research and education D-MON: Horizontal integration of resource and service Monitoring SUGI: Grid support for small institutions and SMEs

18 BauVOGrid Grid-based platform for virtual organisations in the construction industry

19 Seite 19 BIS-Grid Overview Utilisation of Grid technologies to integrate decentralised business information systems

20 Seite 20 BIS-Grid Outcome Horizontal Service Grid New collaboration and business models for Grid Providing and utilisation Especially aiming on SMEs Utilisation of WS-BPEL to orchestrate stateful WSRF-conform Grid Services Development of a Grid Service-enabled WS-BPEL engine Integrated with UNICORE 6 Evaluation of results in partner-specific application scenarios

21 Seite 21 BIS-Grid Application Scenario Enterprise Application Integration using Grid technologies Different sites Extensive amounts of data and legacy data Interrelations of data from different sources/databases

22 22 Financial Business Grid

23 FinGrid23 Research Approaches & Research Objectives 23 Design Science System Engineering Approach Case Studies Development of 3 Grid-Prototypes Prototype 3 Asset-backed Securities Factory Prototype 2 Customer Portfolio Performance Measurement Prototype 1 Grid Ressource Pricing Tool Field Studies Development of a Grid-Economy Reports Workshops Publications FinGrid Standard Project Presentation Release: Requirement profile of Business Grid-Applications Specification of service-oriented Grid-Implementation approaches Development and implementation of diverse pricing models for efficient resource allocation in Grid- Environments Requirement profile of Business Grid-Applications Research of market acceptance and willingness for diffusion

24 Spatial Data Infrastructure Grid GDI-Grid 24 Geo-Data Infrastructure Grid Enhancement of existing GDI applications with Grid technologies: –meet enormous need for processing power –allow access to distributed data sources and huge data storage –combine current base technologies of spatial data infrastructures (SDI) with Grid middleware (GT4) –enable seamless processing of spatial data in Grid infrastructures Development of generic services for the –integration –fusion –management and –processing of spatial data on the D-Grid infrastructure Survey of user requirements, feasibility and marketable potential

25 Spatial Data Infrastructure Grid GDI-Grid 25 Scenarios and Proof of Concept Three selected scenarios for the evaluation of the implemented GDI-Grid components: –spatial simulation of flood disasters - flood hazard

26 Spatial Data Infrastructure Grid GDI-Grid 26 Scenarios and Proof of Concept Three selected scenarios for the evaluation of the implemented GDI-Grid components: –spatial simulation of flood disasters - flood hazard –noise dispersion simulation for noise pollution predictions

27 Spatial Data Infrastructure Grid GDI-Grid 27 Scenarios and Proof of Concept Three selected scenarios for the evaluation of the implemented GDI-Grid components: –spatial simulation of flood disasters - flood hazard –noise dispersion simulation for noise pollution predictions –route optimization for disaster management

28 28 PartnerGrid: Project Goal Development of Grid platform that supports the collaboration within a virtual organisation : –Definition and execution of complex and distributed process flows –User interface for access and use of the Grid via portal technology –Transparent access to distributed data (file systems, data bases) –Management of distributed, virtual organisations and integrated security concepts –Interfaces for integration of complex, application specific analysis modules –Interface to service providers for the execution of compute intensive application –User-transparent use of D-Grid services –Secure and liable procurement of resources to the users considering resource provider and resource user –Resource usage is charged by an accounting and billing function.

29 PartnerGrid Architecture

30 30 PartnerGrid: Application scenarios Scenario: Simulation of a founding process –Use case optimisation Usage of Grid-resources with parallelism in two dimensions Connection of the optimisation-workflows to the grid computing –Use case enterprise scenario Deployment of Grid computing in a big enterprise –Use case outsourcing MAGMASOFT-Users can use external hardware-, software- and license resources, that are provided by a independent service provider (MAGMA GmbH) Scenario: Forming process technique –Use case project processing between customer, supplier and service provider more efficient project work, reduction of the project management cost –Use case provision of compute resources and support better utilisation of hard- & software-resources, consulting service, extension of the service range

31 KIT - Die Kooperation von Forschungszentrum Karlsruhe GmbH und Universität Karlsruhe (TH) 31 | M.Kunze | NORDUnet2008 | Building a national e-Infrastructure for research and industry An attractive infrastructure has been set up Increasing number of projects and Grid users Impact of new developments like Cloud Computing? Important: Operate a sustainable production grid infrastructure after the end of the funding Integration of new communities Evaluating business models (operational models) for grid services D-Grid Summary

32 KIT - Die Kooperation von Forschungszentrum Karlsruhe GmbH und Universität Karlsruhe (TH) 32 | M.Kunze | NORDUnet2008 | Acknowledgments Slides and information have been provided by Wolfgang Gentzsch D-Grid Projects

33 KIT - Die Kooperation von Forschungszentrum Karlsruhe GmbH und Universität Karlsruhe (TH) 33 | M.Kunze | NORDUnet2008 |


Download ppt "Die Kooperation von Forschungszentrum Karlsruhe GmbH und Universität Karlsruhe (TH) D-Grid Marcel Kunze Steinbuch Centre for Computing (SCC)"

Similar presentations


Ads by Google