D-MON TeamCGW 08 Adopting GLUE 2.0 for Interoperation of Grid Monitoring Systems Timo Baur, Rebecca Breu, Tobias Lindinger, Anne Milbert, Gevorg Pogoshyan,

Slides:



Advertisements
Similar presentations
1 Ontolog Open Ontology Repository Review 19 February 2009.
Advertisements

Futures – Alpha Cloud Deployment and Application Management.
Connect. Communicate. Collaborate Click to edit Master title style MODULE 1: perfSONAR TECHNICAL OVERVIEW.
Institute for Software Science – University of ViennaP.Brezany 1 Databases and the Grid Peter Brezany Institute für Scientific Computing University of.
CoreGRID Workpackage 5 Virtual Institute on Grid Information and Monitoring Services Authorizing Grid Resource Access and Consumption Erik Elmroth, Michał.
Information Integration. Modes of Information Integration Applications involved more than one database source Three different modes –Federated Databases.
Chapter 6 Database Design
Interpret Application Specifications
Institute for Scientific Computing – University of ViennaP.Brezany 1 Databases and the Grid Peter Brezany Institute für Scientific Computing University.
6 Chapter 6 Database Design Hachim Haddouti. 6 2 Hachim Haddouti and Rob & Coronel, Ch6 In this chapter, you will learn: That successful database design.
Web-based Portal for Discovery, Retrieval and Visualization of Earth Science Datasets in Grid Environment Zhenping (Jane) Liu.
SecureAware Building an Information Security Management System.
Database System Concepts and Architecture Lecture # 3 22 June 2012 National University of Computer and Emerging Sciences.
Module 12: Designing an AD LDS Implementation. AD LDS Usage AD LDS is most commonly used as a solution to the following requirements: Providing an LDAP-based.
1 The NSDL: A Case Study in Interoperability William Y. Arms Cornell University.
Christopher Chapman | MCT Content PM, Microsoft Learning, PDG Planning, Microsoft.
Agent-based Device Management in RFID Middleware Author : Zehao Liu, Fagui Liu, Kai Lin Reporter :郭瓊雯.
Peer-to-Peer Data Integration Using Distributed Bridges Neal Arthorne B. Eng. Computer Systems (2002) Supervisor: Babak Esfandiari April 12, 2005 Candidate.
Week 4 Lecture Part 3 of 3 Database Design Samuel ConnSamuel Conn, Faculty Suggestions for using the Lecture Slides.
Provisioning/Deployment CDDLM-WG (Configuration Description, Deployment and Lifecycle Management) December 4, 2003 Takashi Kojo, NEC.
Interoperability in Information Schemas Ruben Mendes Orientador: Prof. José Borbinha MEIC-Tagus Instituto Superior Técnico.
OSG Middleware Roadmap Rob Gardner University of Chicago OSG / EGEE Operations Workshop CERN June 19-20, 2006.
Using the Open Metadata Registry (openMDR) to create Data Sharing Interfaces October 14 th, 2010 David Ervin & Rakesh Dhaval, Center for IT Innovations.
Mark L. Green, Ph.D. Grid Computational Scientist Monitoring and Information Services Architecture and Deployment University at Buffalo The State University.
INFSO-RI Enabling Grids for E-sciencE Logging and Bookkeeping and Job Provenance Services Ludek Matyska (CESNET) on behalf of the.
A Novel Approach to Workflow Management in Grid Environments Frank Berretz*, Sascha Skorupa*, Volker Sander*, Adam Belloum** 15/04/2010 * FH Aachen - University.
RELATIONAL FAULT TOLERANT INTERFACE TO HETEROGENEOUS DISTRIBUTED DATABASES Prof. Osama Abulnaja Afraa Khalifah
EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Felix Ehm CERN IT-GD EGEE 2008 GLUE 2.0.
OGSA-DAI in OMII-Europe Neil Chue Hong EPCC, University of Edinburgh.
International Directory Network (IDN) Scalability, Security and Interoperability WGISS, 2006 Tom Northcutt Systems Administrator: GCMD September 13, 2006.
1 1 EPCC 2 Curtin Business School & Edinburgh University Management School Michael J. Jackson 1 Ashley D. Lloyd 2 Terence M. Sloan 1 Enabling Access to.
1 CS 502: Computing Methods for Digital Libraries Lecture 19 Interoperability Z39.50.
Grid User Management System Gabriele Carcassi HEPIX October 2004.
By Umair Ali. Dec 2004Version 1 -PKI - a security architecture – over the internet. -Provides an increased level of confidence for exchanging information.
INFSO-RI Enabling Grids for E-sciencE OGSA DAI Data Access and Integration Marek Ciglan Institute of Informatics, Slovac Academy.
Clinical Collaboration Platform Overview ST Electronics (Training & Simulation Systems) 8 September 2009 Research Enablers  Consulting  Open Standards.
Oleg LODYGENSKY Etienne URBAH LAL, Univ Paris-Sud, IN2P3/CNRS, Orsay,
Ruth Pordes November 2004TeraGrid GIG Site Review1 TeraGrid and Open Science Grid Ruth Pordes, Fermilab representing the Open Science.
Information Integration BIRN supports integration across complex data sources – Can process wide variety of structured & semi-structured sources (DBMS,
Conference name Company name INFSOM-RI Speaker name The ETICS Job management architecture EGEE ‘08 Istanbul, September 25 th 2008 Valerio Venturi.
Edré Moreira Wilton Caldas Osvaldo Carvalho Federal University of Minas Gerais, Brazil CAFe Federation Advanced CAMP Philadelphia, June 2009.
E-infrastructure shared between Europe and Latin America FP6−2004−Infrastructures−6-SSA gLite Information System Pedro Rausch IF.
Issues in Ontology-based Information integration By Zhan Cui, Dean Jones and Paul O’Brien.
WLCG-RUS An Extensible Solution to Grid Accounting & Usage Monitoring EGEE 3 rd User Forum X. Chen, A. Khan Brunel University.
A Resource Discovery Service for the Library of Texas Requirements, Architecture, and Interoperability Testing William E. Moen, Ph.D. Principal Investigator.
EGI-InSPIRE RI EGI-InSPIRE EGI-InSPIRE RI How to integrate portals with the EGI monitoring system Dusan Vudragovic.
EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks APEL CPU Accounting in the EGEE/WLCG infrastructure.
Semantic Data Extraction for B2B Integration Syntactic-to-Semantic Middleware Bruno Silva 1, Jorge Cardoso 2 1 2
Copyright 2007, Information Builders. Slide 1 iWay Web Services and WebFOCUS Consumption Michael Florkowski Information Builders.
Distributed Archives Interoperability Cynthia Y. Cheung NASA Goddard Space Flight Center IAU 2000 Commission 5 Manchester, UK August 12, 2000.
The AstroGrid-D Information Service Stellaris A central grid component to store, manage and transform metadata - and connect to the VO!
Monitoring and Information Services Core Infrastructure (MIS-CI) Service Description Mark L. Green OSG Integration Workshop at UC Feb 15-17, 2005.
Grid Deployment Technical Working Groups: Middleware selection AAA,security Resource scheduling Operations User Support GDB Grid Deployment Resource planning,
EGI-InSPIRE RI EGI-InSPIRE EGI-InSPIRE RI EGI Services for Distributed e-Infrastructure Access Tiziana Ferrari on behalf.
The EPIKH Project (Exchange Programme to advance e-Infrastructure Know-How) gLite Grid Introduction Salma Saber Electronic.
Slide 1 © 2016, Lera Technologies. All Rights Reserved. Oracle Data Integrator By Lera Technologies.
The Operations Portal and the Grid Operations Interoperability
Regional Operations Centres Core infrastructure Centres
Towards GLUE Schema 2.0 Sergio Andreozzi INFN-CNAF Bologna, Italy
Middleware independent Information Service
Similarities between Grid-enabled Medical and Engineering Applications
Chapter 6 Database Design
1/18/2019 Transforming the Way the DoD Manages Data Implementing the Net Centric Data Strategy using Communities of Interest Introduction
2/15/2019 Transforming the Way the DoD Manages Data Implementing the Net Centric Data Strategy using Communities of Interest Introduction
Introduction of Week 11 Return assignment 9-1 Collect assignment 10-1
Sergio Andreozzi (speaker) Laurence Field Balazs Konya
a middleware implementation
Presentation transcript:

D-MON TeamCGW 08 Adopting GLUE 2.0 for Interoperation of Grid Monitoring Systems Timo Baur, Rebecca Breu, Tobias Lindinger, Anne Milbert, Gevorg Pogoshyan, Mathilde Romberg

CGW 08 Outline Interoperability Grid Monitoring Scenario Integration Proxy Approach GLUE 2.0 for Schema Mediation Architecture Implementation Experiences Examples Lessons learned

CGW 08 Interoperability middleware architectures enable interoperable manageability of a Grid’s services for all vital components which need a cross-provider functionality usually one -and only one- middleware or management architecture Architecture constitutes finite technical border for component interaction components of multiple Grid projects do not interoperate on a technical level diverse spectrum of implementations multiple middlewares middleware-agnostic components caused by concurrent co-implementation of resources, services and components by multiple autonomous organizations differing understanding of Grid paradigm differing tastes, targets and realisation requirements differing standards, implementations, versions

CGW 08 Grid Monitoring Scenario to enable comprehensive operations and management –Fault, Configuration, Accounting, Performance, Security –Grid Operation Centre, User Support, Scheduling D-Grid would require Grid-wide monitoring repositories on top of a broad spectrum of non-interoperable and heterogeneous monitoring services How can we realize this without regularly refactoring all components ?

CGW 08 Integration Proxy Approach Low intrusive adaptor modules –Process: Extract: connect to interfaces (XML) Transform: translate information models (XSLT) Load: upload data to repository (SQL) proxy repository –store data –possibility to federate database standardized data provisioning –for users (Webinterface) and services –possibility to feed integrated data back into source systems –support VO-specific views on data

CGW 08 Adopting GLUE 2.0 for Schema Mediation GLUE 2.0 –adequate information model for mediation of Grid resource and service monitoring data –describes a Grid‘s main characteristics: VO modelling (UserDomains) mapping and access policies –allocation of resources and services to VOs resource and service scenarios resource provider modeling (AdminDomains) –extendable –standardization (OGF draft) Schema A Schema B

CGW 08 Architecture

CGW 08 Experiences data transformation, e.g. GLUE > GLUE 2.0 –not everything is mappable –differences in syntax and semantics –possible loss of information gathered and transformed most important data without loss of accuracy, e.g. –ComputingResources –ComputingServices –StorageResources our prototype provides VO specific views on the data –mappings of resources into VOs retrieved rom GRRS (Grid Resource Repository Service) –which acts as policy information base for VO resource management –accordingly generates AccessPolicies and database views

CGW 08 Examples ComputingService (DB) VO-specific View (OGSA-DAI)

CGW 08 Interpreting the Data unique Grid-wide IDs vital for statistics, efficient searches and scheduling organizational issue similar to AS, and IP adresses in the Internet common and large-scale Grid infrastructure requires common naming standards or policies clear policy decision points: „assigned numbers and names authority“ intgrated data allows for structural improvements of the monitored multi-Grid configurations e.g. Site-IDs may not be unique in all Grids

CGW 08 Lessons learned GLUE 2.0 fits well for resource and service monitoring in Grids monitoring gateways can be used to interoperably cache and exchange resource and service monitoring data views can be generated for different VOs.... thank you for your attention