Grid Application Builders Teach In31/01/02Antony Wilson Information & Monitoring Services WP3.

Slides:

Advertisements

Similar presentations

21 Sep 2005LCG's R-GMA Applications R-GMA and LCG Steve Fisher & Antony Wilson.

Advertisements

GridPP July 2003Stefan StonjekSlide 1 SAM middleware components Stefan Stonjek University of Oxford 7 th GridPP Meeting 02 nd July 2003 Oxford.

S.L.LloydGrid Steering Committee 8 March 2002 Slide 1 Status of GridPP Overview Financial Summary Recruitment Status EU DataGrid UK Grid Status GridPP.

EU DataGrid TestBed 2 Component Review Paul Millar (University of Glasgow) (slides based on a presentation by Erwin Laure)

GridPP Meeting, Cambridge, 14 Feb 2002 Paul Mealor, UCL Networking Paul Mealor.

WP3 WP3 17/9/2002 Steve Fisher / RAL. WP3 Steve Fisher 17/9/2002WP32 Summary Quality Current status 1.2 R-GMA in release 2.0 Recent Requirements Work.

EGEE is a project funded by the European Union under contract IST R-GMA: Status and Plans Antony Wilson / RAL GridPP 12 - Brunel

R-GMA Producers and Archiver Paul Mealor. edg-pinger-timeping edg-netmon-rgma-info Producer API edg-gridftplog2rgma Producer API Log Here be servlets.

Abstraction Layers Why do we need them? –Protection against change Where in the hourglass do we put them? –Computer Scientist perspective Expose low-level.

Andrew McNab - Manchester HEP - 22 April 2002 EU DataGrid Testbed EU DataGrid Software releases Testbed 1 Job Lifecycle Authorisation at your site More.

22-Apr-02D.P.Kelsey, Security, UKHEP Sysman1 Grid Security 22 Apr 2002 UK HEP Sysman Meeting David Kelsey CLRC/RAL, UK

Bob Jones – Project Architecture - 1 March n° 1 Information & Monitoring Services Antony Wilson WP3, RAL

Steve Fisher/RAL - 12/6/2002R-GMA and WP71 R-GMA Use the GMA from GGF A relational implementation Applied to both information and monitoring Creates impression.

Andrew McNab - Manchester HEP - 2 May 2002 Testbed and Authorisation EU DataGrid Testbed 1 Job Lifecycle Software releases Authorisation at your site Grid/Web.

A Prototype Implementation of a Framework for Organising Virtual Exhibitions over the Web Ali Elbekai, Nick Rossiter School of Computing, Engineering and.

FP7-INFRA Enabling Grids for E-sciencE EGEE Induction Grid training for users, Institute of Physics Belgrade, Serbia Sep. 19, 2008.

CrossGrid WP3 Task 3.3 Grid Monitoring Trinity College Dublin (TCD, AC14 - CR11) Brian Coghlan, Stuart Kenny CYFRONET Academic Computer Centre, Krakow.

CrossGrid Task 3.3 Grid Monitoring Trinity College Dublin (TCD) Brian Coghlan Paris MAR-2002.

Canonical Producer CP API User Code CP Servlet Files CreateTable, Port, Protocol, Security, SQL Support, Multiple Query Support Security Insert Query Port.

Grid Computing, B. Wilkinson, 20046c.1 Globus III - Information Services.

EGEE-II INFSO-RI Enabling Grids for E-sciencE Introduction to R-GMA: Relational Grid Monitoring Architecture.

The EU DataGrid – Information and Monitoring Services The European DataGrid Project Team

WP3 RGMA Deployment Laurence Field / RAL Steve Fisher / RAL.

Computer and Automation Research Institute Hungarian Academy of Sciences Presentation and Analysis of Grid Performance Data Norbert Podhorszki and Peter.

FP6−2004−Infrastructures−6-SSA E-infrastructure shared between Europe and Latin America Information System (IS) Valeria Ardizzone.

Mark L. Green, Ph.D. Grid Computational Scientist Monitoring and Information Services Architecture and Deployment University at Buffalo The State University.

SZTAKI in DataGrid 2003 What to do this year. Topics ● Application monitoring (GRM) ● Analysis and Presentation (Pulse) ● Performance of R-GMA.

QCDGrid Progress James Perry, Andrew Jackson, Stephen Booth, Lorna Smith EPCC, The University Of Edinburgh.

GRID IIII D UK Particle Physics GridPP Collaboration meeting - R.P.Middleton (RAL/PPD) 23-25th May Grid Monitoring Services Robin Middleton RAL/PPD24-May-01.

EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Information System on gLite middleware Vincent.

Application code Registry 1 Alignment of R-GMA with developments in the Open Grid Services Architecture (OGSA) is advancing. The existing Servlets and.

WP3 Information and Monitoring Steve Fisher / RAL 23/9/2003.

An information and monitoring system for static and dynamic information about grid resources, applications, networks … RDBMS Servlet aware of API during.

CLRC and the European DataGrid Middleware Information and Monitoring Services The current information service is built on the hierarchical database OpenLDAP.

Globus Toolkit Massimo Sgaravatto INFN Padova. Massimo Sgaravatto Introduction Grid Services: LHC regional centres need distributed computing Analyze.

Computer and Automation Research Institute Hungarian Academy of Sciences SZTAKI’s work in DataGrid WP September Norbert Podhorszki Laboratory of.

WP3 RGMA Deployment Laurence Field / RAL Steve Fisher / RAL.

INFSO-RI Enabling Grids for E-sciencE

E-infrastructure shared between Europe and Latin America FP6−2004−Infrastructures−6-SSA gLite Information System Pedro Rausch IF.

©2012 LIESMARS Wuhan University Building Integrated Cyberinfrastructure for GIScience through Geospatial Service Web Jianya Gong, Tong Zhang, Huayi Wu.

Grid Deployment Enabling Grids for E-sciencE BDII 2171 LDAP 2172 LDAP 2173 LDAP 2170 Port Fwd Update DB & Modify DB 2170 Port.

Website: Answering Continuous Queries Using Views Over Data Streams Alasdair J G Gray Werner.

1 e-Science AHM st Aug – 3 rd Sept 2004 Nottingham Distributed Storage management using SRB on UK National Grid Service Manandhar A, Haines K,

R-GMA – an Update A reminder of R-GMA The need for a mediator Work with WP7 Release 1.2 and beyond Some Implications of OGSA.

FP6−2004−Infrastructures−6-SSA E-infrastructure shared between Europe and Latin America gLite Information System Claudio Cherubino.

The impact of R-GMA (upon WP1 and WP4). EDG (Paris) 6 Mar James MagowanImpact of R-GMA Grid Monitoring Architecture (GMA) We use it not only for.

Globus: A Report. Introduction What is Globus? Need for Globus. Goal of Globus Approach used by Globus: –Develop High level tools and basic technologies.

The EU DataGrid – Information and Monitoring Services The European DataGrid Project Team

- GMA Athena (24mar03 - CHEP La Jolla, CA) GMA Instrumentation of the Athena Framework using NetLogger Dan Gunter, Wim Lavrijsen,

INFSO-RI Enabling Grids for E-sciencE Information System Valeria Ardizzone INFN EGEE NA4 Generic Applications Meeting Catania,

EGEE is a project funded by the European Union under contract IST Information and Monitoring Services within a Grid R-GMA (Relational Grid.

INFSO-RI Enabling Grids for E-sciencE R-GMA Gergely Sipos and Péter Kacsuk MTA SZTAKI Credit to Valeria Ardizzone.

Gennaro Tortone, Sergio Fantinel – Bologna, LCG-EDT Monitoring Service DataTAG WP4 Monitoring Group DataTAG WP4 meeting Bologna –

EGEE-II INFSO-RI Enabling Grids for E-sciencE Practical using R-GMA.

INFSO-RI Enabling Grids for E-sciencE gLite Information System: R-GMA Tony Calanducci INFN Catania gLite tutorial at the EGEE User.

FESR Trinacria Grid Virtual Laboratory gLite Information System Muoio Annamaria INFN - Catania gLite 3.0 Tutorial Trigrid Catania,

A System for Monitoring and Management of Computational Grids Warren Smith Computer Sciences Corporation NASA Ames Research Center.

TIFR, Mumbai, India, Feb 13-17, GridView - A Grid Monitoring and Visualization Tool Rajesh Kalmady, Digamber Sonvane, Kislay Bhatt, Phool Chand,

WP3 Relational Work Progress Report 11/5/2001 Steve Fisher / RAL.

E-science grid facility for Europe and Latin America Updates on Information System Annamaria Muoio - INFN Tutorials for trainers 01/07/2008.

General Grid Monitoring Infrastructure (GGMI) Peter kacsuk and Norbert Podhorszki MTA SZTAKI.

WP2: Data Management Gavin McCance University of Glasgow.

The EU DataGrid – Information and Monitoring Services

gLite Information System

Active Directory Stored collection of information about objects

WP7 Network Monitoring Schemata

EGEE Middleware: gLite Information Systems (IS)

RELATIONAL GRID MONITORING ARCHITECHTURE

Global Grid Forum (GGF) Orientation

Information Services Claudio Cherubino INFN Catania Bologna

Presentation transcript:

Grid Application Builders Teach In31/01/02Antony Wilson Information & Monitoring Services WP3

Grid Application Builders Teach In31/01/02Antony Wilson Introduction LDAP R-GMA GRM/PROVE

Grid Application Builders Teach In31/01/02Antony Wilson LDAP Lightweight Directory Access Protocol Globus’s MDS (Metacomputing Directory Service) Ftree

Grid Application Builders Teach In31/01/02Antony Wilson computing element storage elements that are close (not necessarily at the same site) status supported protocols file statistics network information between this and other sites storage element LDAP -Directory Information Tree

Grid Application Builders Teach In31/01/02Antony Wilson LDAP - Example Search Example search ldapsearch -x -H ldap://gppmds.gridpp.rl.ac.uk:2135 -b “Mds-Vo-name=ral,Mds-Vo-name=uk,o=grid” “objectclass=StorageElementStatus”

Grid Application Builders Teach In31/01/02Antony Wilson LDAP - Example Search dn: in=status,seId=gppmds.gridpp.rl.ac.uk,Mds-Vo- name=ral, Mds-Vo-name=ral,o=grid objectClass: StorageElementStstus objectClass: DataGridTop objectClass: DynamicObject SEfreespace: SEId: gppmds.gridpp.rl.ac.uk

Grid Application Builders Teach In31/01/02Antony Wilson R-GMA Relational Grid Monitoring Architecture A relational implementation of the GGF’s GMA Based upon Java servlets Consists of Consumers, Producers and a discovery service

Grid Application Builders Teach In31/01/02Antony Wilson R-GMA - The Producer Consumer Model Invocation Information Registry Servlet Schema Servlet Client side Circular Buffer Producer Servlet Consumer Servlet Consumer Hidden components Circular Buffer Producer Sensor Application API

Grid Application Builders Teach In31/01/02Antony Wilson R-GMA DataBase Producer Sensor Code DataBase Producer RDBMS Uses a RDBMS to avoid data loss Consumer cannot tell the difference Data inserted like a Circular Buffer Producer Can produce more than one table DataBase Producer Servlet

Grid Application Builders Teach In31/01/02Antony Wilson Archiver: Producer/Consumer Utility Application Code Archiver API Archiver Servlet Producer Servlet Consumer Servlet Consumer API Producer Servlet Consumer Servlet Consumer API Producer Servlet Consumer Servlet Consumer API DataBase Producer Servlet DataBase Producer

Grid Application Builders Teach In31/01/02Antony Wilson R-GMA - API’s Java & C++ API’s Consumer Circular buffer producer Database producer Archiver C API’s under development

Grid Application Builders Teach In31/01/02Antony Wilson GRM/PROVE Developed by SZTAKI originally for monitoring parallel programs in a cluster environment GRM/PROVE similar to Netlogger GRM Provides C API for application monitoring PROVE Visualisation tool

Grid Application Builders Teach In31/01/02Antony Wilson GRM/PROVE Instrument the application (GRM lib) Execute in grid Transfer trace file back as a regular output file Visualize with PROVE

Grid Application Builders Teach In31/01/02Antony Wilson PROVE

Grid Application Builders Teach In31/01/02Antony Wilson GRM/PROVE Integration with R-GMA Semi-online model GRM becomes a producer PROVE becomes a consumer

Grid Application Builders Teach In31/01/02Antony Wilson GRM/PROVE & R-GMA Invocation Information Registry Servlet Schema Servlet Client side Circular Buffer Producer Servlet Consumer Servlet Consumer Hidden components Circular Buffer Producer GRM PROVE API

Grid Application Builders Teach In31/01/02Antony Wilson Further Information