NMWG GGF7 Tokyo March 2003 Paul Mealor UCL EDG WP7 Network Monitoring Schema Paul Mealor NM-WG GGF7 Presented by Richard Hughes-Jones.

Slides:



Advertisements
Similar presentations
GridPP Meeting, Cambridge, 14 Feb 2002 Paul Mealor, UCL Networking Paul Mealor.
Advertisements

R-GMA Producers and Archiver Paul Mealor. edg-pinger-timeping edg-netmon-rgma-info Producer API edg-gridftplog2rgma Producer API Log Here be servlets.
Grid Application Builders Teach In31/01/02Antony Wilson Information & Monitoring Services WP3.
Query Methods (SQL). What is SQL A programming language for databases. SQL (structured Query Language) It allows you add, edit, delete and run queries.
Network Performance Measurement
Connect. Communicate. Collaborate Click to edit Master title style MODULE 1: perfSONAR TECHNICAL OVERVIEW.
A conceptual model of grid resources and services Authors: Sergio Andreozzi Massimo Sgaravatto Cristina Vistoli Presenter: Sergio Andreozzi INFN-CNAF Bologna.
GridPP meeting Feb 03 R. Hughes-Jones Manchester WP7 Networking Richard Hughes-Jones.
Information systems and databases Database information systems Read the textbook: Chapter 2: Information systems and databases FOR MORE INFO...
Section 13.1 Add a hit counter to a Web page Identify the limitations of hit counters Describe the information gathered by tracking systems Create a guest.
Reading Report 14 Yin Chen 14 Apr 2004 Reference: Internet Service Performance: Data Analysis and Visualization, Cross-Industry Working Team, July, 2000.
Overview of SQL Server Alka Arora.
The EU DataGrid – Information and Monitoring Services The European DataGrid Project Team
WP3 RGMA Deployment Laurence Field / RAL Steve Fisher / RAL.
Use of R-GMA in BOSS Henry Nebrensky (Brunel University) VRVS 26 April 2004 Some slides stolen from various talks at EDG 2 nd Review (
Tiziana FerrariNetwork metrics usage for optimization of the Grid1 DataGrid Project Work Package 7 Written by Tiziana Ferrari Presented by Richard Hughes-Jones.
INFSO-RI Enabling Grids for E-sciencE Federated Network Performance Monitoring for the Grid K. Kavoussanakis, EPCC, The University.
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Information System on gLite middleware Vincent.
An XML Schema for NMWG Yee-Ting Li, UCL. Metrics All results from Network Monitoring stored in some format All results from Network Monitoring stored.
A monitoring tool for a GRID operation center Sergio Andreozzi (INFN CNAF), Sergio Fantinel (INFN Padova), David Rebatto (INFN Milano), Gennaro Tortone.
The NMWG Framework A (very) brief introduction Raphael Dourado 13/04/20121.
1 Week 5 Lecture 2 IP Layer. 2 Network layer functions transport packet from sending to receiving hosts transport packet from sending to receiving hosts.
13 May 2004EB/TB Middleware meeting Use of R-GMA in BOSS for CMS Peter Hobson & Henry Nebrensky Brunel University, UK Some slides stolen from various talks.
© 2006 Open Grid Forum Network Measurements Working Group Summary of the Version 2 Schemata Richard Hughes-Jones Martin Swany, Jason.
An information and monitoring system for static and dynamic information about grid resources, applications, networks … RDBMS Servlet aware of API during.
Franck Bonnassieux- WP7- n° 1 WP7 Budapest Collaboration with Dante Monitoring & R-GMA GridFTP Logging Network Cost Function MapCenter & TopoGRID Future.
1 Computer Communication & Networks Lecture 21 Network Layer: Delivery, Forwarding, Routing Waleed.
NMWG GGF7 Tokyo March 2003 R. Hughes-Jones Manchester A Hierarchy of Network Measurements for Grid Applications and Services Les Cottrell, Richard Hughes-Jones,
E-infrastructure shared between Europe and Latin America FP6−2004−Infrastructures−6-SSA gLite Information System Pedro Rausch IF.
DataGrid WP7 Meeting Amsterdam Nov 01 R. Hughes-Jones Manchester 1 UDPmon Measuring Throughput with UDP  Send a burst of UDP frames spaced at regular.
NMWG GGF13 Seoul March 2005 R. Hughes-Jones Manchester Network Measurements Working Group Summary of the Work on "new" Schemata Richard Hughes-Jones Main.
DataTAG is a project funded by the European Union DataTAG WP4 meeting, Bologna 29/07/2003 – n o 1 GLUE Schema - Status Report DataTAG WP4 meeting Bologna,
FP6−2004−Infrastructures−6-SSA E-infrastructure shared between Europe and Latin America gLite Information System Claudio Cherubino.
WP7 Middleware Status and Plans Paul Mealor. Contents GridFTP monitoring Network monitoring information in RGMA UK network monitoring.
The impact of R-GMA (upon WP1 and WP4). EDG (Paris) 6 Mar James MagowanImpact of R-GMA Grid Monitoring Architecture (GMA) We use it not only for.
The EU DataGrid – Information and Monitoring Services The European DataGrid Project Team
SQL Query Analyzer. Graphical tool that allows you to:  Create queries and other SQL scripts and execute them against SQL Server databases. (Query window)
Mark Leese Daresbury Laboratory GridMon EGEE JRA4 R-GMA workshop Thursday 22 nd July 2004 University College London Mark Leese.
Gennaro Tortone, Sergio Fantinel – Bologna, LCG-EDT Monitoring Service DataTAG WP4 Monitoring Group DataTAG WP4 meeting Bologna –
1 Schemas and GGF James Magowan / IBM March 2002.
Networking and the Grid Ahmed Abdelrahim NeSC NeSC PPARC e-Science Summer School 10 th May 2005.
CERN 21 January 2005Piotr Nyczyk, CERN1 R-GMA Basics and key concepts Monitoring framework for computing Grids – developed by EGEE-JRA1-UK, currently used.
DataTAG is a project funded by the European Union CERN, 8 May 2003 – n o 1 / 10 Grid Monitoring A conceptual introduction to GridICE Sergio Andreozzi
– 1 – Update on GGF Measurement Activities Bruce Lowekamp The College of William and Mary.
WP2: Data Management Gavin McCance University of Glasgow.
PerfSONAR Schema and Topology Martin Swany. Schema Key Goals: Extensibility, Normalization, Readability Break representation of performance measurements.
June 11, 2002 Abilene Route Quality Control Initiative Aaron D. Britt Guy Almes Route Optimization.
Massimo Sgaravatto INFN Padova
CS 325 Spring ‘09 Chapter 1 Goals:
Northern College Diploma Philip Bird
Network Tools and Utilities
BDII Performance Tests
The EU DataGrid – Information and Monitoring Services
R. Hughes-Jones Manchester
Sergio Fantinel, INFN LNL/PD
Storage elements discovery
EDT-WP4 monitoring group status report
Phil Bernstein Microsoft Corp.
Database.
Jeff Boote, Eric L. Boyd, Rich Carlson, Hyungseok Chung
E2E piPES Project Russ Hobby, Internet2 HENP Working Group Meeting
WP7 Network Monitoring Schemata
LDAP monitoring status
Information and Monitoring System
SLAC monitoring Web Services
RELATIONAL GRID MONITORING ARCHITECHTURE
ACTIVE DIRECTORY An Overview.. By Karan Oberoi.
Database SQL.
Bridge Software A bridge connects networks and forwards frames from one network to another. PORTS A B E F BRIDGE C D G H.
Information Services Claudio Cherubino INFN Catania Bologna
Presentation transcript:

NMWG GGF7 Tokyo March 2003 Paul Mealor UCL EDG WP7 Network Monitoring Schema Paul Mealor NM-WG GGF7 Presented by Richard Hughes-Jones

NMWG GGF7 Tokyo March 2003 Paul Mealor UCL Menu uLDAP schema uR-GMA schema

NMWG GGF7 Tokyo March 2003 Paul Mealor UCL LDAP schema design considerations uLDAP schema for MDS in EDG uPublication of most recent network measurements for host-to-host pairs uEarly work, so Schema design Should be easy to add new metrics to the Schema Should be easy to add new measurement parameters The (EDG?) MDS setup made it hard to add new LDAP objectclasses

NMWG GGF7 Tokyo March 2003 Paul Mealor UCL Example of a LDAP schema objectclass ( NAME 'NetworkMeasurement‘ DESC 'Describes a single measurement.‘ SUP ( NetworkMonitorSource $ NetworkMonitorDest $ NetworkMonitorMetric ) STRUCTURAL MUST ( NMMeasureId $ MetricValue $ MetricTime ) ) objectclass ( NAME 'NetworkMonitorSource' DESC 'Describes a network monitoring host from which measurements are made. This is here to help the with implementation.' SUP DataGridTop STRUCTURAL MUST ( SourceHost ) MAY ( SourceSite $ SourceNE ) ) objectclass ( NAME 'NetworkMonitorDest' DESC 'Describes a network monitoring host to which measurements are made. This is here to help the with implementation.' SUP DataGridTop STRUCTURAL MUST ( DestHost ) MAY ( DestSite $ DestNE ) ) objectclass ( NAME 'NetworkMonitorMetric' DESC 'Describes a single metric and its parameters.Abstract: do not use.' SUP NetworkMonitorToolName ABSTRACT MUST ( MetricName $ MetricUnit ) MAY ( Parameter ) )

NMWG GGF7 Tokyo March 2003 Paul Mealor UCL Schema in use – LDAP Object objectClass: NetworkMeasurement nmMeasureId: foo.ac.uk/bar.ac.uk/rttavg sourceHost: a.foo.ac.uk destHost: b.bar.ac.uk sourceNE: foo.ac.uk destNE: bar.ac.uk metricName: rttavg metricUnit: ms parameter: packetsize:100 parameter: packets:10 metricValue: 67 metricTime: Z Provides Mappings between source and destination “NEs” and Computing or Storage Elements held elsewhere on site This LDAP object contains the average RTT of a measurement between a.foo.ac.uk and b.bar.ac.uk that was made with 10 packets of 100bytes each. LDAP Tree structure discouraged Tree different dependent on location Map Objects in Net Info Index

NMWG GGF7 Tokyo March 2003 Paul Mealor UCL R-GMA Schema Design Considerations uRelational database schema R-GMA looks a lot like a relational database! uR-GMA allows historical information in SQL Dbase uEasier to use: Better understanding of network monitoring & tools now Adding new tables easier Can add custom schemas at run-time Tables store observations between hosts Different tables for different metrics Include parameters (entity annotations) in the table Separate tables for mapping CE & SE to Network monitoring Much better for SQL queries searching for observations

NMWG GGF7 Tokyo March 2003 Paul Mealor UCL Schema in use – RGMA Tables NetworkCE CEId NMId NetworkRTT NMIdSource NMIdDestination tool packetSize time minimum maximum average NetworkCE CEId NMId NetworkSE SEId NMId ComputingElement CEId GRAMVersion Architecture OpSys &c…  1  1  1 1 NetworkTCPThroughput NMIdSource NMIdDestination tool bufferSize streams duration time value ID for Network Monitor nodes Tables provide mappings: SE – Net Monitor node CE – Net Monitor node uTables defined for: RTT TCP throughput ICMP packet loss 1-way IPDV UDP throughput UDP packet loss