WP7 Middleware Status and Plans Paul Mealor. Contents GridFTP monitoring Network monitoring information in RGMA UK network monitoring.

Slides:

Advertisements

Similar presentations

NAGIOS AND CACTI NETWORK MANAGEMENT AND MONITORING SYSTEMS.

Advertisements

LNL M.Biasotto, Roma, 22 novembre Some notes on WP6 INFN Testbed.

21 Sep 2005LCG's R-GMA Applications R-GMA and LCG Steve Fisher & Antony Wilson.

EU DataGrid TestBed 2 Component Review Paul Millar (University of Glasgow) (slides based on a presentation by Erwin Laure)

GridPP Meeting, Cambridge, 14 Feb 2002 Paul Mealor, UCL Networking Paul Mealor.

Status Report University of Bristol 3 rd GridPP Collaboration Meeting 14/15 February, 2002Marc Kelly University of Bristol 1 Marc Kelly University of Bristol.

Andrew McNab - Manchester HEP - 17 September 2002 Putting Existing Farms on the Testbed Manchester DZero/Atlas and BaBar farms are available via the Testbed.

Andrew McNab - Manchester HEP - 24 May 2001 WorkGroup H: Software Support Both middleware and application support Installation tools and expertise Communication.

R-GMA Producers and Archiver Paul Mealor. edg-pinger-timeping edg-netmon-rgma-info Producer API edg-gridftplog2rgma Producer API Log Here be servlets.

Presenter Name Facility Name EDG Testbed Status Moving to Testbed Two.

DataGrid is a project funded by the European Commission under contract IST WP2 – R2.1 Overview of WP2 middleware as present in EDG 2.1 release.

EU 2nd Year Review – Feb – WP2/WP7 demonstration – n° 1 WP7 Report Status on Release 2.0 and plans CNRS/UREC.

CrossGrid WP3 Task Non-invasive Monitoring Trinity College Dublin Brian Coghlan, Stuart Kenny, David O’Callaghan Santiago FEB-2003.

GridPP meeting Feb 03 R. Hughes-Jones Manchester WP7 Networking Richard Hughes-Jones.

CAIDA Bandwidth Estimation Meeting San Diego June 2002 R. Hughes-Jones Manchester 1 EU DataGrid - Network Monitoring Richard Hughes-Jones, University of.

27-29 September 2002CrossGrid Workshop LINZ1 USE CASES (Task 3.5 Test and Integration) Santiago González de la Hoz CrossGrid Workshop at Linz,

EGI-InSPIRE RI EGI-InSPIRE EGI-InSPIRE RI Etienne Dublé - CNRS/UREC Alfredo Pagano – GARR NetJobs: Network Monitoring.

Andrew McNab - Manchester HEP - 22 April 2002 UK Rollout and Support Plan Aim of this talk is to the answer question “As a site admin, what are the steps.

1 WP7 (Network) status &plans Paris 6 th of March 2002 Pascale PRIMET INRIA/ RESO - ENS Lyon

WP3 RGMA Deployment Laurence Field / RAL Steve Fisher / RAL.

Don Quijote Data Management for the ATLAS Automatic Production System Miguel Branco – CERN ATC

C. Loomis – Testbed Status – 28/01/2002 – n° 1 Future WP6 Tasks Charles Loomis January 28, 2002

EDG LCFGng: concepts Fabric Management Tutorial - n° 2 LCFG (Local ConFiGuration system)  LCFG is originally developed by the.

Computer and Automation Research Institute Hungarian Academy of Sciences Presentation and Analysis of Grid Performance Data Norbert Podhorszki and Peter.

Tiziana FerrariNetwork metrics usage for optimization of the Grid1 DataGrid Project Work Package 7 Written by Tiziana Ferrari Presented by Richard Hughes-Jones.

Bob Jones – June n° 1 EDG release Schedule Bob Jones.

First attempt for validating/testing Testbed 1 Globus and middleware services WP6 Meeting, December 2001 Flavia Donno, Marco Serra for IT and WPs.

WP3 Information and Monitoring Steve Fisher / RAL 23/9/2003.

CLRC and the European DataGrid Middleware Information and Monitoring Services The current information service is built on the hierarchical database OpenLDAP.

Franck Bonnassieux- WP7- n° 1 WP7 Budapest Collaboration with Dante Monitoring & R-GMA GridFTP Logging Network Cost Function MapCenter & TopoGRID Future.

EGEE is a project funded by the European Union under contract IST R-GMA: Production Services for Information and Monitoring in the Grid John.

Mark Leese Daresbury Laboratory GridMon – Grid Network Performance Monitoring for UK e-Science AllHands 2003 – Thursday 4 th September.

EGEE is a project funded by the European Union under contract IST Tools survey status, first experiences with the prototype Diana Bosio EGEE.

INFSO-RI Enabling Grids for E-sciencE Information and Monitoring Status and Plans Plzeň, 10 July 2006 Steve Fisher/RAL.

WP3 RGMA Deployment Laurence Field / RAL Steve Fisher / RAL.

Presenter Name Facility Name UK Testbed Status and EDG Testbed Two. Steve Traylen GridPP 7, Oxford.

DataGrid WP7 Meeting Amsterdam Nov 01 R. Hughes-Jones Manchester 1 UDPmon Measuring Throughput with UDP  Send a burst of UDP frames spaced at regular.

Jeremy Nowell EPCC, University of Edinburgh A Standards Based Alarms Service for Monitoring Federated Networks.

Jens G Jensen RAL, EDG WP5 Storage Element Overview DataGrid Project Conference Heidelberg, 26 Sep-01 Oct 2003.

R-GMA – an Update A reminder of R-GMA The need for a mediator Work with WP7 Release 1.2 and beyond Some Implications of OGSA.

2-Sep-02Steve Traylen, RAL WP6 Test Bed Report1 RAL and UK WP6 Test Bed Report Steve Traylen, WP6

Andrew McNab - Manchester HEP - 17 September 2002 UK Testbed Deployment Aim of this talk is to the answer the questions: –“How much of the Testbed has.

EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Update on Network Performance Monitoring.

The impact of R-GMA (upon WP1 and WP4). EDG (Paris) 6 Mar James MagowanImpact of R-GMA Grid Monitoring Architecture (GMA) We use it not only for.

Grid Network Performance Monitoring for e-Science.

NMWG GGF7 Tokyo March 2003 Paul Mealor UCL EDG WP7 Network Monitoring Schema Paul Mealor NM-WG GGF7 Presented by Richard Hughes-Jones.

WP3 Security and R-GMA Linda Cornwall. WP3 UserVOMS service authr map pre-proc authr LCAS LCMAPS pre-proc LCAS Coarse-grained e.g. Spitfire WP2 service.

DataGrid WP7 Network Monitoring Robin Tasker, Daresbury Laboratory, 8 March 2001 Network Monitoring Requirements document produced,

Mark Leese Daresbury Laboratory GridMon EGEE JRA4 R-GMA workshop Thursday 22 nd July 2004 University College London Mark Leese.

Mark Leese (Daresbury Laboratory) Paul Mealor (University College London) 1st EGEE Conference Cork, April 2004 Network Monitoring: The GGF Perspective.

Gennaro Tortone, Sergio Fantinel – Bologna, LCG-EDT Monitoring Service DataTAG WP4 Monitoring Group DataTAG WP4 meeting Bologna –

EGEE is a project funded by the European Union under contract IST End-user requirements for network monitoring Paul Mealor JRA4 EGEE Kick-Off.

EGEE is a project funded by the European Union under contract IST Installation and configuration of gLite services Robert Harakaly, CERN,

DataGrid is a project funded by the European Commission under contract IST EDG Baseline API Document Document build description and current.

Networking and the Grid Ahmed Abdelrahim NeSC NeSC PPARC e-Science Summer School 10 th May 2005.

Andrew McNab - Globus Distribution for Testbed 1 Status of the Globus Distribution for Testbed 1 Andrew McNab, University of Manchester

EGI-InSPIRE RI EGI-InSPIRE EGI-InSPIRE RI Mario Reale – GARR NetJobs: Network Monitoring Using Grid Jobs.

Bob Jones – Project Architecture - 1 March n° 1 Project Architecture, Middleware and Delivery Schedule Bob Jones Technical Coordinator, WP12, CERN.

Maite Barroso – WP4 Workshop – 10/12/ n° 1 -WP4 Workshop- Developers’ Guide Maite Barroso 10/12/2002

J Jensen / WP5 /RAL UCL 4/5 March 2004 GridPP / DataGrid wrap-up Mass Storage Management J Jensen

June 11, 2002 Abilene Route Quality Control Initiative Aaron D. Britt Guy Almes Route Optimization.

Massimo Sgaravatto INFN Padova

Progress Apama Fundamentals

WP1 WMS release 2: status and open issues

Steve Fisher / RAL March 2002

Network Monitoring Using Grid Jobs EGEE SA2

Mario Reale – IGI / GARR Lyon, Sept 19, 2011

WP7 Network Monitoring Schemata

LDAP monitoring status

Presentation transcript:

WP7 Middleware Status and Plans Paul Mealor

Contents GridFTP monitoring Network monitoring information in RGMA UK network monitoring

GridFTP Absolutely definitely will be in EDG 2 Appropriate code for info-providers (and bug fixes for gsiwuftpd) in RPMs and declared to be released with next EDG Appropriate code for info-providers (and bug fixes for gsiwuftpd) in RPMs and declared to be released with next EDG Configuration details declared (inc. LCFG.h files, even though LCFG will change) Configuration details declared (inc. LCFG.h files, even though LCFG will change) Oh, and it’s running at UCL

RGMA ∩ GridFTP Obviously should do We’ve got a schema for it, at least

R-GMA Discussions between WP3 and WP7 some time ago Decided on schemata for publishing the network performance metrics measured by WP7 Decided on schemata for publishing the network performance metrics measured by WP7 RTT, packet loss (1- and 2-way), IPDV, throughput (TCP & UDP), file-transfer throughput RTT, packet loss (1- and 2-way), IPDV, throughput (TCP & UDP), file-transfer throughput Also, information to link the SE and CE to a network monitor Also, information to link the SE and CE to a network monitor

R-GMA Modified the three main WP7 tools to publish into RGMA PingER: RTT & ICMP packet loss PingER: RTT & ICMP packet loss IperfER: TCP throughput IperfER: TCP throughput UDPMon: UDP thoughput & 1-way IPDV UDPMon: UDP thoughput & 1-way IPDV Maintain old web interface, so MDS information providers still work

R-GMA Some machine Network monitor edg-netmon2rgmad Producer API Tomcat: Producer servlets PingER edg-netmon-rgma-infod measurements Notify via FIFO NetworkCE NetworkSE Here be dragons

R-GMA Advantages Push model all the way Push model all the way APIs on NM are lightweight APIs on NM are lightweight Tomcat can go somewhere else Tomcat can go somewhere else edg-netmon2rgmad keeps Producers persistent edg-netmon2rgmad keeps Producers persistent

R-GMA This is really running at UCL (installed from RPM, simply configured) Often (but not now) makes NM data available via the WP3 registry RGMA-capable network cost function under construction Robert Harakaly Robert Harakaly

UK network monitoring To get network monitoring available in the UK WP7 tools repackaged in a single RPM By Gareth Fairey By Gareth Fairey And Mark Leese And Mark Leese Another map with green dots on it Another map with green dots on it

End