Performance Measuring & Monitoring

Slides:



Advertisements
Similar presentations
Connect. Communicate. Collaborate Click to edit Master title style MODULE 1: perfSONAR TECHNICAL OVERVIEW.
Advertisements

Connect. Communicate. Collaborate GÉANT2 JRA1 & perfSONAR Loukik Kudarimoti, DANTE 28 th May, 2006 RNP Workshop, Curitiba.
Massimo Cafaro GridLab Review GridLab WP10 Information Services Massimo Cafaro CACT/ISUFI University of Lecce, Italy.
Introduction to the Internet How did the Internet start? Why was the Internet developed? How does Internet handle the traffic? Why WWW changed the Internet.
Team Members Jason Bender Derek Crane Cliff Crane Renan Pereira Isidro Arribas.
LHC Experiment Dashboard Main areas covered by the Experiment Dashboard: Data processing monitoring (job monitoring) Data transfer monitoring Site/service.
Network Performance Measurement Atlas Tier 2 Meeting at BNL December Joe Metzger
1 ESnet Network Measurements ESCC Feb Joe Metzger
Hands-On Microsoft Windows Server 2008 Chapter 1 Introduction to Windows Server 2008.
Connect. Communicate. Collaborate perfSONAR and Wavelengths Monitoring LHC meeting, Cambridge, 16 of June 2006 Matthias Hamm - DFN Nicolas Simar - DANTE.
Campus Best Practice in Practice e-Infrastructure Summer Workshops Sofia June 19th 2014.
Internet2 Performance Update Jeff W. Boote Senior Network Software Engineer Internet2.
To Patch or not to Patch SharePoint Charmaine Malan 3 October 2015 Johannesburg, SA.
Internet2 & perfSONAR-PS August 23 rd 2012, OSG & perfSONAR-PS Meeting Jason Zurawski – Senior Research Engineer.
Connect. Communicate. Collaborate Implementing Multi-Domain Monitoring Services for European Research Networks Szymon Trocha, PSNC A. Hanemann, L. Kudarimoti,
UNH network currently supports a 2.5 gbps network on campus. This network services thousands of users a day, and must be secure. These security measures.
CoBrow Collaborative Browsing A Virtual Presence Service RE 1003 RE 4003.
Interdomain multicast routing with IPv6 Stig Venaas University of Southampton Jerome Durand RENATER Mickael Hoerdt University Louis Pasteur - LSIIT.
1 Network Measurement Summary ESCC, Feb Joe Metzger ESnet Engineering Group Lawrence Berkeley National Laboratory.
Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Usage of virtualization in gLite certification Andreas Unterkircher.
Connect. Communicate. Collaborate perfSONAR MDM Service for LHC OPN Loukik Kudarimoti DANTE.
Connect. Communicate. Collaborate Click to edit Master title style PERT OPERATIONS.
PerfSONAR-PS Functionality February 11 th 2010, APAN 29 – perfSONAR Workshop Jeff Boote, Assistant Director R&D.
Connect. Communicate. Collaborate Operations of Multi Domain Network Services Marian Garcia Vidondo, DANTE COO TNC 2008, Bruges May.
Jeremy Nowell EPCC, University of Edinburgh A Standards Based Alarms Service for Monitoring Federated Networks.
Connect. Communicate. Collaborate The Security Model of GÉANT2: A Co-operative Approach Christoph Graf, SWITCH TNC’07, Lyngby, 22 May 2007.
Internet2 End-to-End Performance Initiative Eric L. Boyd Director of Performance Architecture and Technologies Internet2.
Connect. Communicate. Collaborate GEANT2 Monitoring Services Emma Apted, DANTE Operations EGEE III, Budapest, 3 rd October 2007.
Connect communicate collaborate perfSONAR MDM for LHCOPN/LHCONE: partnership, collaboration, interoperability, openness Domenico Vicinanza perfSONAR MDM.
Connect. Communicate. Collaborate mcview – A tool for visualising and debugging multicast Stig Venaas, UNINETT TNC 2008, Bruges, May 21 st.
Connect. Communicate. Collaborate JRA1 Status Update Stephan Kraft, RRZE FAU Erlangen-Nürnberg JRA1 Montpellier Meeting, October 2006.
Javier Orellana JRA4 Coordinator Face to Face Partners Meeting University College London 11 December 2003 EGEE is proposed as a project funded by the European.
14-Nov-07 OWAMP (One-Way Latencies) BWCTL (Bandwidth Test Control) Jeff Boote Network Performance Tools BOF-SC07.
DICE Diagnostic Service Joe Metzger Joint Techs Measurement Working Group January
Connect communicate collaborate perfSONAR MDM News Domenico Vicinanza DANTE (UK)
1 Network related topics Bartosz Belter, Wojbor Bogacki, Marcin Garstka, Maciej Głowiak, Radosław Krzywania, Roman Łapacz FABRIC meeting Poznań, 25 September.
Advanced Network Diagnostic Tools Richard Carlson EVN-NREN workshop.
Queensland University of Technology Nagios – an Open Source monitoring solution and it’s deployment at QUT.
PiPEs Tools in Action Rich Carlson SMM Tools Tutorial May 3, 2005.
Campana (CERN-IT/SDC), McKee (Michigan) 16 October 2013 Deployment of a WLCG network monitoring infrastructure based on the perfSONAR-PS technology.
1 Deploying Measurement Systems in ESnet Joint Techs, Feb Joseph Metzger ESnet Engineering Group Lawrence Berkeley National Laboratory.
1 Network Measurement Challenges LHC E2E Network Research Meeting October 25 th 2006 Joe Metzger Version 1.1.
Status of perfSONAR Tools Jason Zurawski April 23, 2007 Spring Member Meeting.
perfSONAR on Low Cost Hardware
PERN (Pakistan Education & Research Network )
Overview – SOE Net-SNMP v
Internet2 End-to-End Performance Initiative
GÉANT BoD Service Roadmap
Overview of New Features in perfSONAR 4.0
Networking for the Future of Science
Robert Szuman – Poznań Supercomputing and Networking Center, Poland
PerfSONAR: Development Status
GÉANT Advanced eduPERT Training
Key Terms Windows 2008 Network Infrastructure Confiuguration Lesson 6
Network Monitoring and Troubleshooting with perfSONAR MDM
Internet2 Performance Update
Alerting/Notifications (MadAlert)
Deployment & Advanced Regular Testing Strategies
Basic Configuration & Deployment
ESnet Network Measurements ESCC Feb Joe Metzger
Good Things Come In Small Packages
Big-Data around the world
Interoperability with Existing PS-PS Instances
Network Performance Measurement
“Detective”: Integrating NDT and E2E piPEs
Network Technology Evolution
Agenda Project overview Technology choice Complementary perspective
Management and Monitoring
Network Technology Evolution
GÉANT network (December 2018)
Presentation transcript:

Performance Measuring & Monitoring perfSONAR and PMP services in GÉANT Antoine Delvaux - PSNC Trondheim, Norway 13th June 2018

PMP: Performance Measurement Platform Outline perfSONAR What is perfSONAR? 4.0.2 in November 2017 4.1 coming up PMP: Performance Measurement Platform Transitioning the Small Nodes in GÉANT project Multi-domain Monitoring Expertise & Consultancy Some examples of support we’ve provided: NORDUNet JISC training UNINETT support to DragonLab project PRACE

All in multi-domain environments What is perfSONAR? perfSONAR is a tool to: Set (hopefully raise) network performance expectations Find network problems (“soft failures”) Help fix these problems All in multi-domain environments Over 2000 public hosts on many different networks See http://stats.es.net/ServicesDirectory/ These problems are all harder when multiple networks are involved Focus on Research and Education (R&E) Networking, 1Gbps links or higher perfSONAR provides a standard way to publish active and passive monitoring data This data is interesting to network researchers as well as network operators As most of you might know …

https://www.perfsonar.net/about/perfsonar-history-timeline/

perfSONAR an international collaboration project First ideas around 2001: 17 years of collaboration By the R&E for the R&E More info on http://www.perfsonar.net Now 5 partner organisations: ESnet GÉANT Indiana University Internet 2 University of Michigan

Bug fixes … but not only, quite a few pScheduler enhancements perfSONAR 4.0.2 — Nov. 2017 Bug fixes … but not only, quite a few pScheduler enhancements Streaming archiving for decreased CPU usage SNMP plugins snmp-get to collect data snmptrap to archive measurements jq support: online JSON manipulation Archivers Limit system Contexts Switch context before running measurement First usage: Linux Network Namespace Contexts and LNN is useful for measurements in virtual environments (think MD-VPN, GTS, …)

perfSONAR 4.1 TWAMP pScheduler pSConfig MCA: Mesh Config Admin Two Way Active Measurement Protocol Similar packets to OWAMP, better measurement accuracy than ping Routers and Switches can act as servers (reflectors) Integrated with pScheduler and toolkit 2 metrics: latency and RTT pScheduler Task priorities and task rewriting pSConfig mesh-config re-imagined MCA: Mesh Config Admin A web GUI to define a perfSONAR measurement mesh TWAMP is useful because of accuracy, easier then 2 OWAMP measurements, more reliable than ping. pSConfig has better integration with pScheduler, more modularity and flexibility, backward compatible with existing mesh files MCA running inside a Docker container

Beta out soon … final during summer Getting ready for 4.1 Beta out soon … final during summer Drop support of CentOS 6 and Debian 7 Drop support of BWCTL Keep your deployments up to date! Run auto-updates We’re putting the final touches to the beta. We’re always looking at more beta testers.

Performance Measurement Platform (PMP) 2 years ago: perfSONAR Small Nodes in GÉANT 20 preconfigured perfSONAR nodes distributed A public measurement mesh across the GÉANT network Successful and more NREN are interested Increase the deployment and the support level New central servers 25 to 30 new nodes to cover all GÉANT NREN Dedicated support team Get in touch with us if your NREN does not yet have one perfsonar@lists.geant.net

Multi-Domain Monitoring Expertise and Consultancy Providing GÉANT NREN Multi-Domain Performance Monitoring expertise, advices and support Can help with training, collaborating with eduPERT Successful examples: perfSONAR deployment help for NORDUNet perfSONAR training at JISC Support to the DragonLab project with UNINETT Coming up: perfSONAR deployment support for PRACE Experts available to you! Get in touch: perfsonar@lists.geant.org

We’d love to hear from you! About your perfSONAR feature requests Post request on https://github.com/perfsonar/project Discuss at https://lists.internet2.edu/sympa/info/perfsonar-user About your multi-domain monitoring expertise needs Write to perfsonar@lists.geant.org eduPERT workshop this Thursday at TNC18 Advanced perfSONAR usage pscheduler, nagios integration, new features, roadmap

antoine.delvaux@man.poznan.pl perfsonar@lists.geant.org