MAGGIE NIIT- SLAC On Going Projects

Slides:



Advertisements
Similar presentations
FIBRE-BR Meeting GENI I&M Marcelo Pinheiro. Agenda GENI Overview GENI User groups GENI I&M Use Cases GENI I&M Services.
Advertisements

© 2008 Cisco Systems, Inc. All rights reserved.Cisco ConfidentialPresentation_ID 1 Chapter 8: Monitoring the Network Connecting Networks.
Overview of network monitoring development at AMRES Slavko Gajin.
Ningning HuCarnegie Mellon University1 Optimizing Network Performance In Replicated Hosting Peter Steenkiste (CMU) with Ningning Hu (CMU), Oliver Spatscheck.
Connect. Communicate. Collaborate Click to edit Master title style MODULE 1: perfSONAR TECHNICAL OVERVIEW.
Connect. Communicate. Collaborate WI5 – tools implementation Stephan Kraft October 2007, Sevilla.
Geolocation Les Cottrell – SLAC University of Helwan / Egypt, Sept 18 – Oct 3, 2010 Partially funded by DOE/MICS Field Work Proposal on Internet End-to-end.
PingER Management1 Error Reporting Model for Ping End-to-End Reporting (PingER Management)
1 SLAC Internet Measurement Data Les Cottrell, Jerrod Williams, Connie Logg, Paola Grosso SLAC, for the ISMA Workshop, SDSC June,
MAGGIE NIIT- SLAC On Going Projects Measurement & Analysis of Global Grid & Internet End to end performance.
1 AMTv6: Active Measurement Tool in IPv6 Network Jaehoon Jeong, ETRI
Stanford University, SLAC, NIIT, the Digital Divide & Projects Prepared by Les Cottrell, SLAC for the NIIT Under Graduate Students, March 15, 2007.
LOGO 1 MAGGIE Measurement & Analysis of the Global Grid & Internet End-to-End Performance Monitoring A Research Collaboration by National University of.
A Step Towards Automated Event Diagnosis Stanford Linear Accelerator Center Adnan Iqbal, Yee-Ting Li, Les Cottrell Connie A. Log. Williams Jerrod.
1 ICFA/SCIC Network Monitoring Prepared by Les Cottrell, SLAC, for ICFA
Network Monitoring grid network performance measurement, simulation & analysis Presented by Warren Matthews at the Performance.
Network Performance Measurement Atlas Tier 2 Meeting at BNL December Joe Metzger
Performance Measurement Tools August 9 th 2011, OSG Site Admin Workshop Jason Zurawski – Internet2 Research Liaison.
Reading Report 14 Yin Chen 14 Apr 2004 Reference: Internet Service Performance: Data Analysis and Visualization, Cross-Industry Working Team, July, 2000.
1 Monitoring Internet connectivity of Research and Educational Institutions Les Cottrell – SLAC/Stanford University Prepared for the workshop on “Developing.
PingER: Research Opportunities and Trends R. Les Cottrell, SLAC University of Malaya.
Module 10: Monitoring ISA Server Overview Monitoring Overview Configuring Alerts Configuring Session Monitoring Configuring Logging Configuring.
LAN and WAN Monitoring at SLAC Connie Logg September 21, 2005.
Use cases Navigation Problem notification Problem analysis.
Measurement & Analysis of Global Grid & Internet End to end performance (MAGGIE) Network Performance Measurement.
1 Overview of IEPM-BW - Bandwidth Testing of Bulk Data Transfer Tools Connie Logg & Les Cottrell – SLAC/Stanford University Presented at the Internet 2.
1 The PingER Project: Measuring the Digital Divide PingER Presented by Les Cottrell, SLAC At the SIS Show Palexpo/Geneva December 2003.
1 Implementing Monitoring and Reporting. 2 Why Should Implement Monitoring? One of the biggest complaints we hear about firewall products from almost.
1 Network Monitoring for SCIC Les Cottrell, SLAC ICFA/SCIC meeting August 24, aug05.ppt Initially.
Locating hosts by TULIP (Trilateration Utility for Locating IP hosts) Prepared by: Les Cottrell SLAC, Faran Javed NIIT, Shahryar Khan NIIT,Umar Kalim NIIT.
1 Network Measurement Summary ESCC, Feb Joe Metzger ESnet Engineering Group Lawrence Berkeley National Laboratory.
1 Measuring The Digital Divide Prepared by: Les Cottrell SLAC, Shahryar Khan NIIT/SLAC, Jared Greeno SLAC, Qasim Lone NIIT/SLAC Presentation to Princess.
1 Internet End-to-end Monitoring Project - Overview Les Cottrell – SLAC/Stanford University Partially funded by DOE/MICS Field Work Proposal on Internet.
1 SLAC IEPM PingER and BW monitoring & tools PingER Presented by Les Cottrell, SLAC At LBNL, Jan 21,
PerfSONAR-PS Functionality February 11 th 2010, APAN 29 – perfSONAR Workshop Jeff Boote, Assistant Director R&D.
Internet2’s Dynamic Circuit Infrastructure Ciena CoreDirectors OSCARS + DRAGON for dynamic circuit allocation ION.
Xrootd Monitoring and Control Harsh Arora CERN. Setting Up Service  Monalisa Service  Monalisa Repository  Test Xrootd Server  ApMon Module.
1 IEPM/PingER Project Les Cottrell, SLAC DoE 2004 PI Network Research Meeting, FNAL Sep ‘04
TeraPaths: A QoS Enabled Collaborative Data Sharing Infrastructure for Petascale Computing Research The TeraPaths Project Team Usatlas Tier 2 workshop.
EGEE-II INFSO-RI Enabling Grids for E-sciencE End-to-End Service Level Agreement Provisioning and Monitoring for End-to-End QoS.
US LHC Tier-2 Network Performance BCP Mar-3-08 LHC Community Network Performance Recommended BCP Eric Boyd Deputy Technology Officer Internet2.
IETF 62 NSIS WG1 Porgress Report: Metering NSLP (M-NSLP) Georg Carle, Falko Dressler, Changpeng Fan, Ali Fessi, Cornelia Kappler, Andreas Klenk, Juergen.
1 PingER performance to Bangladesh Prepared by Les Cottrell, SLAC for Prof. Hilda Cerdeira May 27, 2004 Partially funded by DOE/MICS Field Work Proposal.
Advanced Network Diagnostic Tools Richard Carlson EVN-NREN workshop.
1 Deploying Measurement Systems in ESnet Joint Techs, Feb Joseph Metzger ESnet Engineering Group Lawrence Berkeley National Laboratory.
Network Monitoring Sebastian Büttrich, NSRC / IT University of Copenhagen Last edit: February 2012, ICTP Trieste
ExamUnion ICND2 V3.0 Exam Cisco ICND2 V3.0 Exam Braindumps Material
Which network parameters are interesting
By Sachin Kumar Korenga & Rochita Thakkallapally
WLCG Network Discussion
Report from WLCG Workshop 2017: WLCG Network Requirements GDB - CERN 12th of July 2017
Les Cottrell & Yee-Ting Li, SLAC
Paola Grosso SLAC October
Troubleshooting Network Communications
Networking for the Future of Science
BOF Discussion: Uploading IEPM-BW data to MonALISA
Network Monitoring System
Using Netflow data for forecasting
The PingER Project: Measuring the Digital Divide
Wide Area Networking at SLAC, Feb ‘03
Connie Logg February 13 and 17, 2005
Chapter 8: Monitoring the Network
Navigating PingER Les Cottrell – SLAC
PingER: An Effort to Quantify the Digital Divide
Network Performance Measurement
SLAC monitoring Web Services
“Detective”: Integrating NDT and E2E piPEs
Locating hosts by TULIP (Trilateration Utility for Locating IP hosts)
The PingER Project: Measuring the Digital Divide
Presentation transcript:

MAGGIE NIIT- SLAC On Going Projects Measurement & Analysis of Global Grid & Internet End to end performance

Team Members SLAC NIIT Les Cottrell Arshad Ali Yee-Ting Li Umar Kalim Asif Shahryar Akbar NIIT Arshad Ali Umar Kalim Adnan Iqbal Faran Javed Fahad Satti Nauman

Projects PingER DataGrid WAN Monitoring Infrastructure (DWMI) Terapaths Monitoring Project Trilateration Utility for Locating IP Addresses Event Detection Event Diagnosis Topology Service for PerfSONAR Network Weather Forecasting Proposals under discussion

Internet Remote Monitoring Host host (typically a server) PingER Methodology >ping remhost Uses ubiquitous ping Remote Host (typically a server) Monitoring host Internet 10 ping request packets each 30 mins Once a Day Ping response packets Data Repository @ SLAC Measure Round Trip Time & Loss

PingER (Sub Projects) SmokePing PingER Integration ViPER - Visualization for PingER AMP PingER Integration PingER Executive Plots PingER Management ICFA/SCIC Report Most of South Asia has good connectivity Greater Coverage Area Min RTTs are decreasing globally For S.Asia Loss decreasing, still far behind others

DataGrid WAN Monitoring Infrastructure (DWMI) Terapaths Monitoring Project fully configurable passive monitoring infrastructure based on netflow records exported from routers data collection and aggregation schemes Flexible reporting infrastructure Traffic In Traffic out

Topology Service for PerfSONAR Measurement Point Service Measurement Archive Service Authentication Service Lookup Service Topology Service Transformation Service

Topology Service for PerfSONAR To archive network topology information needed for the operation of perfSONAR and Visualization tools. Each AS has to maintain its own topology database and publish it to the perfSONAR framework. The ToS will define a topology information data format to allow for an easy processing of topology information. Beside of the current topology, it should contain past and planned network configuration. Each AS should register its ToS with the Lookup Service, so that the topology becomes available to every interested user.

Trilateration Utility for Locating IP Addresses (TULIP) www.slac.stanford.edu/comp/net/wan-mon/tulip/ Java applet (needs Java Webstart) Friendly client, easy vizualization Need landmarks around world Enter target Pings min/avg/max from landmarks to targets Landmarks Target Traceroutes from landmarks to targets

Automated Event Detection Based on IEPM-BW Different Network Monitoring tools (Ping, IPerf, Thrulay, Pathchirp etc) Variety of Metrics (Throughput, RTT, available bandwidth, Traceroutes) Topology (5 Monitoring Hosts, Over 25 Monitored nodes) Different Mechanisms (Holt-winters, Plateau etc) Alerts are Detected Reported through e-mail Stored in database Made available on web

Event Diagnosis Heuristics based approach End-to-end analysis; assume that the problem may not just be from the network Initiate analysis of all available results when an event is detected Search Event DB for each metric checked on each host and used to cross correlate results between Monitoring Hosts or Monitored Nodes Use heuristics defined with a simple summation algorithm to narrow down the location of a fault. Tiered system used to pin-point exact cause of problem. Start from high level to very low level to help locate, identify and verify cause of alert Heuristics based approach

Proposals (under process) To establish a network monitoring infrastructure in Pakistan Next Generation Network Monitoring for Pakistan to join the International perfSONAR project (currently: Europe, US & Brazilian NRENs):