LAN and WAN Monitoring at SLAC Connie Logg September 21, 2005.

Slides:

Advertisements

Similar presentations

EC workshop on Support to RENs in SE-Africa Session 2 Chair: W. von Rüden, CERN.

Advertisements

COS 461 Fall 1997 Routing COS 461 Fall 1997 Typical Structure.

QoS Solutions Confidential 2010 NetQuality Analyzer and QPerf.

Monitoring the World’s Networks SCIC Monitoring Group (R. Cottrell et al.) Mapping the Digital Divide.

1 Stanford University, SLAC, NIIT and the Digital Divide Prepared by Les Cottrell, SLAC for the NIIT, March 18, 2005.

1 Traceanal: a tool for analyzing and representing traceroutes Les Cottrell, Connie Logg, Ruchi Gupta, Jiri Navratil SLAC, for the E2Epi BOF, Columbus.

1 Internet End-to-end Monitoring Project at SLAC Les Cottrell, Connie Logg, Jerrod Williams, Gary Buhrmaster Site visit to SLAC by DoE program managers.

PingER Management1 Error Reporting Model for Ping End-to-End Reporting (PingER Management)

1 SLAC Internet Measurement Data Les Cottrell, Jerrod Williams, Connie Logg, Paola Grosso SLAC, for the ISMA Workshop, SDSC June,

1 Quantifying the Digital Divide from Within and Without Les Cottrell, SLAC Internet2 Members Meeting SIG on Hard to Reach Network Places, Washington,

MAGGIE NIIT- SLAC On Going Projects Measurement & Analysis of Global Grid & Internet End to end performance.

1 Network Monitoring for SCIC Les Cottrell, SLAC For ICFA meeting September, 2005 Initially funded by DoE Field Work proposal. Currently partially funded.

1 PingER: Methodology, Uses & Results Les Cottrell SLAC, Warren Matthews GATech Extending the Reach of Advanced Networking: Special International Workshop.

LOGO 1 MAGGIE Measurement & Analysis of the Global Grid & Internet End-to-End Performance Monitoring A Research Collaboration by National University of.

1 ICFA/SCIC Network Monitoring Prepared by Les Cottrell, SLAC, for ICFA

Network Monitoring grid network performance measurement, simulation & analysis Presented by Warren Matthews at the Performance.

Reading Report 14 Yin Chen 14 Apr 2004 Reference: Internet Service Performance: Data Analysis and Visualization, Cross-Industry Working Team, July, 2000.

KEK Network Qi Fazhi KEK SW L2/L3 Switch for outside connections Central L2/L3 Switch A Netscreen Firewall Super Sinet Router 10GbE 2 x GbE IDS.

Hands-on Networking Fundamentals

1 Monitoring Internet connectivity of Research and Educational Institutions Les Cottrell – SLAC/Stanford University Prepared for the workshop on “Developing.

Chapter 4: Managing LAN Traffic

Unit 4, Lesson 11 How Data Travels the Internet

Quantifying the Digital Divide: A scientific overview of the connectivity of South Asian and African Countries Les Cottrell SLAC, Aziz Rehmatullah NIIT,

1 Quantifying the Digital Divide from Within and Without Les Cottrell, SLAC International ICFA Workshop on HEP Networking, Grid and Digital Divide Issues.

1 Using Netflow data for forecasting Les Cottrell SLAC and Fawad Nazir NIIT, Presented at the CHEP06 Meeting, Mumbai India, February

DataGrid Wide Area Network Monitoring Infrastructure (DWMI) Connie Logg February 13-17, 2005.

Measurement & Analysis of Global Grid & Internet End to end performance (MAGGIE) Network Performance Measurement.

1 Overview of IEPM-BW - Bandwidth Testing of Bulk Data Transfer Tools Connie Logg & Les Cottrell – SLAC/Stanford University Presented at the Internet 2.

IEPM-BW: Bandwidth Change Detection and Traceroute Analysis and Visualization Connie Logg, Joint Techs Workshop February 4-9, 2006.

1 The PingER Project: Measuring the Digital Divide PingER Presented by Les Cottrell, SLAC At the SIS Show Palexpo/Geneva December 2003.

1 Quantifying the Digital Divide from Within and Without Les Cottrell, SLAC International ICFA Workshop on HEP Networking, Grid and Digital Divide Issues.

1 Quantifying the Digital Divide Les Cottrell – SLAC Prepared for the ICFA-SCIC video meeting, May 2003

1 Network Monitoring for SCIC Les Cottrell, SLAC ICFA/SCIC meeting August 24, aug05.ppt Initially.

1 Measurements of Internet performance for NIIT, Pakistan Jan – Feb 2004 PingER From Les Cottrell, SLAC For presentation by Prof. Arshad Ali, NIIT.

1 Network Measurement Summary ESCC, Feb Joe Metzger ESnet Engineering Group Lawrence Berkeley National Laboratory.

1 Measuring The Digital Divide Prepared by: Les Cottrell SLAC, Shahryar Khan NIIT/SLAC, Jared Greeno SLAC, Qasim Lone NIIT/SLAC Presentation to Princess.

1 Quantifying the Digital Divide: focus Africa Prepared by Les Cottrell, SLAC for the NSF IRNC meeting, March 11,

IEPM. Warren Matthews (SLAC) Presented at the ESCC Meeting Miami, FL, February 2003.

Quantifying the need for Improved Network Performance for S. Asia Prepared by: Les Cottrell SLAC & Shahryar Khan NIIT For the Internet2 Special Interest.

McGraw-Hill©The McGraw-Hill Companies, Inc., 2004 Connecting Devices CORPORATE INSTITUTE OF SCIENCE & TECHNOLOGY, BHOPAL Department of Electronics and.

1 IEPM/PingER Project Les Cottrell, SLAC DoE 2004 PI Network Research Meeting, FNAL Sep ‘04

1 Distributed Monitoring CERNET's experience Xing Li

ICFA Standing Committee on Interregional Connectivity (SCIC) ICFA Standing Committee on Interregional Connectivity (SCIC) Harvey B. Newman Harvey B. Newman.

Internet Connectivity and Performance for the HEP Community. Presented at HEPNT-HEPiX, October 6, 1999 by Warren Matthews Funded by DOE/MICS Internet End-to-end.

Digital Divide and PingER Prepared by Les Cottrell for the ICFA meeting, August 15, aug03.html Partially.

Internet2 Spring Members Meeting, Arlington, VA, April 9-11, Quantifying the Digital Divide Warren Matthews, Les Cottrell (SLAC), Enrique Cannessa,

La Rural La Rural 1.Africa, 2001, ICTs and rural radio 2.Latin America, 2004, La Onda Rural 3.What has happened since Quito.

Confidential Rapid Troubleshooting for Data, VoIP, and Video VoIP Performance Manager.

1 PingER performance to Bangladesh Prepared by Les Cottrell, SLAC for Prof. Hilda Cerdeira May 27, 2004 Partially funded by DOE/MICS Field Work Proposal.

1 WAN Monitoring Prepared by Les Cottrell, SLAC, for the Joint Engineering Taskforce Roadmap Workshop JLab April 13-15,

1 IEPM / PingER project & PPDG Les Cottrell – SLAC Presented at the NGI workshop, Berkeley, 7/21/99 Partially funded by DOE/MICS Field Work Proposal on.

1 Quantifying the Digital Divide Prepared by Les Cottrell, SLAC for the Internet2/World Bank meeting, Feb 7,

BOF Discussion: Uploading IEPM-BW data to MonALISA Connie Logg SLAC Winter 2006 ESCC/Internet2 Joint Techs Workshop ESCCInternet2ESCCInternet2 February.

1 PingER6 Preliminary PingER Monitoring Results from the 6Bone/6REN. Warren Matthews Les Cottrell.

Pinger and IEPM-BW activity at FNAL By Frank Nagy FTP/CCF Computing Division Fermilab.

1 Deploying Measurement Systems in ESnet Joint Techs, Feb Joseph Metzger ESnet Engineering Group Lawrence Berkeley National Laboratory.

Toward a Measurement Infrastructure. Warren Matthews (SLAC) Presented at the e2e Workshop Miami, FL, February 2003.

End to end Internet Performance today

End to end Internet Performance today

Using Netflow data for forecasting

The PingER Project: Measuring the Digital Divide

Wide Area Networking at SLAC, Feb ‘03

Digital Divide and PingER

Connie Logg February 13 and 17, 2005

PingER: An Effort to Quantify the Digital Divide

Advanced Networking Collaborations at SLAC

IEPM. Warren Matthews (SLAC)

MAGGIE NIIT- SLAC On Going Projects

Quantifying the Global Digital Divide

The PingER Project: Measuring the Digital Divide

Presentation transcript:

LAN and WAN Monitoring at SLAC Connie Logg September 21, 2005

4 Main Areas LAN Internet Traffic Monitoring via Netflow –Traffic types and quantity –primary sources & destinations WAN Performance Testing and Analysis PINGER

LAN Monitoring “model” the network to understand connectivity I/O byte/packet counts, errors, discards, broadcast and multicast stats for all the active connections on the SLAC network Each connection has its own web pagepage Allocation of endpoints and address space – summary pagepage

Internet Traffic Monitoring Analyze Netflow records to determine Types of traffic – Daily summary pagepage Major external and internal sources of traffic

WAN Performance Measurement and Analysis IEPM-BW (since 2001) – distributed to (CERN, CALTECH, BNL, NIIT, FNAL & SLAC) Runs periodic probes to defined targets around the world – low bandwidth links only run traceroute and ping traceroute reports are generated of the performance seenreports Data from monitoring is analyzed for anomalies ( alerts generated)

Alert Report Example From: Connie Logg Sent: Saturday, September 17, :45 PM To: Logg, Connie A.; Cottrell, Les; Nazir, Fawad Subject: iepm-bw.slac.stanford.edu Alert: (node1.dl.ac.uk,tlaytcp) Traceroute Summary Table for TodaySummary node1.dl.ac.uk BANDWIDTH DROPDROP Date: 09/16/2005, Time = 23:34:24, %drop=97.9, Past (mean, stdev) = (37.9, 16.1) Trigger (mean,stdev) = (0.8,0.2) Graph of all the datadata Additional Information for Node= node1.dl.ac.uk, probetype = tlaytcp At epoch time = , 09/16/ :34:24

PINGER Started in 1992 – to check connectivity with our collaborators With DOE funding it was developed further and extended to monitoring the world In heavy use today (30 monitoring nodes) Total: 3665 pairs to 1010 remote nodes at 726 sites in 123 countries (8/05) Very useful for monitoring the digital divide and baselining connectivity around the world

World “Quality” S.E. Europe, Russia: catching up Latin Am., Mid East, China: keeping up India, Africa: falling behind C. Asia, Russia, S.E. Europe, L. America, M. East, China: 4- 5 yrs behind India, Africa: 7 yrs behind Important for policy makers Many institutes in developing world have less performance than a household in N. America or Europe

Additional Information LAN –Quick Guide (links not visible outside of SLAC)Quick Guide Internet Traffic –Netflow AnalysisNetflow Analysis IEPM-BW WAN Monitoring –ReportReport PINGER –Network Monitoring for SCICNetwork Monitoring for SCIC