DICE Diagnostic Service Joe Metzger Joint Techs Measurement Working Group January

Slides:



Advertisements
Similar presentations
Research Challenges in the Emerging Hybrid Network World Tom Lehman University of Southern California Information Sciences Institute (USC/ISI)
Advertisements

Circuit Monitoring July 16 th 2011, OGF 32: NMC-WG Jason Zurawski, Internet2 Research Liaison.
Key Multi-domain GÉANT Network Services June 2011.
NORDUnet Nordic infrastructure for Research & Education LHCONE “Point-to-Point Connection Service” Service Definition Jerry Sobieski.
Connect. Communicate. Collaborate Click to edit Master title style MODULE 1: perfSONAR TECHNICAL OVERVIEW.
1 ESnet Network Measurement Current Status Joe Metzger Jan 24th 2008 ESCC meeting Energy Sciences Network Lawrence Berkeley National Laboratory Networking.
ESnet On-demand Secure Circuits and Advance Reservation System (OSCARS) Chin Guok Network Engineering Group Thomas Ndousse Visit February Energy.
Network Performance Measurement Atlas Tier 2 Meeting at BNL December Joe Metzger
IRNC Special Projects: IRIS and DyGIR Eric Boyd, Internet2 October 5, 2011.
1 ESnet Network Measurements ESCC Feb Joe Metzger
Circuit Services - IPTV Christian Todorov Internet2 Fall Member Meeting October 9, 2007.
ESnet Abilene 3+3 Measurements Presented at the Joint Techs Meeting in Columbus July 19 th 2004 Joe Metzger ESnet Network Engineer
Connect communicate collaborate perfSONAR MDM updates: New interface, new possibilities Domenico Vicinanza perfSONAR MDM Product Manager
Internet2 Performance Update Jeff W. Boote Senior Network Software Engineer Internet2.
InterDomain Dynamic Circuit Network Demo Joint Techs - Hawaii Jan 2008 John Vollbrecht, Internet2
1 Measuring Circuit Based Networks Joint Techs Feb Joe Metzger
DataTAG Research and Technological Development for a Transatlantic Grid Abstract Several major international Grid development projects are underway at.
Connect. Communicate. Collaborate Implementing Multi-Domain Monitoring Services for European Research Networks Szymon Trocha, PSNC A. Hanemann, L. Kudarimoti,
Connect communicate collaborate GÉANT3 Services Connectivity and Monitoring Services by and for NRENs Ann Harding, SWITCH TNC 2010.
Connect. Communicate. Collaborate GÉANT2 and the GRID Domenico Vicinanza DANTE EGEE 08 Meeting, Istanbul September 2008.
ASCR/ESnet Network Requirements an Internet2 Perspective 2009 ASCR/ESnet Network Requirements Workshop April 15/16, 2009 Richard Carlson -- Internet2.
NA-MIC National Alliance for Medical Image Computing UCSD: Engineering Core 2 Portal and Grid Infrastructure.
1 Network Measurement Summary ESCC, Feb Joe Metzger ESnet Engineering Group Lawrence Berkeley National Laboratory.
OGF DMNR BoF Dynamic Management of Network Resources Documents available at: Guy Roberts, John Vollbrecht.
Connect. Communicate. Collaborate The authN and authR infrastructure of perfSONAR MDM Ann Arbor, MI, September 2008.
Connect. Communicate. Collaborate perfSONAR MDM Service for LHC OPN Loukik Kudarimoti DANTE.
Building Dynamic Lightpaths in GÉANT Tangui Coulouarn, DeIC E-Infrastructure Autumn Workshop, Chiinău 8 September 2014.
NORDUnet Nordic Infrastructure for Research & Education Workshop Introduction - Finding the Match Lars Fischer LHCONE Workshop CERN, December 2012.
PerfSONAR-PS Functionality February 11 th 2010, APAN 29 – perfSONAR Workshop Jeff Boote, Assistant Director R&D.
Connect. Communicate. Collaborate Operations of Multi Domain Network Services Marian Garcia Vidondo, DANTE COO TNC 2008, Bruges May.
Jeremy Nowell EPCC, University of Edinburgh A Standards Based Alarms Service for Monitoring Federated Networks.
OSCARS Roadmap Chin Guok Feb 6, 2009 Energy Sciences Network Lawrence Berkeley National Laboratory Networking for the Future of.
Connect. Communicate. Collaborate Global On-demand Light Paths – Developing a Global Control Plane R.Krzywania PSNC A.Sevasti GRNET G.Roberts DANTE TERENA.
Internet2 End-to-End Performance Initiative Eric L. Boyd Director of Performance Architecture and Technologies Internet2.
Connect communicate collaborate LHCONE Diagnostic & Monitoring Infrastructure Richard Hughes-Jones DANTE Delivery of Advanced Network Technology to Europe.
SDN and OSCARS how-to Evangelos Chaniotakis Network Engineering Group ESCC Indianapoilis, July 2009 Energy Sciences Network Lawrence Berkeley National.
PerfSONAR JET/LSN Demo Joe Metzger, Network Engineer ESnet Network Engineering Group JET Meeting, Aug 17, 2010.
Connect communicate collaborate Connectivity Services, Autobahn and New Services Domenico Vicinanza, DANTE EGEE’09, Barcelona, 21 st -25 th September 2009.
DICE: Authorizing Dynamic Networks for VOs Jeff W. Boote Senior Network Software Engineer, Internet2 Cándido Rodríguez Montes RedIRIS TNC2009 Malaga, Spain.
IDCP and NSI: Lessons Learned, Deployments and Gap Analysis Chin Guok, Inder Monga OGF 34 Oxford, UK.
Connect communicate collaborate perfSONAR MDM News Domenico Vicinanza DANTE (UK)
Advanced Network Diagnostic Tools Richard Carlson EVN-NREN workshop.
ESnet’s Use of OpenFlow To Facilitate Science Data Mobility Chin Guok Inder Monga, and Eric Pouyoul OGF 36 OpenFlow Workshop Chicago, Il Oct 8, 2012.
Connecting to the new Internet2 Network What to Expect… Steve Cotter Rick Summerhill FMM 2006 / Chicago.
Brookhaven Science Associates U.S. Department of Energy 1 n BNL –8 OSCARS provisioned circuits for ATLAS. Includes CERN primary and secondary to LHCNET,
1 Deploying Measurement Systems in ESnet Joint Techs, Feb Joseph Metzger ESnet Engineering Group Lawrence Berkeley National Laboratory.
1 Network Measurement Challenges LHC E2E Network Research Meeting October 25 th 2006 Joe Metzger Version 1.1.
Internet2 End-to-End Performance Initiative
Path Monitoring Tools Deployment Planning for U.S. T123
GENUS Virtualisation Service for GÉANT and European NRENs
GÉANT Multi-Domain Bandwidth-on-Demand Service
InterDomain Dynamic Circuit Network Demo
Networking for the Future of Science
Robert Szuman – Poznań Supercomputing and Networking Center, Poland
Integration of Network Services Interface version 2 with the JUNOS Space SDK
Network Monitoring and Troubleshooting with perfSONAR MDM
WP7 objectives, achievements and plans
Internet2 Performance Update
Deployment & Advanced Regular Testing Strategies
ESnet Network Measurements ESCC Feb Joe Metzger
Do you need a Detective? Bob Riddle 24 November 2018.
Big-Data around the world
Network Performance Measurement
Interdomain Dynamic Circuits
Performance Measuring & Monitoring
Interoperable Measurement Frameworks: Internet2 E2E piPEs and NLANR Advisor Eric L. Boyd Internet2 17 April 2019.
“Detective”: Integrating NDT and E2E piPEs
Internet2 E2E piPEs Project
OSCARS Roadmap Chin Guok
Presentation transcript:

DICE Diagnostic Service Joe Metzger Joint Techs Measurement Working Group January

Lawrence Berkeley National LaboratoryU.S. Department of Energy | Office of Science Background Each of the DICE collaborators are defining and delivering services to their users. A subset of these services will be a lot more useful for everyone if all of the DICE participants deploy them in an interoperable fashion. A decision was made last winter to add more rigor or structure to our collaborative efforts and focus on a small set of services. Network Diagnostic Service Dynamic Circuit Provisioning Service End user performance portal service

Lawrence Berkeley National LaboratoryU.S. Department of Energy | Office of Science DICE Network Diagnostic Service The DICE Network Diagnostic service is an agreement between Internet2, ESnet, GEANT, Canarie & USLHCnet to deploy, support and use a interoperable subset of perfSONAR network measurement tools across our backbones to simplify diagnosing inter-domain network performance problems. The target user community for these services is the network engineers in our respective NOCs, and the engineers at around a dozen other transit networks selected from European NRENs (coordinated by GEANT) and Gigapops or Regionals (coordinated by Internet2) The measurement services included in the DICE service are intended to be the minimal useful interoperable subset of the measurement services that each domain is offering to their community.

Lawrence Berkeley National LaboratoryU.S. Department of Energy | Office of Science The Diagnostic Service Includes Definitions of the Service Active latency & bandwidth measurement points Historical latency and bandwidth measurement archives Recommended measurement schedules, parameters & limits Service Level Specifications Incident, problem, change management Reporting details Operational Level Agreements Dealing with target availability goals, outage notification, etc AA (very lightweight.) Agreements about Jointly Operated Service Elements

Lawrence Berkeley National LaboratoryU.S. Department of Energy | Office of Science What are we actually ‘deploying’? Bandwidth measurement services 10G* capable measurement points near network borders Regularly scheduled TCP tests between domains 4 tests per day TCP Using Cubic, BIC or another aggressive TCP stack Long enough to get out of slow start (20-30 seconds) Large TCP windows Best effort QOS tags Results will be archived & published via perfSONAR

Lawrence Berkeley National LaboratoryU.S. Department of Energy | Office of Science What are we actually ‘deploying’? Latency measurement services Measurement points near domain borders Active one-way tests between domains at 10 pps Archives of historical results Target accuracy of clocks for 1-way tests is better than 1ms. Lookup Service Provides a mechanism to find services Looking Glass Service Standard looking glass to look at current info from routers

Lawrence Berkeley National LaboratoryU.S. Department of Energy | Office of Science And, all business processes to support the services… Provide user interfaces and training to our NOC engineers so they can effectively use these services for diagnosing performance problems Monitoring the services, coordinating outages, responding to failures, supporting users, and all of the other things involved with running a production service.

Lawrence Berkeley National LaboratoryU.S. Department of Energy | Office of Science Primary changes of the deployed ESnet measurement infrastructure to support the DICE Diagnostic Service Change TCP stack used for scheduled bandwidth tests from Reno to a more aggressive stack like BIC or Cubic Configure inter-domain bandwidth tests to use best effort instead of scavenger DSCP Expand the metadata bandwidth measurement points register with the lookup service to include info like TCP stack, interface speed, version numbers, etc. Support invoking bandwidth & latency tests via the XML perfSONAR protocol in addition to the bwctl & owamp protocols used today Deploy a router looking glass

Lawrence Berkeley National LaboratoryU.S. Department of Energy | Office of Science Additional Slides about the DICE Services for ESCC talk.

Lawrence Berkeley National LaboratoryU.S. Department of Energy | Office of Science DICE Dynamic Circuit Service The goal of the dynamic circuit service is to support automatic provisioning of dynamic circuits across multiple domains Primary participants are ESnet, Internet2, GEANT & USLHCnet 5-6 European NRENs participation will be coordinated by GEANT 4-6 Regionals or Gigapops participation will be coordinated by Internet2 Initially using OSCARS & AutoBahn & version 1.1 of the IDC protocol Dynamic circuits will transport VLAN tagged frames Will support monitoring of dynamic circuits The target users of the pilot service will be the NOC engineers in the participating domains.

Lawrence Berkeley National LaboratoryU.S. Department of Energy | Office of Science DICE End User Performance Portal The goals of the performance portal are to educate end users by: Explaining basic concepts about network performance Help them determine if what they want to do is feasible Demonstrating what the network is capable of doing Help them distinguish between good and bad network performance Provide guidance on where to go for help The target community is the non-technical end users. (ie humanities professors, not high energy physicists!)