Monitoring backbone networks Manuel ubredu, Valeriu Vraciu – RoEduNet Chiinău, September 9, 2014

Agenda Why ? What ? How ? Tools ? Facts ! E-infrastructure Autumn Workshop, Chisinau, September 8-11, 2014

Why ? A picture is worth a thousand words ! – Frederick R. Barnard, 20 th century E-infrastructure Autumn Workshop, Chisinau, September 8-11, 2014

What to monitor ? Backbone and critical equipment – routers, switches, firewalls, load-balancers, etc Servers and services Values of traffic Error rates Transport network equipment, if available E-infrastructure Autumn Workshop, Chisinau, September 8-11, 2014

How Always use Industry standards for collecting data like:  SNMP  NetFlow v5/v9 and IPFIX E-infrastructure Autumn Workshop, Chisinau, September 8-11, 2014

Tools OSS Software largely available  SNMP based:  NMIS  Cacti  Weathermap  NetFlow based:  NFSEN/NFDUMP Custom software  Maps using free API from Google Maps (CEENGINE VTR)  Maps using different technologies: JS, ActionScript, PHP, SVG, etc (RoEduNet WeatherMap) Proprietary software  For optical network E-infrastructure Autumn Workshop, Chisinau, September 8-11, 2014

Facts for Romanian Education Network ! NMIS:  home: management-system-nmis/  90 routers and 20 switches monitored  Uses SNMP for collection of data  Xen based VPS - 1 x Xeon 2.4Ghz, 1G of memory, 64G of disk  OpenSuSE (64 bits)  Average load of the server – 2-3  3G of disk space for data since 2009 (5 years)  Requires some knowledge of Linux system and services for setup E-infrastructure Autumn Workshop, Chisinau, September 8-11, 2014

NMIS (main page) E-infrastructure Autumn Workshop, Chisinau, September 8-11, 2014

Facts for Romanian Education Network ! Cacti  home:  Uses SNMP for collecting data  Can easily monitor any OID that returns an integer (think about temperature, number of routes, etc)  Easy deployment and small requirements (web server with PHP)  Easy administration using a web interface  Authenticated access, configurable per user views E-infrastructure Autumn Workshop, Chisinau, September 8-11, 2014

Cacti (custom temperature graph) E-infrastructure Autumn Workshop, Chisinau, September 8-11, 2014

Facts for Romanian Education Network ! Weathermap  home: weathermap.com/  Uses RRDs from NMIS  Can be build using only OSS technologies like SVG and JavaScript  Is very flexible and can accommodate all kind of data visualisation  Major downside – requires some programming skills E-infrastructure Autumn Workshop, Chisinau, September 8-11, 2014

RoEduNet Weathermap E-infrastructure Autumn Workshop, Chisinau, September 8-11, 2014

Facts for Romanian Education Network ! Nfsen/nfdump  home:  Uses NetFlow (v5 or v9)  Can have profiles of subset of data (think about graphs by service type or by IP addresses)  Supports plugins (Perl knowledge is required)  Supports alerts based on threshold or deviation from the mean  Major downside – lots of hardware needed on big networks: 1 server for data processing (8 x Xeon E Ghz with 64G of memory) and 22T of storage for 6 month of NetFlow’s exported by 13 core routers (8-12Gbps average traffic). E-infrastructure Autumn Workshop, Chisinau, September 8-11, 2014

Nfsen (main page) E-infrastructure Autumn Workshop, Chisinau, September 8-11, 2014

Facts for Romanian Education Network ! CEENGINE Visual Traceroute  home:  Based on Google Maps  Heavy use of JS and custom web services  Backend and data collector written in Perl E-infrastructure Autumn Workshop, Chisinau, September 8-11, 2014

VTR

Facts for Romanian Education Network ! Custom maps  home: N.A.  Frontend based on JS and HTML5  Backend uses multiple OSS services and technologies:  Lots of data input points: , http, logs, other databases.  PostgreSQL as database server  Perl for data processing  REST API  Low hardware requirements: 1 Xen based VPS with 1 Processor and 4G or memory. E-infrastructure Autumn Workshop, Chisinau, September 8-11, 2014

Project Asgard E-infrastructure Autumn Workshop, Chisinau, September 8-11, 2014

(Extra slide – RoEduNet Optical network management) E-infrastructure Autumn Workshop, Chisinau, September 8-11, 2014

Q ? E-infrastructure Autumn Workshop, Chisinau, September 8-11, 2014