1. a a secure peering. RIB table dump by attributes in order to save space. References 1. RouteViews, http://www.routeviews.org/ 2. RIPE, http://www.ripe.net/ris 3. M. Welsh, D. Culler, and E. Brewer. SEDA: An Architecture for Well- Conditioned, Scalable Internet Services. In the Proceedings of the 18th Symposium on Operation Systems Principles, October 2001. BGP Data Collection BGP Monitoring System (BGPMon) Our Solution BGPMon Architecture Data in XML Ongoing and future work BGPMon functionalities: 1) collects ALL information receive from BGP routers by peering with them, 2) labels BGP updates, 3) provides customizable BGP data to end users or other BGPMons in XML format, and 4) periodically logs the data. The system adopts a modular event-driven design; the data is shared among modules in a producer and consumer way. Record data in a both human and machine readable format by increasing affordable storage space XML is a common interface to other applications. Various existing tools can be used to process data. Easy to add new feature by simply insert a new tag. BGPMon Composition The BGPMon is chainable: Each BGPMon can provide or send data to other BGPMons. The root BGPMon is able to monitor large number of BGP routers through consolidating feeds from regions Address handling of RIB table contents when peer session lost. Integrate with PHAS, share with NetViews team FormatRaw (Bytes)/MRT sizeCompressed/MRT size XML15,606,6167.7243,4051.46 bgpdump5,742,0392.8243,1071.46 MRT2,024,6141.0167,0501.00 updates BGP Peer Session Collectors Central Server BGP data ISP BGP Routers AS ribs Hundreds of peers Millions of updates per day per peer More than 200,000 entries in each peer’s rib Hundreds of peers Millions of updates per day per peer More than 200,000 entries in each peer’s rib 2007-03-22T19:00:07Z 65001 129.82.138.4 65009 129.82.47.109 1 0 65001 14041 3356 22351 129.82.138.4 82.206.163/24 Main Challenges BGP data is an essential resource for researchers and operators in Internet routing. BGP data collection systems passively collect BGP data from Internet BGP routers. BGP data collection system samples: RouteViews and RIPE. 40 publications cite RouteViews [CiteSeer]. 615 documents list RouteViews as references [Google Scholar]. BGP data is an essential resource for researchers and operators in Internet routing. BGP data collection systems passively collect BGP data from Internet BGP routers. BGP data collection system samples: RouteViews and RIPE. 40 publications cite RouteViews [CiteSeer]. 615 documents list RouteViews as references [Google Scholar]. Users Collection system: RouteViews/RIPE BGP data is large! Improve the current infrastructure Improve the current infrastructure -- introduce fewer measurement artifacts (lack of reset messages, inability to clearly identify table transfers, peering session failures etc) Scale the monitoring system Scale the monitoring system -- be able to peer with more routers Add real-time access to data Add real-time access to data over current delay of hours Support for protocol changes and features Support for protocol changes and features -- secure peering, new BGP attributes, etc. Better organize the resulting data Better organize the resulting data for long term storage and ease of use by researchers Improve the current infrastructure Improve the current infrastructure -- introduce fewer measurement artifacts (lack of reset messages, inability to clearly identify table transfers, peering session failures etc) Scale the monitoring system Scale the monitoring system -- be able to peer with more routers Add real-time access to data Add real-time access to data over current delay of hours Support for protocol changes and features Support for protocol changes and features -- secure peering, new BGP attributes, etc. Better organize the resulting data Better organize the resulting data for long term storage and ease of use by researchers Design a lightweight software Design a lightweight software focus on accurately and reliably collecting and storing BGP data ( no forwarding tables, route announcements etc) Provide chainable feature Provide chainable feature to support regional deployment and scalability Allow users directly connect to system Allow users directly connect to system to get real-time data for specific peers and/or prefixes Log data in an extendable and human-readable XML format Log data in an extendable and human-readable XML format to easily support new BGP attributes. Label BGP data and organize it into a single file for each peer’s daily data. Label BGP data and organize it into a single file for each peer’s daily data to facilitate researcher. Design a lightweight software Design a lightweight software focus on accurately and reliably collecting and storing BGP data ( no forwarding tables, route announcements etc) Provide chainable feature Provide chainable feature to support regional deployment and scalability Allow users directly connect to system Allow users directly connect to system to get real-time data for specific peers and/or prefixes Log data in an extendable and human-readable XML format Log data in an extendable and human-readable XML format to easily support new BGP attributes. Label BGP data and organize it into a single file for each peer’s daily data. Label BGP data and organize it into a single file for each peer’s daily data to facilitate researcher. Yan Chen, He Yan, Dave Matthews, Dan Massey (Colorado State University) Lan Wang (University of Memphis) Lixia Zhang (UCLA) http://netsec.colostate.edu/bgpmonitor Comparing the sizes of 15 minutes’ BGP updates in various formats