Presentation on theme: "The Datapository Dave Andersen, CMU James Moss, CMU Nick Feamster, Georgia Tech"— Presentation transcript:
The Datapository Dave Andersen, CMU James Moss, CMU Nick Feamster, Georgia Tech http://www.datapository.net/
Overview Two aspects: –Network data repository –Supporting analysis tools and infrastructure Archive of network data –BGP: RouteViews, Abilene, RIPE –ISIS: Abilene –Spam data: Georgia Tech traps, etc. –NetFlow data: Abilene data –Wide-area probing data
Current Status Grabbing lots of data –Public: Abilene (BGP, IS-IS, Config, etc.), Routeviews (BGP updates and tables) –Semi-public: Georgia Tech campus monitoring probes (ping, traceroute, etc.), spam trap data, etc. –Brokered: Abilene NetFlow –Various other private data Mirroring at CMU and Georgia Tech –~ 12 TB at each site Mysql to postgres migration
Datapository Architecture Separate: collection, storage, analysis Collection: abstract type, format, and access method
Export: Formats and Applications Multiple ways to access data –Web Interface –XMLRPC Text-based output Programmatic interface Output to Matlab –Direct Postgres table access –Raw data Applications –Correlation across data streams –Longitudinal studies
Your consent to our cookies if you continue to use this website.