NLANR/MNA Current Activities

Slides:



Advertisements
Similar presentations
INDIANAUNIVERSITYINDIANAUNIVERSITY HPIIS Performance Review October 25, 2000 Jim Williams.
Advertisements

Surveyor IP Performance Measurements Matt Zekauskas June, 1999 NLANR/I2 Joint Techs.
University of Illinois at Chicago Annual Update Thomas A. DeFanti Principal Investigator, STAR TAP Director, Electronic Visualization Laboratory.
February 2002 Global Terabit Research Network: Building Global Cyber Infrastructure Michael A. McRobbie Vice President for Information Technology & CIO.
Ronn Ritke Tony McGregor NLANR/MNA (UCSD/SDSC) Funded by the National Science Foundation/CISE/SCI cooperative agreement no. ANI
4 February 2014 Internet2 Liaison Report APAN Member Meeting Heather Boyles.
Kento Aida, Tokyo Institute of Technology Grid Working Group Meeting Aug. 27 th, 2003 Tokyo Institute of Technology Kento Aida.
Ronn Ritke Tony McGregor NLANR/MNA (UCSD/SDSC) Funded by the National Science Foundation/CISE/SCI cooperative agreement no. ANI
Slides Please send to Arun
Active Measurement Project on KREONET & APAN Manhee Lee Supercomputing Center Korea Institute of Science & Technology Information.
Network Measurements Session Introduction Joe Metzger Network Engineering Group ESnet Eric Boyd Deputy Technology Officer Internet2 July Joint.
1 In VINI Veritas: Realistic and Controlled Network Experimentation Jennifer Rexford with Andy Bavier, Nick Feamster, Mark Huang, and Larry Peterson
Hans-Werner Braun Ronn Ritke NLANR/MNA (UCSD/SDSC) Funded by the National Science Foundation/CISE/ANIR NLANR/MNA Measurement and.
14 July 2000TWIST George Brett NLANR Distributed Applications Support Team (NCSA/UIUC)
EInfrastructures (Internet and Grids) - 15 April 2004 Sharing ICT Resources – “Think Globally, Act Locally” A point-of-view from the United States Mary.
IP Performance Measurements using Surveyor Matt Zekauskas Guy Almes, Sunil Kalidindi August, 1998 ISMA 98.
1 Int System Introduction to Systems and Networking Department Faculty of Computer Science and Engineering Ho Chi Minh City University of Technology.
Network, Operations and Security Area Tony Rimovsky NOS Area Director
JLN Information Technology Track: Collaborating Across Countries for Health Insurance Information Systems An example of using a network and common tools.
Active Measurement Project for KREONET & APAN Manhee Lee KISTI/Supercomputing Center
1 Association of Pacific Rim Universities Dr Lawrence Loh Secretary General Association of Pacific Rim Universities 22 March, nd.
Global High Performance Networks N+I Tokyo’98 Session Chair : Kilnam Chon Speakers : George Strawn / NSF US Next Generation Internet Projects.
Research on design and implementation of Internet measurement infrastructure Lv Jun Aug 28, 2003.
Department of Health and Human Services National Institutes of Health National Center for Research Resources Division of Research Infrastructure Extending.
An introduction to the group and its projects Tony McGregor
PPDG and ATLAS Particle Physics Data Grid Ed May - ANL ATLAS Software Week LBNL May 12, 2000.
Internet2 Middleware Initiative. Discussion Outline  What is Middleware why is it important why is it hard  What are the major components of middleware.
9 January 2004 Advisory Panel on Computer Networking 1 NATO Science Programme Security Through Science NATO Science Programme Security Through Science.
1 - GEC8, San Diego, July 20-22, 2010 Measurement Tools in PlanetLab Europe Tanja Zseby (Fraunhofer FOKUS, Berlin, Germany) (some slides from other OneLab.
Russ Hobby Program Manager Internet2 Cyberinfrastructure Architect UC Davis.
1 Network Measurement Summary ESCC, Feb Joe Metzger ESnet Engineering Group Lawrence Berkeley National Laboratory.
Slide 1 Defining and Understanding Campus Policies associated with Integrating a Science DMZ into the Campus Environment Moderator: Wendy Huntoon, KINBER.
Connecting Advanced Networks in Asia-Pacific Kilnam Chon APAN Focusing on Applications -
3 December 2015 Examples of partnerships and collaborations from the Internet2 experience Interworking2004 Ottawa, Canada Heather Boyles, Internet2
Pacific Rim Application and Grid Middleware Assembly: PRAGMA A community building collaborations and advancing grid-based applications Peter Arzberger,
Breakout # 1 – Data Collecting and Making It Available Data definition “ Any information that [environmental] researchers need to accomplish their tasks”
August 3, March, The AC3 GRID An investment in the future of Atlantic Canadian R&D Infrastructure Dr. Virendra C. Bhavsar UNB, Fredericton.
STAR TAP, Euro-Link, and StarLight Tom DeFanti April 8, 2003.
Ronn Ritke Tony McGregor NLANR/MNA (UCSD/SDSC) Funded by the National Science Foundation/CISE/SCI cooperative agreement no. ANI
Network, Operations and Security Area Tony Rimovsky NOS Area Director
Thoughts on International e-Science Infrastructure Kevin Thompson U.S. National Science Foundation Office of Cyberinfrastructure iGrid2005 9/27/2005.
Roadmap to Next Generation Internet: Indian Initiatives Subbu C-DAC, India.
Cyberinfrastructure Overview of Demos Townsville, AU 28 – 31 March 2006 CREON/GLEON.
All Hands Meeting 2005 BIRN-CC: Building, Maintaining and Maturing a National Information Infrastructure to Enable and Advance Biomedical Research.
NSF International Research Network Connections (IRNC) Program: TransLight/StarLight Maxine D. Brown and Thomas A. DeFanti Electronic Visualization Laboratory.
Pinger and IEPM-BW activity at FNAL By Frank Nagy FTP/CCF Computing Division Fermilab.
Internet2 Applications & Engineering Ted Hanss Director, Applications Development.
INDIANAUNIVERSITYINDIANAUNIVERSITY IRNC Measurement John Hicks HPCC Engineer Indiana University 18 th APAN Meeting – Cairns 4-July-2004.
1 Network Measurement Challenges LHC E2E Network Research Meeting October 25 th 2006 Joe Metzger Version 1.1.
CIS 375 Bruce R. Maxim UM-Dearborn
The Division includes two lines of effort:
Instructor Materials Chapter 1: LAN Design
Strategies for NIS Development
Measurements on Internet2
Ian Bird GDB Meeting CERN 9 September 2003
Long-term Grid Sustainability
R. Hughes-Jones Manchester
Lessons Learned Through HBD: The Regulator’s View - US FDA
Electrification Products
NLANR/MNA Measurement and Network Analysis
Internet2 and NGN’s Internet 2 The Networks Applications
Internet2 E2E Performance Initiative: NLANR Measurement and Network Analysis Group Ronn Ritke NLANR (UCSD/SDSC)
Optical SIG, SD Telecom Council
NLANR’s Active Measurement Program (AMP)
Advanced Networking Collaborations at SLAC
Update on International Connections and Internet2
Interoperable Measurement Frameworks: Internet2 E2E piPEs and NLANR Advisor Eric L. Boyd Internet2 17 April 2019.
NLANR’s Network Analysis Infrastructure and OCXmon activities
NSF Middleware Initiative
AMP Update and OC192 Monitor
Presentation transcript:

NLANR/MNA Current Activities C:\WINDOWS\Desktop\Temp\NLANR-logo-4ppt.kpg NLANR/MNA Current Activities Hans-Werner Braun Ronn Ritke NLANR/MNA (UCSD/SDSC) http://mna.nlanr.net/ Funded by the National Science Foundation/CISE/SCI cooperative agreement no. ANI-0129677 (2002)

NLANR/MNA The mission of the NLANR Measurement and Network Analysis Group (NLANR/MNA) is to characterize the behavior of high performance connection (HPC) networks. Network measurements are essential for assessing performance issues, identifying and locating problems (malfunctions, bottlenecks, inefficiencies, incompatibilities, etc.) in ultrafast research networks and in high-speed international links.

NLANR/MNA To meet our research goals and support the community, we have created and are continuing to develop a Network Analysis Infrastructure (NAI). Two projects form the core of our research efforts: the Passive Measurement and Analysis (PMA) project the Active Measurement Project (AMP) The NAI includes not only a growing collection of measurement data and multiple analyses, but also tools and methods, avenues for sharing information, and many collaborations (domestic and international) with other researchers both within and outside of the HPC network measurement community.

Passive Measurement and Analysis (PMA) project Led by Joerg Micheel Passive header trace data provides the means to study workload profiles in high speed environments, at measurement points strategically located to provide good overall network coverage. Completely non-invasive, no impact on forwarding paths. Currently take measurements at OC3 through OC48 speeds. Also working towards OC192c instrumentation on the Abilene backbone.

Available PMA Traces PMA Daily Traces Archive (~ 2 GB per day) Many special traces available, such as a variety of OC48 trace data and long, contiguous traces, including: Abilene-I, the first publicly available OC48c backbone trace Auckland-IV, a 45-day continuous trace Bell Labs-I, one-week contiguous Internet access IP header trace Coming soon: Leipzig-I, an illustrated continuous 5-day GPS-synchronized IP header trace NCAR-I, a one-hour trace from our new NCAR Gigabit tap.

New Metrics and Real-Time Analysis for PMA We have developed a link utilization analysis tool. This instantaneous bandwidth/histogram sequence tool uses CDF (cumulative distribution functions) histograms to characterize the distribution of the gaps between packets. A first-phase release of a scalable real-time network sensor has been completed that implements packet length statistics. Current efforts involve the creation of a two site prototype, to be used for testing.

10GigE/OC192 Passive Monitor Interface card Chasis 18 September 2018

Active Measurement Project (AMP) Led by Tony McGregor AMP performs site-to-site active measurements (RTT, topology, and loss) and analyses which enable network researchers and engineers to track problems and/or changes in HPC performance. The monitoring mesh of 150 AMPs allows engineers to quickly identify the location, extent, and duration of network events.

Current AMP Research Activities Moving AMP into new domains: other national meshes, deeper into campuses, more international sites, and a meta measurement system. To facilitate this, NLANR/MNA is reimplementing the original AMP software into a package easily installed on a variety of hardware and software bases. The AMP package will be made freely available, with some limited support given. We will encourage, promote, and manage a meta-measurement system, formed from selected cross-project measurements, creating measurement linkages between projects.

AMP IPMP We have developed a new measurement protocol, the IP Measurement Protocol (IPMP), which allows Internet devices to insert time stamps into packets as they move through the network, creating an "audit trail" for Internet data. In addition to designing and developing the protocol, we are utilizing it in the AMP network measurement mesh and on wireless networks. We have submitted the protocol for standardization by the Internet Engineering Task Force (IETF). http://www.ietf.org/internet-drafts/draft-mcgregor-ipmp-03.txt

Active measurement deployment status UAlaska UWashington Washington State U. Oregon State Montana State MTU UVermont NDSU UWisc- Milwaukee UOregon UWisc SDSMT MSU URochester Dartmouth Iowa State UIowa Startap WSU NTNU UWyoming NWU UMich UMass BU MIT UIC PSU UConn Harvard FNAL Columbia Yale ColoState NCSA CMU/PSC UDel UPenn NCAR UIUC IU UMBC Princeton WVU UCBoulder Kansas State UMd JHU ACCESS UC NSF UMissouri GMU Georgetown UCB UofUtah Stanford UKansas UVirginia ODU SLAC Oklahoma State UCSC WUSTL UTK NCREN/NCSC Vanderbilt UofOklahoma UNC-CH Duke UCLA CSU-SB UC-Irvine ASU NCSU CSUPomona UNM UAH GATech SDSC Mississippi State UofGeorgia UCSD UArizona SMU Emory U. SDSU NMSU UAB UA FSU Rice UFlorida UHawaii UCF USF UMiami UWaikato Active measurement deployment status

Visualization of Slammer worm using NLANR/MNA Cichlid tool

International Collaborations Just as the Internet has expanded into a global network, the more advanced high-speed networks for scientific and academic research in the United States and other countries are also growing and linking up with one another. Many of the challenges that face intra-national high-speed networks are more severe in international networks. Network researchers and system administrators around the world are collaborating with NLANR/MNA researchers by hosting one or more of our AMP monitors and establishing measurement and analysis research projects of their own.

International Collaborations (Cont’d1) We currently have AMP machines in Australia, Brazil, Canada, Finland, Germany, Holland, Hungary, Ireland, Japan, Korea, Mexico, New Zealand, Norway, Taiwan, and Thailand. We are now conducting measurements from the AMP monitor on the NaukaNet link at StarLight to more than 30 sites in Russia. http://amp.nlanr.net/active/amp-naukanetnwu/russia/body.html. Collaborating with the GLORIAD project (http://www.gloriad.org). An NLANR AMP will soon be deployed in Moscow. We are in discussions regarding placing an AMP monitor in Beijing, China.

International Collaborations (Cont’d-2) We are working closely with the Pacific Rim Applications & Grid Middleware Assembly (PRAGMA). Australia and Korea have developed programs in collaboration with NLANR/MNA to create national AMP meshes, to instrument and characterize the performance of their domestic research networks. The KISTI group in Korea has an NLANR AMP machine. Their own AMP mesh currently has 13 sites. http://amp.kreonet2.net/ All seven Australian-owned AMP machines are in place ready for deployment into a mesh. Australia hosts an NLANR AMP in Sydney.