 End to End Performance Initiative Russ Hobby HENP Networking Working Group Meeting, Ann Arbor, Michigan 26 October 2001

Context for E2E Performance Even with high bandwidth network links, the Internet2 community often does not see expected performance.

The Wizard Gap

The E2Epi Mission To enable the researchers, faculty, students and staff who use high performance networks to obtain optimal performance from the current infrastructure on a consistent basis. Raw Connectivity Applications Performance

True End-to-End Experience User perception Application Operating system Host IP stack Host network card Local Area Network Campus backbone network Campus link to regional network/GigaPoP GigaPoP link to Internet2 national backbones International connections EYEBALL APPLICATION STACK JACK NETWORK...

First Steps Workshop in Ann Arbor on 9 January, participants Each participant provided a short paper on “What does E2EPerformance Mean?” Planned agenda was not used in order to respond to more pressing issues from participants. Design team formed to create an overall vision paper.

The Problem Applications Developer System Administrator LAN Administrator Campus Networking Gigapop BackboneCampus Networking LAN Administrator System Administrator Applications Developer How do you solve a problem along a path? Hey, this is not working right! The computer Is working OK Talk to the other guysEverything is AOK No other complaints The network is lightly loaded All the lights are green We don’t see anything wrong Looks fine Others are getting in ok Not our problem 7

Areas of the Initiative Applications Host/OS Tuning Measurement Infrastructure Performance Improvement Environment (PIE) Operations and Human Communications Performance Evaluation and Review Framework (PERF)

Applications Work with specific application communities to help solve their performance problems. High Energy Physics Medical Sciences – Visible Human Project Use a few key, general purpose applications for performance testing. FTP Video Conferencing

Host/OS Tuning Web100 has a leading role Provide Best Practices for getting the most from your computer. Locate or build tools for Host/OS performance diagnostics. Work with computer vendors on Internet2 Performance Packages.

Measurement Infrastructure Bring together current measurement efforts and projects in the community. Establish an End-to-End Measurement Infrastructure from the intersection of these works. Create diagnostic tools to determine the health of the network and locate performance problems.

Standard Operational Info Applications Developer System Administrator LAN Administrator Campus Networking Gigapop BackboneCampus Networking LAN Administrator System Administrator Applications Developer Information from All Parts of the Network Ops Info 12

Standard Operational Info Applications Developer System Administrator LAN Administrator Campus Networking Gigapop BackboneCampus Networking LAN Administrator System Administrator Applications Developer Know the Health of the Network Ops Info End-to-End Analyzer 13

Standard Operational Info Applications Developer System Administrator LAN Administrator Campus Networking Gigapop BackboneCampus Networking LAN Administrator System Administrator Applications Developer Applications Adapt to the Network Ops Info End-to-End Analyzer Apps Tuning 14

Performance Improvement Environment (PIE) Develop a dynamic environment where collaboration and information sharing will happen. Identify, collect and disseminate appropriate information for end-to-end related information. Include success stories,measurement statistics, reference materials, measurement tool documentation. Include pointers to materials already developed by other communities.

E2Epie – Current Status Developing web site content to reflect recommendations of the Design Team and Consultant documents. Actively looking for supporting materials and resources to include in web site. Mail to:

E2Epie – next steps Begin collecting stories. Using interviews and other channels we will begin collecting stories about performance improvement issues. We will work with EDUCAUSE Effective Practices and Solutions database for publishing the E2Epi stories.Effective Practices and Solutions Identify and collect information about projects, resources, and tools. With help of Technical Advisory Group and other E2Epi participants we will make sure to have up-to-date and correct information. Explore resources and tools for collaboration efforts. Discussion forum:

Operations and Human Communications Establish communications among common interest groups System administrators LAN administrators Campus NOCs GigaPoP Application support staff Establish communications between groups for operations and problem resolution.

Groups of Common Interest Applications Developer System Administrator Campus Networking Gigapop BackboneCampus Networking LAN Administrator System Administrator Applications Developer Provide a means of communications Let them share experiences. I don’t know how to solve this problem! I do! LAN Administrator

Find a Solution? Applications Developer System Administrator LAN Administrator Campus Networking Gigapop BackboneCampus Networking LAN Administrator System Administrator Applications Developer A System to Check a Specific Problem Hmm, Time to Check the PIE and Talk to others Performance OK here Throughput OKEverything is Still AOK Not a bottleneck At this point The network is still lightly loaded All the lights are green We don’t see anything wrong Yup. Duplex Does not Agree! It is slow for others too! Ah ha, an Ethernet Duplex problem!

Can You Go Direct to the Problem? How can you tell where is the problem? Need a tool to tell you: Where the problem is. The type of problem Who to contact to get it fixed Terry Gray, University of Washington “We Need a Finger Pointing Tool”

Gray Finger Pointing Tool Applications Developer System Administrator LAN Administrator Campus Networking Gigapop BackboneCampus Networking LAN Administrator System Administrator Applications Developer Locate the Problem Gray Finger Pointing Tool Terry Gray University of Washington Finger Pointing Tool Time!

Gray Finger Pointing Tool Applications Developer System Administrator LAN Administrator Campus Networking Gigapop BackboneCampus Networking LAN Administrator System Administrator Applications Developer Finger Pointing Tool Time You ARE the Weakest Link! OK, I’ll fix it

Performance Evaluation and Review Framework (PERF) Establish a framework for resolving performance problems Provide known solutions by using the PIE Tap community knowledge by facilitating group communications Coordinate a team of experts to solve hard problems

The Hard Problems Applications Developer System Administrator LAN Administrator Campus Networking Gigapop BackboneCampus Networking LAN Administrator System Administrator Applications Developer What if no one has the answer? Hey, Its is not working again! I don’t know what is wrong No clue hereI’m stumpedThis is strange It looks normal here Doh! We can’t figure it out I am Cluefully Challenged Others are getting in ok I don’t know Need a Tiger Team of Experts to Research the Problem

Internet2 Organization Role Staffing Cheryl Munn-Fremon, Initiative Director Russ Hobby, Technical Architect George Brett, Information Architect Lisa Wilberding, Communications Coordinator Terri Saarinen, Program Assistant

Internet2 Organization Role cont’d. Funding Facilitate seeking sources of funding Internet2 will invest about $1.5 million per year Communications coordination Web site Workshops, meeting presentations, …

Anticipated Partners Campuses Faculty and discipline communities GigaPoPs International partners NSF-sponsored engineering efforts NLANR, Web100 Project, Internet2 corporate members Federal labs and agencies

Calls For Participation Identify core applications and services Seek participants in the various work areas Seek stories and best practices Issue later this Fall

Success Criteria Community is involved and integrating what is learned Performance Improvement Environment (E2E pie ) provides satisfactory resources to the community Operational environment meets the needs of application users and supporters End-users understand what to expect and how to get it

For More Information