1. Author : Takatoshi Ikeda
Date : 2010/09/02
Advisor : Quincy Wu
Speaker : Ya-Ling Wang
Author : Takatoshi Ikeda
perfSONAR是介於效能監控與視覺化應用程式之間，運作於中間層 (Intermediate Layer)，這一層為通訊協定主要在處理數個網路間效能測量的交換。

2. Abbreviation perfSONAR APAN-JP JGN2plus NOCs
Performance focused Service Oriented Network monitoring Architecture
APAN-JP
Asia-Pacific Advanced Network in Japan
JGN2plus
Japan Gigabit Network 2 plus
NOCs
Network Operation Centers
perfSONAR
目的在於幫助網路管理者找出影響網路效能的原因並解決問題，即使跨越不同網域 (Multi-Domain) 時，仍能輕易的解決點對點的網路效能問題，保證網路使用者能夠擁有高品質、高效能的網路。
APAN-JP 亞太高級網路
JGN2plus 日本先進的研究和開發測試網路
NOC 網路營運中心

3. Abbreviation SNMP CPAN ESnet OGF Simple Network Management Protocol
Comprehensive Perl Archive Network
ESnet
Energy Sciences Network
OGF
Open Grid Forum
SNMP 簡單網路管理協議，該協定能夠支援網路管理系統，用以監測連線到網路上的裝置是否有任何引起管理上注意的情況。
CPAN Perl 綜合檔案網，它包含了極多用Perl寫成的軟體和其文件。 CPAN亦是一支Perl程式的名字，其作用是讓使用者容易從CPAN下載、安裝、更新及管理其他在CPAN上的Perl程式。
OGF 開放網格論壇是一個開放的社會論壇，以推動快速發展和通過應用分佈式計算。透過公開論壇，以建立社區，探討發展趨勢，交流最佳做法和鞏固這些最佳做法納入標準。 (分佈式計算是至關重要的應用開發新的，創新性和可擴展的應用和基礎設施所必需的生產力，企業和科學界內。 )

4. Deployment Experiences on APAN-JP and JGN2plus
Takatoshi Ikeda
APAN-JP, NICT, KDDI R&D Labs
I’m Takatoshi Ikeda. I deploy the perfSONAR to both APAN-JP and JGN2plus networks.
Today, I’d like to talk about Deployment Experiences on APAN-JP and JGN2plus
Network Engineering Workshop
APAN-30th Meeting in Hanoi
12, Aug

5. Network Engineering Workshop, APAN-30th Meeting
Contents
Overview
APAN-JP and JGN2plus deployment
Deployment experiences
Considerations and issues
Future work
Available perfSONAR data (short demo)
This is the contents of my talk.
First, I’d like to explain the overview of the perfSONAR.
- I’d like introduce APAN-JP and JGN2 plus deployment status quickly.
- I’d like to show the available perfSONAR data and how it works.
Talk about my deployment experience
Finally, issues and future work. 2
Network Engineering Workshop, APAN-30th Meeting

6. Overview

7. Network Engineering Workshop, APAN-30th Meeting
I think you must have this kind of experience during troubleshooting on end-to-end performance problems.
Some researchers perform their experiment over multi-domain network.
However, they have a end-to-end performance problems.
Researcher make an inquiry for the investigation to the NOC.
NOC investigates own network. Then, if, there is no problems in the own network, they make an inquiry to another NOC.
If another NOC replay that there is no problems, they prepare and coordinate to do the measurement with another NOC.
Finally, they can do the measurement and identify the cause of the problems.
If the problems is resolved, it is great but it takes much time.
If there is big time difference, it takes several days to resolve it.
In order to improve this situation, perfSONAR is developing.. 4
Network Engineering Workshop, APAN-30th Meeting

8. Network Engineering Workshop, APAN-30th Meeting
This slide shows very overview of the perfSONAR.
If I explain the perfSONAR in a single phrase, it’s Interoperable network measurement middleware .
perfSONAR defines 3 layers for the measurement system. Performance tools, measurement infrastructure and analysis & visualization.
Then perfSONAR is located in the middle of these layer and helps to perform the measurement over multi-domain network such as On-demand performance measurement and Monitoring by exchanging the measurement data.
perfSONAR adopt the Service Oriented Architecture. The perfSONAR service are modularized and communicate with Web services-based protocol.
Then, its protocol is well-defined.
perfSONAR determine SOAP message for communication between server and client XML formats for encoding the measurement data.
It’s standardized in OGF Working group.
Currently, there are 2 implementations.
One is perfSONAR-PS developed by US folks, another one is perfSONAR-MDM developed by EU folks 5
Network Engineering Workshop, APAN-30th Meeting

9. Network Engineering Workshop, APAN-30th Meeting
By using perfSONAR, previous troubleshooting procedure is changed like this.
When NOC get an inquiry from researcher, they can get the measurement data from perfSONAR of both network and investigate the problem at same time.
Also, if they want to do the performance measurement, they can do it through the perfSONAR.
If there is no problem in their network, they can make an exact inquiry to other NOC.
By doing investigate your self as much as you can, it makes easier and faster to solve the problem.
This is one of the advantage of the perfSONAR. 6
Network Engineering Workshop, APAN-30th Meeting

10. Deployment experiences
From now, I’ll talk a bit about my deployment experiences
Network Engineering Workshop, APAN-30th Meeting

11. Installation Quite easy !! to: Documents may not be sufficient
Install and upgrade perfSONAR-PS by yum
Build perfSONAR node by pS-Performance Toolkit
Documents may not be sufficient
Installation report based on my experience – Step-by-Step instruction
It’s quite easy to Install and upgrade perfSONAR-PS by yum, package management repository of Linux.
Also, easy to build perfSONAR node by pS-Performance Toolkit, which is live CD of linux include all perfSONAR packages.
However, documents may not be sufficient for the people who are not familiar with UNIX system.
So, I wrote Installation report based on my experience. It’s step-by-Step instruction
It’s available 9
Network Engineering Workshop, APAN-30th Meeting

12. Configuration perfSONAR-PS packages Hosts and measurement tools
Almost default configuration
Need to modify for your environment
Host information, measurement type (star, mesh)
APAN-JP’s configuration is available as a sample
Hosts and measurement tools
Not difficult. Need a little know-how
TCP parameters, NTP setting, combination of measurement port and firewall
Require a little care about authentication/authorization of measurement
AES key for the measurement
Authorization
who can do TCP and UDP measurement, who can only do TCP and so on
It’s not difficult to cinfigure for the perfSONAR-PS packages, it’s almost default configuration.
You just need to modify it for your environment,
And I thought sample configuration is helpful for everyone, so I’ll upload APAN-JP configuration as a sample
Hosts and measurement tools
It’s not difficult as well but need a little know-how, TCP parameters, NTP setting, combination of measurement port and firewall
It Require a little care about authentication/authorization of measurement
For the delay and throughput measurement, exchange the AES Key and configure the authorization feature. 10
Network Engineering Workshop, APAN-30th Meeting

13. Lessons in measurement
Multi-path over L2 network
require some considerations due to STP
Assign different VLAN ID for each path and create VLAN tag Interface on the measurement host
Maximum bandwidth
How much bandwidth is allowable for the measurement?
Using 10% but no complaint except in events
Precise time source
Precise NTP time source for delay measurement – Even a little error, it’s a considerable impact in the small country
Regarding to actual measurement.
There are 3 considerable things for the measurement.
In order to do measurement on multi-path over L2 network, it’s require some consideration due to STP.
If there is a ring configuration in the L2 network, as you know the some link is blocked by STP so I can not do the measurement on that link. To avoid this, I assigned different VLAN ID for each path and create VLAN tag Interface on the measurement host.
Another one is maximum bandwidth for the measurement.
We should consider how much bandwidth I can allocate for the measurement. Currently, I use 10% of the link bandwidth. I do not get the any complaint so far except in events
Also, we should consider Precise time source. Precise NTP time source for delay measurement Even little error, it’s a considerable impact in the small country.
As you know Japan is small so error should be sub-milisecond. 11
Network Engineering Workshop, APAN-30th Meeting

14. Considerations and issues
Up to this, current deployment status.
From now, I’ll talk about my experiences and considerations on deployment.
Network Engineering Workshop, APAN-30th Meeting

15. Considerations and issues
Further deployment
Documents
Documents for installation and configuration
I’ll update and write the documents based on my experiments as much as possible
Best common practice
Common scenario for practical use
Equipments
Extra equipments for the measurement are necessary
It’s nice if the perfSONAR is bundled to the router
Cisco AXP
Juniper SDK
This is my considerations and issues.
I have 2 things. One is further deployment, another one is active use.
I think there are 2 issues for the further deployment.
First one is document. Currently, there are few documents for installation and configuration and best common practice.
So, I think many engineers does not know how to utilized it.
I’d like to write the documents based on my experiences as much as possible.
Another one is Equipments, in order to deploy the perfSONAR, Extra equipments for the measurement are necessary. So, if the perfSONAR is bundled to the router, it’s so nice.
Currently, Internet2 guys work with Cisco to implement perfSONAR package into Cisco AXP router.
Regarding to active use,
I deploy the perfSONAR into network so it’s time to use it.
I think there are 2 scenario to use perfSONAR.
First one is for operation, second one is for research.
For the operation, useful operational tools and new service for operation are necessary.
For the research, we must find the possible research projects for active use and work with them.
Also User-friendly API. Currently, US folks develop the new API
That is my considerations,. 13
Network Engineering Workshop, APAN-30th Meeting

16. Considerations and issues
Active use
Operation
Useful operational tools
New service for operation
Research
Find the possible research projects for active use
User-friendly API
This is my considerations and issues.
I have 2 things. One is further deployment, another one is active use.
I think there are 2 issues for the further deployment.
First one is document. Currently, there are few documents for installation and configuration and best common practice.
So, I think many engineers does not know how to utilized it.
I’d like to write the documents based on my experiences as much as possible.
Another one is Equipments, in order to deploy the perfSONAR, Extra equipments for the measurement are necessary. So, if the perfSONAR is bundled to the router, it’s so nice.
Currently, Internet2 guys work with Cisco to implement perfSONAR package into Cisco AXP router.
Regarding to active use,
I deploy the perfSONAR into network so it’s time to use it.
I think there are 2 scenario to use perfSONAR.
First one is for operation, second one is for research.
For the operation, useful operational tools and new service for operation are necessary.
For the research, we must find the possible research projects for active use and work with them.
Also User-friendly API. Currently, US folks develop the new API
That is my considerations,. 13
Network Engineering Workshop, APAN-30th Meeting

17. Future Work 14 This is the future work.
I’m working to deploy the perfSONAR into APAN-JP and JGN2plus so far.
From now on, I’d like to utilize this environment.
I have 3 things for the future work.
First, I’d like to improve visibility. Currently, many people does not know what data is available on the perfSONAR or what we can do by using perfSONAR. So, I’d like many people to see the perfSONAR data. For this matter, I’m going to Create web portal for the perfSONAR data and develop the visualization application such as Weather MAP on Google Earth
Second one is Active use in operation and research. In order to use in the real operation and research, I’m going to Deploy the operational tools and use it for the trouble shooting of end-to-end performance problems and find the research projects and work together to use the perfSONAR
Last one is Encourage deployment is AP region. Deploying to many networks increase the value of perfSONAR. So, I’m willing to Support international partners to install and start to do the measurement with international partners 14
Network Engineering Workshop, APAN-30th Meeting

19. Reference perfSONAR perfSONAR-Wiki perfSONAR-PS APAN-JP perfSONAR OGF
perfSONAR-Wiki
perfSONAR-PS
APAN-JP perfSONAR
OGF
NM-WG
NML-WG 15
Network Engineering Workshop, APAN-30th Meeting

21. Data View APAN APAN Traffic Weather MAP
APAN
Lookup Service
Interface Usage
Throughput
Delay
APAN Traffic Weather MAP
This is a hyperlink of the data view.
In this time, I’ll show you later. 22
Network Engineering Workshop, APAN-30th Meeting

22. Network Configuration

23. Network Configuration

24. Thank you for your listening! Q&A