1. Principles in Communication Networks Instractor: Prof. Yuval Shavitt, –Office hours: room 303 s/w eng. bldg., Tue 14:00- 15:00 Prerequisites (דרישות קדם): –Introduction to computer communications (TAU, Technion, BGU) Expectations from students: –probability –Queueing theory basics –Graph theory

2. Course Syllabus (tentative) Internet structure Introduction to switching, router types Use of Gen. Func.: HOL analysis, TCP analysis. Matching algorithms and their analysis CLOS networks: non-blocking theorem, routing algorithms and their analysis Event simulators – introduction Scheduling algorithms: WFQ, W 2 FQ, priorities Distributed algorithms

3. Grade composition Final exam Home assignments (2-3)

4. Routing in the Internet

5. Routing in the Internet is done in three levels: –In LANs in the MAC layer: Spanning tree protocol for Ethernet Transparent bridge. Source routing for token rings Inside autonomous systems (ASes): –RIP, OSPF, IS-IS, (E)IGRP Between ASes: –BGP

6. Autonomous Systems Autonomous Routing Domains: A collection of physical networks glued together using IP, that have a unified administrative routing policy. An AS is an autonomous routing domain that has been assigned a number. RFC 1930: Guidelines for creation, selection, and registration of an Autonomous System … the administration of an AS appears to other ASes to have a single coherent interior routing plan and presents a consistent picture of what networks are reachable through it.

7. Internet Hierarchical Routing Host h2 a b b a a C A B d c A.a A.c C.b B.a c b Host h1 Intra-AS routing within AS A Inter-AS routing between A and B Intra-AS routing within AS B

8. Policy: Inter-AS: admin wants control over how its traffic routed, who routes through its net. Intra-AS: single admin, so no policy decisions needed Scale: hierarchical routing saves table size, reduced update traffic Performance: Intra-AS: can focus on performance Inter-AS: policy may dominate over performance Why different Intra- and Inter-AS routing ?

9. RIP A distance-vector protocol – (distributed Bellman Ford) Developed in the 80s based on a Xerox protocol RIP-2 is now often used due to its simplicity Distance metric: minimum hop

10. OSPF / IS-IS Link state protocol – each node see the entire network map and calculate shortest paths using Dijksrta algorithm. Allows two level of hierarchy Authentication Complex IS-IS gain popularity among large ISPs

11. The structure of the Internet

12. How are routers connected? Why should we care? –While communication protocols will work correctly on ANY topology –….they may not be efficient for some topologies –Knowledge of the topology can aid in optimizing protocols

13. The Internet as a graph Remember: the Internet is a collection of networks called autonomous systems (ASs) The Internet graph: –The AS graph Nodes: ASs, links: AS peering –The router level graph Nodes: routers, links: fibers, cables, MW channels, etc. How does it looks like?

14. Random graphs in Mathematics The Erdös-Rényi model Generation: –create n nodes. –each possible link is added with probability p. Number of links: np If we want to keep the number of links linear, what happen to p as n  ? Poisson distribution

15. The Waxman model Integrating distance with the E-R model Generation –Spread n nodes on a large enough grid. –Pick a link uar and add it with prob. that exponentially decrease with its length –Stop if enough links Heavily used in the 90s

17. 1999 The Faloutsos brothers Measured the Internet AS and router graphs. Mine, she looks different! Notre Dame Looked at complex system graphs: social relationship, actors, neurons, WWW Suggested a dynamic generation model

18. The Faloutsos Graph 1995 Internet router topology 3888 nodes, 5012 edges, =2.57

20. SCIENCE CITATION INDEX (  = 3) Nodes: papers Links: citations (S. Redner, 1998) P(k) ~k -  2212 25 1736 PRL papers (1988) Witten-Sander PRL 1981

21. Sex-web Nodes: people (Females; Males) Links: sexual relationships Liljeros et al. Nature 2001 4781 Swedes; 18-74; 59% response rate.

22. Web power-laws

23. SCALE-FREE NETWORKS (1) The number of nodes (N) is NOT fixed. Networks continuously expand by the addition of new nodes Examples: WWW : addition of new documents Citation : publication of new papers (2) The attachment is NOT uniform. A node is linked with higher probability to a node that already has a large number of links. Examples : WWW : new documents link to well known sites (CNN, YAHOO, NewYork Times, etc) Citation : well cited papers are more likely to be cited again

24. Scale-free model (1) GROWTH : A t every timestep we add a new node with m edges (connected to the nodes already present in the system). (2) PREFERENTIAL ATTACHMENT : The probability Π that a new node will be connected to node i depends on the connectivity k i of that node A.-L.Barabási, R. Albert, Science 286, 509 (1999) P(k) ~k -3

25. The Faloutsos Graph

27. Back to the Internet Understanding its structure and dynamics –help applications (WWW, file sharing) –help improving routing –predict Internet growth So lets look at the data….

28. …Data? The Internet is an engineered system, so someone must know how it is built, no? NO! It is an uncoordinated interconnection of Autonomous Systems (ASes=networks). No central database about Internet structure. Several projects attempt to reveal the structure: Skitter, RouteViews, …

29. The Internet Structure routers

30. The Internet Structure The AS graph

31. Revealing the Internet Structure

34. 30 new links 7 new links NO new links Diminishing return!  Deploying more boxes does not pay-off

35. Revealing the Internet Structure To obtain the ‘ horizontal ’ links we need strong presence in the edge

36. What is DIMES? Distributed Internet measurement and monitoring –Based on software agents downloaded by volunteers Diminishing return? –Software agents  –The cost of the first agent is very high –each additional agent costs almost zero Capabilities –Obtaining Internet maps at all granularity level connectivity, delay, loss, bandwidth, jitter, …. –Tracking the Internet evolution in time –Monitoring the Internet in real time DIMES

37. Distributed System Design: Obtaining the Internet Structure The Internet as a complex system: static and dynamic analysis Correlating the Internet with the World: Geography, Economics, Social Sciences

38. Diminishing Return? [Chen et al 02], [Bradford et al 01]: when you combine more and more points of view the return diminishes very fast What have they missed? –The mass of the tail is significant No. of views

39. Diminishing Return? [Chen et al 02], [Bradford et al 01]: when you combine more and more points of view the return diminishes very fast What have they missed? –The mass of the tail is significant No. of views

40. Diminish … shminimish

41. How many ASes see an edge? Week 18, 2007

42. Challenges It’s a distributed systems: –Measurement traffic looks malicious Flying under the NOC radar screens (Agents cannot measure too much) –Optimize the architecture: Minimize the number of measurements Expedite the discovery rate BUT agents are –Unreliable –Some move around Distributed System complex system real world

43. Agents To be able to use agents wisely we need agents profiles: –Reliablility Daily (seen in 7 of the last 10 days) Weekly (seen in 3 of the last 4 weeks) –Location: Static Bi-homed: where mostly? Mobile: identify home base –Abilities: what type of measurements can it perform? Distributed System complex system real world

44. Agent shavitt Fairly stable measurements from Israel 2 idle weeks Reappear in Spain

46. C:\>tracert www.fer.hr Tracing route to www.fer.hr [161.53.72.111] over a maximum of 30 hops: 1 <1 ms <1 ms <1 ms 192.168.200.254 2 19 ms 20 ms 19 ms vxr.tau.ac.il [132.66.8.10] 3 17 ms 22 ms 20 ms c6509.tau.ac.il [132.66.8.20] 4 21 ms 19 ms 19 ms tel-aviv.tau.ac.il [132.66.4.1] 5 19 ms 23 ms 18 ms gp1-tau-fe.ilan.net.il [128.139.191.70] 6 20 ms 20 ms 20 ms iucc.il1.il.geant.net [62.40.103.69] 7 69 ms 69 ms 69 ms il.it1.it.geant.net [62.40.96.154] 8 82 ms 82 ms 82 ms it.ch1.ch.geant.net [62.40.96.33] 9 101 ms 98 ms 98 ms ch.at1.at.geant.net [62.40.96.1] 10 105 ms 105 ms 105 ms at.hu1.hu.geant.net [62.40.96.178] 11 117 ms 112 ms 113 ms hu.hr1.hr.geant.net [62.40.96.145] 12 113 ms 115 ms 115 ms carnet-gw.hr1.hr.geant.net [62.40.103.218] 13 120 ms 122 ms 123 ms 193.198.228.6 14 114 ms 112 ms 119 ms 193.198.229.10 15 120 ms 119 ms 119 ms 161.53.16.14 16 114 ms 114 ms 113 ms duality.cc.fer.hr [161.53.72.111] Trace complete. Minimum delay of a link Link delay 19 -2 2 2 49 13 16 7 1 7 2 7 -6 Min. 0 19 17 19 18 20 69 82 98 105 112 113 120 112 119 113 Negative delays

47. A delay of a link inside TAU negative delay

48. Auto-Correlation Histogram Why periodic?

49. int gettimeofday(struct timeval* tv, struct timezone *tz) { if(!tv) return -1; struct _timeb timebuffer; _ftime(&timebuffer); tv->tv_sec = timebuffer.time; tv->tv_usec = timebuffer.millitm * 1000 + 500; return 0; } Maybe something wrong with the code? millisecond accuracy translate to  seconds

50. New vs. Old timing routines

51. Auto-Correlation Histogram Why periodic?

52. How to define distance between ASes? Maybe the same as between nodes? The distance between two ASes will be the distance between the two border routers connecting them 20ms 17ms 26ms 40ms 35ms 89ms 79ms 91ms AS 378 AS 1248 AS 701 14ms ?

53. C:\>tracert www.fer.hr Tracing route to www.fer.hr [161.53.72.111] over a maximum of 30 hops: 1 <1 ms <1 ms <1 ms 192.168.200.254 2 19 ms 20 ms 19 ms vxr.tau.ac.il [132.66.8.10] 3 17 ms 22 ms 20 ms c6509.tau.ac.il [132.66.8.20] 4 21 ms 19 ms 19 ms tel-aviv.tau.ac.il [132.66.4.1] 5 19 ms 23 ms 18 ms gp1-tau-fe.ilan.net.il [128.139.191.70] 6 20 ms 20 ms 20 ms iucc.il1.il.geant.net [62.40.103.69] 7 69 ms 69 ms 69 ms il.it1.it.geant.net [62.40.96.154] 8 82 ms 82 ms 82 ms it.ch1.ch.geant.net [62.40.96.33] 9 101 ms 98 ms 98 ms ch.at1.at.geant.net [62.40.96.1] 10 105 ms 105 ms 105 ms at.hu1.hu.geant.net [62.40.96.178] 11 117 ms 112 ms 113 ms hu.hr1.hr.geant.net [62.40.96.145] 12 113 ms 115 ms 115 ms carnet-gw.hr1.hr.geant.net [62.40.103.218] 13 120 ms 122 ms 123 ms 193.198.228.6 14 114 ms 112 ms 119 ms 193.198.229.10 15 120 ms 119 ms 119 ms 161.53.16.14 16 114 ms 114 ms 113 ms duality.cc.fer.hr [161.53.72.111] Trace complete. private network Tel Aviv Uni. ILAN DANTE HR-ZZ CARnet AS378 AS20965 GEANT MACHBA CARnet AS2108 378209652108 from IP to AS routes 2ms

55. Measurements Per Agent Week 4,2008

56. Measurements per Network 500

57. Agents per Network

58. Topology size

59. Topology Increase

60. Sorted by

61. Different Data – Similar View

62. Average Degree

63. Zipf γ

64. Average Betweenness Centrality

65. Average Clustering Coefficient

66. Aus Ger May 2006

67. Degree distribution [Faloutsos99,Lakhina03,Barford01,Chen02] Clustering coefficient [Bar04] Disassociativity [Vespigni] Network motifs (ala Uri Alon) Distributed System complex system real world Static Internet Graph Analysis

68. Degree Distribution k Pr(k) Zipf plot

69. AS map for July 2005 BGP 20585 nodes 45720 edges = 4.44 DIMES 14332 nodes 60134 edges = 8.39 33,862 edges  DIMES has doubled the connectivity 11,858 edges

70. AS map for July 2005 BGP 20585 nodes 45720 edges = 4.44 DIMES 14332 nodes 60134 edges = 8.39 33,862 edges 21,538 in both maps 38,596 new edges 11,858 edges + 81,672 edges > 7.80

72. The Internet as a real world mirror Changes in the world effect the Internet growth To model Internet growth one needs to take into account –Geographic location –Political/caltural biases –Economic development –Human rights issues Distributed System complex system real world

73. Internet and Politics

74. The Internet Structure The AS graph

75. The Internet Structure The AS graph The PoP level graph

76. Internet and the World City connectivity map Correlation between population * wealth and Internet size Correlation between trade and Internet connectivity PoP level map analysis Distributed System complex system real world

77. Vision A Network that optimizes itself: –every device with a measurement module. –How to concert the measurements? –How to aggregate them? –How to analyze them is a hierarchical fashion?

78. DIMES Future DIMES as a leading research tool (6-8M measurements/day) –Data will be available to all –Easy to run distributed experiments Fast deploy cycle –Easy to add new capabilities Plug-ins to improve applications –P2P communication –Web download (FireFox plug-in will be released soon)

79. Current Status Over 7200 users, over 16,000 agents –105 countries –All continents –100s of ASes Weekly –~1400 agents are active –~200 ASes –Over 35,000,000 measurements –~35 countries Data is used world wide

80. Sp Aus Ger June 2005

81. Early 2008

82. Active agents March 2008

83. DIMES Agents in Europe

84. Internet Distance Estimation via Embedding Why embedding? –With O(n) numbers represent O(n 2 ) distances –O(1) distance calculation. –Problems: accuracy, convergence, calc. time BBS [S. & Tankel: Infocom 2003, ToN 2004] –Accurate and fast embedding calculation. –Up to 1000s of nodes Use hyperbolic coordinates [S.& Tankel: Infocom 2004]

85. Internet Distance Estimation Embedding is hard to calculate for very large graphs [100,000s of nodes] Alternative method for large graphs: hierarchical structures –Trees have a large error Use hierarchical clustering with denser graphs as one ascends the hierarchy

86. Top hierarchy from DIMES router level map.

87. Who PI: Yuval Shavitt Ph.D. students: Eran Shir, Tomer Tankel, Amir Shay Master’s student: Galit Hadad, Dima Feldman,.. Programmers: Anat Halpern, Ohad Serfati Undergrads: Roni Ilani, Shay Collaborators: HUJI, ColBud

88. http://www.netdimes.org

89. The effect of publicity

90. The Internet Topology as a Jellyfish  Core: High-degree clique  Shell: adjacent nodes of previous shell, except 1- degree nodes  1-degree nodes: shown hanging  The denser the 1-degree node population the longer the stem Core Shells: 1 2 3