School of Computer Science Carnegie Mellon Data Mining using Fractals and Power laws Christos Faloutsos Carnegie Mellon University.

Slides:



Advertisements
Similar presentations
1 Dynamics of Real-world Networks Jure Leskovec Machine Learning Department Carnegie Mellon University
Advertisements

Jurij Leskovec, CMU Jon Kleinberg, Cornell Christos Faloutsos, CMU
CMU SCS : Multimedia Databases and Data Mining Lecture #11: Fractals: M-trees and dim. curse (case studies – Part II) C. Faloutsos.
CMU SCS : Multimedia Databases and Data Mining Lecture #10: Fractals - case studies - I C. Faloutsos.
Indexing and Data Mining in Multimedia Databases Christos Faloutsos CMU
CMU SCS : Multimedia Databases and Data Mining Lecture #9: Fractals - introduction C. Faloutsos.
Lecture 21 Network evolution Slides are modified from Jurij Leskovec, Jon Kleinberg and Christos Faloutsos.
CMU SCS : Multimedia Databases and Data Mining Lecture #11: Fractals: M-trees and dim. curse (case studies – Part II) C. Faloutsos.
CMU SCS : Multimedia Databases and Data Mining Lecture #11: Fractals - case studies Part III (regions, quadtrees, knn queries) C. Faloutsos.
CS728 Lecture 5 Generative Graph Models and the Web.
NetMine: Mining Tools for Large Graphs Deepayan Chakrabarti Yiping Zhan Daniel Blandford Christos Faloutsos Guy Blelloch.
Weighted Graphs and Disconnected Components Patterns and a Generator Mary McGlohon, Leman Akoglu, Christos Faloutsos Carnegie Mellon University School.
Social Networks and Graph Mining Christos Faloutsos CMU - MLD.
CMU SCS KDD 2006Leskovec & Faloutsos1 ??. CMU SCS KDD 2006Leskovec & Faloutsos2 Sampling from Large Graphs poster# 305 Jurij (Jure) Leskovec Christos.
CMU SCS APWeb 07(c) 2007, C. Faloutsos 1 Copyright notice Copyright (c) 2007, Christos Faloutsos - all rights preserved. Permission to use all or some.
School of Computer Science Carnegie Mellon Data Mining using Fractals and Power laws Christos Faloutsos Carnegie Mellon University.
1 Complex systems Made of many non-identical elements connected by diverse interactions. NETWORK New York Times Slides: thanks to A-L Barabasi.
CMU SCS Large Graph Mining Christos Faloutsos CMU.
Web as Graph – Empirical Studies The Structure and Dynamics of Networks.
CS Lecture 6 Generative Graph Models Part II.
Indexing and Data Mining in Multimedia Databases Christos Faloutsos CMU
On Power-Law Relationships of the Internet Topology CSCI 780, Fall 2005.
Analysis of the Internet Topology Michalis Faloutsos, U.C. Riverside (PI) Christos Faloutsos, CMU (sub- contract, co-PI) DARPA NMS, no
CMU SCS Bio-informatics, Graph and Stream mining Christos Faloutsos CMU.
CMU SCS Graph and stream mining Christos Faloutsos CMU.
School of Computer Science Carnegie Mellon Boston U., 2005C. Faloutsos1 Data Mining using Fractals and Power laws Christos Faloutsos Carnegie Mellon University.
Carnegie Mellon Powerful Tools for Data Mining Fractals, Power laws, SVD C. Faloutsos Carnegie Mellon University.
CMU SCS Multimedia and Graph mining Christos Faloutsos CMU.
Data Mining using Fractals and Power laws
CMU SCS : Multimedia Databases and Data Mining Lecture #30: Conclusions C. Faloutsos.
CMU SCS Data Mining in Streams and Graphs Christos Faloutsos CMU.
Introduction to Fractals and Fractal Dimension Christos Faloutsos.
CMU SCS : Multimedia Databases and Data Mining Lecture #8: Fractals - introduction C. Faloutsos.
CMU SCS : Multimedia Databases and Data Mining Lecture #8: Fractals - introduction C. Faloutsos.
CMU SCS : Multimedia Databases and Data Mining Lecture #10: Fractals: M-trees and dim. curse (case studies – Part II) C. Faloutsos.
School of Computer Science Carnegie Mellon UIUC 04C. Faloutsos1 Advanced Data Mining Tools: Fractals and Power Laws for Graphs, Streams and Traditional.
CMU SCS : Multimedia Databases and Data Mining Lecture #9: Fractals – examples & algo’s C. Faloutsos.
Weighted Graphs and Disconnected Components Patterns and a Generator IDB Lab 현근수 In KDD 08. Mary McGlohon, Leman Akoglu, Christos Faloutsos.
CMU SCS Large Graph Mining Christos Faloutsos CMU.
Jure Leskovec Computer Science Department Cornell University / Stanford University Joint work with: Jon Kleinberg (Cornell), Christos.
CMU SCS : Multimedia Databases and Data Mining Lecture #12: Fractals - case studies Part III (quadtrees, knn queries) C. Faloutsos.
School of Computer Science Carnegie Mellon Data Mining using Fractals (fractals for fun and profit) Christos Faloutsos Carnegie Mellon University.
School of Computer Science Carnegie Mellon Data Mining using Fractals and Power laws Christos Faloutsos Carnegie Mellon University.
Carnegie Mellon Finding patterns in large, real networks Christos Faloutsos CMU
CMU SCS Finding patterns in large, real networks Christos Faloutsos CMU.
RTM: Laws and a Recursive Generator for Weighted Time-Evolving Graphs Leman Akoglu, Mary McGlohon, Christos Faloutsos Carnegie Mellon University School.
CMU SCS Mining Large Social Networks: Patterns and Anomalies Christos Faloutsos CMU.
School of Computer Science Carnegie Mellon WRIGHT, 2005C. Faloutsos1 Data Mining using Fractals and Power laws Christos Faloutsos Carnegie Mellon University.
1 Patterns of Cascading Behavior in Large Blog Graphs Jure Leskoves, Mary McGlohon, Christos Faloutsos, Natalie Glance, Matthew Hurst SDM 2007 Date:2008/8/21.
Notices of the AMS, September Internet traffic Standard Poisson models don’t capture long-range correlations. Poisson Measured “bursty” on all time.
CMU SCS KDD'09Faloutsos, Miller, Tsourakakis P9-1 Large Graph Mining: Power Tools and a Practitioner’s guide Christos Faloutsos Gary Miller Charalampos.
Carnegie Mellon Data Mining – Research Directions C. Faloutsos CMU
SCS-CMU Data Mining Tools A crash course C. Faloutsos.
Graph Models Class Algorithmic Methods of Data Mining
Next Generation Data Mining Tools: SVD and Fractals
Indexing and Data Mining in Multimedia Databases
NetMine: Mining Tools for Large Graphs
15-826: Multimedia Databases and Data Mining
Finding patterns in large, real networks
Part 1: Graph Mining – patterns
Lecture 13 Network evolution
15-826: Multimedia Databases and Data Mining
15-826: Multimedia Databases and Data Mining
Graph and Tensor Mining for fun and profit
Feifei Li, Ching Chang, George Kollios, Azer Bestavros
15-826: Multimedia Databases and Data Mining
Data Mining using Fractals and Power laws
Lecture 21 Network evolution
Modelling and Searching Networks Lecture 2 – Complex Networks
Presentation transcript:

School of Computer Science Carnegie Mellon Data Mining using Fractals and Power laws Christos Faloutsos Carnegie Mellon University

School of Computer Science Carnegie Mellon Athens, 2007C. Faloutsos2 Thank you! Prof. George Polyzos Nausika Kokkini

School of Computer Science Carnegie Mellon Athens, 2007C. Faloutsos3 Thanks to Deepayan Chakrabarti (CMU/Yahoo) Michalis Faloutsos (UCR) George Siganos (UCR)

School of Computer Science Carnegie Mellon Athens, 2007C. Faloutsos4 Overview Goals/ motivation: find patterns in large datasets: –(A) Sensor data –(B) network/graph data Solutions: self-similarity and power laws Discussion

School of Computer Science Carnegie Mellon Athens, 2007C. Faloutsos5 Applications of sensors/streams ‘Smart house’: monitoring temperature, humidity etc Financial, sales, economic series

School of Computer Science Carnegie Mellon Athens, 2007C. Faloutsos6 Applications of sensors/streams ‘Smart house’: monitoring temperature, humidity etc Financial, sales, economic series

School of Computer Science Carnegie Mellon Athens, 2007C. Faloutsos7 Motivation - Applications Medical: ECGs +; blood pressure etc monitoring Scientific data: seismological; astronomical; environment / anti-pollution; meteorological

School of Computer Science Carnegie Mellon Athens, 2007C. Faloutsos8 Motivation - Applications (cont’d) civil/automobile infrastructure –bridge vibrations [Oppenheim+02] – road conditions / traffic monitoring Automobile traffic time # cars

School of Computer Science Carnegie Mellon Athens, 2007C. Faloutsos9 Motivation - Applications (cont’d) Computer systems –web servers (buffering, prefetching) –network traffic monitoring –...

School of Computer Science Carnegie Mellon Athens, 2007C. Faloutsos10 Web traffic [Crovella Bestavros, SIGMETRICS’96]

School of Computer Science Carnegie Mellon Athens, 2007C. Faloutsos survivable, self-managing storage infrastructure a storage brick (0.5–5 TB) ~1 PB  “self-*” = self-managing, self-tuning, self-healing, …  Goal: 1 petabyte (PB) for CMU researchers  Self-* Storage (Ganger+)

School of Computer Science Carnegie Mellon Athens, 2007C. Faloutsos survivable, self-managing storage infrastructure a storage brick (0.5–5 TB) ~1 PB  “self-*” = self-managing, self-tuning, self-healing, … Self-* Storage (Ganger+)

School of Computer Science Carnegie Mellon Athens, 2007C. Faloutsos13 Problem definition Given: one or more sequences x 1, x 2, …, x t, …; (y 1, y 2, …, y t, …) Find –patterns; clusters; outliers; forecasts;

School of Computer Science Carnegie Mellon Athens, 2007C. Faloutsos14 Problem #1 Find patterns, in large datasets time # bytes

School of Computer Science Carnegie Mellon Athens, 2007C. Faloutsos15 Problem #1 Find patterns, in large datasets time # bytes Poisson indep., ident. distr

School of Computer Science Carnegie Mellon Athens, 2007C. Faloutsos16 Problem #1 Find patterns, in large datasets time # bytes Poisson indep., ident. distr

School of Computer Science Carnegie Mellon Athens, 2007C. Faloutsos17 Problem #1 Find patterns, in large datasets time # bytes Poisson indep., ident. distr Q: Then, how to generate such bursty traffic?

School of Computer Science Carnegie Mellon Athens, 2007C. Faloutsos18 Overview Goals/ motivation: find patterns in large datasets: –(A) Sensor data –(B) network/graph data Solutions: self-similarity and power laws Discussion

School of Computer Science Carnegie Mellon Athens, 2007C. Faloutsos19 Problem #2 - network and graph mining How does the Internet look like? How does the web look like? What constitutes a ‘normal’ social network? What is the ‘network value’ of a customer? which gene/species affects the others the most?

School of Computer Science Carnegie Mellon Athens, 2007C. Faloutsos20 Network and graph mining Food Web [Martinez ’91] Protein Interactions [genomebiology.com] Friendship Network [Moody ’01] Graphs are everywhere!

School of Computer Science Carnegie Mellon Athens, 2007C. Faloutsos21 Problem#2 Given a graph: which node to market-to / defend / immunize first? Are there un-natural sub- graphs? (eg., criminals’ rings)? [from Lumeta: ISPs 6/1999]

School of Computer Science Carnegie Mellon Athens, 2007C. Faloutsos22 Solutions New tools: power laws, self-similarity and ‘fractals’ work, where traditional assumptions fail Let’s see the details:

School of Computer Science Carnegie Mellon Athens, 2007C. Faloutsos23 Overview Goals/ motivation: find patterns in large datasets: –(A) Sensor data –(B) network/graph data Solutions: self-similarity and power laws Discussion

School of Computer Science Carnegie Mellon Athens, 2007C. Faloutsos24 What is a fractal? = self-similar point set, e.g., Sierpinski triangle:... zero area: (3/4)^inf infinite length! (4/3)^inf Q: What is its dimensionality??

School of Computer Science Carnegie Mellon Athens, 2007C. Faloutsos25 What is a fractal? = self-similar point set, e.g., Sierpinski triangle:... zero area: (3/4)^inf infinite length! (4/3)^inf Q: What is its dimensionality?? A: log3 / log2 = 1.58 (!?!)

School of Computer Science Carnegie Mellon Athens, 2007C. Faloutsos26 Intrinsic (‘fractal’) dimension Q: fractal dimension of a line? Q: fd of a plane?

School of Computer Science Carnegie Mellon Athens, 2007C. Faloutsos27 Intrinsic (‘fractal’) dimension Q: fractal dimension of a line? A: nn ( <= r ) ~ r^1 (‘power law’: y=x^a) Q: fd of a plane? A: nn ( <= r ) ~ r^2 fd== slope of (log(nn) vs.. log(r) )

School of Computer Science Carnegie Mellon Athens, 2007C. Faloutsos28 Sierpinsky triangle log( r ) log(#pairs within <=r ) 1.58 == ‘correlation integral’ = CDF of pairwise distances

School of Computer Science Carnegie Mellon Athens, 2007C. Faloutsos29 Observations: Fractals power laws Closely related: fractals self-similarity scale-free power laws ( y= x a ; F=K r -2 ) (vs y=e -ax or y=x a +b) log( r ) log(#pairs within <=r ) 1.58

School of Computer Science Carnegie Mellon Athens, 2007C. Faloutsos30 Outline Problems Self-similarity and power laws Solutions to posed problems Discussion

School of Computer Science Carnegie Mellon Athens, 2007C. Faloutsos31 time #bytes Solution #1: traffic disk traces: self-similar: (also: [Leland+94]) How to generate such traffic?

School of Computer Science Carnegie Mellon Athens, 2007C. Faloutsos32 Solution #1: traffic disk traces (80-20 ‘law’) – ‘multifractals’ time #bytes 20% 80%

School of Computer Science Carnegie Mellon Athens, 2007C. Faloutsos / multifractals 20 80

School of Computer Science Carnegie Mellon Athens, 2007C. Faloutsos / multifractals 20 p ; (1-p) in general yes, there are dependencies 80

School of Computer Science Carnegie Mellon Athens, 2007C. Faloutsos35 More on 80/20: PQRS Part of ‘self-* storage’ project time cylinder#

School of Computer Science Carnegie Mellon Athens, 2007C. Faloutsos36 More on 80/20: PQRS Part of ‘self-* storage’ project pq rs q rs

School of Computer Science Carnegie Mellon Athens, 2007C. Faloutsos37 Overview Goals/ motivation: find patterns in large datasets: –(A) Sensor data –(B) network/graph data Solutions: self-similarity and power laws –sensor/traffic data –network/graph data Discussion

School of Computer Science Carnegie Mellon Athens, 2007C. Faloutsos38 Problem #2 - topology How does the Internet look like? Any rules?

School of Computer Science Carnegie Mellon Athens, 2007C. Faloutsos39 Patterns? avg degree is, say 3.3 pick a node at random – guess its degree, exactly (-> “mode”) degree count avg: 3.3

School of Computer Science Carnegie Mellon Athens, 2007C. Faloutsos40 Patterns? avg degree is, say 3.3 pick a node at random – guess its degree, exactly (-> “mode”) A: 1!! degree count avg: 3.3

School of Computer Science Carnegie Mellon Athens, 2007C. Faloutsos41 Patterns? avg degree is, say 3.3 pick a node at random - what is the degree you expect it to have? A: 1!! A’: very skewed distr. Corollary: the mean is meaningless! (and std -> infinity (!)) degree count avg: 3.3

School of Computer Science Carnegie Mellon Athens, 2007C. Faloutsos42 Solution#2: Rank exponent R A1: Power law in the degree distribution [SIGCOMM99] internet domains log(rank) log(degree) att.com ibm.com

School of Computer Science Carnegie Mellon Athens, 2007C. Faloutsos43 Solution#2’: Eigen Exponent E A2: power law in the eigenvalues of the adjacency matrix E = Exponent = slope Eigenvalue Rank of decreasing eigenvalue May 2001

School of Computer Science Carnegie Mellon Athens, 2007C. Faloutsos44 Power laws - discussion do they hold, over time? do they hold on other graphs/domains?

School of Computer Science Carnegie Mellon Athens, 2007C. Faloutsos45 Power laws - discussion do they hold, over time? Yes! for multiple years [Siganos+] do they hold on other graphs/domains? Yes! –web sites and links [Tomkins+], [Barabasi+] –peer-to-peer graphs (gnutella-style) –who-trusts-whom (epinions.com)

School of Computer Science Carnegie Mellon Athens, 2007C. Faloutsos46 Time Evolution: rank R The rank exponent has not changed! [Siganos+] Domain level log(rank) log(degree) att.com ibm.com

School of Computer Science Carnegie Mellon Athens, 2007C. Faloutsos47 The Peer-to-Peer Topology Number of immediate peers (= degree), follows a power-law [Jovanovic+] degree count

School of Computer Science Carnegie Mellon Athens, 2007C. Faloutsos48 epinions.com who-trusts-whom [Richardson + Domingos, KDD 2001] (out) degree count

School of Computer Science Carnegie Mellon Athens, 2007C. Faloutsos49 Why care about these patterns? better graph generators [BRITE, INET] –for simulations –extrapolations ‘abnormal’ graph and subgraph detection

School of Computer Science Carnegie Mellon Athens, 2007C. Faloutsos50 Recent discoveries [KDD’05] How do graphs evolve? degree-exponent seems constant - anything else?

School of Computer Science Carnegie Mellon Athens, 2007C. Faloutsos51 Evolution of diameter? Prior analysis, on power-law-like graphs, hints that diameter ~ O(log(N)) or diameter ~ O( log(log(N))) i.e.., slowly increasing with network size Q: What is happening, in reality?

School of Computer Science Carnegie Mellon Athens, 2007C. Faloutsos52 Evolution of diameter? Prior analysis, on power-law-like graphs, hints that diameter ~ O(log(N)) or diameter ~ O( log(log(N))) i.e.., slowly increasing with network size Q: What is happening, in reality? A: It shrinks(!!), towards a constant value

School of Computer Science Carnegie Mellon Athens, 2007C. Faloutsos53 Shrinking diameter [Leskovec+05a] Citations among physics papers 2003: –29,555 papers –352,807 citations For each month M, create a graph of all citations up to month M time diameter

School of Computer Science Carnegie Mellon Athens, 2007C. Faloutsos54 Shrinking diameter Authors & publications 1992 –318 nodes –272 edges 2002 –60,000 nodes 20,000 authors 38,000 papers –133,000 edges

School of Computer Science Carnegie Mellon Athens, 2007C. Faloutsos55 Shrinking diameter Patents & citations 1975 –334,000 nodes –676,000 edges 1999 –2.9 million nodes –16.5 million edges Each year is a datapoint

School of Computer Science Carnegie Mellon Athens, 2007C. Faloutsos56 Shrinking diameter Autonomous systems 1997 –3,000 nodes –10,000 edges 2000 –6,000 nodes –26,000 edges One graph per day N diameter

School of Computer Science Carnegie Mellon Athens, 2007C. Faloutsos57 Temporal evolution of graphs N(t) nodes; E(t) edges at time t suppose that N(t+1) = 2 * N(t) Q: what is your guess for E(t+1) =? 2 * E(t)

School of Computer Science Carnegie Mellon Athens, 2007C. Faloutsos58 Temporal evolution of graphs N(t) nodes; E(t) edges at time t suppose that N(t+1) = 2 * N(t) Q: what is your guess for E(t+1) =? 2 * E(t) A: over-doubled!

School of Computer Science Carnegie Mellon Athens, 2007C. Faloutsos59 Temporal evolution of graphs A: over-doubled - but obeying: E(t) ~ N(t) a for all t where 1<a<2

School of Computer Science Carnegie Mellon Athens, 2007C. Faloutsos60 Densification Power Law ArXiv: Physics papers and their citations 1.69 N(t) E(t)

School of Computer Science Carnegie Mellon Athens, 2007C. Faloutsos61 Densification Power Law ArXiv: Physics papers and their citations 1.69 N(t) E(t) ‘tree’ 1

School of Computer Science Carnegie Mellon Athens, 2007C. Faloutsos62 Densification Power Law ArXiv: Physics papers and their citations 1.69 N(t) E(t) ‘clique’ 2

School of Computer Science Carnegie Mellon Athens, 2007C. Faloutsos63 Densification Power Law U.S. Patents, citing each other 1.66 N(t) E(t)

School of Computer Science Carnegie Mellon Athens, 2007C. Faloutsos64 Densification Power Law Autonomous Systems 1.18 N(t) E(t)

School of Computer Science Carnegie Mellon Athens, 2007C. Faloutsos65 Densification Power Law ArXiv: authors & papers 1.15 N(t) E(t)

School of Computer Science Carnegie Mellon Athens, 2007C. Faloutsos66 Outline problems Fractals Solutions Discussion –what else can they solve? –how frequent are fractals?

School of Computer Science Carnegie Mellon Athens, 2007C. Faloutsos67 What else can they solve? separability [KDD’02] forecasting [CIKM’02] dimensionality reduction [SBBD’00] non-linear axis scaling [KDD’02] disk trace modeling [PEVA’02] selectivity of spatial/multimedia queries [PODS’94, VLDB’95, ICDE’00]...

School of Computer Science Carnegie Mellon Athens, 2007C. Faloutsos68 Problem #3 - spatial d.m. Galaxies (Sloan Digital Sky Survey w/ B. Nichol) - ‘spiral’ and ‘elliptical’ galaxies - patterns? (not Gaussian; not uniform) -attraction/repulsion? - separability??

School of Computer Science Carnegie Mellon Athens, 2007C. Faloutsos69 Solution#3: spatial d.m. log(r) log(#pairs within <=r ) spi-spi spi-ell ell-ell slope - plateau! - repulsion! CORRELATION INTEGRAL!

School of Computer Science Carnegie Mellon Athens, 2007C. Faloutsos70 Solution#3: spatial d.m. log(r) log(#pairs within <=r ) spi-spi spi-ell ell-ell slope - plateau! - repulsion! [w/ Seeger, Traina, Traina, SIGMOD00]

School of Computer Science Carnegie Mellon Athens, 2007C. Faloutsos71 Solution#3: spatial d.m. r1r2 r1 r2 Heuristic on choosing # of clusters

School of Computer Science Carnegie Mellon Athens, 2007C. Faloutsos72 Solution#3: spatial d.m. log(r) log(#pairs within <=r ) spi-spi spi-ell ell-ell slope - plateau! - repulsion!

School of Computer Science Carnegie Mellon Athens, 2007C. Faloutsos73 What else can they solve? separability [KDD’02] forecasting [CIKM’02] dimensionality reduction [SBBD’00] non-linear axis scaling [KDD’02] disk trace modeling [PEVA’02] selectivity of spatial/multimedia queries [PODS’94, VLDB’95, ICDE’00]...

School of Computer Science Carnegie Mellon Athens, 2007C. Faloutsos74 Problem#4: dim. reduction given attributes x 1,... x n –possibly, non-linearly correlated drop the useless ones mpg cc

School of Computer Science Carnegie Mellon Athens, 2007C. Faloutsos75 Problem#4: dim. reduction given attributes x 1,... x n –possibly, non-linearly correlated drop the useless ones (Q: why? A: to avoid the ‘dimensionality curse’) Solution: keep on dropping attributes, until the f.d. changes! [w/ Traina+, SBBD’00] mpg cc

School of Computer Science Carnegie Mellon Athens, 2007C. Faloutsos76 Outline problems Fractals Solutions Discussion –what else can they solve? –how frequent are fractals?

School of Computer Science Carnegie Mellon Athens, 2007C. Faloutsos77 Fractals & power laws: appear in numerous settings: medical geographical / geological social computer-system related

School of Computer Science Carnegie Mellon Athens, 2007C. Faloutsos78 Fractals: Brain scans brain-scans octree levels Log(#octants) 2.63 = fd

School of Computer Science Carnegie Mellon Athens, 2007C. Faloutsos79 More fractals periphery of malignant tumors: ~1.5 benign: ~1.3 [Burdet+]

School of Computer Science Carnegie Mellon Athens, 2007C. Faloutsos80 More fractals: cardiovascular system: 3 (!) lungs: ~2.9

School of Computer Science Carnegie Mellon Athens, 2007C. Faloutsos81 Fractals & power laws: appear in numerous settings: medical geographical / geological social computer-system related

School of Computer Science Carnegie Mellon Athens, 2007C. Faloutsos82 More fractals: Coastlines:

School of Computer Science Carnegie Mellon Athens, 2007C. Faloutsos83

School of Computer Science Carnegie Mellon Athens, 2007C. Faloutsos84 More fractals: the fractal dimension for the Amazon river is 1.85 (Nile: 1.4) [ems.gphys.unc.edu/nonlinear/fractals/examples.html]

School of Computer Science Carnegie Mellon Athens, 2007C. Faloutsos85 More fractals: the fractal dimension for the Amazon river is 1.85 (Nile: 1.4) [ems.gphys.unc.edu/nonlinear/fractals/examples.html]

School of Computer Science Carnegie Mellon Athens, 2007C. Faloutsos86 Cross-roads of Montgomery county: any rules? GIS points

School of Computer Science Carnegie Mellon Athens, 2007C. Faloutsos87 GIS A: self-similarity: intrinsic dim. = 1.51 log( r ) log(#pairs(within <= r)) 1.51

School of Computer Science Carnegie Mellon Athens, 2007C. Faloutsos88 Examples:LB county Long Beach county of CA (road end-points) 1.7 log(r) log(#pairs)

School of Computer Science Carnegie Mellon Athens, 2007C. Faloutsos89 More power laws: areas – Korcak’s law Scandinavian lakes Any pattern?

School of Computer Science Carnegie Mellon Athens, 2007C. Faloutsos90 More power laws: areas – Korcak’s law Scandinavian lakes area vs complementary cumulative count (log-log axes) log(count( >= area)) log(area)

School of Computer Science Carnegie Mellon Athens, 2007C. Faloutsos91 More power laws: Korcak Japan islands; area vs cumulative count (log-log axes) log(area) log(count( >= area))

School of Computer Science Carnegie Mellon Athens, 2007C. Faloutsos92 (Korcak’s law: Aegean islands)

School of Computer Science Carnegie Mellon Athens, 2007C. Faloutsos93 More power laws Energy of earthquakes (Gutenberg-Richter law) [simscience.org] log(count) Magnitude = log(energy)day Energy released

School of Computer Science Carnegie Mellon Athens, 2007C. Faloutsos94 Fractals & power laws: appear in numerous settings: medical geographical / geological social computer-system related

School of Computer Science Carnegie Mellon Athens, 2007C. Faloutsos95 A famous power law: Zipf’s law Bible - rank vs. frequency (log-log) log(rank) log(freq) “a” “the” “Rank/frequency plot”

School of Computer Science Carnegie Mellon Athens, 2007C. Faloutsos96 TELCO data # of service units count of customers ‘best customer’

School of Computer Science Carnegie Mellon Athens, 2007C. Faloutsos97 SALES data – store#96 # units sold count of products “aspirin”

School of Computer Science Carnegie Mellon Athens, 2007C. Faloutsos98 Olympic medals (Sidney’00, Athens’04): log( rank) log(#medals)

School of Computer Science Carnegie Mellon Athens, 2007C. Faloutsos99 Olympic medals (Sidney’00, Athens’04): log( rank) log(#medals)

School of Computer Science Carnegie Mellon Athens, 2007C. Faloutsos100 Even more power laws: Income distribution (Pareto’s law) size of firms publication counts (Lotka’s law)

School of Computer Science Carnegie Mellon Athens, 2007C. Faloutsos101 Even more power laws: library science (Lotka’s law of publication count); and citation counts: (citeseer.nj.nec.com 6/2001) log(#citations) log(count) Ullman

School of Computer Science Carnegie Mellon Athens, 2007C. Faloutsos102 Even more power laws: web hit counts [w/ A. Montgomery] Web Site Traffic log(freq) log(count) Zipf “yahoo.com”

School of Computer Science Carnegie Mellon Athens, 2007C. Faloutsos103 Fractals & power laws: appear in numerous settings: medical geographical / geological social computer-system related

School of Computer Science Carnegie Mellon Athens, 2007C. Faloutsos104 Power laws, cont’d In- and out-degree distribution of web sites [Barabasi], [IBM-CLEVER] log indegree - log(freq) from [Ravi Kumar, Prabhakar Raghavan, Sridhar Rajagopalan, Andrew Tomkins ]

School of Computer Science Carnegie Mellon Athens, 2007C. Faloutsos105 Power laws, cont’d In- and out-degree distribution of web sites [Barabasi], [IBM-CLEVER] log indegree log(freq) from [Ravi Kumar, Prabhakar Raghavan, Sridhar Rajagopalan, Andrew Tomkins ]

School of Computer Science Carnegie Mellon Athens, 2007C. Faloutsos106 Power laws, cont’d In- and out-degree distribution of web sites [Barabasi], [IBM-CLEVER] log indegree log(freq) Q: ‘how can we use these power laws?’

School of Computer Science Carnegie Mellon Athens, 2007C. Faloutsos107 “Foiled by power law” [Broder+, WWW’00] (log) in-degree (log) count

School of Computer Science Carnegie Mellon Athens, 2007C. Faloutsos108 “Foiled by power law” [Broder+, WWW’00] “The anomalous bump at 120 on the x-axis is due a large clique formed by a single spammer” (log) in-degree (log) count

School of Computer Science Carnegie Mellon Athens, 2007C. Faloutsos109 Power laws, cont’d In- and out-degree distribution of web sites [Barabasi], [IBM-CLEVER] length of file transfers [Crovella+Bestavros ‘96] duration of UNIX jobs

School of Computer Science Carnegie Mellon Athens, 2007C. Faloutsos110 Additional projects Find anomalies in traffic matrices [SDM’07] Find correlations in sensor/stream data [VLDB’05] –Chlorine measurements, with Civ. Eng. –temperature measurements (INTEL/MIT) Virus propagation (SIS, SIR) [Wang+, ’03] Graph partitioning [Chakrabarti+, KDD’04]

School of Computer Science Carnegie Mellon Athens, 2007C. Faloutsos111 Conclusions Fascinating problems in Data Mining: find patterns in –sensors/streams –graphs/networks

School of Computer Science Carnegie Mellon Athens, 2007C. Faloutsos112 Conclusions - cont’d New tools for Data Mining: self-similarity & power laws: appear in many cases Bad news: lead to skewed distributions (no Gaussian, Poisson, uniformity, independence, mean, variance) Good news: ‘correlation integral’ for separability rank/frequency plots (multifractals) (Hurst exponent, strange attractors, renormalization theory, ++)

School of Computer Science Carnegie Mellon Athens, 2007C. Faloutsos113 Resources Manfred Schroeder “Chaos, Fractals and Power Laws”, 1991

School of Computer Science Carnegie Mellon Athens, 2007C. Faloutsos114 References [vldb95] Alberto Belussi and Christos Faloutsos, Estimating the Selectivity of Spatial Queries Using the `Correlation' Fractal Dimension Proc. of VLDB, p , 1995 [Broder+’00] Andrei Broder, Ravi Kumar, Farzin Maghoul1, Prabhakar Raghavan, Sridhar Rajagopalan, Raymie Stata, Andrew Tomkins, Janet Wiener, Graph structure in the web, WWW’00 M. Crovella and A. Bestavros, Self similarity in World wide web traffic: Evidence and possible causes, SIGMETRICS ’96.

School of Computer Science Carnegie Mellon Athens, 2007C. Faloutsos115 References J. Considine, F. Li, G. Kollios and J. Byers, Approximate Aggregation Techniques for Sensor Databases (ICDE’04, best paper award). [pods94] Christos Faloutsos and Ibrahim Kamel, Beyond Uniformity and Independence: Analysis of R-trees Using the Concept of Fractal Dimension, PODS, Minneapolis, MN, May 24-26, 1994, pp. 4-13

School of Computer Science Carnegie Mellon Athens, 2007C. Faloutsos116 References [vldb96] Christos Faloutsos, Yossi Matias and Avi Silberschatz, Modeling Skewed Distributions Using Multifractals and the `80-20 Law’ Conf. on Very Large Data Bases (VLDB), Bombay, India, Sept [sigmod2000] Christos Faloutsos, Bernhard Seeger, Agma J. M. Traina and Caetano Traina Jr., Spatial Join Selectivity Using Power Laws, SIGMOD 2000

School of Computer Science Carnegie Mellon Athens, 2007C. Faloutsos117 References [vldb96] Christos Faloutsos and Volker Gaede Analysis of the Z-Ordering Method Using the Hausdorff Fractal Dimension VLD, Bombay, India, Sept [sigcomm99] Michalis Faloutsos, Petros Faloutsos and Christos Faloutsos, What does the Internet look like? Empirical Laws of the Internet Topology, SIGCOMM 1999

School of Computer Science Carnegie Mellon Athens, 2007C. Faloutsos118 References [Leskovec 05] Jure Leskovec, Jon M. Kleinberg, Christos Faloutsos: Graphs over time: densification laws, shrinking diameters and possible explanations. KDD 2005:

School of Computer Science Carnegie Mellon Athens, 2007C. Faloutsos119 References [ieeeTN94] W. E. Leland, M.S. Taqqu, W. Willinger, D.V. Wilson, On the Self-Similar Nature of Ethernet Traffic, IEEE Transactions on Networking, 2, 1, pp 1-15, Feb [brite] Alberto Medina, Anukool Lakhina, Ibrahim Matta, and John Byers. BRITE: An Approach to Universal Topology Generation. MASCOTS '01

School of Computer Science Carnegie Mellon Athens, 2007C. Faloutsos120 References [icde99] Guido Proietti and Christos Faloutsos, I/O complexity for range queries on region data stored using an R-tree (ICDE’99) Stan Sclaroff, Leonid Taycher and Marco La Cascia, "ImageRover: A content-based image browser for the world wide web" Proc. IEEE Workshop on Content-based Access of Image and Video Libraries, pp 2-9, 1997.

School of Computer Science Carnegie Mellon Athens, 2007C. Faloutsos121 References [kdd2001] Agma J. M. Traina, Caetano Traina Jr., Spiros Papadimitriou and Christos Faloutsos: Tri- plots: Scalable Tools for Multidimensional Data Mining, KDD 2001, San Francisco, CA.

School of Computer Science Carnegie Mellon Athens, 2007C. Faloutsos122 Thank you! Contact info: christos cs.cmu.edu www. cs.cmu.edu /~christos (w/ papers, datasets, code for fractal dimension estimation, etc)