1 Entropy Waves, The Zigzag Graph Product, and New Constant-Degree Expanders Omer Reingold Salil Vadhan Avi Wigderson Lecturer: Oded Levy.

Slides:



Advertisements
Similar presentations
Walk the Walk: On Pseudorandomness, Expansion, and Connectivity Omer Reingold Weizmann Institute Based on join works with Michael Capalbo, Kai-Min Chung,
Advertisements

A Combinatorial Construction of Almost-Ramanujan Graphs Using the Zig-Zag product Avraham Ben-Aroya Avraham Ben-Aroya Amnon Ta-Shma Amnon Ta-Shma Tel-Aviv.
10.4 Complex Vector Spaces.
Totally Unimodular Matrices
The Structure of Polyhedra Gabriel Indik March 2006 CAS 746 – Advanced Topics in Combinatorial Optimization.
(Omer Reingold, 2005) Speaker: Roii Werner TexPoint fonts used in EMF. Read the TexPoint manual before you delete this box.: AA A AA A A A A AA A.
Symmetric Matrices and Quadratic Forms
Undirected ST-Connectivity in Log-Space Author: Omer Reingold Presented by: Yang Liu.
Chapter 5 Orthogonality
Totally Unimodular Matrices Lecture 11: Feb 23 Simplex Algorithm Elliposid Algorithm.
Constant Degree, Lossless Expanders Omer Reingold AT&T joint work with Michael Capalbo (IAS), Salil Vadhan (Harvard), and Avi Wigderson (Hebrew U., IAS)
Undirected ST-Connectivity 2 DL Omer Reingold, STOC 2005: Presented by: Fenghui Zhang CPSC 637 – paper presentation.
Ch 7.3: Systems of Linear Equations, Linear Independence, Eigenvalues
EXPANDER GRAPHS Properties & Applications. Things to cover ! Definitions Properties Combinatorial, Spectral properties Constructions “Explicit” constructions.
Undirected ST-Connectivity in Log-Space By Omer Reingold (Weizmann Institute) Year 2004 Presented by Maor Mishkin.
Zig-Zag Expanders Seminar in Theory and Algorithmic Research Sashka Davis UCSD, April 2005 “ Entropy Waves, the Zig-Zag Graph Product, and New Constant-
Dirac Notation and Spectral decomposition Michele Mosca.
Expanders Eliyahu Kiperwasser. What is it? Expanders are graphs with no small cuts. The later gives several unique traits to such graph, such as: – High.
Lecture 18 Eigenvalue Problems II Shang-Hua Teng.
Orthogonality and Least Squares
Ramanujan Graphs of Every Degree Adam Marcus (Crisply, Yale) Daniel Spielman (Yale) Nikhil Srivastava (MSR India)
Undirected ST-Connectivity In Log Space
Dirac Notation and Spectral decomposition
Undirected ST-Connectivity In Log Space Omer Reingold Slides by Sharon Bruckner.
Correlation. The sample covariance matrix: where.
Stats & Linear Models.
5.1 Orthogonality.
1 Entropy Waves, The Zigzag Graph Product, and New Constant-Degree Expanders Omer Reingold Salil Vadhan Avi Wigderson Lecturer: Oded Levy.
5  Systems of Linear Equations: ✦ An Introduction ✦ Unique Solutions ✦ Underdetermined and Overdetermined Systems  Matrices  Multiplication of Matrices.
Orthogonal Matrices and Spectral Representation In Section 4.3 we saw that n  n matrix A was similar to a diagonal matrix if and only if it had n linearly.
UNIVERSITI MALAYSIA PERLIS
Final Exam Review II Chapters 5-7, 9 Objectives and Examples.
Systems and Matrices (Chapter5)
1 February 24 Matrices 3.2 Matrices; Row reduction Standard form of a set of linear equations: Chapter 3 Linear Algebra Matrix of coefficients: Augmented.
Eigenvalue Problems Solving linear systems Ax = b is one part of numerical linear algebra, and involves manipulating the rows of a matrix. The second main.
CPSC 491 Xin Liu Nov 17, Introduction Xin Liu PhD student of Dr. Rokne Contact Slides downloadable at pages.cpsc.ucalgary.ca/~liuxin.
Cryptographic hash functions from expander graphs Denis Charles, Microsoft Research Eyal Goren, McGill University Kristin Lauter, Microsoft Research ECC.
1 Chapter 5 – Orthogonality and Least Squares Outline 5.1 Orthonormal Bases and Orthogonal Projections 5.2 Gram-Schmidt Process and QR Factorization 5.3.
Computing Eigen Information for Small Matrices The eigen equation can be rearranged as follows: Ax = x  Ax = I n x  Ax - I n x = 0  (A - I n )x = 0.
Chapter 5 Eigenvalues and Eigenvectors 大葉大學 資訊工程系 黃鈴玲 Linear Algebra.
Vector Norms and the related Matrix Norms. Properties of a Vector Norm: Euclidean Vector Norm: Riemannian metric:
Elementary Linear Algebra Anton & Rorres, 9th Edition
11/6/20151 ENM 503Linear Algebra Review 1. u = (2, -4, 3) and v = (-5, 1, 2). u + v = (2-5, -4+1, 3 +2) = (-3, -3, 5). 2u = (4, -8, 6); -v = (5, -1, -2);
Chapter 10 Real Inner Products and Least-Square
Elementary Linear Algebra Anton & Rorres, 9 th Edition Lecture Set – 07 Chapter 7: Eigenvalues, Eigenvectors.
Vocabulary and Representations of Graphs. NC Standard Course of Study Competency Goal 1: The learner will use matrices and graphs to model relationships.
Introduction to Linear Algebra Mark Goldman Emily Mackevicius.
Mathematical Tools of Quantum Mechanics
4.8 Rank Rank enables one to relate matrices to vectors, and vice versa. Definition Let A be an m  n matrix. The rows of A may be viewed as row vectors.
Presented by Alon Levin
Section 1-1 Points and Lines. Each point in the plane can be associated with an ordered pair of numbers, called the coordinates of the point. Each ordered.
(CSC 102) Lecture 30 Discrete Structures. Graphs.
1 Objective To provide background material in support of topics in Digital Image Processing that are based on matrices and/or vectors. Review Matrices.
Matrices, Vectors, Determinants.
رياضيات متقطعة لعلوم الحاسب MATH 226. Chapter 10.
Matrix Representation of Graphs
Coding, Complexity and Sparsity workshop
5 Systems of Linear Equations and Matrices
Markov Chains Mixing Times Lecture 5
Distinct Distances in the Plane
Degree and Eigenvector Centrality
Chapter 3 Linear Algebra
Undirected ST-Connectivity In Log Space
Spin Models and Distance-Regular Graphs
Symmetric Matrices and Quadratic Forms
ENM 500 Linear Algebra Review
Linear Vector Space and Matrix Mechanics
Chapter 2 Determinants.
Symmetric Matrices and Quadratic Forms
Presentation transcript:

1 Entropy Waves, The Zigzag Graph Product, and New Constant-Degree Expanders Omer Reingold Salil Vadhan Avi Wigderson Lecturer: Oded Levy

2 Introduction Most random constant degree graphs are good expanders. Most applications need explicit constructions. This lecture deals with the Zigzag product which is used in order to explicitly build expanders.

3 The zigzag product G A = (N A, D A, λ A ), G B = (D A, D B, λ B ). We define their zigzag product as a graph which Its vertices are N A × N B (each vertex is represented as a pair (v, u) such that v  N A and u  N B. For each vertex (v, k) we put an edge between a pair (v, k) to (v[k[i]], k[i][j]).

4 Example

5

6 We can separate it to three steps: Move from one vertex to another vertex at the same cloud. Jump between clouds. Move from one vertex to another vertex at the same cloud

7 Theorem G = G A Z G B = (N A × D A, D B 2, f(λ A, λ B )). f(λ A’ λ B ) ≤ λ A + λ B + λ B 2. λ A, λ B < 1→ f(λ A, λ B ) < 1. We know that. We aim to show that for each

8 Why does it work? Given a distribution vector π over G ’s vertices, we distinguish between two cases of π :  uniform within clouds.  non-uniform within clouds. We aim to show that after one step in G, π becomes more uniform.

9 Step 1 does not change anything.  uniform within clouds.

10 Step 2 is a random walk on G A.  uniform within clouds.

11 Step 3 is a random walk on G B.  uniform within clouds.

12 Step 1 is a random walk on G B.  non-uniform within clouds.

13 Step 2 is a permutation.  non-uniform within clouds.

14 Step 3 is a random step on a regular graph.  non-uniform within clouds.

15 Proof Let M be G ’s normalized adjacency matrix. We’ll decompose M into three matrices, corresponding to three steps as defined before. Then is a normalized matrix where we connect vertices within each cloud. is a normalized matrix where we connect clouds.

16 Decomposing α

17 The relation between and B is The relation between and A will be defined later.

18 is symmetric Recall that we want to bound Since G B is a regular graph, (1, 1, …, 1) is an eigenvector of B with eigenvalue 1,

19

20 Thus Combining it with previous results our expression becomes Opening the inner product we get

21 Using triangular inequality we get Since à is a permutation matrix, it is unitary thus preserves length Using Cauchy-Schwartz inequality

22 We’ll first bound. Decomposing α  to its components we have By the expansion of G B we get Thus

23 For our analysis we’ll define linear map C such that:

24

25

26 Now we’ll bound. We’ll first relate A to Ã. Claim:

27

28

29

30 e v is a basis, thus this claim holds for all vectors. Substituting ß = Cα yields AC α = CÃ α ||.

31 Hence Since,. Thus Combining these claims we have

32 We’ll mark by p and q By Pythagoras theorem we have. Thus

33 pq gets maximum value of ½ (when), thus we showed that for every

34 It remains to show that if both λ 1 and λ 2 are smaller than 1, f(λ 1,λ 2 ) is also smaller than 1. Case I

35 Case II

36 We have Finally

37 Summary We started from vector α orthogonal to the uniform distribution. We decomposed it to its parallel and perpendicular components. We showed that we can shrink both the parallel and the perpendicular components individually.

38 We decreased the length of the perpendicular component in the Zig part. The second step did not increase the length of the parallel component, but the third step surly decreased it. The zigzag graph decreased the length of α.

39 We can show that we the bound may be reduced to f(λ, 0)= f(0, λ)=0 f(λ, 1)= f(1, λ)=1 f is strictly increasing in both λ 1 and λ 2. If λ 1 <1 and λ 2 <1 then f(λ 1, λ 2 )<1. f(λ 1, λ 2 )≤ λ 1 + λ 2

40 Families of expanders In this section we’ll introduce two families of expanders: Basic construction More efficient construction

41 Basic family construction Let H = (D 4, D, 1/5). We build a family of graph in the following way: G 1 = H 2 G i+1 = G i 2 Z H G i is an infinite family of expanders such that G i = (D 4i, D 2, 2/5)

42 Vertices. Degree. Expansion Bounded by 2/5 since the limit of the series λ n = λ 2 n-1 + 6/25 is 2/5.

43 More efficient construction We use tensoring in order to make the construction in more efficient by reducing the depth of the recursion. Let H = (D 8, D, λ). For every t we define

44 For each t ≥ 0, G t = (D 8t, D 2, λ t ) such that λ t = λ + O(λ 2 ). Vertices. Degree. Expansion Let μ t = max{λ i | 1 ≤ i ≤ t}. We have μ t = max{μ t-1, μ t λ + λ 2 }. Solving this yields μ t < λ + O(λ 2 ).

45 Can we do better? The best possible 2 nd largest eigenvalues of infinite families of graph is 2(D – 1) ½ / D. Ramanujan graphs meet this bound. In this section we’ll try to get closer to this bound.

46 Derandomizing the Zigzag product In order to improve the bound we’ll make two steps within the zig part and two steps within the zag part. In order to save on the degree, we’ll correlate the second part of the zig part and the first part of the zag part.

47 Example

48 We ’ ll map each step within each cloud to a step on other cloud. Given a step in the initial cloud and a target cloud, the permutation will return a step in the target cloud. We’ll use a matrix to represent this permutation.

49 Each edge on the improved Zigzag product can be separated into six steps: 1. Move one step within the first cloud. 2. Move one step within the first cloud. 3. Jump between clouds. 4. Move one step within the second cloud according to the step made in step Move one step within the second cloud.

50 Claim: A Z’ B = (N A D A, D B 3, λ A +2 λ B 2 ) Let B i a D A ×D A permutation matrix Note that the normalized adjacency matrix corresponding to steps 2-4 is Thus

51 B i is a permutation matrix thus We can now decompose M’α || Substitutting this in the formula we get that

52 All the eigenvalues of M’ are smaller than 1 since they are eigenvalues of an normalized adjacency matrix of an undirected regular graph. Thus M’ does not increase the length of any vector.

53 Using the same techniques from previous results we get the desired result.

54 The affine plane Consider field F q such that q = p t for some prime number t. We define AF q be a F q × F q graph such that each vertex is a pair. We put an edge between (a, b) and (c, d) if and only if ac = b + d, i.e. we connect for all the points on the line y = ax - b.

55 Example (4, 4)(4, 3)(4, 2)(4, 1) (1, 4) (1, 3) (1, 2) (1, 1) (2, 1)(2, 2)(2, 3)(2, 4) (3, 1) (3, 2) (3, 3) (3, 4)

56 Lemma: AF q = (q 2, q, q -½ ). Proof : An entry in the square of the normalized adjacency matrix of AF q in row (a, b) and column (c, d) holds the number of common neighbors of (a, b) and (c, d). Since each vertex neighbor is a line, the common neighbors of (a, b) and (c, d) is |L a,b  L c,d | / q 2.

57 We distinguish between 3 cases: a ≠ c The two lines intersect in exactly one point. a = c and b ≠ d The two lines does not intersect. a = c and b = d The two lines intersect in exactly q points. Denote I q the identity matrix in size q Denote J q the all one’s matrix in size q

58 Obviously Since eigenvalues of J q are q (one time) and 0 ( q - 1 times), (J q - I q )  J q eigenvalues are q(q – 1), -q and 0. I q  q qI q contribute s q to each eigenvalue. Dividing it by q we get that M 2 eigenvalues are 1, 0 and 1/q, thus the 2 nd largest eigenvalue is q -1, and M’ s 2 nd largest eigenvalue is q -½.

59 Define the following graph family: (APq) 1 = (APq)  APq) (APq) i+1 = (APq) i Z (APq) Combining it with the previous theorem we get that (APq) i = (q 2(i+1), q 2, O(iq -½ ))