1. Introduction to Flocking {Stochastic Matrices} A. S. Morse Yale University Gif – sur - Yvette May 21, 2012 TexPoint fonts used in EMF. Read the TexPoint manual before you delete this box.: A A A A A A A A AA A A AAAA A Supelec EECI Graduate School in Control

3. CRAIG REYNOLDS - 1987 BOIDS The Lion King

4. separationcohesion alignment CRAIG REYNOLDS - 1987 BOID neighborhood BOIDS Flocking Rules

5. separationcohesion alignment Flocking Rules Demetri Terzopoulos

6. Motivated by simulation results reported in

7. s µ i s = spee d µ i = h ea di ng Each agent’s heading is updated at the same time as the rest using a local rule based on the average of its own current heading plus the headings of its “neighbors.” Vicsek’s simulations demonstrated that these nearest neighbor rules can cause all agents to eventually move in the same direction despite 1. the absence of a leader and/or centralized coordination 2. the fact that each agent’s set of neighbors changes with time.

8. Vicsek Model

9. riri agent i neighbors of agent i Each agent is a neighbor of itself Each agent has its own sensing radius r i So neighbor relations are not symmetric

10. s µ i s = spee d µ i = h ea di ng HEADING UPDATE EQUATIONS Average at time t of headings of neighbors of agent i. Vicsek Flocking Problem: Under what conditions do all n headings converge to a common value? N i (t) = set of indices of agent i 0 s neighbors at time t n i (t) = number of indices in N i (t) Another rule: Convex combination {Requires collaboration!}

11. 7 4 1 3 5 2 6 (1,2) j i j i sane i g hb oro f i N e i g hb orgrap h s = se lf -arce d grap h s Neighbor Graph N of Index Sets N 1, N 2,…., N n G = all directed graphs with vertex set V = {1,2,…,n} N = graph in G with an arc from j to i whenever j 2 N i, i 2 {1,2,…,n} A self-arced graph = any graph G with self-arcs at all vertices

12. 7 4 1 3 5 2 6 (1,2) State Space Model Adjacency Matrix A G of a graph G 2 G : An n £ n matrix of 0 ‘ s and 1 ’ s with a ij = 1 whenever there is an arc in G from i to j. In-degree of vertex i = number of arcs entering vertex i Out-degree of vertex i = number of arcs leaving vertex i In-degree = 4, out-degree = 1 _ 4

13. State Model: State Space Model Update Eqns: Adjacency Matrix A G of a graph G 2 G : An n £ n matrix of 0 ‘ s and 1 ’ s with a ij = 1 whenever there is an arc in G from i to j. Flocking Matrix F N of a neighbor graph N 2 G : bijection j D N = di agona l f d 1 ; d 2 ;:::; d n g an d d i = i n- d egreeo f ver t ex i = n X = 1 a ji where n i =

14. Vicsek flocking problem: Under what conditions do all n headings converge to a common value? No common quadratic Lyapunov function exists A switched linear system is at least non-increasing along trajectories B u tt h enon-nega t i ve f unc t i on V ( µ ) = max i f µ i g ¡ m i n i f µ i g µ ( t + 1 ) = F N ( t ) µ ( t ) But it takes much more to conclude that V ! 0 Verify this!

15. and so where For if this is so, then Vicsek flocking problem: Under what conditions do all n headings converge to a common value? µ ( t + 1 ) = F N ( t ) µ ( t ) Problem reduces to determining conditions on the sequence N (0), N (1),... under which where

16. {Right} Stochastic Matrices 1. i t h ason l ynon-nega t i veen t r i es 2. its row sums all equal 1 Flocking matrices are stochastic Stochastic matrices closed under multiplication S n £ n = stochastic if – flocking matrices are not Therefore it is sufficient to determine conditions on an infinite sequence of n £ n stochastic matrices S 1, S 2,.... so that If S is a compact set of n £ n stochastic matrices whose members each have at least one positive column, then for each sequence of matrices S 1, S 2, … from S, and this limit is approached exponentially fast. Why is this true? This is a well studied problem in the theory of non-homogeneous Markov chains

17. Induced Norms and Semi-Norms For M 2 R n £ n and p > 0, let ||M|| p denote the induced matrix p norm on R n £ n. 1. Nonnegative: |M| p ¸ 0 2. Homogeneous: |rM| p = r|M| p 3. Triangle inequality: |M 1 + M 2 | p · |M 1 | p + |M 2 | p verify! These three properties mean that | ¢ | p is a semi-norm {If |M| p = 0 were to imply M = 0, then | ¢ | p would be a norm.} We will be interested primarily in the cases p = 1, 2, 1 : For any such p, define |M| p = 0 ; M = 0

18. 2. Sub-multiplicative: Suppose M is a subset of R n £ n such that M1 = 1 for all M 2 M. Then 1. |M| p · 1 if ||M|| p · 1 M is semi - contractive in the p semi-norm if |M| p < 1 Additional Properties of Let c 0,c 1 and c 2 denote values of c which minimize ||M 2 M 1 - 1c|| p, ||M 1 -1c|| p, and ||M 2 -1c|| p respectively. Because |M| p · ||M|| p Proof: 1 = M 2 1

19. Suppose M is a subset of R n £ n such that M1 = 1 for all M 2 M. Let p be fixed and let C be a compact set of semi - contractive matrices in M. Let Then for each infinite sequence of matrices M 1, M 2,... in C, the matrix product converges as i ! 1 as fast as ¸ i converges to zero, to a rank one matrix of the form 1c. A stochastic matrix S is semi-contractive in the semi-norm | ¢ | 1 if S has a positive column. To do this, it is enough to show that: We want to use this fact to prove that: If S is a compact set of n £ n stochastic matrices whose members each have at least one positive column, then for each sequence of matrices S 1, S 2, … from S, and this limit is approached exponentially fast. Proof: See board

20. Any stochastic matrix S can be written as S = 1c + T where c is the largest row vector for which S - 1c is nonnegative and T = S – 1c T1 = S1 – 1c1 = (1 - c1)1 so all row sums of T = (1 - c1) Moreover c  0 if and only if S has a positive column. verify! ¸ 0 because T ¸ 0 Therefore (1 – c1) < 1 if and only if S has a positive column A stochastic matrix S is semi-contractive in the semi-norm | ¢ | 1 if S has a positive column.

21. Transitioning from Matrices to Graphs For a nonnegative matrix M n £ n, °(M) is that graph whose adjacency matrix is the transpose of the matrix which results when each non-zero entries in M is replaced by a 1. In other words, for a nonnegative matrix M, °(M) is that graph which has an arc (i, j) from i to j whenever m j,i  0.

22. strongly rooted graph Transitioning from Matrices to Graphs For a nonnegative matrix M n £ n, °(M) is that graph whose adjacency matrix is the transpose of the matrix which results when each non-zero entries in M is replaced by a 1. °( F N ) = °( A 0 N ) = N A graph is strongly rooted if at least one vertex is adjacent to every vertex in the graph °(M) is strongly rooted, M has a positive column For any nonnegative matrix M, °(M) has an arc (i, j) whenever m j,i  0. Motivation for strongly rooted:

23. If S is a compact set of n £ n stochastic matrices whose members each have at least one positive column, then for each sequence of matrices S 1, S 2, … from S, and this limit is approached exponentially fast. Transitioning from Matrices to Graphs If S is a compact set of n £ n stochastic matrices whose members each have a strongly rooted graph, then for each sequence of matrices S 1, S 2, … from S, and this limit is approached exponentially fast.

24. ... T TqTq T2T2 T1T1 Thus establishing convergence to 1c of an infinite product of stochastic matrices boils down to determining when the graph of a product of stochastic matrices is strongly rooted. Transitioning from Matrices to Graphs When does If then

25. °(BA) = °(B) ± °(A) Transitioning from Matrices to Graphs By the composition of graph G 2 2 G with graph G 1 2 G, written G 2 ± G 1, is that directed graph in G which has an arc (i, j) from i to j whenever there is an integer k such that (i, k) is an arc in G 1 and (k, j) is an arc in G 2. If A and B are nonnegative n £ n matrices and C = BA, then Thus c ji  0 if and only if for some k, b jk  0 and a ki  0. Therefore (i, j) is an arc in °(C) if and only if for some k, (i, k) is an arc in °(A) and (k, j) is an arc in °(B). As before G = set of all directed graphs with vertex set {1,2,....,n}. What motivates this definition?

26. Thus deciding when a finite product of stochastic matrices has a strongly rooted graph is the same problem as deciding when a finite composition of graphs is strongly rooted. So............ Transitioning from Matrices to Graphs When is the composition of a finite number of graphs strongly rooted? °(S 2 S 1 ) = °(S 2 ) ± °(S 1 ) Graph composition is defined so that for any two n £ n stochastic matrices S 1 and S 2

27. 3 roots rooted graph A rooted graph is any graph in G which has has at least one vertex v which, for each vertex i 2 V there is a directed path from v to i. Every composition of (n – 1) 2 or more self-arced, rooted graphs in G is strongly rooted. The set of self-arced, rooted graphs in G is the largest set of set of self-arced graphs in G for which every sufficiently long composition is strongly rooted. When is the composition of a finite number of graphs strongly rooted? Proof: See notes.

28. Every composition of (n – 1) 2 or more self-arced, rooted graphs in G is strongly rooted.

29. Every composition of (n – 1) 2 or more self-arced, rooted graphs in G is strongly rooted. If G 1 has a self-arc at i and (i, j) 2 A ( G 2 ) for some j, then (i, j) 2 A ( G 2 ± G 1 ) If G 2 has a self-arc at j and (i, j) 2 A ( G 1 ) for some i, then (i, j) 2 A ( G 2 ± G 1 ) If G 1 and G 2 both have self-arcs at all vertices, then A ( G 2 ) [A ( G 1 ) ½ A ( G 2 ± G 1 ). For given graphs G 1, G 2 2 G, G 2 ± G 1, is that graph in G for which (i, j) 2 A ( G 2 ± G 1 ) whenever there is an integer k such that (i, k) 2 A ( G 1 ) and (k, j) 2 A ( G 2 ). If G 1 has a self-arc at i, then (i, i) 2 A ( G 1 ). If G 2 has a self-arc at j, then (j, j) 2 A ( G 2 ). In general for A ( G 2 ) [A ( G 1 )  A ( G 2 ± G 1 ) even if both graphs are self-arced. However for self-arced graphs, if there is a directed path between i and j in G 2 ± G 1 then there is a directed bath between i and j in G 2 [ G 1 Define A ( G ) = set of arcs in G

30. If S is a compact set of n £ n stochastic matrices whose members each have a strongly rooted graph, then for each sequence of matrices S 1, S 2, … from S, and this limit is approached exponentially fast. If S is a compact set of n £ n stochastic matrices whose members each have a self-arced, rooted graph, then for each sequence of matrices S 1, S 2, … from S, and this limit is approached exponentially fast. We can generalize further still.............. strongly rooted strongly rooted strongly rooted

31. An infinite sequence of graphs G 1, G 2,... in G is repeatedly jointly rooted if there is a finite positive integer m for which each of the sequences G m(k -1)+1,....... G k -1, k ¸ 1, is jointly rooted. An finite sequence of graphs G 1, G 2,..., G p in G is jointly rooted if the composed graph G p ± G p-1 ±  ± G 1 is rooted. Repeatedly Jointly Rooted Sequences... rooted repeatedly jointly rooted rooted If S is a compact set of n £ n stochastic matrices whose members each have a self-arced, rooted graph, then for each sequence of matrices S 1, S 2, … from S, and this limit is approached exponentially fast. compact set

32. and this limit is approached exponentially fast. Suppose S is a compact set of n £ n stochastic matrices whose members each have a self-arced graph. Suppose that S 1, S 2,..... is an infinite sequence of matrices from S whose corresponding sequence of graphs °(S 1 ), °(S 2 ),.... is repeatedly jointly rooted by sub-sequences of length m. Suppose in addition that the set of all products of m matrices from S with rooted graphs, written C (m), is closed. Then Compactness of S does not in general imply compactness of C (m). Exception: If S is finite and thus compact {as in flocking applications} so is C (m) Construct an example for 2 £ 2 matrices with m = 2. Exception: If S is the set of stochastic matrices modeling the convex combo flocking rule, then S and C (m) are both compact. verify this! Flocking Theorem: For each trajectory of the Vicsek flocking system µ(t +1) = F N (t) µ(t) along which the sequence of neighbor graphs N (0), N (1),.... is repeatedly jointly rooted, there is a constant steady state heading µ ss which µ(t) approaches exponentially fast, as t ! 1.

33. Collectively Rooted Sequences The flocking theorem relies on the notion of jointly rooted sequences: An finite sequence of graphs G 1, G 2,..., G p in G is jointly rooted if the composed graph G p ± G p-1 ±  ± G 1 is rooted. By the union of G 1, G 2 2 G is meant that graph G 1 [ G 2 in G with arc set A ( G 1 ) [ A ( G 2 ). An finite sequence of graphs G 1, G 2,..., G p in G is collectively rooted if the union graph G p [ G p-1 [  [ G 1 is rooted. In general, for self-arced graphs A ( G p [ G p-1 [  [ G 1 ) is a strictly proper subset of A ( G p ± G p-1 ±  ± G 1 ) However, for each arc (i, j) 2 A ( G p ± G p-1 ±  ± G 1 ) there must be a directed path between (i, j) in G p [ G p-1 [  [ G 1 Therefore for self-arced graphs, the sequence G 1, G 2,..., G p in G is jointly rooted if and only if it is collectively rooted.

34. Leader Following Suppose that one of the agents in the group, namely agent k, ignores Vicsek’s update rule and decides instead to move with some arbitrary but fixed heading  0. Suppose that the remaining agents are unaware of this non-conformist’s decision and continue to follow Vicsek’s rule just as before. Note that under these conditions, agent k must have no neighbors to follow which means that vertex k of any neighbor graph N for the group cannot have any incident arcs. Because of this, the only possible way such a graph N could be rooted or strongly rooted would be if vertex k were the root of N and the only root of N. All of the preceding results are applicable to this case without change. Thus for example, all agents in the group will eventually move in the same direction as agent k if the sequence of neighbor graphs is repeatedly jointly rooted. However more can be said in this special case

35. Leader Following For example, suppose that the neighbor graphs N (1), N (2),..... are all rooted. Then each N (t) must be rooted at k. It was noted before that the composition of any (n -1) 2 self-arced rooted graphs in G must be strongly rooted. However in the special case of self-arced, rooted graphs in G which all have a root at the same vertex v, it takes the composition of only (n -1) of them to produce a strongly rooted graph. See notes for a proof Because of this, one would expect faster convergence than in the leaderless case, all other things being equal.

36. FOLLOWING RED LEADER

37. Leader’s Neighbors Yellow

38. FOLLOWING RED LEADER Rectangle Pattern Leader’s Neighbors Yellow

39. Symmetric Neighbor Relations The original version of the flocking problem considered the case when all neighbor relations were symmetric – that is if agent i is a neighbor of agent j then agent j is a neighbor of agent i. Mathematically, a symmetric neighbor relation means that i 2 N j, j 2 N i The corresponding neighbor graph N would thus be “symmetric” as well. A directed graph G 2 G is symmetric if (i, j) 2 A ( G ), (j, i) 2 A ( G ) A rooted symmetric graph is the same thing as a “strongly connected’’ symmetric graph A graph G 2 G is strongly connected if there is a directed path between any two distinct vertices i and j.

40. Another Way to Write the Vicsek Flocking System L(t) is a symmetric matrix if N (t) is symmetric.

41. Simplified Rule for Symmetric Neighbor Relations 1. Symmetric Simplified flocking matrix: 2. Nonnegative if g > max d i L1 = D1 – A1 = 03. F s 1 = 1 F s is stochastic if g > max d i

42. Comparing Flocking Matrices Let N be a given self-arcd directed, symmetric, neighbor graph. °(F s ) = °(F) = N Therefore all convergence results hold without change for the simplified flocking rule assuming symmetric neighbor relations. A = A 0 Can extend the symmetric case to continuous time.

43. Convergence Rates First we will consider this matter in relation to the semi-norm | ¢ | 1

44. Let C be a compact set of n £ n stochastic matrices which are semi - contractive in the infinity norm. Then for each infinite sequence of matrices S 1 S 2,... in C, the matrix product converges as i ! 1 to a rank one matrix as fast as converges to zero. Note that the ith entry c i in c must be the smallest entry in the ith column of S. Since (1 – c1) · 1 - c i for any i, Any stochastic matrix S can be written as S = 1c + T where c is the largest row vector for which S - 1c is nonnegative and T = S – 1c So what we’d like is a uniform upper bound on |S| 1 over C. = a convergence rate bound

45. Suppose that F is a flocking matrix whose graph is strongly rooted at vertex k Then °(F) must have an arc from vertex k to each other vertex in the graph which means that the kth row of adjacency matrix A of °(F) must be [1 1 1  1] Since F = D -1 A 0 where D = diagonal {n 1,n 2,..., n n }, the kth column of F must be The smallest entry in this column is bounded below by Therefore for any flocking matrix F with a strongly rooted graph Convergence Rate Bound for Flocking Matrices with Strongly Rooted Graphs = a convergence rate bound If c i is the smallest element in the ith column of S, then |S| 1 · 1 – c i

46. An Explicit Formula for the Infinity Semi-Norm If M is a stochastic matrix, the quantity on the right is known as the coefficient of ergodicity. See notes of a proof of this fact. For any real numbers x and y So for a stochastic matrix S For any nonnegative n £ n matrix M,

47. 1. |S| 1 · 1Because |S| 1 · ||S|| 1 = 1 2. |S| 1 = 0 if and only if all rows are equal = iff S = 1c Therefore |S| 1 < 1 iff for each distinct i and j, s ik  0 and s jk  0 for at least one value of k. A stochastic matrix with this property is called a scrambling matrix * For fixed i and j, the kth term in the sum in will be positive iff s ik  0 and s jk  0 * Therefore the sum in will be positive iff s ik  0 and s jk  0 for at least one value of k *

48. Summary A stochastic matrix S is a scrambling matrix for each distinct i and j, s ik  0 and s jk  0 for at least one value of k. Equivalently, a stochastic matrix is a scrambling matrix if no two rows are orthogonal. A stochastic matrix is a semi-contraction in the infinity norm iff it is a scrambling matrix. An explicit formula for the infinity semi-norm of any stochastic matrix S is

49. The Graph of a Scrambling Matrix. A graph G 2 G is neighbor shared if each two distinct vertices i and j have a common neighbor k A stochastic matrix S is a scrambling matrix if and only if its graph is neighbor shared. A stochastic matrix S is a scrambling matrix for each distinct i and j, s ik  0 and s jk  0 for at least one value of k. In a strongly rooted graph there must be a root which is the neighbor of each vertex in the graph. So........... Every strongly rooted graph is neighbor shared. The converse is clearly false.

50. 2 1 4 3 2 and 4 share 4 1 and 2 share 2 1 and 3 share 2 1 and 4 share 4 3 and 4 share 1 2 and 3 share 2 Neighbor-Shared Directed Graph A neighbor shared graph is a directed graph in which each pair of distinct vertices share a common neighbor

51. Suppose G 2 G is neighbor shared. Then any pair of vertices (i, j) must be reachable from a {common neighbor} vertex k. Suppose for some integer p 2 {2, 3,..., n -1}, each subset of p vertices is reachable from a single vertex. Let {v 1, v 2,..., v p } be any any such set and let v be a vertex from which all of the v i can be reached. Let w be any vertex not in the set {v 1, v 2,..., v p }. Since G is neighbor shared, w and v can be reached from a common vertex y Therefore every vertex in the set {v 1, v 2,..., v p, w} can be reached from y. So every subset of p + 1 vertices in the graph is reachable from a single vertex. Every neighbor-shared graph in G is rooted. Converse is false. Verify by constructing an example. Strongly rooted graphs ½ neighbor shared graphs ½ rooted graphs So by induction all n vertices are reachable from a single vertex.

52. Strongly rooted graphs ½ neighbor shared graphs ½ rooted graphs The composition on any n – 1 or more self-arced, rooted graphs in G is neighbor shared. Proof: See notes. The composition on any n – 1 or more neighbor-shared graphs in G is strongly rooted. We will use this fact a little later to get a convergence rate bound for products of flocking matrices whose sequence of graphs is repeatedly jointly rooted. Compositions of rooted and neighbor shared graphs Let’s outline a proof of this:

53. A graph G 2 G is k neighbor shared if each set of k distinct vertices in G share a common neighbor. A 2 neighbor shared graph is thus a neighbor shared graph and an n neighbor shared graph is obviously strongly rooted. Suppose G is neighbor shared and H is k neighbor shared for some k < n Let {v 1, v 2,..., v k+1 } be distinct vertices. Since H is k neighbor shared, in H {v 1, v 2,..., v k } share a common neighbor p and {v 2, v 3,..., v k +1 } share a common neighbor q Since G is neighbor shared, in G p and q share a common neighbor w. In H ± G, vertices v 1, v 2,..., v k must have w for a neighbor as must vertices v 2, v 3,..., v k +1 Therefore in H ± G, vertices v 1, v 2,..., v k+1 must have w for a neighbor. Complete the proof using induction. The composition on any n – 1 or more neighbor-shared graphs in G is strongly rooted. Therefore H ± G must be k + 1 neighbor shared.

54. Let C be a compact set of n £ n stochastic matrices which are semi - contractive in the infinity norm. Then for each infinite sequence of matrices S 1 S 2,... in C, the matrix product converges as i ! 1 to a rank one matrix as fast as converges to zero. Let C be a compact set of n £ n scrambling matrices. Then for each infinite sequence of matrices S 1 S 2,... in C, the matrix product converges as i ! 1 to a rank one matrix as fast as converges to zero. Scrambling matrices are semi-contractive in the infinity norm. What can be said about convergence rate for scrambling matrices which are also flocking matrices? Convergence rate bounds for products of scrambling matrices

55. Since all d i · n, all non-zero f ij satisfy d i = in-degree of vertex i D = diagonal {d 1, d 2, …, d n } n £ n a ij = 1 if i is a neighbor of j a ij = 0 otherwise A = [a ij ] °(F) = N = neighbor shared Worst Case |F| 1 for F = D -1 A 0 = Scrambling

56. Since all d i · n, all non-zero f ij satisfy d i = in-degree of vertex i D = diagonal {d 1, d 2, …, d n } n £ n a ij = 1 if i is a neighbor of j a ij = 0 otherwise A = [a ij ] Fix distinct i and j and let k be a shared neighbor. Then f ik  0  f jk. °(F) = N = neighbor shared Worst Case |F| 1 for F = D -1 A 0 = Scrambling

57. Vertex 1 has only itself as a neighbor Vertex 2 has every vertex as a neighbor n ¸ 3 For i > 2, vertex i has only itself and vertex 1 as neighbors 2 1 4 3 How tight is this bound? °(F) = N = neighbor shared Worst Case |F| 1 for F = D -1 A 0 = Scrambling

58. There exist infinite product of n £ n flocking matrices with neighbor-shared graphs which actually converge to a rank-one matrix product 1c at this rate. Flocking Matrices with Neighbor-Shared Graphs Summary Every infinite product of n £ n flocking matrices with neighbor-shared graphs converges to a rank-one matrix product 1c at a rate no slower than

59. Let S be a compact set of n £ n rooted matrices and write C for the compact set of all products of n – 1 matrices from S. Then for each infinite sequence of matrices S 1 S 2,... in S, the matrix product converges as i ! 1 to a rank one matrix as fast as converges to zero The composition on any n – 1 or more self-arced, rooted graphs in G is neighbor shared. Let C be a compact set of n £ n scrambling matrices. Then for each infinite sequence of matrices S 1 S 2,... in C, the matrix product converges as i ! 1 to a rank one matrix as fast as converges to zero. Convergence rates for products of stochastic matrices with rooted graphs What can be said about the convergence rate for the product of an infinite sequence of flocking matrices whose sequence of graphs is repeatedly jointly rooted?

60. For any nonzero matrix M ¸ 0, define Á(M) = smallest nonzero element of M. For S 1 and S 2 n £ n stochastic matrices We need a few ideas Note that M can be written as where By induction

61. Recall that Suppose S is scrambling Claim that Since S is scrambling, for any distinct i and j there must be a k such that

62. F (p) = { F p F p-1  F 1 : F i 2 F, { ° (F 1 ), ° (F 2 ),...,° (F p ) } is jointly rooted } F = set of all n £ n flocking matrices F k (p) = set of all products of k matrices from F (p) Each matrix in F k (p) is scrambling if k ¸ n - 1 Each matrix in F (p) is rooted For any F 2 F, If S 2 F k (p), then S is the product of kp flocking matrices so If S is scrambling |S| 1 · 1 - Á(S) The composition on any n – 1 or more self-arced, rooted graphs in G is neighbor shared. If k = n – 1, then S is scrambling and Therefore a convergence rate bound for the infinite product of flocking matrices whose sequence of graphs is repeatedly jointly rooted is