Graph Algorithms – 2.

Slides:



Advertisements
Similar presentations
Introduction to Algorithms Graph Algorithms
Advertisements

Comp 122, Spring 2004 Graph Algorithms – 2. graphs Lin / Devi Comp 122, Fall 2004 Identification of Edges Edge type for edge (u, v) can be identified.
Comp 122, Fall 2004 Elementary Graph Algorithms. graphs Lin / Devi Comp 122, Fall 2004 Graphs  Graph G = (V, E) »V = set of vertices »E = set of.
Tirgul 7 Review of graphs Graph algorithms: –DFS –Properties of DFS –Topological sort.
Elementary Graph Algorithms Depth-first search.Topological Sort. Strongly connected components. Chapter 22 CLRS.
Theory of Computing Lecture 6 MAS 714 Hartmut Klauck.
Lecture 16: DFS, DAG, and Strongly Connected Components Shang-Hua Teng.
More Graphs COL 106 Slides from Naveen. Some Terminology for Graph Search A vertex is white if it is undiscovered A vertex is gray if it has been discovered.
Graphs - Definition G(V,E) - graph with vertex set V and edge set E
Tirgul 8 Graph algorithms: Strongly connected components.
Tirgul 11 DFS Properties of DFS Topological sort.
16a-Graphs-More (More) Graphs Fonts: MTExtra:  (comment) Symbol:  Wingdings: Fonts: MTExtra:  (comment) Symbol:  Wingdings:
CS 473Lecture 151 CS473-Algorithms I Lecture 15 Graph Searching: Depth-First Search and Topological Sort.
Data Structures, Spring 2004 © L. Joskowicz 1 Data Structures – LECTURE 14 Strongly connected components Definition and motivation Algorithm Chapter 22.5.
CPSC 311, Fall CPSC 311 Analysis of Algorithms Graph Algorithms Prof. Jennifer Welch Fall 2009.
UMass Lowell Computer Science Analysis of Algorithms Prof. Karen Daniels Spring, 2001 Makeup Lecture Chapter 23: Graph Algorithms Depth-First SearchBreadth-First.
CPSC 411 Design and Analysis of Algorithms Set 8: Graph Algorithms Prof. Jennifer Welch Spring 2011 CPSC 411, Spring 2011: Set 8 1.
1 Data Structures DFS, Topological Sort Dana Shapira.
Lecture 10 Topics Application of DFS Topological Sort
CSE 780 Algorithms Advanced Algorithms Graph Alg. DFS Topological sort.
Data Structures, Spring 2006 © L. Joskowicz 1 Data Structures – LECTURE 14 Strongly connected components Definition and motivation Algorithm Chapter 22.5.
Depth-First Search Idea: Keep going forward as long as there are unseen nodes to be visited. Backtrack when stuck. v G G G G is completely traversed.
COSC 3101A - Design and Analysis of Algorithms 10
Elementary Graph Algorithms CSc 4520/6520 Fall 2013 Slides adapted from David Luebke, University of Virginia and David Plaisted, University of North Carolina.
Spring 2015 Lecture 10: Elementary Graph Algorithms
Graphs.
Lecture 11 Algorithm Analysis Arne Kutzner Hanyang University / Seoul Korea.
Jan Topological Order and SCC Edge classification Topological order Recognition of strongly connected components.
Topological Sort (an application of DFS) CSC263 Tutorial 9.
1 Chapter 22 Elementary Graph Algorithms. 2 Introduction G=(V, E) –V = vertex set –E = edge set Graph representation –Adjacency list –Adjacency matrix.
Elementary Graph Algorithms Many of the slides are from Prof. Plaisted’s resources at University of North Carolina at Chapel Hill.
 2004 SDU Lectrue4-Properties of DFS Properties of DFS Classification of edges Topological sort.
Chapter 22: Elementary Graph Algorithms
Shahed University Dr. Shahriar Bijani May  A path is a sequence of vertices P = (v 0, v 1, …, v k ) such that, for 1 ≤ i ≤ k, edge (v i – 1, v.
1 Chapter 22: Elementary Graph Algorithms III. 2 About this lecture Topological Sort.
1 Algorithms CSCI 235, Fall 2015 Lecture 35 Graphs IV.
ALGORITHMS THIRD YEAR BANHA UNIVERSITY FACULTY OF COMPUTERS AND INFORMATIC Lecture nine Dr. Hamdy M. Mousa.
 2004 SDU 1 Lecture5-Strongly Connected Components.
CSC317 1 At the same time: Breadth-first search tree: If node v is discovered after u then edge uv is added to the tree. We say that u is a predecessor.
Chapter 22: Elementary Graph Algorithms Overview: Definition of a graph Representation of graphs adjacency list matrix Elementary search algorithms breadth-first.
Graph Algorithms – 2. graphs Parenthesis Theorem Theorem 22.7 For all u, v, exactly one of the following holds: 1. d[u] < f [u] < d[v] < f [v] or.
CS138A Elementary Graph Algorithms Peter Schröder.
Introduction to Algorithms
Elementary Graph Algorithms
Chapter 22 Elementary Graph Algorithms
Main algorithm with recursion: We’ll have a function DFS that initializes, and then calls DFS-Visit, which is a recursive function and does the depth first.
Lecture 16 Strongly Connected Components
Topological Sort Minimum Spanning Tree
Depth-First Search Depth-first search is a strategy for exploring a graph Explore “deeper” in the graph whenever possible Edges are explored out of the.
Topological Sort (an application of DFS)
CS200: Algorithm Analysis
CSCE 411 Design and Analysis of Algorithms
Many slides here are based on E. Demaine , D. Luebke slides
CS 3343: Analysis of Algorithms
Graph Algorithms – 2 DAGs Topological order
Graph Representation Adjacency list representation of G = (V, E)
Lecture 10 Algorithm Analysis
Advanced Algorithms Analysis and Design
Advanced Algorithms Analysis and Design
Applications of DFS Topological sort (for directed acyclic graph)
Analysis of Algorithms CS 477/677
Topological Sort (an application of DFS)
Trevor Brown DC 2338, Office hour M3-4pm
Trevor Brown DC 2338, Office hour M3-4pm
Algorithms CSCI 235, Spring 2019 Lecture 35 Graphs IV
Elementary Graph Algorithms
CSC 325: Algorithms Graph Algorithms David Luebke /24/2019.
Advanced Algorithms Analysis and Design
Chapter 22: Elementary Graph Algorithms III
Graph Traversals Some applications require visiting every vertex in the graph exactly once. The application may require that vertices be visited in some.
Presentation transcript:

Graph Algorithms – 2

Parenthesis Theorem f [v] = finishing time (v turns from gray to black) Theorem 22.7 For all u, v, exactly one of the following holds: 1. d[u] < f [u] < d[v] < f [v] or d[v] < f [v] < d[u] < f [u] and neither u nor v is a descendant of the other. 2. d[u] < d[v] < f [v] < f [u] and v is a descendant of u. 3. d[v] < d[u] < f [u] < f [v] and u is a descendant of v. So d[u] < d[v] < f [u] < f [v] cannot happen. Like parentheses: OK: ( ) [ ] ( [ ] ) [ ( ) ] Not OK: ( [ ) ] [ ( ] ) Corollary v is a proper descendant of u if and only if d[u] < d[v] < f [v] < f [u]. d[v] = discovery time (v turns from white to gray)

Identification of Edges Edge type for edge (u, v) can be identified when it is first explored by DFS. Identification is based on the color of v. White – tree edge. Gray – back edge. Black – forward or cross edge.

Directed Acyclic Graph DAG – Directed graph with no cycles. Good for modeling processes and structures that have a partial order: a > b and b > c  a > c. But may have a and b such that neither a > b nor b > a. Can always make a total order (either a > b or b > a for all a  b) from a partial order.

Example DAG of dependencies for putting on goalie equipment. T-shirt batting glove socks shorts chest pad hose pants sweater skates mask leg pads catch glove blocker

Characterizing a DAG Proof: : Show that back edge  cycle. Lemma 22.11 A directed graph G is acyclic iff a DFS of G yields no back edges. Proof: : Show that back edge  cycle. Suppose there is a back edge (u, v). Then v is ancestor of u in depth-first forest. Therefore, there is a path v u, so v u v is a cycle. T T T V u B

Characterizing a DAG Proof (Contd.): Lemma 22.11 A directed graph G is acyclic iff a DFS of G yields no back edges. Proof (Contd.):  : Show that a cycle implies a back edge. c : cycle in G, v : first vertex discovered in c, (u, v) : preceding edge in c. At time d[v], vertices of c form a white path v u. Why? By white-path theorem, u is a descendent of v in depth-first forest. Therefore, (u, v) is a back edge. T T T v u B

Topological Sort A topological sort or topological ordering of a directed acyclic graph (DAG) is a linear ordering of its nodes in which each node comes before all nodes to which it has outbound edges A B D C E

Example A B D C E A B C D E

Topological Sort Want to “sort” a directed acyclic graph (DAG). A B D Think of original DAG as a partial order. Want a total order that extends this partial order.

Order Si el orden no es total, entonces es parcial. Orden total: Para todo par de nodos A, B en el grafo se cumpleque A precede a B o B precede a A A B D C E Si el orden no es total, entonces es parcial. ¿De qué tipo es este orden?

Topological Sort Performed on a DAG. Linear ordering of the vertices of G such that if (u, v)  E, then u appears somewhere before v. Topological-Sort (G) call DFS(G) to compute finishing times f [v] for all v  V as each vertex is finished, insert it onto the front of a linked list return the linked list of vertices Time: (V + E). Example: On board.

Example (Courtesy of Prof. Jim Anderson) A B D 1/ C E Linked List:

Example A B D 1/ 2/ C E Linked List:

Example A B D 1/ 2/3 C E Linked List: 2/3 E

Example A B D 1/4 2/3 C E Linked List: 1/4 2/3 D E

Example A B D 5/ 1/4 2/3 C E Linked List: 1/4 2/3 D E

Example A B D 5/ 1/4 6/ 2/3 C E Linked List: 1/4 2/3 D E

Example A B D 5/ 1/4 6/7 2/3 C E Linked List: 6/7 1/4 2/3 C D E

Example A B D 5/8 1/4 6/7 2/3 C E Linked List: 5/8 6/7 1/4 2/3 B C D E

Example A B D 9/ 5/8 1/4 6/7 2/3 C E Linked List: 5/8 6/7 1/4 2/3 B C

Example A B D 5/8 1/4 6/7 2/3 C E Linked List: 5/8 6/7 1/4 2/3 A B C D 9/10 6/7 2/3 C E Linked List: 5/8 6/7 1/4 2/3 9/10 A B C D E

Correctness Proof Just need to show if (u, v)  E, then f [v] < f [u]. When we explore (u, v), what are the colors of u and v? u is gray. Is v gray, too? No, because then v would be ancestor of u.  (u, v) is a back edge.  contradiction of Lemma 22.11 (dag has no back edges). Is v white? Then becomes descendant of u. By parenthesis theorem, d[u] < d[v] < f [v] < f [u]. Is v black? Then v is already finished. Since we’re exploring (u, v), we have not yet finished u. Therefore, f [v] < f [u].

Strongly Connected Components G is strongly connected if every pair (u, v) of vertices in G is reachable from one another. A strongly connected component (SCC) of G is a maximal set of vertices C  V such that for all u, v  C, both u v and v u exist.

Component Graph GSCC = (VSCC, ESCC). VSCC has one vertex for each SCC in G. ESCC has an edge if there’s an edge between the corresponding SCC’s in G. GSCC for the example considered:

GSCC is a DAG Proof: Suppose there is a path v v in G. Lemma 22.13 Let C and C be distinct SCC’s in G, let u, v  C, u, v  C, and suppose there is a path u u in G. Then there cannot also be a path v v in G. Proof: Suppose there is a path v v in G. Then there are paths u u v and v v u in G. Therefore, u and v are reachable from each other, so they are not in separate SCC’s.

Transpose of a Directed Graph GT = transpose of directed G. GT = (V, ET), ET = {(u, v) : (v, u)  E}. GT is G with all edges reversed. Can create GT in Θ(V + E) time if using adjacency lists. G and GT have the same SCC’s. (u and v are reachable from each other in G if and only if reachable from each other in GT.)

Algorithm to determine SCCs SCC(G) call DFS(G) to compute finishing times f [u] for all u compute GT call DFS(GT), but in the main loop, consider vertices in order of decreasing f [u] (as computed in first DFS) output the vertices in each tree of the depth-first forest formed in second DFS as a separate SCC Time: (V + E). Example: On board.

Example (Courtesy of Prof. Jim Anderson) G a b c d 1/10 8/9 3/4 2/7 11/16 1/10 8/9 13/14 12/15 3/4 2/7 5/6 e f g h

Example GT a b c d e f g h

Example cd abe fg h

How does it work? Idea: Notation: By considering vertices in second DFS in decreasing order of finishing times from first DFS, we are visiting vertices of the component graph in topologically sorted order. Because we are running DFS on GT, we will not be visiting any v from a u, where v and u are in different components. Notation: d[u] and f [u] always refer to first DFS. Extend notation for d and f to sets of vertices U  V: d(U) = minuU{d[u]} (earliest discovery time) f (U) = maxuU{ f [u]} (latest finishing time)

SCCs and DFS finishing times Lemma 22.14 Let C and C be distinct SCC’s in G = (V, E). Suppose there is an edge (u, v)  E such that u  C and v C. Then f (C) > f (C). Proof: Case 1: d(C) < d(C) Let x be the first vertex discovered in C. At time d[x], all vertices in C and C are white. Thus, there exist paths of white vertices from x to all vertices in C and C. By the white-path theorem, all vertices in C and C are descendants of x in depth-first tree. By the parenthesis theorem, f [x] = f (C) > f(C). C C u v x

SCCs and DFS finishing times Lemma 22.14 Let C and C be distinct SCC’s in G = (V, E). Suppose there is an edge (u, v)  E such that u  C and v C. Then f (C) > f (C). Proof: Case 2: d(C) > d(C) Let y be the first vertex discovered in C. At time d[y], all vertices in C are white and there is a white path from y to each vertex in C  all vertices in C become descendants of y. Again, f [y] = f (C). At time d[y], all vertices in C are also white. By earlier lemma, since there is an edge (u, v), we cannot have a path from C to C. So no vertex in C is reachable from y. Therefore, at time f [y], all vertices in C are still white. Therefore, for all w  C, f [w] > f [y], which implies that f (C) > f (C). C C u v x y

SCCs and DFS finishing times Corollary 22.15 Let C and C be distinct SCC’s in G = (V, E). Suppose there is an edge (u, v)  ET, where u  C and v  C. Then f(C) < f(C). Proof: (u, v)  ET  (v, u)  E. Since SCC’s of G and GT are the same, f(C) > f (C), by Lemma 22.14.

Correctness of SCC When we do the second DFS, on GT, start with SCC C such that f(C) is maximum. The second DFS starts from some x  C, and it visits all vertices in C. Corollary 22.15 says that since f(C) > f (C) for all C  C, there are no edges from C to C in GT. Therefore, DFS will visit only vertices in C. Which means that the depth-first tree rooted at x contains exactly the vertices of C.

Correctness of SCC The next root chosen in the second DFS is in SCC C such that f (C) is maximum over all SCC’s other than C. DFS visits all vertices in C, but the only edges out of C go to C, which we’ve already visited. Therefore, the only tree edges will be to vertices in C. We can continue the process. Each time we choose a root for the second DFS, it can reach only vertices in its SCC—get tree edges to these, vertices in SCC’s already visited in second DFS—get no tree edges to these.