Exponential random graphs and dynamic graph algorithms David Eppstein Comp. Sci. Dept., UC Irvine.

Slides:



Advertisements
Similar presentations
Hardware and Petri nets Symbolic methods for analysis and verification.
Advertisements

Dynamic Graph Algorithms - I
Exact Inference in Bayes Nets
Dynamic Bayesian Networks (DBNs)
Breadth-First Search Seminar – Networking Algorithms CS and EE Dept. Lulea University of Technology 27 Jan Mohammad Reza Akhavan.
SILVIO LATTANZI, D. SIVAKUMAR Affiliation Networks Presented By: Aditi Bhatnagar Under the guidance of: Augustin Chaintreau.
Perfect Matching for Biconnected Cubic Graphs in O(nlog 2 n) Time Krzysztof Diks & Piotr Stańczyk.
1 Representing Graphs. 2 Adjacency Matrix Suppose we have a graph G with n nodes. The adjacency matrix is the n x n matrix A=[a ij ] with: a ij = 1 if.
1 On Compressing Web Graphs Michael Mitzenmacher, Harvard Micah Adler, Univ. of Massachusetts.
Presented by Ozgur D. Sahin. Outline Introduction Neighborhood Functions ANF Algorithm Modifications Experimental Results Data Mining using ANF Conclusions.
ETH Zurich – Distributed Computing Group Roger Wattenhofer 1ETH Zurich – Distributed Computing – Christoph Lenzen Roger Wattenhofer Minimum.
CSE 421 Algorithms Richard Anderson Lecture 4. What does it mean for an algorithm to be efficient?
High Performance Computing 1 Parallelization Strategies and Load Balancing Some material borrowed from lectures of J. Demmel, UC Berkeley.
SubSea: An Efficient Heuristic Algorithm for Subgraph Isomorphism Vladimir Lipets Ben-Gurion University of the Negev Joint work with Prof. Ehud Gudes.
1 On the Benefits of Adaptivity in Property Testing of Dense Graphs Joint work with Mira Gonen Dana Ron Tel-Aviv University.
Algorithms and Data Structures for Fast Computations on Networks Michael T. Goodrich Dept. of Computer Science University of California, Irvine.
Algebraic Structures and Algorithms for Matching and Matroid Problems Nick Harvey.
Maximal Cliques in UDG: Polynomial Approximation Rajarshi Gupta, Jean Walrand Dept of EECS, UC Berkeley Olivier Goldschmidt, OPNET Technologies International.
Finding a maximum independent set in a sparse random graph Uriel Feige and Eran Ofek.
Data Structures Hashing Uri Zwick January 2014.
Rubao Ji Advisor: Dr. Robert W. Robinson Committee: Dr. E. Rodney Canfield Dr. Daniel M. Everett   Dynamic connectivity algorithms for Feynman.
Neighbourhood Sampling for Local Properties on a Graph Stream A. Pavan, Iowa State University Kanat Tangwongsan, IBM Research Srikanta Tirthapura, Iowa.
Approximating the MST Weight in Sublinear Time Bernard Chazelle (Princeton) Ronitt Rubinfeld (NEC) Luca Trevisan (U.C. Berkeley)
Minimal Spanning Trees What is a minimal spanning tree (MST) and how to find one.
6. Experimental Analysis Visible Boltzmann machine with higher-order potentials: Conditional random field (CRF): Exponential random graph model (ERGM):
Lecture 13 Graphs. Introduction to Graphs Examples of Graphs – Airline Route Map What is the fastest way to get from Pittsburgh to St Louis? What is the.
CS 3343: Analysis of Algorithms Lecture 21: Introduction to Graphs.
+ Mayukha Bairy Disk Intersection graphs and CDS as a backbone in wireless ad hoc networks.
Theory of Computing Lecture 15 MAS 714 Hartmut Klauck.
GRAPHS CSE, POSTECH. Chapter 16 covers the following topics Graph terminology: vertex, edge, adjacent, incident, degree, cycle, path, connected component,
Mixture Models, Monte Carlo, Bayesian Updating and Dynamic Models Mike West Computing Science and Statistics, Vol. 24, pp , 1993.
Learning With Bayesian Networks Markus Kalisch ETH Zürich.
Data Structures & Algorithms Graphs
CSE 589 Part VI. Reading Skiena, Sections 5.5 and 6.8 CLR, chapter 37.
1 12/2/2015 MATH 224 – Discrete Mathematics Formally a graph is just a collection of unordered or ordered pairs, where for example, if {a,b} G if a, b.
Most of contents are provided by the website Graph Essentials TJTSD66: Advanced Topics in Social Media.
Slides for “Data Mining” by I. H. Witten and E. Frank.
Minimum Spanning Trees CS 146 Prof. Sin-Min Lee Regina Wang.
CS270 Project Overview Maximum Planar Subgraph Danyel Fisher Jason Hong Greg Lawrence Jimmy Lin.
Exact Inference in Bayes Nets. Notation U: set of nodes in a graph X i : random variable associated with node i π i : parents of node i Joint probability:
Data Structures and Algorithms in Parallel Computing Lecture 7.
A light metric spanner Lee-Ad Gottlieb. Graph spanners A spanner for graph G is a subgraph H ◦ H contains vertices, subset of edges of G Some qualities.
GRAPHS. Graph Graph terminology: vertex, edge, adjacent, incident, degree, cycle, path, connected component, spanning tree Types of graphs: undirected,
CSE 421 Algorithms Richard Anderson Winter 2009 Lecture 5.
Graphs Definition: a graph is an abstract representation of a set of objects where some pairs of the objects are connected by links. The interconnected.
1 Structure Learning (The Good), The Bad, The Ugly Inference Graphical Models – Carlos Guestrin Carnegie Mellon University October 13 th, 2008 Readings:
NOTE: To change the image on this slide, select the picture and delete it. Then click the Pictures icon in the placeholder to insert your own image. Fast.
CSE 421 Algorithms Richard Anderson Autumn 2015 Lecture 5.
1 CS270 Project Overview Maximum Planar Subgraph Danyel Fisher Jason Hong Greg Lawrence Jimmy Lin.
Graphs David Kauchak cs302 Spring Admin HW 12 and 13 (and likely 14) You can submit revised solutions to any problem you missed Also submit your.
Lecture 20. Graphs and network models 1. Recap Binary search tree is a special binary tree which is designed to make the search of elements or keys in.
Certifying Algorithms [MNS11]R.M. McConnell, K. Mehlhorn, S. Näher, P. Schweitzer. Certifying algorithms. Computer Science Review, 5(2), , 2011.
CS 201: Design and Analysis of Algorithms
Algorithms for Finding Distance-Edge-Colorings of Graphs
Graphs Lecture 19 CS2110 – Spring 2013.
Minimum Dominating Set Approximation in Graphs of Bounded Arboricity
Approximating the MST Weight in Sublinear Time
CS 3343: Analysis of Algorithms
CS 3343: Analysis of Algorithms
MST in Log-Star Rounds of Congested Clique
CIS 700: “algorithms for Big Data”
Randomized Algorithms CS648
CSCI B609: “Foundations of Data Science”
Richard Anderson Autumn 2016 Lecture 5
Richard Anderson Winter 2009 Lecture 6
Dynamic Graph Algorithms
GRAPHS Lecture 17 CS2110 Spring 2018.
Clustering.
Important Problem Types and Fundamental Data Structures
Richard Anderson Lecture 5 Graph Theory
Presentation transcript:

Exponential random graphs and dynamic graph algorithms David Eppstein Comp. Sci. Dept., UC Irvine

What are we trying to do? Probabilistic reasoning on social networks Appropriately model the different likelihoods of finding different types of network

Exponential Random Graphs Family of graphs with fixed vertex set Probability of a graph is proportional to exp(sum of weights of features) Different choices of features give simpler or more powerful models

ERG models can be simple… Easily subsumes many standard random graph models E.g. G(n,p): –Edges are independent w/probability p –Feature = edge –Weight = log(p) - log(1-p)

…but ERG models can also be very powerful Powerful enough to represent any distribution over n-vertex graphs –Feature = isomorphism with one graph –Weight = log(probability of that graph) More power requires a more complex set of features

Computational tasks for reasoning with ERGs Compute normalizing factor (partition function) for graph probabilities Generate random graphs from the model Use the model as a prior for max- likelihood data fitting, or modify the feature weights to fit the data

Monte Carlo methods for computing with ERGs Start with an arbitrary graph Repeatedly propose a small change (e.g., insert or delete a single edge) Compute log-likelihood of the modified graph and use it to accept or reject the proposed change

The Algorithmic Lens Social scientists and statisticians determine the sorts of models that best describe their data Algorithms researchers (e.g. me) figure out how to make the model run quickly Faster algorithms lead to the ability to use more accurate models

Algorithmic rephrasing of the computational task Maintain a dynamic graph subject to edge insertions and deletions As the graph changes, keep track of its computational properties efficiently (faster than recomputing them from scratch) The properties we track should be the ones needed for ERG feature vectors

A brief survey of dynamic graph algorithms Sparsification (E., Galil, Italiano, Nissenzweig, JACM ‘92): –Replace dense graphs by tree of sparse subgraphs –Applies to many problems including maintaining connected components –Replaces #edges by #vertices in running times of update algorithms

A brief survey of dynamic graph algorithms Fast dynamic connectivity (Holm, de Lichtenberg, Thorup, JACM 2001): –Maintain connected components, number of connected components, or a spanning tree (so can use #components as ERG feature) –Update time O(log n log log n) –Complicated, of interest to search for more easily implemented variants

A brief survey of dynamic graph algorithms Distance and reachability in graphs –Of likely use in ERGs (e.g. to model small- world properties of these graphs) –Some dynamic graph algorithms are known but more theoretical than practical

A brief survey of dynamic graph algorithms Graphs in the plane and on surfaces –E. et al, J. Algorithms 1992 –E. et al, J. Comp. Sys. Sci –E., SODA 2002 Of possible interest for integrating social networks with geographic data

Not-yet-dynamized graph algorithms useful for ERGs Low-degree orientations of sparse graphs (Chrobak, E., Theor. Comp. Sci. 1991) –Assign directions to the edges of the graph so that each vertex has O(1) outgoing edges –Enable fast search for small subgraphs (e.g. list all cliques in linear time) –May be found in linear time

Not-yet-dynamized graph algorithms useful for ERGs Finding all maximal complete bipartite subgraphs in a sparse graph (E., IPL 1994) –Allows concise representation of all four- vertex cycles (quadratically many cycles may be represented in linear space and time) –Based on low-degree orientation

Not-yet-dynamized graph algorithms useful for ERGs Subgraph isomorphism: finding all copies of some small pattern graph in a larger graph (E., J. Graph Th and J. Graph Algorithms 1999) –Commonly used as ERG features –Known fast algorithms rely on special graph properties e.g. planarity

Not-yet-dynamized graph algorithms useful for ERGs Centrality: measuring the importance of a node in a social network Fast approximation of closeness centrality based on small world hypothesis (E., Wang, J. Graph Algorithms 2004) Other centralities e.g. betweennness

Conclusions ERG are important model for social nets ERG computation naturally involves dynamic graphs Many existing dynamic graph algorithms known, not fully adapted to ERG problems Much opportunity for further study of dynamic graph algorithms in ERG setting