Iterative Byzantine Vector Consensus in Incomplete Graphs Nitin Vaidya University of Illinois at Urbana-Champaign ICDCN presentation by Srikanth Sastry.

Slides:



Advertisements
Similar presentations
Impossibility of Distributed Consensus with One Faulty Process
Advertisements

Lecture 8: Asynchronous Network Algorithms
Gossip and its application Presented by Anna Kaplun.
Distributed Computing 8. Impossibility of consensus Shmuel Zaks ©
Announcements. Midterm Open book, open note, closed neighbor No other external sources No portable electronic devices other than medically necessary medical.
Prepared by Ilya Kolchinsky.  n generals, communicating through messengers  some of the generals (up to m) might be traitors  all loyal generals should.
Linearizing Peer-to-Peer Systems with Oracles by Rizal Mohd Nor Mikhail Nesterenko Sébastien Tixeuil SSS 2013 Nov 13-16, 2013.
Basic Feasible Solutions: Recap MS&E 211. WILL FOLLOW A CELEBRATED INTELLECTUAL TEACHING TRADITION.
CPSC 668Set 10: Consensus with Byzantine Failures1 CPSC 668 Distributed Algorithms and Systems Fall 2009 Prof. Jennifer Welch.
Computational Geometry The art of finding algorithms for solving geometrical problems Literature: –M. De Berg et al: Computational Geometry, Springer,
Computational Geometry The art of finding algorithms for solving geometrical problems Literature: –M. De Berg et al: Computational Geometry, Springer,
Sergio Rajsbaum 2006 Lecture 3 Introduction to Principles of Distributed Computing Sergio Rajsbaum Math Institute UNAM, Mexico.
Convergent and Correct Message Passing Algorithms Nicholas Ruozzi and Sekhar Tatikonda Yale University TexPoint fonts used in EMF. Read the TexPoint manual.
CPSC 668Set 9: Fault Tolerant Consensus1 CPSC 668 Distributed Algorithms and Systems Fall 2006 Prof. Jennifer Welch.
CPSC 668Set 9: Fault Tolerant Consensus1 CPSC 668 Distributed Algorithms and Systems Spring 2008 Prof. Jennifer Welch.
Global Approximate Inference Eran Segal Weizmann Institute.
CPSC 668Set 10: Consensus with Byzantine Failures1 CPSC 668 Distributed Algorithms and Systems Fall 2006 Prof. Jennifer Welch.
1 Fault-Tolerant Consensus. 2 Failures in Distributed Systems Link failure: A link fails and remains inactive; the network may get partitioned Crash:
CPSC 689: Discrete Algorithms for Mobile and Wireless Systems Spring 2009 Prof. Jennifer Welch.
Message Passing Algorithms for Optimization
Bit Complexity of Breaking and Achieving Symmetry in Chains and Rings.
Distributed systems Module 2 -Distributed algorithms Teaching unit 1 – Basic techniques Ernesto Damiani University of Bozen Lesson 4 – Consensus and reliable.
EE 685 presentation Optimization Flow Control, I: Basic Algorithm and Convergence By Steven Low and David Lapsley Asynchronous Distributed Algorithm Proof.
Distributed systems Module 2 -Distributed algorithms Teaching unit 1 – Basic techniques Ernesto Damiani University of Bozen Lesson 2 – Distributed Systems.
A Local Facility Location Algorithm Supervisor: Assaf Schuster Denis Krivitski Technion – Israel Institute of Technology.
Distributed Algorithms: Agreement Protocols. Problems of Agreement l A set of processes need to agree on a value (decision), after one or more processes.
Partial Orderings: Selected Exercises
On the Cost of Fault-Tolerant Consensus When There are no Faults Idit Keidar & Sergio Rajsbaum Appears in SIGACT News; MIT Tech. Report.
Message Passing Systems A Formal Model. The System Topology – network (connected undirected graph) Processors (nodes) Communication channels (edges) Algorithm.
Experts and Boosting Algorithms. Experts: Motivation Given a set of experts –No prior information –No consistent behavior –Goal: Predict as the best expert.
1 Fault Tolerance in Collaborative Sensor Networks for Target Detection IEEE TRANSACTIONS ON COMPUTERS, VOL. 53, NO. 3, MARCH 2004.
Message Passing Systems A Formal Model. The System Topology – network (connected undirected graph) Processors (nodes) Communication channels (edges) Algorithm.
Algorithms for Network Optimization Problems This handout: Minimum Spanning Tree Problem Approximation Algorithms Traveling Salesman Problem.
1 A Modular Approach to Fault-Tolerant Broadcasts and Related Problems Author: Vassos Hadzilacos and Sam Toueg Distributed Systems: 526 U1580 Professor:
Equality Function Computation (How to make simple things complicated) Nitin Vaidya University of Illinois at Urbana-Champaign Joint work with Guanfeng.
1 © P. Kouznetsov A Note on Set Agreement with Omission Failures Rachid Guerraoui, Petr Kouznetsov, Bastian Pochon Distributed Programming Laboratory Swiss.
Approximating Minimum Bounded Degree Spanning Tree (MBDST) Mohit Singh and Lap Chi Lau “Approximating Minimum Bounded DegreeApproximating Minimum Bounded.
Distributed Algorithms – 2g1513 Lecture 9 – by Ali Ghodsi Fault-Tolerance in Distributed Systems.
“Revisiting Fault Diagnosis Agreement in a New Territory” S. C. Wang and K. Q. Yan Operating Systems Review, April 2004, p. 41– 61. An extension of the.
Functions. Warm Up Solve each equation. 1.2x – 6 = x = X + 29 = x – 5 – 4x = 17 x = 14 x = - 7 x = -15 x = 11.
CSCI 2670 Introduction to Theory of Computing Instructor: Shelby Funk.
10/4/10 A. Smith; based on slides by E. Demaine, C. Leiserson, S. Raskhodnikova, K. Wayne Adam Smith Algorithm Design and Analysis L ECTURE 17 Dynamic.
Mohamed Hefeeda 1 School of Computing Science Simon Fraser University, Canada Efficient k-Coverage Algorithms for Wireless Sensor Networks Mohamed Hefeeda.
EE 685 presentation Optimization Flow Control, I: Basic Algorithm and Convergence By Steven Low and David Lapsley.
The Cost of Fault Tolerance in Multi-Party Communication Complexity Binbin Chen Advanced Digital Sciences Center Haifeng Yu National University of Singapore.
2.1 Functions.
Chap 15. Agreement. Problem Processes need to agree on a single bit No link failures A process can fail by crashing (no malicious behavior) Messages take.
1 Distributed Resilient Consensus Nitin Vaidya University of Illinois at Urbana-Champaign.
Agreement in Distributed Systems n definition of agreement problems n impossibility of consensus with a single crash n solvable problems u consensus with.
1 Fault tolerance in distributed systems n Motivation n robust and stabilizing algorithms n failure models n robust algorithms u decision problems u impossibility.
Failure Detectors n motivation n failure detector properties n failure detector classes u detector reduction u equivalence between classes n consensus.
Replication predicates for dependent-failure algorithms Flavio Junqueira and Keith Marzullo University of California, San Diego Euro-Par Conference, Lisbon,
DISTRIBUTED ALGORITHMS Spring 2014 Prof. Jennifer Welch Set 9: Fault Tolerant Consensus 1.
1 Fault-Tolerant Consensus. 2 Communication Model Complete graph Synchronous, network.
1 SECOND PART Algorithms for UNRELIABLE Distributed Systems: The consensus problem.
1 Distributed Resilient Consensus Nitin Vaidya University of Illinois at Urbana-Champaign Some research reported here is supported in part by.
1 Distributed Vertex Coloring. 2 Vertex Coloring: each vertex is assigned a color.
Byzantine Vector Consensus in Complete Graphs Nitin Vaidya University of Illinois at Urbana-Champaign Vijay Garg University of Texas at Austin.
Partial Orderings: Selected Exercises
Computation of the solutions of nonlinear polynomial systems
CSCE 668 DISTRIBUTED ALGORITHMS AND SYSTEMS
Privacy and Fault-Tolerance in Distributed Optimization Nitin Vaidya University of Illinois at Urbana-Champaign.
James B. Orlin Presented by Tal Kaminker
Fault-tolerant Consensus in Directed Networks Lewis Tseng Boston College Oct. 13, 2017 (joint work with Nitin H. Vaidya)
CSCE 668 DISTRIBUTED ALGORITHMS AND SYSTEMS
2.1 Functions.
2.1 Functions.
Clustering.
Presentation transcript:

Iterative Byzantine Vector Consensus in Incomplete Graphs Nitin Vaidya University of Illinois at Urbana-Champaign ICDCN presentation by Srikanth Sastry Google

Byzantine Fault Model  Faulty nodes may misbehave arbitrarily, including sending inconsistent messages to neighbors 2

This Paper 3  Which directed graphs can solve iterative Byzantine vector consensus?

Vector Consensus  Input: d-dimensional vector of reals  Output: Vector in convex hull of inputs at fault-free nodes 4

Exact Vector Consensus in Complete Graphs Necessary and sufficient condition for a complete graph of N nodes tolerating f faults  Synchronous: N ≥ max(3f, (d+1)f+1)  Asynchronous: N ≥ (d+2)f+1 [STOC13: Mendes-Herlihy PODC13: Vaidya-Garg] 5

This Paper  Incomplete directed graphs  Iterative approximate consensus  Synchronous system … similar results can be obtained for asynchronous 6

Iterative Structure  Each node maintains a state: initial state = input vector  Each iteration … communicate with neighbors … update state  Output = state at termination

Correctness Conditions  Termination after finite number of iterations  Validity: State of a fault-free node always in convex hull of input at fault-free nodes (“Minimal state”)  ε-Agreement: Corresponding elements of output vectors at fault-free nodes within ε at termination 8

Necessary Condition on Network Graph 9

Notation A B if there exists a node in B with c+1 incoming edges from A 10 c

A Necessary Condition 11

A Necessary Condition  Proof by contradiction … omitted  Do not know if this condition is tight 12

A Sufficient Condition 13

A Sufficient Condition 14 Partition nodes into 4 sets F L C R ≥ df+1 i j

A Sufficient Condition potential fault set ≥ df+1 i j L, R non-empty

A Sufficient Condition 16 ≥ df+1 i j i or j exists

Sufficiency Proof  Algorithm & its correctness under the sufficient condition 17

Iterative Algorithm  Obtain current state of all neighbors  Find Tverberg point for each subset of (d+1)f+1 states (own & neighbors)  New state = average of all Tverberg points Terminate after number of rounds that depends on ε and the input domain 18

Tverberg Point for a Multiset S  Partition S into f+1 non-empty subsets such that the intersection of their convex hull is non-empty  Any point in the intersection is a Tverberg point  Intersection is non-empty if |S| ≥ (d+1)f+1 [Tverberg Theorem] 19

Proof of Correctness  V i [t] = state of fault-free node i at the end of iteration t  Think of the vector state as a point in Euclidean space  V[t] = Vector of states of fault-free nodes 20

Proof of Correctness  For a given execution, always possible to find a row stochastic matrix M[t] such that V[t] = M[t] V[t-1]  Row stochastic: All elements non-negative Each row adds to 1 21

Proof of Correctness  Rest follows from the previous matrix equation … proof structure used in our prior work too … borrowed from work on non-fault-tolerant consensus (decentralized consensus [Tsitsiklis])  Our main contribution is to prove that the matrix form holds with Byzantine faults … proof omitted 22

Summary  Vector consensus  Using simple iterative structure  Minimal state  Sufficient condition ≠ Necessary condition 23

Open Problem  Finding conditions such that Sufficient condition = Necessary condition 24

Thanks ! 25