CONSISTENCY IN DISTRIBUTED SYSTEMS

Slides:



Advertisements
Similar presentations
Replication. Topics r Why Replication? r System Model r Consistency Models r One approach to consistency management and dealing with failures.
Advertisements

Distributed Systems CS Consistency and Replication – Part II Lecture 11, Oct 10, 2011 Majd F. Sakr, Vinay Kolar, Mohammad Hammoud.
Tanenbaum & Van Steen, Distributed Systems: Principles and Paradigms, 2e, (c) 2007 Prentice-Hall, Inc. All rights reserved DISTRIBUTED SYSTEMS.
Computer Science Lecture 14, page 1 CS677: Distributed OS Consistency and Replication Today: –Introduction –Consistency models Data-centric consistency.
Replication and Consistency CS-4513 D-term Replication and Consistency CS-4513 Distributed Computing Systems (Slides include materials from Operating.
Computer Science Lecture 14, page 1 CS677: Distributed OS Consistency and Replication Introduction Consistency models –Data-centric consistency models.
Tanenbaum & Van Steen, Distributed Systems: Principles and Paradigms, 2e, (c) 2007 Prentice-Hall, Inc. All rights reserved Chapter 7 Consistency.
Computer Science Lecture 16, page 1 CS677: Distributed OS Last Class:Consistency Semantics Consistency models –Data-centric consistency models –Client-centric.
IBM Haifa Research 1 The Cloud Trade Off IBM Haifa Research Storage Systems.
CSE 486/586, Spring 2012 CSE 486/586 Distributed Systems Case Study: Amazon Dynamo Steve Ko Computer Sciences and Engineering University at Buffalo.
Databases with Scalable capabilities Presented by Mike Trischetta.
Consistency and Replication CSCI 4780/6780. Chapter Outline Why replication? –Relations to reliability and scalability How to maintain consistency of.
© , OrangeScape Technologies Limited. Confidential 1 Write Once. Cloud Anywhere. Building Highly Scalable Web applications BASE gives way to ACID.
CSE 486/586, Spring 2012 CSE 486/586 Distributed Systems Distributed Shared Memory Steve Ko Computer Sciences and Engineering University at Buffalo.
AZR308. Building distributed systems on an abstraction against commodity hardware at Internet scale, composed of multiple services. Distributed System.
Distributed Systems CS Consistency and Replication – Part IV Lecture 21, Nov 10, 2014 Mohammad Hammoud.
Tanenbaum & Van Steen, Distributed Systems: Principles and Paradigms, 2e, (c) 2007 Prentice-Hall, Inc. All rights reserved DISTRIBUTED SYSTEMS.
Distributed Systems CS Consistency and Replication – Part I Lecture 10, September 30, 2013 Mohammad Hammoud.
Chapter 4 Wenbing Zhao Department of Electrical and Computer Engineering Cleveland State University Building Dependable Distributed Systems.
Consistency and Replication. Outline Introduction (what’s it all about) Data-centric consistency Client-centric consistency Replica management Consistency.
Client-Centric Consistency Models
CSE 486/586 Distributed Systems Consistency --- 3
EEC 688/788 Secure and Dependable Computing Lecture 9 Wenbing Zhao Department of Electrical and Computer Engineering Cleveland State University
Distributed databases A brief introduction with emphasis on NoSQL databases Distributed databases1.
Department of Computer Science, Johns Hopkins University EN Instructor: Randal Burns 24 September 2013 NoSQL Data Models and Systems.
Intro to NoSQL Databases Tony Hannan November 2011.
CSCI5570 Large Scale Data Processing Systems
CS6320 – Performance L. Grewe.
Trade-offs in Cloud Databases
Parallel Databases.
Distributed Systems CS
CSE 486/586 Distributed Systems Consistency --- 1
NOSQL.
Christian Stark and Odbayar Badamjav
Consistency and CAP.
Distributed Transactions and Spanner
NOSQL databases and Big Data Storage Systems
Failure recovery and Checkpointing in Distributed Systems
The SNOW Theorem and Latency-Optimal Read-Only Transactions
Consistency in Distributed Systems
Chapter 7: Consistency & Replication IV - REPLICATION MANAGEMENT -Sumanth Kandagatla Instructor: Prof. Yanqing Zhang Advanced Operating Systems (CSC 8320)
Storage Systems for Managing Voluminous Data
Massively Parallel Cloud Data Storage Systems
CSE 486/586 Distributed Systems Consistency --- 3
CLIENT-CENTRIC CONSISTENCY MODELS
Consistency Models.
EECS 498 Introduction to Distributed Systems Fall 2017
آزمايشگاه سيستمهای هوشمند علی کمالی زمستان 95
Outline Midterm results summary Distributed file systems – continued
7.1. CONSISTENCY AND REPLICATION INTRODUCTION
DATA CENTRIC CONSISTENCY MODELS
PERSPECTIVES ON THE CAP THEOREM
EEC 688/788 Secure and Dependable Computing
EECS 498 Introduction to Distributed Systems Fall 2017
Process Migration Troy Cogburn and Gilbert Podell-Blume
EEC 688/788 Secure and Dependable Computing
Scalable Causal Consistency
CAP Theorem and Consistency Models
Replication and Availability in Distributed Systems
Atomic Commit and Concurrency Control
DISTRIBUTED SYSTEMS Principles and Paradigms Second Edition ANDREW S
Distributed Systems CS
Transaction Properties: ACID vs. BASE
COS 418: Distributed Systems Lecture 16 Wyatt Lloyd
Outline Review of Quiz #1 Distributed File Systems 4/20/2019 COP5611.
Last Class: Web Caching
Database System Architectures
EEC 688/788 Secure and Dependable Computing
CSE 486/586 Distributed Systems Consistency --- 3
Presentation transcript:

CONSISTENCY IN DISTRIBUTED SYSTEMS Mante Luo, Yu Qiu CS 455: Introduction to Distributed Systems Computer Science Department, Colorado State University

Why Consistent? Distributed System is widely deployed Same data stored at different locations All replications have to follow some rules Consistency has to be maintained e.g. Two withdraws at two locations from the same bank account. If not consistent, final balance could be incorrect.

The Problem Replicas: Fault tolerance and performance Conflicts: Possible when concurrent writing Consistency: Maintain a updating order across all replicas e.g. First Machine A updates the value a to variable X, and then Machine B updates b to X. All replicas should have a consensus that the latest value is b.

Model Design Consistency Performance CAP Theorem Strong consistency Weaker consistency Performance CAP Theorem Consistency, Availability, Partition Tolerance Choose at most 2 Usually trade-off between C & A.

Dominant Approach Models Give up some consistency Strong consistency Sequential consistency (weaker than strong one) Eventual consistency (much weaker) Give up some consistency We got Eventual consistency

Dominant Approach cont. Eventual Consistency if no new updates are made to a data item, eventually all access to that item will return the last updated value much weaker, but with additional mechanisms, eventual consistency is often strongly consistent provide much better performance as well Application: Recent NoSQL databases

Quite Surprisingly How can a weak consistency like eventual consistency actually work? It may not seem to work at first glance, but with breakthrough in recent a few years, it works not only good, many major NoSQL vendors adopt it, e.g. Dynamo, Google Cloud Datastore, CouchDB.

Future Globally-Distributed System Outer space colonies deploy systems everywhere on earth Google Spanner Outer space colonies Colonies in another planet can be separated by geographic conditions, distributed systems have to keep in consistency

Make It Work in Future Is there a model stronger than eventual consistency, while still works considerably well in performance? In the future, the system will be scaled up Though eventual consistency works good now, giving up some consistency makes it not suitable for some conditions. Stronger model will make application programmer easier to work.

Thank You! Any questions?