Consistency and Replication

Slides:



Advertisements
Similar presentations
Distributed Systems Major Design Issues Presented by: Christopher Hector CS8320 – Advanced Operating Systems Spring 2007 – Section 2.6 Presentation Dr.
Advertisements

Consistency and Replication Chapter 7 Part II Replica Management & Consistency Protocols.
Consistency and Replication Chapter Introduction: replication and scalability 6.2 Data-Centric Consistency Models 6.3 Client-Centric Consistency.
Reliability on Web Services Presented by Pat Chan 17/10/2005.
Computer Science Lecture 14, page 1 CS677: Distributed OS Consistency and Replication Today: –Introduction –Consistency models Data-centric consistency.
Distributed components
Business Continuity and DR, A Practical Implementation Mich Talebzadeh, Consultant, Deutsche Bank
Tanenbaum & Van Steen, Distributed Systems: Principles and Paradigms, 2e, (c) 2007 Prentice-Hall, Inc. All rights reserved DISTRIBUTED SYSTEMS.
Computer Science Lecture 14, page 1 CS677: Distributed OS Consistency and Replication Today: –Introduction –Consistency models Data-centric consistency.
OCT1 Principles From Chapter One of “Distributed Systems Concepts and Design”
Overview Distributed vs. decentralized Why distributed databases
EEC-681/781 Distributed Computing Systems Lecture 3 Wenbing Zhao Department of Electrical and Computer Engineering Cleveland State University
Replication and Consistency CS-4513 D-term Replication and Consistency CS-4513 Distributed Computing Systems (Slides include materials from Operating.
Computer Science Lecture 14, page 1 CS677: Distributed OS Consistency and Replication Introduction Consistency models –Data-centric consistency models.
Tanenbaum & Van Steen, Distributed Systems: Principles and Paradigms, 2e, (c) 2007 Prentice-Hall, Inc. All rights reserved Chapter 7 Consistency.
Jeff Chheng Jun Du.  Distributed file system  Designed for scalability, security, and high availability  Descendant of version 2 of Andrew File System.
1 Content Distribution Networks. 2 Replication Issues Request distribution: how to transparently distribute requests for content among replication servers.
Distributed Data Stores – Facebook Presented by Ben Gooding University of Arkansas – April 21, 2015.
Word Wide Cache Distributed Caching for the Distributed Enterprise.
Consistency and Replication CSCI 4780/6780. Chapter Outline Why replication? –Relations to reliability and scalability How to maintain consistency of.
Distributed File System By Manshu Zhang. Outline Basic Concepts Current project Hadoop Distributed File System Future work Reference.
Introduction & Background Lakshmish Ramaswamy. Why Distributed Systems? A collection of independent computers that appears to its users as a single coherent.
Chapter 2: System Models. Objectives To provide students with conceptual models to support their study of distributed systems. To motivate the study of.
Consistency and Replication. Replication of data Why? To enhance reliability To improve performance in a large scale system Replicas must be consistent.
Introduction to DFS. Distributed File Systems A file system whose clients, servers and storage devices are dispersed among the machines of a distributed.
1- Distributed Systems Principles and Paradigms Operating Systems: Concurrent and Distributed Software Design Jean Bacon, Tim Harris 2003.
Distributed Computing Systems CSCI 4780/6780. Geographical Scalability Challenges Synchronous communication –Waiting for a reply does not scale well!!
Distributed Databases DBMS Textbook, Chapter 22, Part II.
Computer Science Lecture 13, page 1 CS677: Distributed OS Last Class: Canonical Problems Distributed synchronization and mutual exclusion Distributed Transactions.
GLOBE DISTRIBUTED SHARED OBJECT. INTRODUCTION  Globe stands for GLobal Object Based Environment.  Globe is different from CORBA and DCOM that it supports.
1 Distributed Databases Chapter 21, Part B. 2 Introduction v Data is stored at several sites, each managed by a DBMS that can run independently. v Distributed.
Replication (1). Topics r Why Replication? r System Model r Consistency Models – How do we reason about the consistency of the “global state”? m Data-centric.
Distributed Systems CS Consistency and Replication – Part IV Lecture 21, Nov 10, 2014 Mohammad Hammoud.
Tanenbaum & Van Steen, Distributed Systems: Principles and Paradigms, 2e, (c) 2007 Prentice-Hall, Inc. All rights reserved DISTRIBUTED SYSTEMS.
Distributed Systems CS Consistency and Replication – Part I Lecture 10, September 30, 2013 Mohammad Hammoud.
Distributed Computing Systems CSCI 4780/6780. Scalability ConceptExample Centralized servicesA single server for all users Centralized dataA single on-line.
Hwajung Lee.  Improves reliability  Improves availability ( What good is a reliable system if it is not available?)  Replication must be transparent.
1 Distributed Systems Distributed Object-Based Systems Chapter 10.
© Oxford University Press 2011 DISTRIBUTED COMPUTING Sunita Mahajan Sunita Mahajan, Principal, Institute of Computer Science, MET League of Colleges, Mumbai.
Dsitributed File Systems
Distributed File System. Outline Basic Concepts Current project Hadoop Distributed File System Future work Reference.
PERFORMANCE MANAGEMENT IMPROVING PERFORMANCE TECHNIQUES Network management system 1.
Chapter 1 Characterization of Distributed Systems
Last Class: Introduction
CS6320 – Performance L. Grewe.
Definition of Distributed System
6.4 Data and File Replication
Distributed DBMS Concepts of Distributed DBMS
Consistency and Replication
Chapter 7: Consistency & Replication IV - REPLICATION MANAGEMENT -Sumanth Kandagatla Instructor: Prof. Yanqing Zhang Advanced Operating Systems (CSC 8320)
Consistency Models.
Outline Midterm results summary Distributed file systems – continued
Linearizability Linearizability is a correctness criterion for concurrent object (Herlihy & Wing ACM TOPLAS 1990). It provides the illusion that each operation.
7.1. CONSISTENCY AND REPLICATION INTRODUCTION
Consistency and Replication
Distributed Systems CS
Outline Announcements Lab2 Distributed File Systems 1/17/2019 COP5611.
SAMANVITHA RAMAYANAM 18TH FEBRUARY 2010 CPE 691
Replication and Availability in Distributed Systems
CS510 - Portland State University
DISTRIBUTED SYSTEMS Principles and Paradigms Second Edition ANDREW S
Distributed Systems CS
Replica Placement Model: We consider objects (and don’t worry whether they contain just data or code, or both) Distinguish different processes: A process.
DISTRIBUTED SYSTEMS Principles and Paradigms Second Edition ANDREW S
Outline Review of Quiz #1 Distributed File Systems 4/20/2019 COP5611.
Last Class: Web Caching
Replication Chapter 7.
Distributed Systems (15-440)
Distributed Databases
Presentation transcript:

Consistency and Replication CSCI 6900/4900

Chapter Outline Why replication? Relations to reliability and scalability How to maintain consistency of replicated data? Consistency models Consistency schemes How to distributed updates and when to distribute them Examples Parallel programming WWW-based systems

Reasons for Replication Two primary reasons Improving reliability of system Improving scalability and performance of system Reliability Resilience to failures Protection against data corruption: Byzantine failures and quorum-based systems

Scalability and Performance Scaling in numbers Replication can help to scale the distributed system by numbers If number of processes accessing data increases, it helps to replicate the data Example: Parallel programs Geographical scaling Placing replica close to process using the data, improves the performance Example: Edge cache networks, browser caches, etc.

Problems of Replication Creating and maintaining replicas is not free Multiple copies leads to consistency problems What happens when one of the replicas gets modified? Modifications have to be carried out at all replicas How and when determines the cost of replication WWW-based systems Browser and client side caches May lead to stale pages TTL model, Update/Invalidate model

Object Replication Studying replication on objects helps understanding Objects encapsulate data and related functions Synchronization in distributed remote objects Object-level implementation Server-level implementation Replicated distributed objects Object-specific replication protocol Middleware replication protocol

Object Replication (2) Organization of a distributed remote object shared by two different clients.

Object Replication (3) A remote object capable of handling concurrent invocations on its own. A remote object for which an object adapter is required to handle concurrent invocations

Object Replication (4) A distributed system for replication-aware distributed objects. A distributed system responsible for replica management

Replication as Scalability Technique Replication can help to solve geographical scalability problems Placing replicas closer to clients Maintaining replicas consistent may place sever overheads Examples: N accesses and M updates per unit time and N<<M Problems with multiple copies and tight consistency Implementing global synchronization Relaxing consistency requirements is a possible solution

Data-Centric Consistency Models The general organization of a logical data store, physically distributed and replicated across multiple processes.