Caching Consistency and Concurrency Control Contact: Dingshan He

Slides:



Advertisements
Similar presentations
Serverless Network File Systems. Network File Systems Allow sharing among independent file systems in a transparent manner Mounting a remote directory.
Advertisements

Distributed Databases John Ortiz. Lecture 24Distributed Databases2  Distributed Database (DDB) is a collection of interrelated databases interconnected.
MIS 385/MBA 664 Systems Implementation with DBMS/ Database Management Dave Salisbury ( )
Chapter 13 (Web): Distributed Databases
Overview of Mobile Computing (3): File System. File System for Mobile Computing Issues for file system design in wireless and mobile environments Design.
Coda file system: Disconnected operation By Wallis Chau May 7, 2003.
Transaction Management and Concurrency Control
Transaction Management and Concurrency Control
Data Sharing in OSD Environment Dingshan He September 30, 2002.
Real-Time Distributed Databases By: Chris Scardino CSC536 Monday, May 2, 2005.
Concurrency Control & Caching Consistency Issues and Survey Dingshan He November 18, 2002.
Jeff Chheng Jun Du.  Distributed file system  Designed for scalability, security, and high availability  Descendant of version 2 of Andrew File System.
Database Systems: Design, Implementation, and Management Eighth Edition Chapter 10 Transaction Management and Concurrency Control.
CS 603 Data Replication February 25, Data Replication: Why? Fault Tolerance –Hot backup –Catastrophic failure Performance –Parallelism –Decreased.
Transaction Management and Concurrency Control
TRANSACTION PROCESSING TECHNIQUES BY SON NGUYEN VIJAY RAO.
Chapter 4 Database Management Systems. Chapter 4Slide 2 What is a Database Management System (DBMS)?  Database An organized collection of related data.
Distributed Systems Tutorial 11 – Yahoo! PNUTS written by Alex Libov Based on OSCON 2011 presentation winter semester,
1 Distributed and Parallel Databases. 2 Distributed Databases Distributed Systems goal: –to offer local DB autonomy at geographically distributed locations.
AN OPTIMISTIC CONCURRENCY CONTROL ALGORITHM FOR MOBILE AD-HOC NETWORK DATABASES Brendan Walker.
Mobility in Distributed Computing With Special Emphasis on Data Mobility.
Distributed OSes Continued Andy Wang COP 5911 Advanced Operating Systems.
Chapter Oracle Server An Oracle Server consists of an Oracle database (stored data, control and log files.) The Server will support SQL to define.
By Lecturer / Aisha Dawood 1.  You can control the number of dispatcher processes in the instance. Unlike the number of shared servers, the number of.
1 Adapted from Pearson Prentice Hall Adapted form James A. Senn’s Information Technology, 3 rd Edition Chapter 7 Enterprise Databases and Data Warehouses.
BIS Database Systems School of Management, Business Information Systems, Assumption University A.Thanop Somprasong Chapter # 10 Transaction Management.
Chapter 20 Distributed File Systems Copyright © 2008.
CEPH: A SCALABLE, HIGH-PERFORMANCE DISTRIBUTED FILE SYSTEM S. A. Weil, S. A. Brandt, E. L. Miller D. D. E. Long, C. Maltzahn U. C. Santa Cruz OSDI 2006.
Data in the Cloud – I Parallel Databases The Google File System Parallel File Systems.
Replicated Databases. Reading Textbook: Ch.13 Textbook: Ch.13 FarkasCSCE Spring
Concurrency Control. Objectives Management of Databases Concurrency Control Database Recovery Database Security Database Administration.
Chapter 6.5 Distributed File Systems Summary Junfei Wen Fall 2013.
1 Distributed Databases BUAD/American University Distributed Databases.
Distributed OSes Continued Andy Wang COP 5611 Advanced Operating Systems.
INTRODUCTION TO DBS Database: a collection of data describing the activities of one or more related organizations DBMS: software designed to assist in.
1 Principles of Database Systems With Internet and Java Applications Today’s Topic Chapter 15: Reliability and Security in Database Servers Instructor’s.
CS425 / CSE424 / ECE428 — Distributed Systems — Fall 2011 Some material derived from slides by Prashant Shenoy (Umass) & courses.washington.edu/css434/students/Coda.ppt.
Feb 1, 2001CSCI {4,6}900: Ubiquitous Computing1 Eager Replication and mobile nodes Read on disconnected clients may give stale data Eager replication prohibits.
Distributed File Systems
1 Multiversion Reconciliation for Mobile Databases Shirish Hemanath Phatak & B.R.Badrinath Presented By Presented By Md. Abdur Rahman Md. Abdur Rahman.
Information/File Access and Sharing Coda: A Case Study J. Kistler, M. Satyanarayanan. Disconnected operation in the Coda File System. ACM Transaction on.
An Architecture for Mobile Databases By Vishal Desai.
Chapter 7: Consistency & Replication IV - REPLICATION MANAGEMENT By Jyothsna Natarajan Instructor: Prof. Yanqing Zhang Course: Advanced Operating Systems.
Introduction to Distributed Databases Yiwei Wu. Introduction A distributed database is a database in which portions of the database are stored on multiple.
 Distributed Database Concepts  Parallel Vs Distributed Technology  Advantages  Additional Functions  Distribution Database Design  Data Fragmentation.
Database Systems: Design, Implementation, and Management Eighth Edition Chapter 10 Transaction Management and Concurrency Control.
Highly Available Services and Transactions with Replicated Data Jason Lenthe.
Dsitributed File Systems
Zookeeper Wait-Free Coordination for Internet-Scale Systems.
Chapter 13 Managing Transactions and Concurrency Database Principles: Fundamentals of Design, Implementation, and Management Tenth Edition.
Mobility Victoria Krafft CS /25/05. General Idea People and their machines move around Machines want to share data Networks and machines fail Network.
Chapter 25: Advanced Data Types and New Applications
Nache: Design and Implementation of a Caching Proxy for NFSv4
Replication.
Introduction There are many situations in which we might use replicated data Let’s look at another, different one And design a system to work well in that.
Today: Coda, xFS Case Study: Coda File System
Chapter 10 Transaction Management and Concurrency Control
CSE 4340/5349 Mobile Systems Engineering
Consistency and Replication
Distributed File Systems
Distributed File Systems
Distributed File Systems
Distributed OSes Continued
Distributed Database Management Systems
Global Distribution.
Ch 6. Summary Gang Shen.
Concurrency Control.
Concurrency control (OCC and MVCC)
System-Level Support CIS 640.
Transactions-Concurrency Problems
Presentation transcript:

Caching Consistency and Concurrency Control Contact: Dingshan He

General Problems in Distributed System Object replication to improve performance Multiple clients may simultaneously READ/WRITE the same object Clients may cache either part of an object or the entire object to reduce network traffic Link or system failures

New Challenges in Proposed System Mobility –Clients could have high mobility –OSD’s have mediate mobility –Regional Managers are relatively static Connectivity –Disconnection is possible at any place –Clients could have weak connectivity (low bandwidth/long latency)

More Challenges Partition of Objects –Objects consists of attributes, metadata, and data –Attributes could be stored at either tier Compound Objects –A compound object refers multiple other objects, either compound or not

Levels of Consistency Objects indicate desired consistency level Strong consistency –global consistency at any moment –using server locking Weak consistency –allow temporary inconsistency –using optimistic concurrency control Something in between?!

Versions of Objects Optimistic concurrency control generates co- existing multiple versions of objects Version history has to be maintained until final reconciliation Full copy of individual versions consume too much storage Exploiting incremental/differential updates –Existing scheme for text file and database app. –Seek more general support for various objects

Distributed Committing Updates of compound object may involve several referenced objects Such updates have to be performed in a transaction way Such updates also have to support versions such that rollback is possible Determine global serializability of distributed updates