Jan 31, 2001CSCI {4,6}900: Ubiquitous Computing1 Recap. Ubiquitous Computing Vision –The Computer for the Twenty-First Century, Mark Weiser –The Coming.

Slides:



Advertisements
Similar presentations
1 Scaleable Replicated Databases Jim Gray (Microsoft) Pat Helland (Microsoft) Dennis Shasha (Columbia) Pat ONeil (U.Mass)
Advertisements

School of Information Technologies Hyungsoo Jung (presenter) Hyuck Han* Alan Fekete Uwe Röhm Serializable Snapshot Isolation for Replicated Databases in.
Consistency and Replication Chapter 7 Part II Replica Management & Consistency Protocols.
Replication and Consistency (2). Reference r Replication in the Harp File System, Barbara Liskov, Sanjay Ghemawat, Robert Gruber, Paul Johnson, Liuba.
POND: the OceanStore Prototype Sean Rhea, Patrick Eaton, Dennis Geels, Hakim Weatherspoon, Ben Zhao and John Kubiatowicz UC, Berkeley File and Storage.
Pond: the OceanStore Prototype CS 6464 Cornell University Presented by Yeounoh Chung.
David Choffnes, Winter 2006 OceanStore Maintenance-Free Global Data StorageMaintenance-Free Global Data Storage, S. Rhea, C. Wells, P. Eaton, D. Geels,
Chapter 13 (Web): Distributed Databases
OceanStore: An Infrastructure for Global-Scale Persistent Storage John Kubiatowicz, David Bindel, Yan Chen, Steven Czerwinski, Patrick Eaton, Dennis Geels,
1 Ubiquitous Computing CS376 Reading Summary Taemie Kim.
Database Replication techniques: a Three Parameter Classification Authors : Database Replication techniques: a Three Parameter Classification Authors :
Mobile Computing and Databases - A Survey A presentation by Dharmesh Thakkar based on the publication by Daniel Barbara.
Mondo Bringing Distributed File Systems to the People Xavid Pretzer Bringing Distributed File Systems to the People Xavid Pretzer.
OceanStore An Architecture for Global-scale Persistent Storage By John Kubiatowicz, David Bindel, Yan Chen, Steven Czerwinski, Patrick Eaton, Dennis Geels,
Overview Distributed vs. decentralized Why distributed databases
EEC-681/781 Distributed Computing Systems Lecture 3 Wenbing Zhao Department of Electrical and Computer Engineering Cleveland State University
Real-Time Distributed Databases By: Chris Scardino CSC536 Monday, May 2, 2005.
Replication and Consistency CS-4513 D-term Replication and Consistency CS-4513 Distributed Computing Systems (Slides include materials from Operating.
Concurrency Control & Caching Consistency Issues and Survey Dingshan He November 18, 2002.
CS 603 Data Replication February 25, Data Replication: Why? Fault Tolerance –Hot backup –Catastrophic failure Performance –Parallelism –Decreased.
OceanStore: An Architecture for Global - Scale Persistent Storage John Kubiatowicz, David Bindel, Yan Chen, Steven Czerwinski, Patric Eaton, Dennis Geels,
CSE598C Project: Dynamic virtual server placement Yoojin Hong.
6.4 Data and File Replication Gang Shen. Why replicate  Performance  Reliability  Resource sharing  Network resource saving.
Practical Replication. Purposes of Replication Improve Availability Replicated databases can be accessed even if several replicas are unavailable Improve.
Mobility in Distributed Computing With Special Emphasis on Data Mobility.
Distributed OSes Continued Andy Wang COP 5911 Advanced Operating Systems.
Feb 7, 2001CSCI {4,6}900: Ubiquitous Computing1 Announcements.
Feb 7, 2001CSCI {4,6}900: Ubiquitous Computing1 Announcements Tomorrow’s class is officially cancelled. If you need someone to go over the reference implementation.
CS Storage Systems Dangers of Replication Materials taken from “J. Gray, P. Helland, P. O’Neil, and D. Shasha. The Dangers of Replication and a.
Replication and Consistency. Reference The Dangers of Replication and a Solution, Jim Gray, Pat Helland, Patrick O'Neil, and Dennis Shasha. In Proceedings.
Pond: the OceanStore Prototype Sean Rhea, Patric Eaton, Dennis Gells, Hakim Weatherspoon, Ben Zhao, and John Kubiatowicz University of California, Berkeley.
A New Method for Concurrency Control in Centralized Database Systems Victor T.S. Shi and William Perrizo Computer Science, North Dakota State University.
Presented by Dr. Greg Speegle April 12,  Two-phase commit slow relative to local transaction processing  CAP Theorem  Option 1: Reduce availability.
OceanStore: An Infrastructure for Global-Scale Persistent Storage John Kubiatowicz, David Bindel, Yan Chen, Steven Czerwinski, Patrick Eaton, Dennis Geels,
Copyright © George Coulouris, Jean Dollimore, Tim Kindberg This material is made available for private study and for direct.
Jan 16, 2001CSCI {4,6}900: Ubiquitous Computing1 Announcements ACM meeting, Thursday Jan 18 at 5:30 PM in GSRC 328 –All the benefits of membership in the.
Consistent and Efficient Database Replication based on Group Communication Bettina Kemme School of Computer Science McGill University, Montreal.
Replicated Databases. Reading Textbook: Ch.13 Textbook: Ch.13 FarkasCSCE Spring
Preventive Replication in Database Cluster Esther Pacitti, Cedric Coulon, Patrick Valduriez, M. Tamer Özsu* LINA / INRIA – Atlas Group University of Nantes.
Distributed Computing Systems CSCI 4780/6780. Geographical Scalability Challenges Synchronous communication –Waiting for a reply does not scale well!!
Jan 30, 2001CSCI {4,6}900: Ubiquitous Computing1 Announcements Project Milestone 2 due today. Undergraduate projects should have 3 students per project.
IM NTU Distributed Information Systems 2004 Replication Management -- 1 Replication Management Yih-Kuen Tsay Dept. of Information Management National Taiwan.
1 Distributed Databases BUAD/American University Distributed Databases.
Distributed OSes Continued Andy Wang COP 5611 Advanced Operating Systems.
Replica Consistency in a Data Grid1 IX International Workshop on Advanced Computing and Analysis Techniques in Physics Research December 1-5, 2003 High.
Copyright © George Coulouris, Jean Dollimore, Tim Kindberg This material is made available for private study and for direct.
Feb 1, 2001CSCI {4,6}900: Ubiquitous Computing1 Eager Replication and mobile nodes Read on disconnected clients may give stale data Eager replication prohibits.
Caching Consistency and Concurrency Control Contact: Dingshan He
Jan 17, 2001CSCI {4,6}900: Ubiquitous Computing1 Announcements Did you hear about the Microsoft site crash yesterday? Compiling in Solaris (gemini) gcc.
Chapter 4 Wenbing Zhao Department of Electrical and Computer Engineering Cleveland State University Building Dependable Distributed Systems.
Distributed Computing Systems CSCI 4780/6780. Scalability ConceptExample Centralized servicesA single server for all users Centralized dataA single on-line.
Chapter 7: Consistency & Replication IV - REPLICATION MANAGEMENT By Jyothsna Natarajan Instructor: Prof. Yanqing Zhang Course: Advanced Operating Systems.
3/6/99 1 Replication CSE Transaction Processing Philip A. Bernstein.
DATABASE REPLICATION DISTRIBUTED DATABASE. O VERVIEW Replication : process of copying and maintaining database object, in multiple database that make.
CSE 486/586 Distributed Systems Consistency --- 3
EEC 688/788 Secure and Dependable Computing Lecture 9 Wenbing Zhao Department of Electrical and Computer Engineering Cleveland State University
Highly Available Services and Transactions with Replicated Data Jason Lenthe.
Feb 22, 2001CSCI {4,6}900: Ubiquitous Computing1 Announcements Send today with people in your project group. People seem to be dropping off and I.
CS791Aravind Elango Maintenance-Free Global Data Storage Sean Rhea, Chris Wells, Patrick Eaten, Dennis Geels, Ben Zhao, Hakim Weatherspoon and John Kubiatowicz.
OceanStore: An Architecture for Global-Scale Persistent Storage
Introduction to NewSQL
HWP2 – Distributed search
Joint Advanced Students School 2005
CSCI {4,6}900: Ubiquitous Computing
EEC 688/788 Secure and Dependable Computing
Outline The Case for Non-transparent Replication: Examples from Bayou Douglas B. Terry, Karin Petersen, Mike J. Spreitzer, and Marvin M. Theimer. IEEE.
Distributed Database Management Systems
Outline for today Feasibility of a Serverless Distributed File System deployed on an Existing set of Desktop PCs – Microsoft research. ACM SIGMETRICS 2000.
System-Level Support CIS 640.
Presentation transcript:

Jan 31, 2001CSCI {4,6}900: Ubiquitous Computing1 Recap. Ubiquitous Computing Vision –The Computer for the Twenty-First Century, Mark Weiser –The Coming Age Of Calm Technology, Mark Weiser and John Seely Brown –People, Places, Things: Web Presence for the Real World Tim Kindberg, John Barton, Jeff Morgan, Gene Becker, Ilja Bedner, Debbie Caswell, Phillipe Debaty, Gita Gopal, Marcos Frid, Venky Krishnan, Howard Morris, Celine Pering, John Schettino, Bill Serra. –Next Century Challenges: Data-Centric Networking for Invisible Computing. Mike Esler, Jeffrey Hightower, Tom Anderson, and Gaetano Borriello

Jan 31, 2001CSCI {4,6}900: Ubiquitous Computing2 Recap Distributed Systems Architecture –Intro. to Distributed system architecture (Domain Name Service (DNS), Gnutella, DNS round robin etc.) –Oceanstore: An Extremely Wide-Area Storage System David Bindel, Yan Chen, Patrick Eaton, Dennis Geels, Ramakrishna Gummadi, Sean Rhea, Haim Weatherspoon, Westley Weimer, Christopher Wells, Ben Zhao, and John Kubiatowicz –Feasibility of a Serverless Distributed File System Deployed on an Existing Set of Desktop PCs William J. Bolosky, John R. Douceur, David Ely, and Marvin Theimer

Jan 31, 2001CSCI {4,6}900: Ubiquitous Computing3 Recap Location and Naming management –The Anatomy of a Context-Aware Application Andy Harter, Andy Hopper, Pete Steggles, Andy Ward, Paul Webster –Active Names: Flexible Location and Transport of Wide- Area Resources Amin Vahdat, Michael Dahlin, Thomas Anderson, and Amit Aggarwal

Jan 31, 2001CSCI {4,6}900: Ubiquitous Computing4 Outline 1.The Dangers of Replication and a Solution, Jim Gray, Pat Helland, Patrick O'Neil, and Dennis Shasha. In Proceedings of the ACM SIGMOD international conference on Management of data, 1996

Jan 31, 2001CSCI {4,6}900: Ubiquitous Computing5 Replication – Intro. As systems grow, need to scale up ….

Jan 31, 2001CSCI {4,6}900: Ubiquitous Computing6 Scale Up You can scale up by buying a bigger machine ….

Jan 31, 2001CSCI {4,6}900: Ubiquitous Computing7 Partition You can scale up by partitioning the machines (e.g. service users in east coast from Atlanta and west coast from L.A.) ….

Jan 31, 2001CSCI {4,6}900: Ubiquitous Computing8 Replication You can replicate data ….

Jan 31, 2001CSCI {4,6}900: Ubiquitous Computing9 Serializability – Intro. What is the value of X in node 3? Causal ordering (Update x when you hear from Node 1 or Node 2) Node 1 Node 2 time X=1000 X=200 X=100 Node 3 X=?

Jan 31, 2001CSCI {4,6}900: Ubiquitous Computing10 Serializability – Intro. What is the value of X in node 3? Causal ordering (Update x when you hear from Node 1 or Node 2) Node 1 Node 2 time X=1000 X=200 X=100 Node 3 X=? X=200

Jan 31, 2001CSCI {4,6}900: Ubiquitous Computing11 Goals of replication Availability and scaleability Provide high availability and scaleability through replication Mobility Allow mobile nodes to read and update the database while disconnected from the network Serializability Provide single-copy serializable transaction execution Convergence Provide convergence to avoid system delusion

Jan 31, 2001CSCI {4,6}900: Ubiquitous Computing12 Eager Replication All replicas synchronized to the same value immediately R R R RR R time

Jan 31, 2001CSCI {4,6}900: Ubiquitous Computing13 Eager Replication All replicas synchronized to the same value Lower update performance and response time R R R RR R time

Jan 31, 2001CSCI {4,6}900: Ubiquitous Computing14 Lazy Replication One replica is updated by the transaction Replicas synchronize asynchronously Multiple versions of data R R R RR R time

Jan 31, 2001CSCI {4,6}900: Ubiquitous Computing15 Single node Transaction No conflicts Checking –1000 Savings +500 CD +500 Commit

Jan 31, 2001CSCI {4,6}900: Ubiquitous Computing16 Eager Transaction N nodes – N times as much work Checking –1000 Savings +500 CD +500 Commit Checking –1000 Savings +500 CD +500 Commit Checking –1000 Savings +500 CD +500 Commit

Jan 31, 2001CSCI {4,6}900: Ubiquitous Computing17 Lazy Transaction N nodes – N times as much work N transactions Checking –1000 Savings +500 CD +500 Commit Checking –1000 Savings +500 CD +500 Commit Checking –1000 Savings +500 CD +500 Commit

Jan 31, 2001CSCI {4,6}900: Ubiquitous Computing18 Concurrency anomaly in Lazy Replication R` - Which version of data should it see? If committed transaction is ‘wrong’, conflict Conflicts have to be reconciled R’ R R``` RR`` R` time

Jan 31, 2001CSCI {4,6}900: Ubiquitous Computing19 Scaleup pitfall When the nodes divulge hopelessly System delusion – database is inconsistent and no obvious way to repair it R’ R R``` RR`` R` time

Jan 31, 2001CSCI {4,6}900: Ubiquitous Computing20 Regulate replica updates Group: Any node with a copy can update item –Update anywhere Master: Only a master can update the primary copy. All replicas are read-only. All update requests are sent to the master

Jan 31, 2001CSCI {4,6}900: Ubiquitous Computing21 Replication strategies Propagation Vs. Ownership LazyEager GroupN transactions N object owners 1 transaction N object owners MasterN transactions 1 object owner 1 transaction 1 object owner Two tierN+1 transactions, 1 object owner Tentative locate update, eager base update