1. Replication

2. Topics r Why Replication? r System Model r Consistency Models r One approach to consistency management and dealing with failures

3. Readings r Van Steen and Tanenbaum: 6.1, 6.2 and 6.3, 6.4 r Coulouris: 11,14

4. Why Replicate? r Fault-tolerance / High availability m As long as one replica is up, the service is available m Assume each of n replicas has same independent probability p to fail. Availability = 1 - pn Fault-Tolerance: Take-Over

5. Why Replicate? r Fast local access m Client can always send requests to closest replica m Goal: no communication to remote replicas necessary during request execution m Goal: client experiences location transparency since all access is fast local access Fast local access Toronto Beijing Dubai

6. Why Replicate? r Scalability and load distribution m Requests can be distributed among replicas m Handle increasing load by adding new replicas to the system cluster instead of bigger server

7. Common Replication Examples r DNS naming service r Web browsers often locally store a copy of a previously fetched web page. m This is referred to as caching a web page. r Replication of a database r Replication of game state r Google File System (GFS) r Amazon r Banks

8. System Model FE Requests and replies C Replica C Service Clients Front ends managers RM FE RM Clients’ request are handled by front ends. A front end makes replication transparent.

9. Developing Replication Systems r Consistency r Faults r Changes in Group Membership

10. Example of Data Inconsistency r Assume x = 6 r Client operations: m write(x = 5) m read (x) // should return 5 on a single- server system r Assume 3 replicas: R1,R2,R3

11. Example of Data Inconsistency r Client executes write (x = 5) r We want x = 5 at R1,R2,R3 r The write requires network communication m Assume a message is sent to each replica indicating that x=5 BTW, this is multicasting r The amount of time it takes for a message to get to a replica varies

12. Example of Data Inconsistency r R1 receives message m x is now 5 at R1 r A client executes read (x) m The read causes a message to be sent to R2 r If R2 hasn’t received the update message then R2 sends the old value of x (which is 6)

13. Example Scenario r Replicated accounts in New York(NY) and San Francisco(SF) r Two transactions occur at the same time and multicast m Current balance: $1,000 m Add $100 at SF m Add interest of 1% at NY m If not done in the same order at each site then one site will record a total amount of $1,111 and the other records $1,110.

14. Example Scenario r Updating a replicated database and leaving it in an inconsistent state.

15. Consistency Model r Consistency model (or consistency semantics) can be thought of as a contract between processes and the data store. r The difference between the models is in how the “last” write is determined/defined

16. Strict Consistency r Strict consistency is defined as follows: m Read is expected to return the value resulting from the most recent write operation m Assumes absolute global time m All writes are instantaneously visible to all r Suppose that process p i updates the value of x to 5 from 4 at time t 1 and multicasts this value to all replicas m Process p j reads the value of x at t 2 (t 2 > t 1 ). m Process p j should read x as 5 regardless of the size of the (t 2 -t 1 ) interval.

17. Strict Consistency r What if t 2 -t 1 = 1 nsec and the optical fiber between the host machines with the two processes is 3 meters. m The update message would have to travel at 10 times the speed of light m Not allowed by Einsten’s special theory of relativity. r Can’t have strict consistency

18. Sequential Consistency r Sequential Consistency m The result of any execution is the same as if the (read and write) operations by all processes on the data were executed in some sequential order m Operations of each individual process appears in this sequence in the order specified by its programs.

19. Sequential Consistency r When is sequential consistency desired? r Consider banking operations m We must ensure that the two update operations are performed in the same order at each replica. m Although it makes a difference whether the deposit is processed before the interest update or the other way around, it does matter which order is followed from the point of view of consistency.

20. Causal Consistency r Causal Consistency: If one update, U1, causes another update, U2, to occur then U1 should be executed before U2 at each copy. r Application: Bulletin board/chat room

21. FIFO Consistency r Writes done by a single process are seen by all other processes in the order in which they were issued r … but writes from different processes may be seen in a different order by different processes. r i.e., there are no guarantees about the order in which different processes see writes, except that two or more writes from a single source must arrive in order.

22. FIFO Consistency r An example of where FIFO consistency is desirable is with caches in web browsers r Caches in web browsers m All updates are updated by page owner. m No conflict between two writes

23. Eventual Consistency r In absence of updates, all replicas converge towards identical copies m Only requirement: an update should eventually propagate to all replicas r Need to resolve conflicts in the presence of multiple updates r This is useful when there are few updates or it is relatively easy to resolve conflicts

24. Design Considerations r Where to submit updates? m A designated server or any server? r When to propagate updates? r How many replicas to install?

25. Summary r We have given you a taste of some of the issues r We will now focus on logical clock algorithms and it role in implementing some of the consistency models