1. Synchronization Chapter 6 Part III Transactions

2. –Most of the lecture notes are based on slides by Prof. Jalal Y. Kawash at Univ. of Calgary –Some slides are from Prof. Steve Goddard at University Nebraska, Lincoln, Prof. Harandi, Prof. Hou, Prof. Gupta and Prof. Vaidya from University of Illinois, Prof. Kulkarni from Princeton University –I have modified them and added new slides Giving credit where credit is due: CSCE455/855 Distributed Operating Systems

3. Transactions Example Transaction: Transfer amount X from A to B debit(Account A; Amount X): A = A – X; credit(Account B; Amount X): B = B + X; Either do the whole thing or nothing

4. ACID Properties – AC Atomicity: No intermediate results are observable –To an external observer, T jumps from the initial state to the final state, or never leaves the initial state Consistency: T produces consistent results only, otherwise it aborts –T fulfills the consistency constraints of the application, no violation of system invariants

5. ACID Properties – ID Isolation: T looks like it is the only program running –Notice the looks like! Durability: T produces unforgettable by the system results –T’s results become part of reality

6. Some Transaction Primitives Examples of primitives for transactions. PrimitiveDescription BEGIN_TRANSACTIONMake the start of a transaction END_TRANSACTIONTerminate the transaction and try to commit ABORT_TRANSACTIONKill the transaction and restore the old values READRead data from a file, a table, etc. WRITEWrite data to a file, a table, etc.

7. Transaction Types Flat Transactions Flat Transactions with Savepoints Chained Transactions Nested Transactions Distributed Transactions Multi-level Transactions Open Nested Transactions Long-lived Transactions

8. Flat Transactions – All or Nothing Simplest Type Basic building block for organizing an application into atomic actions Encloses a program with brackets: –BEGIN_TRANSACTION –END_TRANSACTION All that is between the brackets is performed or nothing at all Strictly satisfies ACID

9. Flat Transactions – Limitations All-or-nothing is not always appropriate It is beneficial to commit partial results (violate atomicity) Trip Planning: commit part of a transaction Bulk Updates: can be expensive to undo all updates

10. Trip Planning a)Transaction to reserve three flights commits b)Transaction aborts when third flight is unavailable BEGIN_TRANSACTION reserve LNK -> MSP; reserve MSP -> SEA; reserve SEA -> YVR; END_TRANSACTION (a) BEGIN_TRANSACTION reserve LNK -> MSP; reserve MSP -> SEA; reserve SEA -> YVR full => ABORT_TRANSACTION (b)

11. Flat Transactions with SavePoints T: BEGIN_TRANSACTION S 1 … S m SAVEPOINT S m+1 … END_TRANSACTION Failure here ROLLBACK Flat T w/o SavePoint W SavePoint

12. Nested Transactions – No D They organize T actions into a hierarchy 1.A nested T is a tree of T’s; sub-trees are flat or nested 2.Leaf T’s are flat 3.Root T = top-level T; all other are subTs 4.SubT can commit or roll back. Its commit will not take effect unless the root commits 5.When a subT rolls back, all its children are rolled back Satisfy ACI, not the D (except for top level)

13. Nested Transactions – Trip Planning BEGIN_TRANSACTION BEGIN_SUB reserve LNK -> MSP; END_SUB BEGIN_SUB reserve MSP -> SEA; END_SUB BEGIN_SUB reserve SEA -> YVR; END_SUB END_TRANSACTION Failure here Can Commit

14. Distributed Transactions A flat transaction that runs in a distributed environment: –Visit several nodes in the system Distributed T: structure is determined by the distribution of data in the DS Nested T: structure is determined by the functional decomposition of the application

15. Nested versus Distributed Ts a)A nested transaction b)A distributed transaction

16. How to Implement Transactions?

17. Achieving Atomicity (I) Private Workspace: –Change a copy of data, keeping original intact –COMMIT: copy changed data to original –ROLLBACK: discard copy

18. Private Workspace a)The file index and disk blocks for a three-block file b)The situation after a transaction has modified block 0 and appended block 3 c)After committing

19. Achieving Atomicity (II) Writeahead Log: –Change original data, logging every change before making it –COMMIT: leave changes –ROLLBACK: restore from log

20. Writeahead Log a) A transaction b) – d) The log before each statement is executed x = 0; y = 0; BEGIN_TRANSACTION; x = x + 1; y = y + 2 x = y * y; END_TRANSACTION; (a) Log [x = 0 / 1] (b) Log [x = 0 / 1] [y = 0 / 2] (c) Log [x = 0 / 1] [y = 0 / 2] [x = 1 / 4] (d)

21. Achieving Consistency & Isolation Concurrency Control: controlling the execution of concurrent Ts operating on shared data Consistency & Isolation: All Ts must appear as if they executed in some sequential order, one after another (Serializability)

22. Serializability d) Possible schedules BEGIN_TRANSACTION x = 0; x = x + 1; END_TRANSACTION (a) BEGIN_TRANSACTION x = 0; x = x + 2; END_TRANSACTION (b) BEGIN_TRANSACTION x = 0; x = x + 3; END_TRANSACTION (c) Schedule 1x = 0; x = x + 1; x = 0; x = x + 2; x = 0; x = x + 3Legal Schedule 2x = 0; x = 0; x = x + 1; x = x + 2; x = 0; x = x + 3;Legal Schedule 3x = 0; x = 0; x = x + 1; x = 0; x = x + 2; x = x + 3;Illegal (d) a) – c) Three transactions

23. Ts as Sequences of Reads and Writes Transaction = sequence of read and write operations –Read of x returning 1 by T: r T (x)1 –Write to x a value 2 by T: w T (x)2 T a BEGIN_TRANSACTION x = 0; x = x + 1; END_TRANSACTION BT w a (x)0 r a (x) 0 w a (x)1 ET 

24. Conflicting Operations Two operations o 1 and o 2 conflict if: –Both o 1 and o 2 are on the same data item, and –At least one of o 1 and o 2 is a write w a (x)0 r a (x) 0 w a (x)1 w b (x)0 r b (x) 0 w b (x)2 w c (x)0 r c (x) 0 w c (x)3 X

25. Concurrency Control Algorithms (CCA) CCA: order read and write operations –By using locks (critical sections) –By using timestamps Pessimistic CCA: Act conservatively so that nothing can go wrong Optimistic CCA: Act aggressively, if something goes wrong, abort

26. Using Locks For T to access (read or write) a data item x: –T requests a lock on x from the scheduler When T finishes accessing x: –T releases the lock Scheduler grants acquisitions & releases on locks so that serializability is guaranteed Locks: –Shared: can only read x –Exclusive: can read and write x

27. Example T a x = 0 x = x + 1 T b x = 0 x = x + 2 Serializability x = 1 or 2 only Acquire x.lock w(x)0 Release x.lock Acquire x.lock w(x)0 Release x.lock Acquire x.lock r(x)0 Release x.lock Acquire x.lock w(x)1 Release x.lock Acquire x.lock r(x)1 Release x.lock Acquire x.lock w(x)3 Release x.lock x = 3

28. Two-Phase Locking – Pessimistic A transaction executes in two phases

29. 2PL – Scheduler Rules 1.When sched receives operation o T (x)v: a.If ((exists o’ holding a lock on x) & (o’ and o are conflicting)) Delay o b.Else grant a lock to o and pass o to the data manager 2.Sched never releases a lock for x granted for operation o, until data manager acks the completion of o 3.Once sched releases a lock for T, T cannot be granted another lock. If T tries to, abort it

30. 2PL – Analysis 2PL guarantees serializability BUT not every serializable schedule can be generated by 2PL 2PL can cause a deadlock, concurrency is reduced BEGIN_TRANSACTION x = 0; x = x + 1; x = 6 END_TRANSACTION (a) BEGIN_TRANSACTION x = 0; x = x + 2; x = 8 END_TRANSACTION (b) BEGIN_TRANSACTION x = 0; x = x + 3; x = 10; END_TRANSACTION (c)

31. Strict 2PL Do not release locks until a T is finished

32. 2PL – Discussion Strict 2PL can also lead to a deadlock –Use timeouts to preempt locks Strict 2PL advantages: –Acquisitions and releases can be done more easily, without T’s knowledge –T always reads committed data  avoid cascaded aborts

33. 2PL – Discussion Strict 2PL can also lead to a deadlock –Use timeouts to preempt locks Strict 2PL advantages: –Acquisitions and releases can be done more easily, without T’s knowledge –T always reads committed data  avoid cascaded aborts Every 2PL (both versions) schedule is serializable BUT not every serializable schedule can be generated by 2PL (both versions)

34. Pessimistic Timestamp Ordering (PTO) Each T has a timestamp, denoted T.ts Each operation in T has same timestamp (T.ts) Using Lamport’s or vector timestamps, all Ts have unique timestamp values If T.ts < T’.ts then T must appear before T’ in the schedule With each data item x, associate: –x.wts : largest ts of any T that executed w T (x)v –x.rts : largest ts of any T that executed r T (x)v Update x.wts (resp. x.rts) whenever w T (x)v (resp. r T (x)v) occurs

35. PTO General Concept If T.ts < T’.ts then T must appear before T’ in the schedule Process transactions in a serial order Can use the same file, but must do it in order Therefore isolation is preserved

36. PTO – read operation When Sched receives r T (x)v operation: –if T.ts < x.wts \\T tries to read the past reject r T (x)v roll T back (assign T a new ts and restart) –if T.ts  x.wts –(Do we need to compare T.ts with x.rts?) execute r T (x)v x.rts = max(x.rts, T.ts)

37. PTO – write operation When Sched receives w T (x)v operation: –if (T.ts < x.rts) or (T.ts < x.wts) \\T tries to write in the past reject w T (x)v roll T back (assign T a new ts and restart) –else execute w T (x)v x.wts = T.ts

38. PTO – Analysis Will PTO cause deadlock? –PTO is deadlock-free Each PTO schedule is serializable Not every serializable schedule is possible in PTO 2PL can produce schedules not possible under PTO, and vice versa All serializable Schedules All PTO Schedules All 2PL Schedules

39. Optimistic Timestamp Ordering (OTO) Each T does its changes to data (in its private workspace) When done either commit or restart Each data item x has x.wts and x.rts, updated as before When T needs to commit, Check x’s ts If there is a conflict then restart else commit

40. OTO (cont.) Parallelism is maximized –No waiting on locks –Inefficient when an abort is needed Pessimistic vs. Optimistic CCA –For instance, PTO vs. OTO ??

41. TO: Cascaded Aborts Problem For example the following run with transactions T1 and T2: –W 1 (x) R 2 (x) W 2 (y) R 1 (z), when can we commit T1 and T2? –W 1 (x) R 2 (x) W 2 (y) C 2 R 1 (z) C 1 –This could be produced by a TO scheduler T2 commits even though having read (i.e., R 2 (x)) from an uncomitted transaction –Answer: a scheduler can keep a list of other transactions each transaction has read from, and not let a transaction commit before this list consists of only committed transactions Cascaded aborts still possible! –Answer: To avoid cascaded aborts, the scheduler can tag data written by uncommitted transactions as dirty, and never let a read operation start on such a data item before it was untagged

42. Appendix

43. Concurrency Control General organization of managers for handling transactions. Concurrency Control

44. Concurrency Control for Distributed Ts General organization of managers for handling distributed transactions.