1. POND: the OceanStore Prototype Sean Rhea, Patrick Eaton, Dennis Geels, Hakim Weatherspoon, Ben Zhao and John Kubiatowicz UC, Berkeley File and Storage Technologies, March 2003 Presenter: Prashanth

2. Goals of OceanStore Provide an Internet-scale cooperative file system High Durability Universal availability Balance between privacy & information sharing Integrity

3. Challenges Maintenance Many components, many administrative domains Constant change Must be self-organizing Must be self-maintaining Security Must have end-to-end encryption Must not place too much trust in any one host

4. Assumptions Infrastructure is untrusted except in aggregate. No more than some fraction of a given set are faulty/malicious. Infrastructure is constantly changing.

5. OceanStore uses Tapestry Tapestry performs Distributed Object Location and Routing Locality aware Efficient O(log N ) location time Self-organizing, self-maintaining

6. Data Model of OceanStore The unit of storage is called Data Object. Analogous to file in a file system Ordered sequences of read-only versions.

8. Byzantine agreement Guarantees all non-faulty replicas agree Given N =3f +1 replicas, up to f may be faulty/corrupt Expensive Requires O(N 2 ) communication

9. Erasure Codes Z WW ZY X f f -1

10. The Path of a Write Primary Replicas HotOS Attendee Other Researchers Archival Servers (for durability) Secondary Replicas (soft state)

11. The prototype: Pond Coding in Java Staged Event-Driven Architecture

12. OceanStore PhaseNFS5121024 I0.92.86.6 II9.416.840.4 III8.31.81.9 IV6.91.5 V21.532.070.7 Total47.054.9120.3 (times in seconds) Performance Results: Andrew Benchmark Pond faster on reads: 4.6x –Phases III and IV –Only contact primary when cache older than 30 seconds Ran Andrew on Pond –Primary replicas at UCB, UW, Stanford, Intel Berkeley –Client at UCB But slower on writes: 7.3x –Phases I, II, and V –Only 1024-bit are secure –512-bit keys show CPU cost

13. A closer look at Write Small writes Signature dominates Threshold sigs. slow! Takes 70+ ms to sign Compare to 5 ms for regular sig Large writes Encoding dominates Archive cost per byte Signature cost per write Phase 4 kB write 2 MB write Validate0.30.4 Serialize6.126.6 Apply1.5113.0 Archive4.5566.9 Sign Result77.875.8 (times in milliseconds)

14. Performance of Write

15. Stream Benchmark

16. Sources: The OceanStore Project http://oceanstore.cs.berkeley.edu/ http://oceanstore.cs.berkeley.edu/ THANK YOU!