1. OceanStore An Architecture for Global-Scale Persistent Storage Motivation Feature Application Specific Components - Secure Naming - Update - Access Control- Deep Archival Storage - Data Location and Routing- Introspection Conclusion http://oceanstore.cs.berkeley.edu

2. provides persistent storage for ubiquitous computing Secure information Durable information Automatic and reliable archiving of information Geographically distributed data and cache 10 10 users * 10,000 files/user = 10 14 files Motivation

3. Data Utility Model - user - service provider / responsible party Untrusted Infrastructure - privacy & integrity & robustness Nomadic Data/Promiscuous Caching floating replicas Deep Archival Storage archival form of data object self-verifying data Introspection Features Computation OptimizationObservation

4. Groupware and personal information management tools challenge: concurrent updates from many people solution: flexible update mechanism Digital libraries and repositories for scientific data challenge: Massive quantities of storage, reliability, complicated management solution: Deep archival storage + seamless data migration New streaming applications challenge: data aggregation and dissemination solution: uniform infrastructure Applications

5. Secure Naming Fundamental Unit: Persistent Object GUID: secure hash, 160bit, location independent Uniqueness + unforgeability + verification AGUID Active data: SHA-1(human-readable name + owner’s public key) VGUID Archival data: SHA-1(data) NodeID Server: SHA-1(public key of server) Directory object: securely mapping human-readable names to GUID

6. GUIDs  Secure Pointers Name+Key Active GUID Global Object Resolutions Floating Replica (Active Object) Active Data Commit Logs CKPoint GUID Archival GUID Signature RP Keys ACLs MetaData Global Object Resolution Archival copy or snapshot Archival copy or snapshot Archival copy or snapshot Erasure Coded Archival GUID Signature Inactive Object Global Object Resolution

7. Access Control Reader restriction restrict key distribution only to readers Writer restriction ACL require all writes be signed

8. Data Location and Routing Two levels: Fast probabilistic search for “routing cache” Attenuated Bloom filter first Bloom filter: record of the objects contained locally on the current node ith Bloom filter:union of all of the Bloom filters for all of the nodes a distance i through any path from the current node. fully distributed, constant amount of storage locality – provided by introspection mechanism Slow guaranteed global search plaxton mesh

9. Global Algorithm Nodes : NodeID Data Object: GUID –Each object has Root node f (ObjectID) = RootID, randomly mapped –Root node is responsible for storing object’s location –Publish process : deposit a pointer at every hop along the path to root node Plaxton mesh Incremental suffix based routing

10. 4 2 3 3 3 2 2 1 2 4 1 2 3 3 1 3 4 1 1 43 2 4 Plaxton Mesh Incremental suffix-based routing NodeID 0x43FE NodeID 0x13FE NodeID 0xABFE NodeID 0x1290 NodeID 0x239E NodeID 0x73FE NodeID 0x423E NodeID 0x79FE NodeID 0x23FE NodeID 0x73FF NodeID 0x555E NodeID 0x035E NodeID 0x44FE NodeID 0x9990 NodeID 0xF990 NodeID 0x993E NodeID 0x04FE NodeID 0x43FE

11. Object Location Randomization and Locality

12. Fault-tolerant Routing Multiple roots of each object using salted hash Additional neighbor links & neighbor link repair Repeat publishing process to repair location pointers Detect failures via soft-state probe packets Dynamic insertion & deletion

13. Update Model TimeStamp Client ID {Pred1, Update1} {Pred2, Update2} {Pred3, Update3} Client Signature Update message format: Conflict resolution Predicate-action pairs write restriction All updates submitted to Inner Ring servers which use byzantine agreement protocol to choose the final commit order Responsible party decides the inner ring Use plaxton mesh to disseminate commit order to secondary tier replicas Flexible update: support a range of consistency semantics (e.g. ACID) Untrusted infrastructure, limitation to work over ciphertext. Performance:- requirement of network bandwidth - latency of the client side

14. OceanStore Update

15. Deep Archive Storage Archival Data in Erasure Coded Fragments - Erasure codes produce n fragments, where any m is sufficient to reconstruct data. m < n. rate r = m/n. Storage overhead is 1/r. OceanStore equivalent of stable store Archival Fragments generated by Inner Ring Fragments are self-verifying

16. Deep Archive Storage- update

17. Deep Archival Storage - Self Verifying Data Fragment 3: Fragment 4: Data: Fragment 1: Fragment 2: H2H34HdF1 - fragment data H14 data H1H34HdF2 - fragment data H4H12HdF3 - fragment data H3H12HdF4 - fragment data F1F2F3F4 H1H2H3H4 H12H34 H14 B-GUID Hd Data Encoded Fragments F1 H2 H34 Hd Fragment 1: H2H34HdF1 - fragment data

18. Introspection Monitoring and adaptation of routing substrate –Optimization of Plaxton Mesh –Adaptation of second-tier multicast tree Continuous monitoring of access patterns: –Clustering algorithms to discover object relationships Clustered prefetching: demand-fetching related objects Proactive-prefetching: get data there before needed –Time series-analysis of user and data motion Continuous testing and repair of information –Slow sweep through all information to make sure there are sufficient erasure-coded fragments –Continuously reevaluate risk and redistribute data –Diagnosis and repair of routing and location infrastructure

19. Conclusions OceanStore: everyone’s data, one big utility –Global Utility model for persistent data storage OceanStore properties: –Provides security, privacy, and integrity –Provides extreme durability –Lower maintenance cost through continuous adaptation, self-diagnosis and repair –Large scale system has good statistical properties

20. Difference: Oceanstore: persistent storage infrastructure, untrusted infrastructure, passive data object OSD: active/dynamic object, trust model can not be too active over ciphertext. Common issues: - data security(privacy, integrity, reliability) - authentication and authorization - naming and routing - data consistency - caching - maintain-free - applications OceanStore vs OSD