1. A Technical Overview Bill Branan DuraCloud Technical Lead

2. Agenda Introduction Storage Services Reporting UI Security Tools Roadmap

3. Introduction DuraCloud is: – Hosted service Runs on cloud-based compute systems Connects to cloud-based storage systems Provides a service platform – Open source software suite Webinar Focus: – Components of software platform – Interacting with hosted DuraCloud

4. File System Data Repository Data Repository User Data Center DuraCloud Management Console Account Management Instance Management DuraCloud Management Console Account Management Instance Management DuraCloud in Context

5. Administrative User Interface (DurAdmin) Storage Management (DuraStore) Service Management (DuraService) Service Container Report Management (DuraReport) DuraCloud Instance REST API DuraCloud Storage

6. Storage Provider Interface SDSC Cloud Storage Microsoft Azure Storage Rackspace Cloud Files Rackspace Cloud Files Amazon S3 User Data Center Storage Management (DuraStore) Amazon Storage Adapter REST API Rackspace Storage Adapter Azure Storage Adapter SDSC Storage Adapter Storage Mediation Storage Mediation DuraCloud Storage

7. Storage REST Interface Space Actions Add Space Get/Set Space Properties Get Spaces List Get Space Content List Get/Set Space Access Delete Space Content Actions Add Content Get/Set Content Properties Get Content Copy Content Delete Content Other Actions Get Stores Get Tasks List Perform Task Storage Provider Interface

8. Storage Adapters Transform calls from DuraCloud interface into calls understood by a specific storage provider Determine how DuraCloud “spaces” translate into top level provider containers (buckets) Define how space and content properties are stored and retrieved Manage eventual consistency concerns

9. Administrative User Interface (DurAdmin) Storage Management (DuraStore) Service Management (DuraService) Service Container Report Management (DuraReport) DuraCloud Instance REST API DuraCloud Services

10. Bit Integrity Checker Bit Integrity Checker Tools Bit Integrity Checker Bulk Duplicate on Demand Duplicate on Change Media Streamer Image Transformer Bulk Image Transformer Image Server … so how are they deployed?

11. Service Manager REST API Service Management (DuraService) Service Registry Service Bundle Service Config Service Plan Services Available? Services In Plan? Service List 1 2 3 4 Part 1: Ask which services are available DuraCloud Service Deployment

12. Service Manager REST API Service Management (DuraService) Service Registry Service Bundle Service Config Service Plan DuraCloud Service Deployment Deploy Service Retrieve Service Bundle Service Bundle 1 2 3 Part 2: Deploy Service Service Config Service Configurator Deployed Service Config Deployed Service Service Container 4 Deploy Service Service Config Service Bundle

13. Service REST Interface Get Services Deploy Service Get (Deployed) Service Get Deployed Service Properties Update Service Configuration UnDeploy Service

14. DuraCloud Instance Services Bit Integrity Checker Bit Integrity Checker Tools Bit Integrity Checker Bulk Duplicate on Demand Duplicate on Change Media Streamer Image Transformer Bulk Image Transformer Image Server DuraCloud Distributed Services Runs on DuraCloud Instance Connects to DuraStore Can be direct Java service Can be deployed web app Runs primarily outside of DuraCloud Instance Connects to DuraStore Makes use of cloud network or computation features

15. Service Manager REST API Service Management (DuraService) Service Registry Bundle Config Service Plan DuraCloud Bulk Service Deployment 1 2 3 Config Deployed Service Service Container 4 Task Management (DuraStore) REST API Hadoop 5 Run Service Task 6 Run Hadoop Job

16. Administrative User Interface (DurAdmin) Storage Management (DuraStore) Service Management (DuraService) Service Container Report Management (DuraReport) DuraCloud Instance REST API DuraCloud Reporting

17. Report Management (DuraReport) Report Management (DuraReport) Storage Management (DuraStore) Service Management (DuraService) REST API DuraCloud Report Generation Message Broker Storage Report Builder Service Report Builder Deposit Reports Service Event Messages REST API Storage Data

18. Report REST Interface Storage Report Start Storage Report Get Latest Storage Report Get Storage Report List Get Storage Report Get Storage Report Info Cancel Storage Report Schedule Storage Report Cancel Storage Report Schedule Service Report Get Deployed Services Report Get Latest Completed Services Report Get Completed Services Report List Get Services Report

19. Administrative User Interface (DurAdmin) Storage Management (DuraStore) Service Management (DuraService) Service Container Report Management (DuraReport) DuraCloud Instance REST API DuraCloud UI

20. Storage Management (DuraStore) Service Management (DuraService) REST API Report Management (DuraReport) REST API Administrative User Interface (DurAdmin) Store Client Service Client Report Client DuraCloud UI Interaction

21. DuraCloud Security Storage Provider DurAdmin DuraStore DuraService DuraReport Application Security Storage Provider Access Control User Data Center Transport Security Instance Firewall

22. DuraCloud Tools Transfer to DuraCloud Upload Tool – GUI to select files and folders – Visual transfer progress Sync Tool – Monitors for changes – Run one time or continually Chunk Tool – Transfer large files – Acts on a single file Transfer from DuraCloud Retrieval Tool – Retrieve files from one, selected, or all spaces Stitch Tool – Retrieve large files – Acts on a single file

23. Storage Management (DuraStore) REST API DuraCloud Tools User Data Center Store Client Chunk Tool Sync Tool Store Client Stitch Tool Retrieval Tool Upload Tool

24. Near Term Road Map New features Access control at the space level Improved format identification Automated bit integrity checking Email notification on service completion Multi-Account DuraCloud instances Content indexing and Search – Improved discovery – Improved content browsing Folder-based navigation Improved handling of very large files Multi-Item updates/deletes Integrations SDSC storage provider (production version) Fedora-in-the-cloud prototype DSpace-in-the-cloud prototype

25. Long Term Road Map New Features Video transcoding Document format transformation Improved image support services Media streaming access controls Metadata extraction services Integrations Azure storage provider (production version) Eucalyptus Walrus storage provider Rackspace compute instances Managed Fedora-in-the-cloud Managed DSpace-in-the-cloud

26. Questions?

27. Upcoming DuraCloud Webinars Fedora and DuraCloud January 11, 2012 at 1pm ET DSpace and DuraCloud November 30, 2011 at 1pm ET

28. Thank You! Further Questions? info@duracloud.org