1. www.egi.eu EGI-InSPIRE RI-261323 EGI-InSPIRE www.egi.eu EGI-InSPIRE RI-261323 03/04/14 1 EGI Community Forum 2014 Federated Cloud image management Marios Chatziangelou, et al. mhaggel@iasa.gr Institute of Accelerating Systems and Applications (IASA) www.iasa.gr

2. www.egi.eu EGI-InSPIRE RI-261323 Main mission VM image management working group primary tasks: Provide a mechanism so that a user can upload transparently his own image to the Fedcloud testbed. Provide a common place to add an endorsement to a pertinent VM so that it can be trusted by the resource providers.

3. www.egi.eu EGI-InSPIRE RI-261323 The “Tools” Tools used, developed or extended for this purpose:  EGI Applications Database service EGI Applications Database  Hepix VMCaster/VMCatcher toolsetVMCasterVMCatcher

4. www.egi.eu EGI-InSPIRE RI-261323 EGI Applications Database A community driven central service that stores and provides to the public:  software solutions in the form of a native software and/or vAppliances, originated from almost every scientific area/discipline  the programmers and scientists who developed them  the publications derived from the registered software solution  Acts as a distribution mechanism for native software packages as well as for virtual images

5. www.egi.eu EGI-InSPIRE RI-261323 EGI Applications Database A community driven central service that stores and provides to the public:  software solutions in the form of a native software and/or vAppliances, originated from almost every scientific area/discipline  the programmers and scientists who developed them  the publications derived from the registered software solution  Acts as a distribution mechanism for native software packages as well as for virtual images

6. www.egi.eu EGI-InSPIRE RI-261323 VMCaster & VMCatcher VMCaster is a tool for managing and updating your published virtual machines image lists. Following the HEPiX image list format. VMCatcher is a tool which allows users to subscribe to Virtual Machine Image Lists, cache the images referenced to in the Virtual Machine Image List, validate the images list with x.509 based public key cryptography, and validate the images against sha512 hashes in the images lists and provide events for further applications to process update or expire changes of virtual machine images without having to further validate the images. Tip: You are welcome to imagine VMCatcher something like YUM for VMIs

7. www.egi.eu EGI-InSPIRE RI-261323 The big picture RPs/Sites vmcatcher site-bdii cloud mw AppDB Cloud Marketplace Top-BDII vmcaster sub-service Insert/update/remove image(s) Publish new vAppliance version Register a vAppliance Create a new vAppliance version Store:VOStore:vAppliance Republish VO-wide image list Select/update/exclude vAppliances Search for vAppliances Download images Get usage details Start/Stop/…. an image users VO Managersubmitter subscribe and/or get image_list updates perform occi cmds subscribe and/or get image_list updates (optional) push info retrieve info generate image_list generate image_list AppDB portal

8. www.egi.eu EGI-InSPIRE RI-261323 What we will see today (1) Part I 1.Introduction to VMCaster/VMcatcher 2.Using the Cloud marketplace from a submitter prospective – Register a VA Register a VA – Create new VA version and associate VM images metadata Create new VA version and associate VM images metadata – Publish a VA version Publish a VA version – Update a VA version (same as ‘create’, edit the cloned metadata) Update a VA version – Permissions & Privacy Permissions Privacy Private metadata Grant/revoke access Personal Access Tokens for authoritative API calls Personal Access Tokens Part I 1.Introduction to VMCaster/VMCatcher 2.Using the Cloud marketplace from a submitter prospective – Register a VA Register a VA – Create new VA version and associate VM images metadata Create new VA version and associate VM images metadata – Publish a VA version Publish a VA version – Update a VA version (same as ‘create’, edit the cloned metadata) Update a VA version – Permissions & Privacy Permissions Privacy Private metadata Grant/revoke access Personal Access Tokens for authoritative API calls Personal Access Tokens

9. www.egi.eu EGI-InSPIRE RI-261323 What we will see today (2) 3. VMCatcher subscriptions to Image Lists – use case: Public Image listsPublic Image lists – use case: Private Image listsPrivate Image lists 4. The Cloud Marketplace from a user prospective – Browse Virtual Appliances & Download Images – Get availability & usage details – Perform OCCI commands Perform OCCI commands Discussion & Feedback

10. www.egi.eu EGI-InSPIRE RI-261323 What we will see today (3) Part II: Advanced usage – Installing VMCaster & VMCatcher – Manage VO-wide Image Lists (for VO managers) Manage VO-wide Image Lists – Subscribe to VO-wide image lists (for site admins) Subscribe to VO-wide image lists – Operations using the VMCaster CLI Operations using the VMCaster CLI use case: Upload new VA versionUpload new VA version use case: Upload new & publishUpload new & publish Discussion & Feedback

11. www.egi.eu EGI-InSPIRE RI-261323 Thank you!! Questions

12. www.egi.eu EGI-InSPIRE RI-261323 Documentation: https://wiki.appdb.egi.eu/ https://github.com/hepix-virtualisation/vmcaster https://github.com/hepix-virtualisation/vmcatcher https://wiki.egi.eu/wiki/Fedcloud-tf:Main Contact: appdb-support@iasa.gr https://appdb.egi.eu/pages/contact/feedback

13. www.egi.eu EGI-InSPIRE RI-261323 Next steps Abandon x509 cert dependencies - where is that possible? i.e. vmcaster Support of FedAAI, eduGAIN Implement OCCI library for offering brokering functionality for the fedCloud – ideas for supporting other protocols/mechanisms are welcome Contextualization related features Introduce the personal ‘workspace’ where the user could start/stop/create/delete/monitor VMs Extend our notification system and many more….