StratusLab is co-funded by the European Community’s Seventh Framework Programme (Capacities) Grant Agreement INFSO-RI-261552 StratusLab: Marketplace EGI.

Slides:



Advertisements
Similar presentations
Dr. Leo Obrst MITRE Information Semantics Information Discovery & Understanding Command & Control Center February 6, 2014February 6, 2014February 6, 2014.
Advertisements

StratusLab is co-funded by the European Community’s Seventh Framework Programme (Capacities) Grant Agreement INFSO-RI Management Overview StratusLab.
StratusLab is co-funded by the European Community’s Seventh Framework Programme (Capacities) Grant Agreement INFSO-RI StratusLab: Enhancing grid.
StratusLab is co-funded by the European Community’s Seventh Framework Programme (Capacities) Grant Agreement INFSO-RI Work Package 4 Software Integration.
Virtual Machine Lifecycle StratusLab Tutorial (Orsay, France) 28 November 2012.
Using Storage with VMs StratusLab Tutorial (Orsay, France) 28 November 2012.
19-20 March 2003 IVOA Registry Workgroup LeSc Astrogrid Registry: Early Designs Elizabeth Auden Astrogrid Registry Workgroup Leader IVOA Registry Workgroup.
Marketplace and Appliance Management Charles (Cal) Loomis & Mohammed Airaj LAL, Univ. Paris-Sud, CNRS/IN2P October 2013.
StratusLab is co-funded by the European Community’s Seventh Framework Programme (Capacities) Grant Agreement INFSO-RI Sharing Virtual Appliances.
StratusLab is co-funded by the European Community’s Seventh Framework Programme (Capacities) Grant Agreement INFSO-RI VM Lifecycle ACGRID-III (Hanoi)
StratusLab is co-funded by the European Community’s Seventh Framework Programme (Capacities) Grant Agreement INFSO-RI Introduction to Cloud Technology.
StratusLab is co-funded by the European Community’s Seventh Framework Programme (Capacities) Grant Agreement INFSO-RI StratusLab: Cloud Federation.
StratusLab is co-funded by the European Community’s Seventh Framework Programme (Capacities) Grant Agreement INFSO-RI StratusLab Cloud Distribution.
Evolution to CIMI Charles (Cal) Loomis & Mohammed Airaj LAL, Univ. Paris-Sud, CNRS/IN2P3 29 August 2013.
Client Installation StratusLab Tutorial (Orsay, France) 28 November 2012.
StratusLab is co-funded by the European Community’s Seventh Framework Programme (Capacities) Grant Agreement INFSO-RI Cloud Computing and Challenges.
StratusLab Cloud Distribution Installation Charles Loomis (CNRS/LAL) 3 July 2014.
StratusLab is co-funded by the European Community’s Seventh Framework Programme (Capacities) Grant Agreement INFSO-RI Marketplace & Image Metadata.
Advanced Computing Services for Research Organisations Bob Jones Head of openlab IT dept CERN This document produced by Members of the Helix Nebula consortium.
EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks C. Loomis (CNRS/LAL) M.-E. Bégin (SixSq.
StratusLab is co-funded by the European Community’s Seventh Framework Programme (Capacities) Grant Agreement INFSO-RI Storage Services ACGRID-III.
StratusLab Roadmap StratusLab Tutorial (Orsay, France) 28 November 2012.
StratusLab is co-funded by the European Community’s Seventh Framework Programme (Capacities) Grant Agreement INFSO-RI Virtual Machine Isolation.
Advanced Topics StratusLab Tutorial (Orsay, France) 28 November 2012.
Copyright © cs-tutorial.com. Overview Introduction Architecture Implementation Evaluation.
StratusLab is co-funded by the European Community’s Seventh Framework Programme (Capacities) Grant Agreement INFSO-RI Client Installation ACGRID-III.
Storage Services Charles (Cal) Loomis & Mohammed Airaj LAL, Univ. Paris-Sud, CNRS/IN2P October 2013.
Registration Charles (Cal) Loomis & Mohammed Airaj LAL, Univ. Paris-Sud, CNRS/IN2P October 2013.
StratusLab is co-funded by the European Community’s Seventh Framework Programme (Capacities) Grant Agreement INFSO-RI Registration ACGRID-III (Hanoi)
StratusLab is co-funded by the European Community’s Seventh Framework Programme (Capacities) Grant Agreement INFSO-RI The StratusLab Cloud Distribution.
StratusLab is co-funded by the European Community’s Seventh Framework Programme (Capacities) Grant Agreement INFSO-RI StratusLab: Tutorial Recap.
StratusLab is co-funded by the European Community’s Seventh Framework Programme (Capacities) Grant Agreement INFSO-RI StratusLab: Storage Services.
StratusLab is co-funded by the European Community’s Seventh Framework Programme (Capacities) Grant Agreement INSFO-RI StratusLab project Update.
StratusLab is co-funded by the European Community’s Seventh Framework Programme (Capacities) Grant Agreement INFSO-RI StratusLab Collaborations.
StratusLab is co-funded by the European Community’s Seventh Framework Programme (Capacities) Grant Agreement INSFO-RI Integrating Cloud Monitoring.
StratusLab is co-funded by the European Community’s Seventh Framework Programme (Capacities) Grant Agreement INFSO-RI StratusLab: Storage Services.
Appliance Management StratusLab Tutorial (Orsay, France) 28 November 2012.
StratusLab is co-funded by the European Community’s Seventh Framework Programme (Capacities) Grant Agreement INSFO-RI Operating grid services on.
StratusLab is co-funded by the European Community’s Seventh Framework Programme (Capacities) Grant Agreement INFSO-RI StratusLab: Enhancing Grid.
StratusLab is co-funded by the European Community’s Seventh Framework Programme (Capacities) Grant Agreement INFSO-RI Management Overview StratusLab.
StratusLab is co-funded by the European Community’s Seventh Framework Programme (Capacities) Grant Agreement INFSO-RI Work Package 3 Dissemination.
StratusLab is co-funded by the European Community’s Seventh Framework Programme (Capacities) Grant Agreement INFSO-RI Demonstration StratusLab First.
StratusLab is co-funded by the European Community’s Seventh Framework Programme (Capacities) Grant Agreement INFSO-RI Work Package 2 Interactions.
StratusLab is co-funded by the European Community’s Seventh Framework Programme (Capacities) Grant Agreement INFSO-RI VM Lifecycle StratusLab Tutorial.
StratusLab is co-funded by the European Community’s Seventh Framework Programme (Capacities) Grant Agreement INFSO-RI Client Installation StratusLab.
StratusLab is co-funded by the European Community’s Seventh Framework Programme (Capacities) Grant Agreement INFSO-RI Technical Overview StratusLab.
StratusLab is co-funded by the European Community’s Seventh Framework Programme (Capacities) Grant Agreement INFSO-RI StratusLab: Enhancing Grid.
StratusLab is co-funded by the European Community’s Seventh Framework Programme (Capacities) Grant Agreement INFSO-RI StratusLab Marketplace C.
StratusLab is co-funded by the European Community’s Seventh Framework Programme (Capacities) Grant Agreement INFSO-RI Work Package 2 Interactions.
Registration StratusLab Tutorial (Orsay, France) 28 November 2012.
StratusLab is co-funded by the European Community’s Seventh Framework Programme (Capacities) Grant Agreement INFSO-RI Cloud Computing and Challenges.
StratusLab is co-funded by the European Community’s Seventh Framework Programme (Capacities) Grant Agreement INFSO-RI Work Package 5 Infrastructure.
StratusLab is co-funded by the European Community’s Seventh Framework Programme (Capacities) Grant Agreement INFSO-RI Virtual Machine Isolation.
StratusLab is co-funded by the European Community’s Seventh Framework Programme (Capacities) Grant Agreement INFSO-RI Work Package 5 Infrastructure.
StratusLab is co-funded by the European Community’s Seventh Framework Programme (Capacities) Grant Agreement INFSO-RI Introduction to Cloud Technology.
StratusLab is co-funded by the European Community’s Seventh Framework Programme (Capacities) Grant Agreement INFSO-RI Exploitation and Sustainability.
The StratusLab Distribution and Its Evolution 4ème Journée Cloud (Bordeaux, France) 30 November 2012.
StratusLab is co-funded by the European Community’s Seventh Framework Programme (Capacities) Grant Agreement INFSO-RI StratusLab: Overview & Collaboration.
Current Status of the Project C. Loomis CNRS/LAL The StratusLab project is co-funded by the European Community’s Seventh Framework Programme (Capacities)
StratusLab is co-funded by the European Community’s Seventh Framework Programme (Capacities) Grant Agreement INFSO-RI StratusLab Sustainability.
StratusLab is co-funded by the European Community’s Seventh Framework Programme (Capacities) Grant Agreement INFSO-RI Work Package 4 Software Integration.
StratusLab is co-funded by the European Community’s Seventh Framework Programme (Capacities) Grant Agreement INFSO-RI Features, Use Cases, and Sustainability.
StratusLab is co-funded by the European Community’s Seventh Framework Programme (Capacities) Grant Agreement INFSO-RI StratusLab: VM Lifecycle EGI.
C Loomis (CNRS/LAL) and V. Floros (GRNET)
StratusLab Cloud Distribution
StratusLab Roadmap C. Loomis (CNRS/LAL) EGI TCB (Amsterdam)
An Overview of Data-PASS Shared Catalog
StratusLab Tutorial (Bordeaux, France)
StratusLab Tutorial (Bordeaux, France)
StratusLab Sustainability
Presentation transcript:

StratusLab is co-funded by the European Community’s Seventh Framework Programme (Capacities) Grant Agreement INFSO-RI StratusLab: Marketplace EGI User Forum (Vilnius, Lithuania) 12 April 2011

2 StratusLab Marketplace Machine image creation is a barrier to cloud adoption  Creating virtual machine images is time-consuming  Ensuring that machines are secure and correct is difficult  Sharing existing machines lowers this barrier Marketplace facilitates sharing of images  Registry of metadata for machine & disk images  Image contents are kept in cloud, grid, or web storage Benefits  End-users: browse and use existing images for their analyses  Creators: publicize their work and attract larger user base  Cloud Admins.: Use metadata to evaluate trustworthiness of images

3 Interfaces REST interface  Exposes a simple HTTP-based REST interface  Easy to program against in all languages Web interface  REST interface also allows browsing via a web browser  Signed entries can also be uploaded via the browser Endpoints:  Standard:  Tutorial:

4 Web Portal

5 Metadata Entries

6 Metadata Image metadata  Must conform to a defined schema  Uses the RDF-XML format  Must be cryptographically signed with a (grid) certificate  Must contain image ID and checksums to make connection to image  May contain location elements with image content URL(s)

7 Workflow Typical Marketplace workflow:  Create image from scratch or based on existing image  Upload the image to cloud, grid, or web storage area  Create the metadata for the image  Sign the metadata with your (grid) certificate  Upload the signed metadata to the Marketplace

8 Creating & Uploading Image Creating an image is a time consuming process… Cheat (!) and just create a file with random contents:  This "image" certainly will never run: Also bypass the uploading…  Normally, it would be transferred to cloud, grid, or web storage.  Images must be accessible via http(s) at the moment.  Location URL(s) would usually be part of the metadata. Pretend that we've created and uploaded an image. $ dd of=dummy.img if=/dev/random bs=1024 count= records in 10+0 records out bytes transferred in secs ( bytes/sec)

9 Create Metadata Description Create the metadata description for the image:  stratus-build-metadata  "ttylinux-9.3-i686-base-1.0.xml"  Wait for the unknown state, then kill (remove) the instance: Look at the contents of the file:  Identifier is based on SHA-1 checksum and looks like "LJaGVOfKSRZLVmq5RP1ZUAO68bn"  Checksums ensure that downloaded images match the metadata  Normal file would have location elements; this one does not  Empty endorser element and no signature element $ stratus-build-metadata \ --author='Charles Loomis' \ --os=ttylinux \ --os-version=9.3 \ --os-arch=i686 \ --version=1.0 \ dummy.img

10 Create Metadata Description Try to validate the unsigned metadata file:  There is no signature so the file should not be valid Sign the contents of the file with a grid certificate:  ttylinux-9.3-i686-base-1.0.xml  ttylinux-9.3-i686-base-1.0.xml.orig  ttylinux-9.3-i686-base-1.0.xml contains endorser and signature elements $ stratus-validate-metadata ttylinux-9.3-i686-base-1.0.xml Invalid: ttylinux-9.3-i686-base-1.0.xml no signature $ stratus-sign-metadata \ --p12-cert grid.p12 \ --p12-password xxxxxx \ ttylinux-9.3-i686-base-1.0.xml Manifest file successfully signed: ttylinux-9.3-i686-base-1.0.xml $ stratus-validate-metadata ttylinux-9.3-i686-base-1.0.xml Valid: ttylinux-9.3-i686-base-1.0.xml

11 Upload Metadata Description File can be uploaded via the command line:  stratus-upload-image NOTE: address may be validated before entry is added to database! $ stratus-upload-image \ --marketplace-endpoint= \ --marketplace-only \ ttylinux-9.3-i686-base-1.0.xml ::::::::::::::::::::::::::::::: :: Starting appliance upload :: ::::::::::::::::::::::::::::::: :: Parsing manifest :: Uploading metadata ::::::::::::::::::::::::::::::::::::: :: Appliance uploaded successfully :: :::::::::::::::::::::::::::::::::::::

12 Web Upload of Metadata

13 Querying Marketplace with SPARQL

14 Querying Marketplace with SPARQL PREFIX dcterms: PREFIX slterms: select distinct ?os ?identifier where { ?x dcterms:identifier ?identifier. ?x slterms:os ?os }

15 Querying Marketplace with SPARQL PREFIX dcterms: PREFIX slreq: select distinct ?identifier ? ?created where { ?x dcterms:identifier ?identifier; slreq:endorsement ?endorsement. ?endorsement slreq:endorser ?endorser; dcterms:created ?created. ?endorser slreq: ? . FILTER (? = }

16 Using an Image in the Marketplace Pass the URL for metadata entry when starting instance.  stratus-run-instance …  Use normal machine lifecycle to control machine. StratusLab cloud will validate image before running it:  stratus-policy-image: invokes site policy to determine if the referenced image can be used; includes endorser white lists, checksum black lists, etc.  stratus-download-image: will download a validated image to be used by a VM instance; uses the location URL(s) in the metadata entry

Copyright © 2011, Members of the StratusLab collaboration: Centre National de la Recherche Scientifique, Universidad Complutense de Madrid, Greek Research and Technology Network S.A., SixSq Sàrl, Telefónica Investigación y Desarrollo SA, and The Provost Fellows and Scholars of the College of the Holy and Undivided Trinity of Queen Elizabeth Near Dublin. This work is licensed under the Creative Commons Attribution 3.0 Unported License