GLOBAL VIRTUAL CLUSTER DEPLOYMENT THROUGH A CONTENT DELIVERY NETWORK Pongsakorn U-chupala, Kohei Ichikawa (NAIST) Luca Clementi, Philip Papadopoulos (UCSD)

Slides:

Advertisements

Similar presentations

Wei Lu 1, Kate Keahey 2, Tim Freeman 2, Frank Siebenlist 2 1 Indiana University, 2 Argonne National Lab

Advertisements

1 Applications Virtualization in VPC Nadya Williams UCSD.

Lecture 12 IaaS Chapter 3 of the second reference book.

Amazon Web Services (aws) B. Ramamurthy. Introduction  Amazon.com, the online market place for goods, has leveraged the services that worked for their.

University of Notre Dame

Amazon Web Services and Eucalyptus

WEB & MOBILE CLOUD APP With Bootstrap, Backbone, Pusher, AWS, Slim Gabriele Mittica –

1 NETE4631 Cloud deployment models and migration Lecture Notes #4.

© UC Regents 2010 Extending Rocks Clusters into Amazon EC2 Using Condor Philip Papadopoulos, Ph.D University of California, San Diego San Diego Supercomputer.

Firefox 2 Feature Proposal: Remote User Profiles TeamOne August 3, 2007 TeamOne August 3, 2007.

Nikolay Tomitov Technical Trainer SoftAcad.bg.  What are Amazon Web services (AWS) ?  What’s cool when developing with AWS ?  Architecture of AWS 

SaaS, PaaS & TaaS By: Raza Usmani

Google AppEngine. Google App Engine enables you to build and host web apps on the same systems that power Google applications. App Engine offers fast.

By : Bridget Kargbo. /watch?v=XyjY8ZLzZrw &feature=player_embedd ed /watch?v=XyjY8ZLzZrw &feature=player_embedd.

Managing Client Access

Module 4 Managing Client Access. Module Overview Configuring the Client Access Server Role Configuring Client Access Services for Outlook Clients Configuring.

Introduction to Cloud Computing

“Salesforce” - meet Amazon Cloud Upload unlimited files sizes to your salesforce Get Started On Demand Files Storage for Salesforce Cloud Storage, a Salesforce.

IT 210 The Internet & World Wide Web introduction.

Opensource for Cloud Deployments – Risk – Reward – Reality

Appcipia.com. What is Appcipia? Step1 Book of Useful Mathematica Recipes In Print Form and Down-loadable code from O'Reilly So Web 1.0!

Chapter 9: Novell NetWare

Cloud Computing. What is Cloud Computing? Cloud computing is a model for enabling convenient, on-demand network access to a shared pool of configurable.

Cloud Computing 1. Outline  Introduction  Evolution  Cloud architecture  Map reduce operation  Platform 2.

The Blue Book pages 19 onwards

UI and Data Entry UI and Data Entry Front-End Business Logic Mid-Tier Data Store Back-End.

Introduction to Cloud Computing

Flexibility and user-friendliness of grid portals: the PROGRESS approach Michal Kosiedowski

Cloud Computing & Amazon Web Services – EC2 Arpita Patel Software Engineer.

EIDE Design Considerations 1 EIDE Design Considerations Brian Wright Portland General Electric.

Copyright © cs-tutorial.com. Overview Introduction Architecture Implementation Evaluation.

A Survey on Network Storage Ning Zong Haibin Song Richard Alimi Richard Yang.

Authors: Haowei Yuan and Patrick Crowley Publisher: 2013 Proceedings IEEE INFOCOM Presenter: Chia-Yi Chu Date: 2013/08/14 1.

The VAO is operated by the VAO, LLC. What is cloud computing and how can scientists use it? Matthew J. Graham, Caltech.

© 2008 by Shawn Spiars; made available under the EPL v1.0 | March 17, 2008 Case Study – Phurnace Software and RCP Shawn Spiars Lead UI Developer Phurnace.

Microsoft Azure Active Directory. AD Microsoft Azure Active Directory.

CLOUD COMPUTING RICH SANGPROM. What is cloud computing? “Cloud computing is a model for enabling ubiquitous, convenient, on-demand network access to a.

Vignesh Ravindran Sankarbala Manoharan. Infrastructure As A Service (IAAS) is a model that is used to deliver a platform virtualization environment with.

The CernVM Infrastructure Insights of a paradigmatic project Carlos Aguado Sanchez Jakob Blomer Predrag Buncic.

Cloud Computing Shannon McManus Michael Weihert. What is Cloud Computing?

Cloud Computing ILAS project DONE BY:. Table of content INTRODUCTION. ◦ Cloud computing in general ◦ What are the things that worked during the implementation.

Cloud computing: IaaS. IaaS is the simplest cloud offerings. IaaS is the simplest cloud offerings. It is an evolution of virtual private server offerings.

PRAGMA 25 Working Group Updates Resources Working Group Yoshio Tanaka (AIST) Phil Papadopoulos (UCSD) Most slides by courtesy of Peter, Nadya, Luca, and.

Aimee Stewart (KU) Nadya Williams (UCSD) 1.

Unit 2 VIRTUALISATION. Unit 2 - Syllabus Basics of Virtualization Types of Virtualization Implementation Levels of Virtualization Virtualization Structures.

CloudBerry Explorer for S3. CB Explorer Free to use Browse and manage files PowerShell functions Open and edit files  CloudBerry Explorer is an easy.

MICROSOFT AJAX CDN (CONTENT DELIVERY NETWORK) Make Your ASP.NET site faster to retrieve.

© 2015 MetricStream, Inc. All Rights Reserved. AWS server provisioning © 2015 MetricStream, Inc. All Rights Reserved. By, Srikanth K & Rohit.

Fault – Tolerant Distributed Multimedia Streaming Web Application By Nirvan Sagar – Srishti Ganjoo – Syed Shahbaaz Safir

Unit 3 Virtualization.

CLOUD ARCHITECTURE Many organizations and researchers have defined the architecture for cloud computing. Basically the whole system can be divided into.

Chapter 6: Securing the Cloud

Amazon Web Services (aws)

By: Raza Usmani SaaS, PaaS & TaaS By: Raza Usmani

Engineering a Content Delivery Network

Quattor in Amazon Cloud

Securing the Network Perimeter with ISA 2004

What are the most popular services offered by Amazon Web Services..?Amazon Web Services

Cloud based Open Source Backup/Restore Tool

Introduction to Cloud Computing

Amazon AWS Solution Architect Associate Exam Dumps For Full Exam Info Visit This Link:

Scalable SoftNAS Cloud Protects Customers’ Mission-Critical Data in the Cloud with a Highly Available, Flexible Solution for Microsoft Azure MICROSOFT.

AWS: EC2, S3 and Other Services

AWS Cloud Computing Masaki.

Cloud Web Filtering Platform

The Blue Book pages 19 onwards

Cloud-Enabling Technology

Cloud Computing: Concepts

Engineering a Content Delivery Network

Engineering a Content Delivery Network

Presentation transcript:

GLOBAL VIRTUAL CLUSTER DEPLOYMENT THROUGH A CONTENT DELIVERY NETWORK Pongsakorn U-chupala, Kohei Ichikawa (NAIST) Luca Clementi, Philip Papadopoulos (UCSD)

Some History PRAGMA 21 Easily share computational infrastructure components between PRAGMA members PRAGMA Virtual Cluster Sharing

Virtual Cluster Sharing 1. Virtual Cluster Images Standard KVM Single disk image RAW format The first partition is the root / partition No LVM or RAID!! Frontend 2 network interfaces First private Second public Compute 1 network interface /root/vc-out.xml for all network configuration Virtual Cluster Image Frontend Image.gz Compute Image.gz vc-in.xml

Virtual Cluster Sharing 2. Deployment mechanism Pragma Bootstrap: a software tool to help with deployment of PRAGMA compliant virtual cluster. Available at: Plugins architecture (to support more platforms) DynIP: To enable Rocks cluster to work inside PRAGMA Bootstrap VC-out-parser: generic driver for RedHat system

Virtual Cluster Sharing Where is the sharing? Amazon Simple Storage Service (S3): an online file storage web service Amazon CloudFront: is a content delivery network

Amazon S3 Amazon Simple Storage Service: online file storage web service -Web based GUI -Multiple user accounts -Fine-grained access control -Pay per use

Amazon CloudFront Global Content Delivery Network: Multiple edge locations in Asia Work with Amazon S3 Pay as you use Access control for protected content

Amazon CloudFront Our images are stored in the US Standard S3 bucket

Amazon CloudFront Delivered by all edge locations

Performance Object was already cached Network issue due to Pragma ENT No clues!! On average: S3: ~20-25 MB/s CloudFront hit: 50 MB/s CloudFront miss: 2 MB/s No clue!! Caching

Pragma Bootstrap Disk images are delivered by local CloudFront Edge servers S3 bucket pragma_boot GET /abs/disk1.vda

Pragma Bootstrap Pluggable download architecture Local: use local file Http: use plain http or https to download file CloudFront: support Cloud Front security mechanism (signed URL) Supported file format: raw: plain file gzip: compressed with gzip splited: split file in multiple sub-files splited_gzip: split file in multiple sub-files and compress them

Thank you! Questions? Source code available at: pragma_boot: Contacts: