Elastic HPC Extending the Cluster into the Cloud Ruth Lynch, Research IT Service 13 th November 2009.

Slides:

Advertisements

Similar presentations

Mitesh Soni. Not an Expert Session… Only an Overview Please Ask Questions Stop me if I am throwing Bouncers Language Preference?

Advertisements

Implementing Tableau Server in an Enterprise Environment

SCARF Duncan Tooke RAL HPCSG. Overview What is SCARF? Hardware & OS Management Software Users Future.

Summary of Cloud Computing (CC) from the paper Abovce the Clouds: A Berkeley View of Cloud Computing (Feb. 2009)

Creating HIPAA-Compliant Medical Data Applications with Amazon Web Services Presented by, Tulika Srivastava Purdue University.

Grow your business with your head in the cloud. What is Cloud Computing ? Internet-based computing, whereby shared resources, software and information.

Distributed Data Processing

© 2010 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 1 Taiwan ITQ.

Ivan Pleština Amazon Simple Storage Service (S3) Amazon Elastic Block Storage (EBS) Amazon Elastic Compute Cloud (EC2)

1 Chapter 11: Data Centre Administration Objectives Data Centre Structure Data Centre Structure Data Centre Administration Data Centre Administration Data.

…delivery models. “ASC-HS” - The official hosting services for ARCHIBUS, the number one Software Solution for Real Estate, Infrastructure, and Facilities.

The Internet2 NET+ Services Program Jerry Grochow Interim Vice President CSG January, 2012.

CTS PRIVATE CLOUD Quarterly Customer Meeting October 23, 2013 Kay Metsker.

Copyright © 2013, Oracle and/or its affiliates. All rights reserved. 1.

Introducing Progress Arcade Roy Ellis

Statewide IT Conference30-September-2011 HPC Cloud Penguin on David Hancock –

Low Cost, Scalable Proteomics Data Analysis Using Amazon's Cloud Computing Services and Open Source Search Algorithms Brian D. Halligan, Ph.D. Medical.

Infrastructure as a Service (IaaS) Amazon EC2

HTCondor at Cycle Computing: Better Answers. Faster. Ben Cotton Senior Support Engineer.

Research IT Service Projects 2009 Fred Clarke, Head of Research IT Service 25 th February 2009.

Cloud Computing (101).

INTRODUCTION TO CLOUD COMPUTING CS 595 LECTURE 4.

Cloud Computing Will Crowley Monica Lopez Jaimie Morrison.

Barracuda Networks Confidential1 Barracuda Backup Service Integrated Local & Offsite Data Backup.

Cloud Computing Guide & Handbook SAI USA Madhav Panwar.

An Introduction to DuraCloud Carissa Smith, Partner Specialist Michele Kimpton, Project Director Bill Branan, Lead Software Developer Andrew Woods, Lead.

An Introduction to Cloud Computing. The challenge Add new services for your users quickly and cost effectively.

Plan Introduction What is Cloud Computing?

3DAPAS/ECMLS panel Dynamic Distributed Data Intensive Analysis Environments for Life Sciences: June San Jose Geoffrey Fox, Shantenu Jha, Dan Katz,

Clouds on IT horizon Faculty of Maritime Studies University of Rijeka Sanja Mohorovičić INFuture 2009, Zagreb, 5 November 2009.

CLOUD COMPUTING & COST MANAGEMENT S. Gurubalasubramaniyan, MSc IT, MTech Presented by.

Cloud Computing using AWS C. Edward Chow. Advanced Internet & Web Systems chow2 Outline of the Talk Introduction to Cloud Computing AWS EC2 EC2 API A.

Software to Data model Lenos Vacanas, Stelios Sotiriadis, Euripides Petrakis Technical University of Crete (TUC), Greece Workshop.

PhD course - Milan, March /09/ Some additional words about cloud computing Lionel Brunie National Institute of Applied Science (INSA) LIRIS.

Cloud Computing in Cube Tor Vorraa Citilabs Regional Director Europe & Middle East.

Cloud computing is the use of computing resources (hardware and software) that are delivered as a service over the Internet. Cloud is the metaphor for.

Developing Scalable Web Applications on Amazon Web Services

Ocean Observatories Initiative Common Execution Infrastructure (CEI) Overview Michael Meisinger September 29, 2009.

IPlant Collaborative Tools and Services Workshop iPlant Collaborative Tools and Services Workshop Overview of Atmosphere.

Advantages Cloud Computing. customers only pay for the access and interfaces that they need. The customer buys only the services they need Cost Advantages.

HEAnet Conference, 2009 Cloud Does the ‘Cloud’ have a Silver Lining? Gareth Eason.

Copyright © 2012 Axceleon Intellectual Property All rights reserved HPC User Forum, Dearborn MI. Our Focus: Enable HPC solutions in the Cloud for our Customer.

Cloud Computing Changing the way business computing is (will be) done.

Presented by: Mostafa Magdi. Contents Introduction. Cloud Computing Definition. Cloud Computing Characteristics. Cloud Computing Key features. Cost Virtualization.

Cloud Computing By: Carley Paxton. What is Cloud Computing? CloudCloud computing is the next stage in the Internet's evolution, providing the means through.

Looking Ahead: A New PSU Research Cloud Architecture Chuck Gilbert - Systems Architect and Systems Team Lead Research CI Coordinating Committee Meeting.

How AWS Pricing Works Jinesh Varia Technology Evangelist.

Weather Forecast for IT Futures 1/8/091 Bill Clebsch CSG: Boulder, Colorado.

HUSKY CONSULTANTS FRANKLIN VALENCIA WIOLETA MILCZAREK ANTHONY GAGLIARDI JR. BRIAN CONNERY.

| nectar.org.au NECTAR TRAINING Module 4 From PC To Cloud or HPC.

3/12/2013Computer Engg, IIT(BHU)1 CLOUD COMPUTING-1.

Web Technologies Lecture 13 Introduction to cloud computing.

Cloud Computing. new buzz word driven largely by marketing and service offerings Provided by big corporate players Google IBM Amazon Apple.

© 2014 VMware Inc. All rights reserved. Cloud Archive for vCloud ® Air™ High-level Overview August, 2015 Date.

Data Hosting and Security Overview January, 2011.

INTRODUCTION TO GRID & CLOUD COMPUTING U. Jhashuva 1 Asst. Professor Dept. of CSE.

Architecture of a platform for innovation and research Erik Deumens – University of Florida SC15 – Austin – Nov 17, 2015.

Amazon Web Services. Amazon Web Services (AWS) - robust, scalable and affordable infrastructure for cloud computing. This session is about:

IPlant Collaborative Tools and Services Workshop iPlant Collaborative Tools and Services Workshop Overview of Atmosphere.

Agenda  What is Cloud Computing?  Milestone of Cloud Computing  Common Attributes of Cloud Computing  Cloud Service Layers  Cloud Implementation.

DISCUSSION LEADERS PRAVINA KOTA, KEVAN ESSMYER, NAVEEN KARDURI

Cloud Computing Cloud computing: (the Internet represents the Cloud).

Cloud computing-The Future Technologies

Recommendation 6: Using ‘cloud computing’ to meet the societal need ‘Faster and transparent access to public sector services’ Cloud computing Faster and.

Amazon Web Services Submitted By- Section - B Group - 4

Avast Confidential.

Weather Forecast for IT Futures

Security Information and Event Management (SIEM) Solution Runs on Microsoft Azure Power “We are so happy to be using Microsoft Azure to make our security.

ENA Cloud Services.

The Database World of Azure

Presentation transcript:

Elastic HPC Extending the Cluster into the Cloud Ruth Lynch, Research IT Service 13 th November 2009

HPC in UCD Research IT Service 2005 HPC is Core Service Phaeton Cluster - Community & Shared Services 11% ICHEC Stokes Cluster 2008

What's the problem? Physical HPC Cluster is inelastic Users sometimes need more resources than are available Adding resources can be a slow process Capital intensive process

Possible Solutions "Pre-order" hardware Buy compute time on other facilities Investigate "The Cloud"

Which Cloud? Cloud options Locations Different definitions "a style of computing where massively scalable IT enabled capabilities are delivered 'as a service' to external customers using Internet technologies" - Gartner Inc.

Getting on the Cloud Amazon Web Services No technical issues How to pay for the services? Credit Card? Prepaid credit card? Prepay for Amazon credit? Get billed by Amazon?

All Aboard the Cloud Contacted Amazon Applied for a research grant with Amazon Got a small grant Started building...

Technical Specifications Compute Nodes Up to 20 x Large Instances AMD Opteron 2218 HE 4 vCPU Cores 7GB of RAM CentOS 5.2 On Demand

Security Users authenticate through Phaeton Login Node LDAP Authentication Encrypted Communications 128 bit AES encryption for the data link 160 bit SHA1 checksum for both the data and control channels

Management Cloud Nodes are managed by Phaeton Head Node MOAB from Adaptive Computing / Torque Specific queue for cloud based resources

Data Concerns Data Protection Laws Data Transfer Rules Intellectual Property Laws Data Privacy

Data Concerns Amazon gives choice of location EU-WEST-1A & EU-WEST-1B Data not "stored" in the cloud Computation only in the cloud UCD Campus AWS

Computational Results Real users with real jobs Results dependent on job and user type

What else? AMD vs INTEL Licensing Tuning Cost comparison Currently appears more expensive than local resources Approx. 9,500 per month for AWS Costs have recently fallen

The Benefits Immediately available resources "Once off" usage charge for resources Relatively quick to set up Easy to maintain Viable option for occasional large scale single jobs

Future Plans UCD Cloud Incorporating existing local resources Access to multiple public cloud resources Seamless service provision Automated cloud bursting

Thanks to... Amazon Kurt Messersmith Iain Galvin UCD Research IT Team Research Community Lukasz Szmit

Thank You