Cloud Usage Overview The IBM SmartCloud Enterprise infrastructure provides an API and a GUI to the users. This is being used by the CloudBroker Platform.

Slides:



Advertisements
Similar presentations
Building Portals to access Grid Middleware National Technical University of Athens Konstantinos Dolkas, On behalf of Andreas Menychtas.
Advertisements

Evaluating the Cost-Benefit of Using Cloud Computing to Extend the Capacity of Clusters Presenter: Xiaoyu Sun.
CHANGING THE WAY IT WORKS Cloud Computing 4/6/2015 Presented by S.Ganesh ( )
SLA-Oriented Resource Provisioning for Cloud Computing
EHarmony in Cloud Subtitle Brian Ko. eHarmony Online subscription-based matchmaking service Available in United States, Canada, Australia and United Kingdom.
4/2/2002HEP Globus Testing Request - Jae Yu x Participating in Globus Test-bed Activity for DØGrid UTA HEP group is playing a leading role in establishing.
XSEDE 13 July 24, Galaxy Team: PSC Team:
RCAC Research Computing Presents: DiaGird Overview Tuesday, September 24, 2013.
1 Software & Grid Middleware for Tier 2 Centers Rob Gardner Indiana University DOE/NSF Review of U.S. ATLAS and CMS Computing Projects Brookhaven National.
IPlant Collaborative Tools and Services Workshop iPlant Collaborative Tools and Services Workshop Overview of Atmosphere.
Chapter-7 Introduction to Cloud Computing Cloud Computing.
CLOUD COMPUTING. A general term for anything that involves delivering hosted services over the Internet. And Cloud is referred to the hardware and software.
SyBIT Tools for SystemsX.ch Ela Hunt and Peter Kunszt, SyBIT, SystemsX.ch, ETH Zurich {ela.hunt, SystemsX.ch is a consortium.
Cloud computing is the use of computing resources (hardware and software) that are delivered as a service over the Internet. Cloud is the metaphor for.
 Cloud computing  Workflow  Workflow lifecycle  Workflow design  Workflow tools : xcp, eucalyptus, open nebula.
Customized cloud platform for computing on your terms !
CloudBroker integration to WS- PGRADE/gUSE Zoltán Farkas MTA SZTAKI LPDS
Using the WS-PGRADE Portal in the ProSim Project Protein Molecule Simulation on the Grid Tamas Kiss, Gabor Testyanszky, Noam.
Connecting OurGrid & GridSAM A Short Overview. Content Goals OurGrid: architecture overview OurGrid: short overview GridSAM: short overview GridSAM: example.
Cloud Computing. What is Cloud Computing? Cloud computing is a model for enabling convenient, on-demand network access to a shared pool of configurable.
Click to add text TWA Cloud Integration with Tivoli Service Automation Manager TWS Education.
SCI-BUS is supported by the FP7 Capacities Programme under contract no. RI CloudBroker Platform Presentation Wibke Sudholt CloudBroker GmbH Technoparkstrasse.
SCI-BUS is supported by the FP7 Capacities Programme under contract nr RI CloudBroker Platform integration into WS-PGRADE/gUSE Zoltán Farkas MTA.
IPlant Collaborative Tools and Services Workshop iPlant Collaborative Tools and Services Workshop Overview of Atmosphere.
BLAST: A Case Study Lecture 25. BLAST: Introduction The Basic Local Alignment Search Tool, BLAST, is a fast approach to finding similar strings of characters.
A Framework for Elastic Execution of Existing MPI Programs Aarthi Raveendran Tekin Bicer Gagan Agrawal 1.
1 Overview of the Application Hosting Environment Stefan Zasada University College London.

Protein Molecule Simulation on the Grid G-USE in ProSim Project Tamas Kiss Joint EGGE and EDGeS Summer School.
Wenjing Wu Computer Center, Institute of High Energy Physics Chinese Academy of Sciences, Beijing BOINC workshop 2013.
The Grid System Design Liu Xiangrui Beijing Institute of Technology.
Resource Brokering in the PROGRESS Project Juliusz Pukacki Grid Resource Management Workshop, October 2003.
WNoDeS – Worker Nodes on Demand Service on EMI2 WNoDeS – Worker Nodes on Demand Service on EMI2 Local batch jobs can be run on both real and virtual execution.
The iPlant Collaborative Community Cyberinfrastructure for Life Science Tools and Services Workshop Discovery Environment Overview.
Ames Research CenterDivision 1 Information Power Grid (IPG) Overview Anthony Lisotta Computer Sciences Corporation NASA Ames May 2,
The iPlant Collaborative Community Cyberinfrastructure for Life Science Tools and Services Workshop Discovery Environment Overview.
SCI-BUS is supported by the FP7 Capacities Programme under contract no. RI CloudBroker Platform Tutorial Wibke Sudholt CloudBroker GmbH Technoparkstrasse.
1 Andrea Sciabà CERN Critical Services and Monitoring - CMS Andrea Sciabà WLCG Service Reliability Workshop 26 – 30 November, 2007.
Grid and Cloud Computing Alessandro Usai SWITCH Sergio Maffioletti Grid Computing Competence Centre - UZH/GC3
My project  Small-Medium Enterprises (SMEs)  faces goods distribution problems  needs necessary resources, money and technical expertise, to purchase.
Globus and PlanetLab Resource Management Solutions Compared M. Ripeanu, M. Bowman, J. Chase, I. Foster, M. Milenkovic Presented by Dionysis Logothetis.
Timeshared Parallel Machines Need resource management Need resource management Shrink and expand individual jobs to available sets of processors Shrink.
A Technical Overview Bill Branan DuraCloud Technical Lead.
Tier3 monitoring. Initial issues. Danila Oleynik. Artem Petrosyan. JINR.
Web Technologies Lecture 13 Introduction to cloud computing.
SCI-BUS is supported by the FP7 Capacities Programme under contract nr RI Accessing Cloud Systems from WS-PGRADE/gUSE Zoltán Farkas MTA SZTAKI LPDS.
AHM04: Sep 2004 Nottingham CCLRC e-Science Centre eMinerals: Environment from the Molecular Level Managing simulation data Lisa Blanshard e- Science Data.
Azure in a Day Training: Windows Azure Module 1: Windows Azure Overview Module 2: Development Environment / Portal – DEMO: Signing up for Windows Azure.
OGCE Workflow and LEAD Overview Suresh Marru, Marlon Pierce September 2009.
OpenStack Chances and Practice at IHEP Haibo, Li Computing Center, the Institute of High Energy Physics, CAS, China 2012/10/15.
Capacity Planning in a Virtual Environment Chris Chesley, Sr. Systems Engineer
All rights reserved. © CloudBroker GmbH Cloud Computing for Scientific and Technical Applications GridKa School 2012 August 28, 2012, Karlsruhe, Germany.
Claudio Grandi INFN Bologna Virtual Pools for Interactive Analysis and Software Development through an Integrated Cloud Environment Claudio Grandi (INFN.
SCI-BUS is supported by the FP7 Capacities Programme under contract no. RI SCI-BUS and the CloudBroker Platform: Extending Science Gateways to Clouds.
SCI-BUS is supported by the FP7 Capacities Programme under contract nr RI Accessing cloud resources through the WS-PGRADE/gUSE and CloudBroker integrated.
IPlant Collaborative Tools and Services Workshop iPlant Collaborative Tools and Services Workshop Overview of Atmosphere.
SCI-BUS is supported by the FP7 Capacities Programme under contract nr RI Improving the Swiss Grid Proteomics Portal Peter Kunszt, Lorenz Blum,
Scientific Data Processing Portal and Heterogeneous Computing Resources at NRC “Kurchatov Institute” V. Aulov, D. Drizhuk, A. Klimentov, R. Mashinistov,
Cloud computing-The Future Technologies
Amazon Storage- S3 and Glacier
The CIPRES Portal: Current Status and Future Plans
Centre for Computational Science, University College London
Tools and Services Workshop Overview of Atmosphere
Recap: introduction to e-science
Cloud Computing B. Ramamurthy 9/19/2018 B. Ramamurthy.
Cloud Management Mechanisms
Module 01 ETICS Overview ETICS Online Tutorials
Storing and Accessing G-OnRamp’s Assembly Hubs outside of Galaxy
Overview of Workflows: Why Use Them?
Distributing META-pipe on ELIXIR compute resources
Presentation transcript:

Cloud Usage Overview The IBM SmartCloud Enterprise infrastructure provides an API and a GUI to the users. This is being used by the CloudBroker Platform to control the automatic provisioning of the infrastructure and launches the instances with the Rosetta Application. The CloudBroker Platform manages the Rosetta jobs automatically and monitors the execution. Fail-safes are built into the system with automatic restarts and shutdowns. The end-user is given a CloudBroker Rosetta Client that can be used on the command line very similarly to the Rosetta software itself. It is a smart client that automatically creates the jobs from the input files as necessary. The smart client was used at IMSB to submit the parameters for the protein structure modeling. The jobs can be monitored using the web GUI, which also allows to manually steer the execution, to submit or to cancel jobs and to upload and download data. Administrators can also use the interfaces directly to monitor the execution or to intervene in case of problems. Accelerating 3D Protein Modeling Using Cloud Computing Lars Malmström, Ruedi Aebersold – ETH Zürich, IMSB Wibke Sudholt, Nicola Fantini – CloudBroker GmbH Roland Reifler, Marcel Lautenschlager, Stefan Ruckstuhl – IBM Schweiz Peter Kunszt – SystemsX.ch, SyBIT Institute of Molecular Systems Biology Modeling Streptococcus Proteins CloudBroker Platform Authentication and authorization Software and resource management Job and data management Accounting and billing CloudBroker Platform Authentication and authorization Software and resource management Job and data management Accounting and billing … 123n IaaS – Virtual Machines IBM SmartCloud Enterprise CloudBroker Rosetta Application Administrator Cloud GUI IMSB (Institute of Molecular Systems Biology at ETH Zurich) REST API Compute Power out of the Cloud REST API Rosetta Client Web GUI CloudBroker Administrator End User Detailed knowledge about the protein structures in highly virulent pathogens is essential in the fight against antibiotics-resistant bacteria. In an ongoing experiment, the genome of a mutated and highly virulent strain of streptococcus (AP1) was sequenced and compared to a low virulent strain (sf370), identifying proteins that have higher mutation rates than expected. The question is how the mutated proteins are structurally different to be able to investigate differences in protein-protein affinities to the host. Predicting the protein structure from the amino acid sequence involves a lot of simulation and is very compute intensive. Each structural domain is modeled independently. Some models are very compute intensive and others are relatively quickly done. On average there are 10’000 models for each structural domain. Finally, during scientific post-analysis, where many additional factors are taken into account, the best or most accurate models are selected and evaluated. Number of proteins1697 Structural domains832 de-novo, 1440 homology Number of models22’720’000 Total CPU hours needed800’000 Control and Data Flow Approach Identification of mutations in the protein structure between low virulent strains (sf370) and high virulent strains (AP1) is done by sequencing and comparing both genomes. The 3D protein structures are then predicted and compared as well. Bacteria / Protein preparations Genome sequencing Genome comparison Rosetta 3D Folding Prediction Structural domains modeled on the Cloud249 out of 832 de-novo Number parallel Cloud CPU resourcesup to 1008 Net CPU hours processed~ 249’000 Number of jobs~ 36’000 Number of models~ 2’300’000 In just two weeks, the most significant proteins could already be modeled, allowing for scientific data post-analysis. On the available university shared cluster resources this calculation would have taken several months. IBM SmartCloud Data Centers IMSBCloudBrokerIBM Platform Client … Rosetta Instances Storage Instance Input file download Result file upload Number crunching Job steering Instance allocation and deallocation Client request Result file download Input file upload Data is stored on a dedicated in-cloud storage instance. The CloudBroker Platform manages the data placement and steers Rosetta instance allocations and de-allocations. The CloudBroker Platform also provides interfaces to the client for data upload and download and smart job submission. In the Cloud, the data are staged to the instances running the calculations dynamically. Cloud Computing and Rosetta Biology as a scientific domain needs a growing amount of computational power. However, not every researcher has access to high performance computing resources locally. Today, it is easy to buy computing resources on demand from public cloud providers like IBM, paying only for the amount of computing that is really being used. However, the difficulty of setting up the simulation and operating the virtual infrastructure is also often a showstopper for scientists to use cloud resources. CloudBroker fills this gap by providing interfaces to scientific software to be used immediately on the cloud as a service. The Rosetta software suite focuses on the prediction and design of protein structures, protein folding mechanisms, and protein-protein interactions. It is one of the tools that are provided as a service by CloudBroker on the IBM SmartCloud, ready to be used by the scientists.