CernVM Status Report Predrag Buncic (CERN/PH-SFT).

Slides:



Advertisements
Similar presentations
Introduction to Virtualization
Advertisements

© 2012 The McGraw-Hill Companies, Inc. All rights reserved. 1 Third Edition Chapter 3 Desktop Virtualization McGraw-Hill.
To run the program: To run the program: You need the OS: You need the OS:
Red Hat Installation. Installing Red Hat Linux is the process of copying operating system files from a CD, DVD, or USB flash drive to hard disk(s) on.
Space Science and Engineering Center University of Wisconsin-Madison Virtual Machines: A method for distributing DB processing software Liam Gumley.
Virtualization and Open source Software Mr. Lau Ka Lun – Lai King Catholic Secondary School Date: 9 th, 21 st, 22 nd March, 2011.
Tanenbaum 8.3 See references
About the Presentations The presentations cover the objectives found in the opening of each chapter. All chapter objectives are listed in the beginning.
Testing Virtual Machine Performance Running ATLAS Software Yushu Yao Paolo Calafiura LBNL April 15,
1 port BOSS on Wenjing Wu (IHEP-CC)
Hands-On Virtual Computing
Virtualization. ABCs Special software: hypervisors or virtual machine managers Guest OS (virtual machine) sits on top of host OS (Win 7 in our case) We.
INTRODUCTION TO CLOUD COMPUTING CS 595 LECTURE 2.
Network Plus Virtualization Concepts. Virtualization Overview Virtualization is the emulation of a computer environment called a Virtual Machine. A Hypervisor.
INTRODUCTION TO VIRTUALIZATION KRISTEN WILLIAMS MOSES IKE.
CS 390 Unix Programming Summer Unix Programming - CS 3902 Course Details Online Information Please check.
Predrag Buncic (CERN/PH-SFT) CernVM - a virtual software appliance for LHC applications C. Aguado-Sanchez 1), P. Buncic 1), L. Franco 1), A. Harutyunyan.
Predrag Buncic (CERN/PH-SFT) CernVM - a virtual software appliance for LHC applications C. Aguado-Sanchez 1), P. Buncic 1), L. Franco 1), S. Klemer 1),
Predrag Buncic (CERN/PH-SFT) WP9 - Workshop Summary
VMWare Workstation Installation. Starting Vmware Workstation Go to the start menu and start the VMware Workstation program. *Note: The following instructions.
1 BOINC-VM and Volunteer Cloud Computing Ben Segal / CERN and: Predrag Buncic, Jakob Blomer, Pere Mato / CERN Carlos Aguado Sanchez, Artem Harutyunyan.
Predrag Buncic (CERN/PH-SFT) Introduction to WP9 Portable Analysis Environment Using Virtualization Technology IBM-VM 360, CERNVM,
DPHEP Workshop CERN, December Predrag Buncic (CERN/PH-SFT) CernVM R&D Project Portable Analysis Environments using Virtualization.
Exercise #1: Exploring Open- Source Operating Systems with Virtual Machines J. H. Wang Sep. 25, 2015.
WLCG Overview Board, September 3 rd 2010 P. Mato, P.Buncic Use of multi-core and virtualization technologies.
© 2015 by McGraw-Hill Education. This proprietary material solely for authorized instructor use. Not authorized for sale or distribution in any manner.
© Copyright 2011 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice. HP Restricted Module 7.
Predrag Buncic (CERN/PH-SFT) Virtualizing LHC Applications.
1 BOINC Case Study: Ben Segal / CERN with: Predrag Buncic / CERN Daniel Lombrana Gonzalez / Univ. Extremadura David Weir / Imperial.
The CernVM Infrastructure Insights of a paradigmatic project Carlos Aguado Sanchez Jakob Blomer Predrag Buncic.
Predrag Buncic (CERN/PH-SFT) Software Packaging: Can Virtualization help?
2nd ASPERA Workshop May 2011, Barcelona, Spain P. Mato /CERN.
Predrag Buncic (CERN/PH-SFT) Virtualization – the road ahead.
The CernVM Project A new approach to software distribution Carlos Aguado Jakob Predrag
36 th LHCb Software Week Pere Mato/CERN.  Provide a complete, portable and easy to configure user environment for developing and running LHC data analysis.
NA61 Collaboration Meeting CERN, December Predrag Buncic, Mihajlo Mudrinic CERN/PH-SFT Enabling long term data preservation.
Predrag Buncic (CERN/PH-SFT) CernVM Status. CERN, 24/10/ Virtualization R&D (WP9)  The aim of WP9 is to provide a complete, portable and easy.
EGI-InSPIRE RI EGI Webinar EGI-InSPIRE RI Porting your application to the EGI Federated Cloud 17 Feb
Virtual PC 2007 Virtualization for Fermi Desktops KTF
Journées Informatiques de l'IN2P May 2010, Aussois, France P. Mato /CERN.
VIRTUAL MACHINE – VMWARE. VIRTUAL MACHINE (VM) What is a VM? – A virtual machine (VM) is a software implementation of a computing environment in which.
Predrag Buncic (CERN/PH-SFT) Virtualization R&D (WP9) Status Report.
Predrag Buncic, CERN/PH-SFT The Future of CernVM.
CHEP 2010 Taipei, 19 October Predrag Buncic Jakob Blomer, Carlos Aguado Sanchez, Pere Mato, Artem Harutyunyan CERN/PH-SFT.
Building (Virtual) Appliances
Exercise #1: Exploring Open-Source Operating Systems with Virtual Machines J. H. Wang Sep. 20, 2016.
Guide to Operating Systems, 5th Edition
CSC227: Operating Systems
Fundamentals Sunny Sharma Microsoft
Matt Lemons Nate Mayotte
AWS Integration in Distributed Computing
NA61/NA49 virtualisation:
Dag Toppe Larsen UiB/CERN CERN,
Progress on NA61/NA49 software virtualisation Dag Toppe Larsen Wrocław
Dag Toppe Larsen UiB/CERN CERN,
Desktop Virtualization
ATLAS Cloud Operations
StratusLab Final Periodic Review
StratusLab Final Periodic Review
From Application to Appliance
Exercise #1: Exploring Open-Source Operating Systems with Virtual Machines J. H. Wang Sep. 19, 2017.
Virtualization in the gLite Grid Middleware software process
Creating a Windows 10 Virtual machine
Guide to Operating Systems, 5th Edition
Exercise #1: Exploring Open-Source Operating Systems with Virtual Machines J. H. Wang Sep. 21, 2018.
Virtual Operating Systems
Ivan Reid (Brunel University London/CMS)
Different types of Linux installation
bitcurator-access-webtools Quick Start Guide
Hypervisor A hypervisor or virtual machine monitor (VMM) is computer software, firmware or hardware that creates and runs virtual machines. A computer.
Presentation transcript:

CernVM Status Report Predrag Buncic (CERN/PH-SFT)

Virtualization R&D Provide a complete, portable and easy to configure user environment for developing and running LHC data analysis locally and on the Grid independent of physical software and hardware platform (Linux, Windows, MacOS) Code check-out, edition, compilation, local small test, debugging, … Grid submission, data access… Event displays, interactive data analysis, … Suspend, resume… Decouple application lifecycle from evolution of system infrastructure Reduce effort to install, maintain and keep up to date the experiment software Web site: http://cernvm.cern.ch 3/9/09 2 CERN, June 16 2009 - 2

From Application to Appliance Starting from experiment software… Build types Installable CD/DVD Stub Image Raw Filesystem Image Netboot Image Compressed Tar File Demo CD/DVD (Live CD/DVD) Raw Hard Disk Image Vmware ® Virtual Appliance Vmware ® ESX Server Virtual Appliance Microsoft ® VHD Virtual Apliance Xen Enterprise Virtual Appliance Virtual Iron Virtual Appliance Parallels Virtual Appliance Amazon Machine Image Update CD/DVD Appliance Installable ISO …ending with custom Linux specialised for a given task CERN, June 16 2009 - 3

“Thin” Virtual Machine The experiment are packaging a lot of code but really use only fraction of it at runtime CernVM downloads what is needed and puts it in the cache Does not require persistent network connection (offline mode) CERN, June 16 2009 - 4

Publishing Releases Each experiment is given a VM to install and test their software using own installation tools Publishing is atomic operation

Select experiment, appliance flavor and preferences As easy as 1,2,3 Login to Web interface Create user account Select experiment, appliance flavor and preferences CERN, June 16 2009 - 6

1.3.0 Development release Next development release available for testing Once 1.3.0 is officially released, you will have to download it again Development release will be frequently updated Available now for download from http://rbuilder.cern.ch/project/cernvm-devel/releases Can be run on Linux (VMware Player, VirtualBox) Windows(VMware Player, VirtualBox) Mac (Fusion, VirtualBox) Appliance can be configured and used with ALICE, LHCb, ATLAS, CMS and LCD frameworks This release comes in two editions Basic (text development environment, suitable for ssh login, ~250MB) Desktop (full desktop environment, works on VMware & VirtualBox, ~500MB) CERN, June 16 2009 - 7

Conclusions Lots of interest from LHC experiments and huge momentum in industry Hypervisors are nowadays available for free (Linux, Mac and Windows) CernVM approach solves problem of efficient software distribution using a special file system One image fits all What is this good for? Performance penalty ~5% (~1% with the latest CPU generation) To develop and test your code on your local desktop/laptop without having to worry about installation and updates of software framework Grid User Interface Compatible with Cloud Beware There will always be performance penalty Hypervisors and CernVM are still in development Not yet clear how to deploy virtual machines as batch/grid job containers Workshop on adapting applications and computing services to multi-core and virtualization, June 24-26 CERN, June 16 2009 - 8