Predrag Buncic (CERN/PH-SFT) CernVM Status. CERN, 24/10/2008 - 2 Virtualization R&D (WP9)  The aim of WP9 is to provide a complete, portable and easy.

Slides:



Advertisements
Similar presentations
INFSO-RI An On-Demand Dynamic Virtualization Manager Øyvind Valen-Sendstad CERN – IT/GD, ETICS Virtual Node bootstrapper.
Advertisements

European Organization for Nuclear Research Virtualization Review and Discussion Omer Khalid 17 th June 2010.
CVMFS: Software Access Anywhere Dan Bradley Any data, Any time, Anywhere Project.
Virtual Machine Management
© 2012 The McGraw-Hill Companies, Inc. All rights reserved. 1 Third Edition Chapter 3 Desktop Virtualization McGraw-Hill.
Virtual Desktop Infrastructure Solution Stack Cam Merrett – Demonstrator User device Connection Bandwidth Virtualisation Hardware Centralised desktops.
To run the program: To run the program: You need the OS: You need the OS:
Red Hat Installation. Installing Red Hat Linux is the process of copying operating system files from a CD, DVD, or USB flash drive to hard disk(s) on.
Virtualization and Open source Software Mr. Lau Ka Lun – Lai King Catholic Secondary School Date: 9 th, 21 st, 22 nd March, 2011.
XD 5.6 Overview. XenDesktop 5.6 Main Focus = Integration of personal vDisk Features Support for Microsoft SCVMM 2012 and SCCM 2012 Updated Citrix License.
OM. Brad Gall Senior Consultant
CERN IT Department CH-1211 Genève 23 Switzerland t Virtualization with Windows at CERN Juraj Sucik, Emmanuel Ormancey Internet Services Group.
1 port BOSS on Wenjing Wu (IHEP-CC)
Model a Container Runtime environment on Your Mac with VMware AppCatalyst VMworld Fabio Rapposelli
Introduction to CVMFS A way to distribute HEP software on cloud Tian Yan (IHEP Computing Center, BESIIICGEM Cloud Computing Summer School.
Predrag Buncic (CERN/PH-SFT) CernVM - a virtual software appliance for LHC applications C. Aguado-Sanchez 1), P. Buncic 1), L. Franco 1), A. Harutyunyan.
Predrag Buncic (CERN/PH-SFT) CernVM - a virtual software appliance for LHC applications C. Aguado-Sanchez 1), P. Buncic 1), L. Franco 1), S. Klemer 1),
Cloud Status Laurence Field IT/SDC 09/09/2014. Cloud Date Title 2 SaaS PaaS IaaS VMs on demand.
Predrag Buncic (CERN/PH-SFT) WP9 - Workshop Summary
Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Usage of virtualization in gLite certification Andreas Unterkircher.
Biomedical Big Data Training Collaborative biobigdata.ucsd.edu BBDTC UPDATES Biomedical Big Data Training Collaborative biobigdata.ucsd.edu.
1 BOINC-VM and Volunteer Cloud Computing Ben Segal / CERN and: Predrag Buncic, Jakob Blomer, Pere Mato / CERN Carlos Aguado Sanchez, Artem Harutyunyan.
Predrag Buncic (CERN/PH-SFT) Introduction to WP9 Portable Analysis Environment Using Virtualization Technology IBM-VM 360, CERNVM,
DPHEP Workshop CERN, December Predrag Buncic (CERN/PH-SFT) CernVM R&D Project Portable Analysis Environments using Virtualization.
NA61/NA49 virtualisation: status and plans Dag Toppe Larsen CERN
WLCG Overview Board, September 3 rd 2010 P. Mato, P.Buncic Use of multi-core and virtualization technologies.
© 2015 by McGraw-Hill Education. This proprietary material solely for authorized instructor use. Not authorized for sale or distribution in any manner.
Intro to Datazen.
Servicing HEP experiments with a complete set of ready integrated and configured common software components Stefan Roiser 1, Ana Gaspar 1, Yves Perrin.
Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Tools and techniques for managing virtual machine images Andreas.
2012 Objectives for CernVM. PH/SFT Technical Group Meeting CernVM/Subprojects The R&D phase of the project has finished and we continue to work as part.
INFSO-RI Enabling Grids for E-sciencE ARDA Experiment Dashboard Ricardo Rocha (ARDA – CERN) on behalf of the Dashboard Team.
Catalin Condurache STFC RAL Tier-1 GridPP OPS meeting, 10 March 2015.
Predrag Buncic (CERN/PH-SFT) Virtualizing LHC Applications.
1 BOINC Case Study: Ben Segal / CERN with: Predrag Buncic / CERN Daniel Lombrana Gonzalez / Univ. Extremadura David Weir / Imperial.
NA61/NA49 virtualisation: status and plans Dag Toppe Larsen Budapest
MND review. Main directions of work  Development and support of the Experiment Dashboard Applications - Data management monitoring - Job processing monitoring.
The CernVM Infrastructure Insights of a paradigmatic project Carlos Aguado Sanchez Jakob Blomer Predrag Buncic.
Predrag Buncic (CERN/PH-SFT) Software Packaging: Can Virtualization help?
2nd ASPERA Workshop May 2011, Barcelona, Spain P. Mato /CERN.
Feedback from CMS Andrew Lahiff STFC Rutherford Appleton Laboratory Contributions from Christoph Wissing, Bockjoo Kim, Alessandro Degano CernVM Users Workshop.
Predrag Buncic (CERN/PH-SFT) Virtualization – the road ahead.
The CernVM Project A new approach to software distribution Carlos Aguado Jakob Predrag
36 th LHCb Software Week Pere Mato/CERN.  Provide a complete, portable and easy to configure user environment for developing and running LHC data analysis.
NA61 Collaboration Meeting CERN, December Predrag Buncic, Mihajlo Mudrinic CERN/PH-SFT Enabling long term data preservation.
Cloud Computing Application in High Energy Physics Yaodong Cheng IHEP, CAS
Virtual PC 2007 Virtualization for Fermi Desktops KTF
Journées Informatiques de l'IN2P May 2010, Aussois, France P. Mato /CERN.
Advancing CernVM-FS and its Development Infrastructure José Molina Colmenero CERN EP-SFT.
WP5 – Infrastructure Operations Test and Production Infrastructures StratusLab kick-off meeting June 2010, Orsay, France GRNET.
EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Towards an Information System Product Team.
© 2010 VMware Inc. All rights reserved Why Virtualize? Beng-Hong Lim, VMware, Inc.
VIRTUAL MACHINE – VMWARE. VIRTUAL MACHINE (VM) What is a VM? – A virtual machine (VM) is a software implementation of a computing environment in which.
Predrag Buncic (CERN/PH-SFT) Virtualization R&D (WP9) Status Report.
Fermilab Scientific Computing Division Fermi National Accelerator Laboratory, Batavia, Illinois, USA. Off-the-Shelf Hardware and Software DAQ Performance.
CVMFS Alessandro De Salvo Outline  CVMFS architecture  CVMFS usage in the.
Predrag Buncic, CERN/PH-SFT The Future of CernVM.
CHEP 2010 Taipei, 19 October Predrag Buncic Jakob Blomer, Carlos Aguado Sanchez, Pere Mato, Artem Harutyunyan CERN/PH-SFT.
Intro To Virtualization Mohammed Morsi
Virtual machines ALICE 2 Experience and use cases Services at CERN Worker nodes at sites – CNAF – GSI Site services (VoBoxes)
CSC227: Operating Systems
Use of HLT farm and Clouds in ALICE
NA61/NA49 virtualisation:
Blueprint of Persistent Infrastructure as a Service
Dag Toppe Larsen UiB/CERN CERN,
Progress on NA61/NA49 software virtualisation Dag Toppe Larsen Wrocław
Dag Toppe Larsen UiB/CERN CERN,
From Application to Appliance
CernVM Status Report Predrag Buncic (CERN/PH-SFT).
Introduction to VM Les 5 12 September 2019.
Presentation transcript:

Predrag Buncic (CERN/PH-SFT) CernVM Status

CERN, 24/10/ Virtualization R&D (WP9)  The aim of WP9 is to provide a complete, portable and easy to configure user environment for developing and running LHC data analysis locally and on the Grid using virtualization technology  Technology survey and initial prototyping carried out during first 3 months  Procured hardware and software licenses and setup a service and support infrastructure (web site, project and bug tracker)  Close interaction with experiments Bi-weekly steering meetings, reports in AF ATLAS is showing the biggest interest with LHCb and ALICE following CMS has recently found and committed manpower  First release ahead of the original schedule, planned for the end of October

CERN, 24/10/ Key Building Blocks rPath Linux 1 (  Slim Linux OS binary compatible with RH/SLC4 rAA - rPath Linux Appliance Agent  Web user interface  XMLRPC API rBulder  A tool to build VM images for various virtualization platforms CVMFS - CernVM file system  Read only file system optimized for software distribution Aggressive caching  Operational in offline mode For as long as you stay within the cache Build types  Installable CD/DVD  Stub Image  Raw Filesystem Image  Netboot Image  Compressed Tar File  Demo CD/DVD (Live CD/DVD)  Raw Hard Disk Image  Vmware ® Virtual Appliance  Vmware ® ESX Server Virtual Appliance  Microsoft ® VHD Virtual Apliance  Xen Enterprise Virtual Appliance  Virtual Iron Virtual Appliance  Parallels Virtual Appliance  Amazon Machine Image  Update CD/DVD  Appliance Installable ISO

CERN, 24/10/ CernVM Components group-cernvm (core packages) group-cernvm (core packages) group-cernvm-devel (development tools) group-cernvm-devel (development tools) group-slc4 (SLC4 compatibility libs) group-slc4 (SLC4 compatibility libs) group- groups and extra packages required by experiment group- groups and extra packages required by experiment 100 MB compat-db4 compat-openssl compat-linstdc++slc3 compat-libxml2 compat-readline compat-tcl compat-tk group- -desktop Lightweight X working environemnt group- -desktop Lightweight X working environemnt group-cernvm-desktop X11 group-cernvm-desktop X11

CERN, 24/10/ “Thin” Software Appliance JeOS (based on rPath Linux) rAArAA KERNEL fuse module FILESYSTEMFILESYSTEM rAA plugin Extra Liibs & Apps Cache HTTPDHTTPD Software Repository 10 GB1 GB0.1 GB LAN/WAN (HTTP) Just-In-Time & Just-Enough OS

CERN, 24/10/ rAA Web UI

CERN, 24/10/ rAA: XML-RPC API import xmlrpclib import os url = ' + user + ':' + password + + host + ':8004/rAA/xmlrpc' server = xmlrpclib.ServerProxy(url) r = server.cernvm.Config.configUpdate(' 'ALICE', # (can be None,ATLAS, ALICE, LHCB, CMS) 'off', # (on/off - if on it will make cvmfs locally writeable) 'off', # (on/off - enable/disable grid UI) 'off') # (on/off - enable VO profile) print r["message"] #### # Here we create initial user 'test' with the same password as Web admin #### r = server.cernvm.User.userUpdate('test', password,password) print r["message"] #### # Select grid UI version #### r = server.cernvm.Config.configGridUIVersion(” ") print r["message"]

CERN, 24/10/ Scalable HA Infrastructure

CernVM Central Services

CERN, 24/10/ CernVM File System App On same host: /opt/ -> /mnt/cmfs/ open(“/opt/lcg”) On File (Web) Server /opt/ Cache Kernel NFSLFSFUSE CernVM Fuse HTTP /opt/alice RSYNC /opt/alice

Publishing Releases

CERN, 24/10/ Developing CernVM JANFEBMARAPRMAYJUNJULAUGSEPOCTNOVDEC -Preparation Release Release 0.6 On time! Release 1.0 Scheduled for end of October Kickoff Workshop - Release Release Release 0.91 (RC1) -Release 0.92 (RC2) Carlos, Leandro, Steffen, Artem

CERN, 24/10/ Release (RC3) Available for download from  Can be run on  Linux (KVM, Xen,VMware Player, VirtualBox)  Windows(WMware Player, VirtualBox)  Mac (Fusion, Parallels, VirtualBox) Release Notes HowTo Appliance can be configured and used with ALICE, LHCb, ATLAS (and CMS) software frameworks

CERN, 24/10/ Mailing lists  (Open list to discuss about design, user experience and related issues with the CernVM project)  (End-user support for the CernVM project) Savannah Portal  Please submit bugs and feature requests to Savannah at Web site(s)   CernVM Links…