Virtual Infrastructure: kvm, uvb + libvirt Bryan McLellan Senior Systems Administrator Widemile.

Slides:



Advertisements
Similar presentations
With ovirt & virt manager
Advertisements

Virtual Machine Technology Dr. Gregor von Laszewski Dr. Lizhe Wang.
Cloud Computing Open source cloud infrastructures Keke Chen.
NWCLUG 01/05/2010 Jared Moore Xen Open Source Virtualization.
Sandor Acs 05/07/ OpenNebula 3.6 (beta) Hands-on.
INFSO-RI An On-Demand Dynamic Virtualization Manager Øyvind Valen-Sendstad CERN – IT/GD, ETICS Virtual Node bootstrapper.
A comparison between xen and kvm Andrea Chierici Riccardo Veraldi INFN-CNAF.
Virtualization B. Ramamurthy. References Practical Virtualization Solutions: Virtualization from the Trenches by K. Hess and A. Newman, Prentice-Hall.
E-Commerce The technical side. LAMP Linux Linux Apache Apache MySQL MySQL PHP PHP All Open Source and free packages. Can be installed and run on most.
Unix Presentation. What is an Operating System An operating system (OS) is a program that allows you to interact with the computer -- all of the software.
To run the program: To run the program: You need the OS: You need the OS:
Condor Project Computer Sciences Department University of Wisconsin-Madison Virtual Machines in Condor.
Jaime Frey Computer Sciences Department University of Wisconsin-Madison Virtual Machines in Condor.
Capistrano for System Administrators (not rails developers) Bryan McLellan Senior Systems Administrator Widemile.
Website Administration Information Systems 337 Prof. Harry Plantinga.
Methodologies, strategies and experiences Virtualization.
Tanenbaum 8.3 See references
V Avon High School Tech Crew Agenda Old Business –Delete Files New Business –Week 10 Topics: Coming up: –Yearbook Picture: Feb 7 12:20PM.
The Network Management Lab pc pc pc pc pc Virtual Servers Your Laptop.
Installation and Integration of Virtual Clusters onto Pragma Grid NAIST Nara, Japan Kevin Lam 06/28/13.
The EPIKH Project (Exchange Programme to advance e-Infrastructure Know-How) Overview of software tools for gLite installation & configuration.
DevCloud and CloudMonkey in Apache CloudStack
Windows 2003 Overview Lecture 1. Windows Networking Evolution Windows for Workgroups – peer-to-peer networking built into the OS Windows NT – separate.
MSc. Miriel Martín Mesa, DIC, UCLV. The idea Installing a High Performance Cluster in the UCLV, using professional servers with open source operating.
Exercise #1: Exploring Open- Source Operating Systems with Virtual Machines J. H. Wang Mar. 9, 2010.
2010 Technology Decision Making Roundtable: Cloud Computing Google Apps vs. Daryl Tilley Director of Technology Services Ingham Intermediate School.
Working with Ubuntu Linux Track 2 Workshop June 2010 Pago Pago, American Samoa.
Section 3.1: Operating Systems Concepts 1. A Computer Model An operating system has to deal with the fact that a computer is made up of a CPU, random.
Julien Thibault  Bells Labs develop a new operating system called “UNIX”  Written in C instead of assembly code  Able.
Eucalyptus 3 (&3.1). Eucalyptus 3 Product Overview – Govind Rangasamy.
Continous Integration & Continous Deployment - For the new nameserver infrastructures of DENIC eG 15/10/03 – Christian Petrasch
Wordpress with Mina Automated Deployment Solution Jonathan Gravato DIG 4104c.
EVGM081 Multi-Site Virtual Cluster: A User-Oriented, Distributed Deployment and Management Mechanism for Grid Computing Environments Takahiro Hirofuchi,
Exercise #1: Exploring Open- Source Operating Systems with Virtual Machines J. H. Wang Sep. 25, 2015.
Virtual Machines Created within the Virtualization layer, such as a hypervisor Shares the physical computer's CPU, hard disk, memory, and network interfaces.
Linux Services Configuration
Docker and Container Technology
PTA Linux Series Copyright Professional Training Academy, CSIS, University of Limerick, 2006 © Workshop I Introduction to Linux Professional Training Academy.
Predrag Buncic (CERN/PH-SFT) CernVM Status. CERN, 24/10/ Virtualization R&D (WP9)  The aim of WP9 is to provide a complete, portable and easy.
Libvirt management Andrea Chierici Virtualization tutorial Catania 1-3 dicember 2010.
© ExplorNet’s Centers for Quality Teaching and Learning 1 Explain the purpose of Microsoft virtualization. Objective Course Weight 2%
Introduction to KVM Andrea Chierici Virtualization tutorial Catania 1-3 dicember 2010.
KVM tutorial #2 Andrea Chierici Virtualization tutorial Catania 1-3 dicember 2010.
The EPIKH Project (Exchange Programme to advance e-Infrastructure Know-How) Overview of software tools for gLite installation & configuration.
RuggedPOD O/S Deployment strategy. Disclaimers The content of this presentation is released under GPL v2 license en Creative Common Attribution-ShareAlike.
A comparison between xen and kvm Andrea Chierici Riccardo Veraldi INFN-CNAF CCR 2009.
Intro To Virtualization Mohammed Morsi
Virtualisation Exercise Installing VirtualBox Installing FreeBSD in a virtual machine Chris Wilson Joel Jaeggli AfNOG 2012.
Using Grsync with Ubuntu Presented by Dave Mawdsley, DACS Member, Linux SIG August 20, 2008 (making rsync easy with a memory key or a server)
VMware in Linux: A flexible demo room29/09/2016 Slide 1 Secrets of the Ontario Linux Fest Demo Room Lori Paniak 4п Solutions Inc.
Ubuntu Server Jaunty 9.04 Server Features. Kernel Ubuntu 9.04 Server includes the Memory management improvements Scalability improvements Tracepoints.
Daniel P. Berrangé Principal Software Engineer, Red Hat.
VirtualBox Introduction:
Upgrading to Ubuntu Server Edition LTS
Andrea Chierici Virtualization tutorial Catania 1-3 dicember 2010
Virtualization Mini Summit, Austin 2008 mmm, tasty penguins...
2V0-620 Real Questions with Correct Answers
RHEV Platform at LHCb Red Hat at CERN 17-18/1/17
Connect:Direct for UNIX v4.2.x Silent Installation
How Fedora Does Early Adoption & Uses Free Software
Our chosen platform is:
Virtualization in the gLite Grid Middleware software process
An introduction... Mike Latimer Sr. Engineering Manager SUSE
Integration of Singularity With Makeflow
Virtual Machines.
Xen Summit Spring 2007 Platform Virtualization with XenEnterprise
Hands-On Virtualization in the Classroom
Virtualization Meetup Discussion
Understanding Linux and the BASH shell v
Presentation transcript:

Virtual Infrastructure: kvm, uvb + libvirt Bryan McLellan Senior Systems Administrator Widemile

Widemile is awesome I work there, and thus the world is a better place for all of humanity.

What I got for “free” Identical Blades Running non identical Debian installs (etch/sid, i386/amd64) Running different versions of vmware-server OS, software, installed by hand Configure using notes in an outlook public folder Host database tracked with DNS vm04-something.test.widemile.com

Problems Lack of Homogeneity Monkey configuration sucks Documentation offensive

What I did Lack of Homogeneity – debian pxe install with preseeds Monkey configuration sucks – puppify (configuration management) – capistrano (ruby scripting over ssh) – iclassify (node classification) Documentation offensive – Configuration management is self documenting – Wikify the notes

We can always do better

What upset me (nobody else cares) PXE installs take soooooo long Backporting too many packages to debian Interacting with VMware programmatically too much work. VMware UIs cost $$ Dreams: cpu/ram hotplug, live migration

How I Learned to Stop Worrying and Love the Bomb PXE installs take soooooo long – deb-bootstrap with ubuntu-vm-builder (2.5min) Backporting too many packages to debian – switch to Ubuntu! Interacting with VMware programmatically too much work. – libvirt is much easier and cleaner VMware UIs cost $$ – Libvirt is free Dreams: cpu/ram hotplug, live migration – Word on the street is that kvm + libvirt support these – I don’t think they’re there yet though.

libvirt – virtualization API Started at Redhat ‘s Emerging Technology Group Was Xen focused, but Redhat recently bought Qumranet, makers of KVM Ubuntu/Canonical picked KVM as virtualization platform of choice libvirt doesn’t really support all that Provides CLI management (virsh) Provides GUI management (virt-manager)

virsh

virt-manager

ubuntu-vm-builder Bash script wrapper for deb-bootstrap + qemu apt-get install ubuntu-vm-builder capistrano script: vmware: 102 lines uvb: 12 lines ubuntu-vm-builder kvm hardy --addpkg openssh-server -d /srv/kvm/#{hostname} --domain #{domain} --hostname #{hostname} --mem #{memory} --mirror --libvirt qemu:///system --bridge #{eth0}

ubuntu-vm-builder Bash script wrapper for deb-bootstrap + qemu apt-get install ubuntu-vm-builder capistrano script: vmware: 102 lines uvb: 12 lines ubuntu-vm-builder kvm hardy --addpkg openssh-server -d /srv/kvm/#{hostname} --domain #{domain} --hostname #{hostname} --mem #{memory} --mirror --libvirt qemu:///system --bridge #{eth0} Not a lot of enterprise features yet Bridging vs NAT Root password / creates user Not a lot of enterprise features yet Bridging vs NAT Root password / creates user

kvm The cool hypervisor on the block (ubuntu, redhat) Kernel modifications are mainlined (unlike xen) Super fast / lightweight (feel the wind in your hair) Growing fast class kvm { case $lsbdistid { "Ubuntu": { # Only Ubuntu releases are new enough for this package { "kvm": ensure => present; "libvirt-bin": ensure => present; "ubuntu-vm-builder": ensure => latest; }

file { "/srv/kvm": ensure => directory, group => admins, mode => 0775, } # Permissions required for remote access # Puppet doesn't support managing the libvirtd group members through the group type file { "/var/run/libvirt/libvirt-sock": group => admins, require => Service["libvirt-bin"]; "/var/run/libvirt/libvirt-sock-ro": group => admins, require => Service["libvirt-bin"]; }

service { "libvirt-bin": ensure => running, hasstatus => true, require => Package["libvirt-bin"], } # required by u-v-b exec { "devmapper-autoload": command => "/bin/echo dm_mod >> /etc/modules", onlyif => "/usr/bin/test `grep -c '^dm_mod' /etc/modules` -lt 1", } exec { "devmapper-load": command => "/sbin/modprobe dm_mod", onlyif => "/usr/bin/test `/bin/lsmod | grep -c '^dm_mod'` -lt 1", } realize Group["libvirtd"] }