Database Systems on Virtual Machines: How Much Do We Lose? Kristin Travis March 2, 2011.

Slides:

Advertisements

Similar presentations

Buffers & Spoolers J L Martin Think about it… All I/O is relatively slow. For most of us, input by typing is painfully slow. From the CPUs point.

Advertisements

Virtual Memory (II) CSCI 444/544 Operating Systems Fall 2008.

Difference Engine: Harnessing Memory Redundancy in Virtual Machines by Diwaker Gupta et al. presented by Jonathan Berkhahn.

Silberschatz, Galvin and Gagne  2002 Modified for CSCI 399, Royden, Operating System Concepts Operating Systems Lecture 36 Virtual Memory Read.

Silberschatz, Galvin and Gagne ©2009 Operating System Concepts – 8 th Edition, Lecture 13: Main Memory (Chapter 8)

A Fast Rejuvenation Technique for Server Consolidation with Virtual Machines Kenichi Kourai Shigeru Chiba Tokyo Institute of Technology.

Segmentation and Paging Considerations

VSphere vs. Hyper-V Metron Performance Showdown. Objectives Architecture Available metrics Challenges in virtual environments Test environment and methods.

1 Cheriton School of Computer Science 2 Department of Computer Science RemusDB: Transparent High Availability for Database Systems Umar Farooq Minhas 1,

Novell Server Linux vs. windows server 2008 By: Gabe Miller.

Towards High-Availability for IP Telephony using Virtual Machines Devdutt Patnaik, Ashish Bijlani and Vishal K Singh.

G Robert Grimm New York University Disco.

Recap. The Memory Hierarchy Increasing distance from the processor in access time L1$ L2$ Main Memory Secondary Memory Processor (Relative) size of the.

Chapter 3 Data Storage and Access Methods Title: Operating Systems Support for Database Management Author: Michael Stonebraker Pages: 217 – 223 Group 01:

Virtual Machines Measure Up John Staton Karsten Steinhaeuser University of Notre Dame December 15, 2005 Graduate Operating Systems, Fall 2005 Final Project.

1  2004 Morgan Kaufmann Publishers Chapter Seven.

1 SRAM: –value is stored on a pair of inverting gates –very fast but takes up more space than DRAM (4 to 6 transistors) DRAM: –value is stored as a charge.

1 CSE SUNY New Paltz Chapter Seven Exploiting Memory Hierarchy.

Virtualization for Cloud Computing

Virtual Machine Monitors CSE451 Andrew Whitaker. Hardware Virtualization Running multiple operating systems on a single physical machine Examples:  VMWare,

To run the program: To run the program: You need the OS: You need the OS:

Virtualization Technology Prof D M Dhamdhere CSE Department IIT Bombay Moving towards Virtualization… Department of Computer Science and Engineering, IIT.

Denny Cherry Senior Database Administrator / Architect MVP, MCSA, MCDBA, MCTS, MCITP.

Microkernels, virtualization, exokernels Tutorial 1 – CSC469.

Disco : Running commodity operating system on scalable multiprocessor Edouard et al. Presented by Jonathan Walpole (based on a slide set from Vidhya Sivasankaran)

CS533 Concepts of Operating Systems Jonathan Walpole.

Remus: VM Replication Jeff Chase Duke University.

Benefits: Increased server utilization Reduced IT TCO Improved IT agility.

Virtualization for Adaptability Project Presentation CS848 Fall 2006 Umar Farooq Minhas 29 Nov 2006 David R. Cheriton School of Computer Science University.

1 Moshe Shadmon ScaleDB Scaling MySQL in the Cloud.

Linux in a Virtual Environment Nagarajan Prabakar School of Computing and Information Sciences Florida International University.

Virtualization in the Data Center Virtual Servers – How it works – Pros – Cons IPAC’s implementation – Hardware resource usage and trends – Virtualization.

Cosc 2150: Computer Organization Chapter 6, Part 2 Virtual Memory.

Session objectives Discuss whether or not virtualization makes sense for Exchange 2013 Describe supportability of virtualization features Explain sizing.

1 Xen and Co.: Communication-aware CPU Scheduling for Consolidated Xen-based Hosting Platforms Sriram Govindan, Arjun R Nath, Amitayu Das, Bhuvan Urgaonkar,

CS533 Concepts of Operating Systems Jonathan Walpole.

Dynamic Resource Monitoring and Allocation in a virtualized environment.

Chapter 9: Virtual Memory Background Demand Paging Copy-on-Write Page Replacement Allocation of Frames Thrashing Memory-Mapped Files Allocating Kernel.

Disco: Running Commodity Operating Systems on Scalable Multiprocessors Edouard Bugnion, Scott Devine, and Mendel Rosenblum Summary By A. Vincent Rayappa.

Hakim Weatherspoon Robbert van Renesse SUPERCLOUD: GOING BEYOND FEDERATED CLOUDS 1.

Disco: Running Commodity Operating Systems on Scalable Multiprocessors Edouard et al. Madhura S Rama.

Supporting Multi-Processors Bernard Wong February 17, 2003.

 Virtual machine systems: simulators for multiple copies of a machine on itself.  Virtual machine (VM): the simulated machine.  Virtual machine monitor.

1 Virtual Machine Memory Access Tracing With Hypervisor Exclusive Cache USENIX ‘07 Pin Lu & Kai Shen Department of Computer Science University of Rochester.

DMBS Internals I. What Should a DBMS Do? Store large amounts of data Process queries efficiently Allow multiple users to access the database concurrently.

Silberschatz, Galvin and Gagne ©2013 Operating System Concepts – 9 th Edition Chapter 9: Virtual Memory.

Lecture 11 Page 1 CS 111 Online Working Sets Give each running process an allocation of page frames matched to its needs How do we know what its needs.

VTurbo: Accelerating Virtual Machine I/O Processing Using Designated Turbo-Sliced Core Embedded Lab. Kim Sewoog Cong Xu, Sahan Gamage, Hui Lu, Ramana Kompella,

Virtualization and Databases Ashraf Aboulnaga University of Waterloo.

Lecture 26 Virtual Machine Monitors. Virtual Machines Goal: run an guest OS over an host OS Who has done this? Why might it be useful? Examples: Vmware,

1 Chapter Seven CACHE MEMORY AND VIRTUAL MEMORY. 2 SRAM: –value is stored on a pair of inverting gates –very fast but takes up more space than DRAM (4.

1  1998 Morgan Kaufmann Publishers Chapter Seven.

DMBS Internals I February 24 th, What Should a DBMS Do? Store large amounts of data Process queries efficiently Allow multiple users to access the.

DMBS Internals I. What Should a DBMS Do? Store large amounts of data Process queries efficiently Allow multiple users to access the database concurrently.

CSE598c - Virtual Machines - Spring Diagnosing Performance Overheads in the Xen Virtual Machine EnvironmentPage 1 CSE 598c Virtual Machines “Diagnosing.

Summary of caches: The Principle of Locality: –Program likely to access a relatively small portion of the address space at any instant of time. Temporal.

The vMatrix: Teleporting Servers via Virtual Machine Monitors (work in progress – LISA’02) Amr A. Awadallah Mendel Rosenblum

Virtual Machine Monitors

Logistics Homework 5 will be out this evening, due 3:09pm 4/14

Virtual Memory CSSE 332 Operating Systems

Chapter 9: Virtual Memory

CSCI206 - Computer Organization & Programming

Mobile and Desktop Memory Management

Haiyan Meng and Douglas Thain

Page Replacement.

Preventing Performance Degradation on Operating System Reboots

Chapter 4: Memory Management

TLB Performance Seung Ki Lee.

Virtual Memory: Working Sets

Efficient Migration of Large-memory VMs Using Private Virtual Memory

Presentation transcript:

Database Systems on Virtual Machines: How Much Do We Lose? Kristin Travis March 2, 2011

Article Information Authors: Minhas, Yadav, Aboulnaga, Salem University of Waterloo Conference: IEEE 24 th International Conference on Data Engineering Date: April 2008

Background Obvious benefits with using virtual machines Decreased costs, flexibility, etc. Virtual machines add performance overhead Question: is it worth it? Personal interest

Setup DBMS: PostgreSQL Base System: SUSE Linux 10.1 VM system uses VMM Xen 3.1 VM also runs SUSE Linux 3 GB memory, 1 virtual CPU Test DB is 2 GB in size, ensuring that the entire DB can fit in memory 22 TPC-H queries are run in identical settings on both machinesTPC-H

First Experiment “Warm” Experiment Run the 22 queries to “warm” up the buffer, then measure performance in the 2 nd run Queries experience a fairly large overhead Slowdown in system time is much larger than slowdown in user time Base Runtime (secs) Xen Runtime (secs) Relative Slow- down (%) Q Q Q Q Q

Overhead Causes System Call Time System calls are usually handled by OS, but in the VM most go through the Xen VMM Negligible in this case Page Fault Handling Time Page faults in Xen are more than twice as expensive as they are in the base system The average relative slowdown of all 22 queries is only 9.8%

Second Experiment “Cold” Experiment Restart PostgreSQL and flush the file system caches before running each query Interesting results: the relative slowdown is not high, and some queries actually run faster Slowdown is caused by disk I/O, having to read from the disk every query Some queries run faster because Xen VMM aggressively prefetches data for the VM The average relative slowdown of all 22 queries is only 6.2% (better than “warm” experiment)

Conclusions The many advantages to running a DBMS in a VM does not come at a high cost in performance Future work: Different VM environments (Hyper-V) Different DBMS (MySQL, Oracle, etc.) Using multiple VMs on one physical machine