HTCondor and Beyond: Research Computer at Syracuse University Eric Sedore ACIO – Information Technology and Services.

Slides:



Advertisements
Similar presentations
Dan Bradley Computer Sciences Department University of Wisconsin-Madison Schedd On The Side.
Advertisements

© 2010 VMware Inc. All rights reserved Confidential Performance Tuning for Windows Guest OS IT Pro Camp Presented by: Matthew Mitchell.
Virtualization Futures VMworld Europe 2008 Dr. Stephen Alan Herrod CTO and VP of R&D, VMware.
Adam Duffy Edina Public Schools.  The heart of virtualization is the “virtual machine” (VM), a tightly isolated software container with an operating.
Antony Jo The University of Montana. Virtualization  The process of abstraction; making something more abstract  Many types: Server Desktop Application.
Managing storage requirements in VMware Environments October 2009.
© 2008 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice In search of a virtual yardstick:
Virtual techdays INDIA │ 9-11 February 2011 Cross Hypervisor Management Using SCVMM 2008 R2 Vikas Madan │ Partner Consultant II, Microsoft Corporation.
DatacenterMicrosoft Azure Consistency Connectivity Code.
Virtual Machines. Virtualization Virtualization deals with “extending or replacing an existing interface so as to mimic the behavior of another system”
Building a Virtualized Desktop Grid Eric Sedore
Introducing VMware vSphere 5.0
Private Cloud or Dedicated Hosts Mason Mabardy & Matt Maples.
Presented by Jacob Wilson SharePoint Practice Lead Bross Group 1.
Virtualization A way To Begin with Virtual Reality… - Rahul Khanwani.
Network+ Guide to Networks 6 th Edition Chapter 10 Virtual Networks and Remote Access.
Hyper-V 3.0 – What’s New in Windows Server 2012? Brien Posey
To run the program: To run the program: You need the OS: You need the OS:
Server 2008 & Virtualization. Costs are too highCan’t meet SLAs Providing business continuity for operating systems and applications Expensive space across.
Tanenbaum 8.3 See references
VAP What is a Virtual Application ? A virtual application is an application that has been optimized to run on virtual infrastructure. The application software.
1 The Virtual Reality Virtualization both inside and outside of the cloud Mike Furgal Director – Managed Database Services BravePoint.
Network+ Guide to Networks 6 th Edition Chapter 10 Virtual Networks and Remote Access.
About the Presentations The presentations cover the objectives found in the opening of each chapter. All chapter objectives are listed in the beginning.
CERN IT Department CH-1211 Genève 23 Switzerland t Virtualization with Windows at CERN Juraj Sucik, Emmanuel Ormancey Internet Services Group.
INTRODUCTION TO CLOUD COMPUTING CS 595 LECTURE 7 2/23/2015.
Chapter 4 COB 204. What do you need to know about hardware? 
Virtualization Dr. John P. Abraham Professor. Grid computing Multiple independent computing clusters which act like a “grid” because they are composed.
SAIGONTECH COPPERATIVE EDUCATION NETWORKING Spring 2010 Seminar #1 VIRTUALIZATION EVERYWHERE.
Microsoft Azure Virtual Machines. Networking Compute Storage Virtual Machine Operating System Applications Data & Access Runtime Provision & Manage.
Projects. High Performance Computing Projects Design and implement an HPC cluster with one master node and two compute nodes. (Hint: use Rocks HPC Cluster.
Appendix B Planning a Virtualization Strategy for Exchange Server 2010.
VMware Infrastructure 3 The Next Generation in Virtualization.
M.A.Doman Short video intro Model for enabling the delivery of computing as a SERVICE.
ITServices Virtualization Terry Black January 2013.
Network Plus Virtualization Concepts. Virtualization Overview Virtualization is the emulation of a computer environment called a Virtual Machine. A Hypervisor.
Virtual Machine and its Role in Distributed Systems.
MDC417 Follow me on Working as Practice Manager for Insight, he is a subject matter expert in cloud, virtualization and management.
Adam Duffy Edina Public Schools.  Traditional server ◦ One physical server ◦ One OS ◦ All installed hardware is limited to that one server ◦ If hardware.
INTRODUCTION TO VIRTUALIZATION KRISTEN WILLIAMS MOSES IKE.
From Virtualization Management to Private Cloud with SCVMM 2012 Dan Stolts Sr. IT Pro Evangelist Microsoft Corporation
Focus on SCVMM features and an introduction on how to implement into your current environment. Overview of System Center Virtual Machine Manager 2012 Jim.
Server Performance, Scaling, Reliability and Configuration Norman White.
© 2015 by McGraw-Hill Education. This proprietary material solely for authorized instructor use. Not authorized for sale or distribution in any manner.
Peter Couvares Associate Researcher, Condor Team Computer Sciences Department University of Wisconsin-Madison
Full and Para Virtualization
20409A 7: Installing and Configuring System Center 2012 R2 Virtual Machine Manager Module 7 Installing and Configuring System Center 2012 R2 Virtual.
Enabling Technologies for Distributed Computing Dr. Sanjay P. Ahuja, Ph.D. Fidelity National Financial Distinguished Professor of CIS School of Computing,
Docker and Container Technology
Hands-On Virtual Computing
Cloud Computing Lecture 5-6 Muhammad Ahmad Jan.
Turn Bare Metal Into Silver Lining With SCVMM 2012, Today! Mark Rhodes OBS SESSION CODE: SEC313 (c) 2011 Microsoft. All rights reserved.
Cloud Computing – UNIT - II. VIRTUALIZATION Virtualization Hiding the reality The mantra of smart computing is to intelligently hide the reality Binary->
Cloud computing: IaaS. IaaS is the simplest cloud offerings. IaaS is the simplest cloud offerings. It is an evolution of virtual private server offerings.
SYSTEM CENTER VIRTUAL MACHINE MANAGER 2012 Gorazd Šemrov Microsoft Consulting Services
Managing a growing campus pool Eric Sedore
© ExplorNet’s Centers for Quality Teaching and Learning 1 Explain the purpose of Microsoft virtualization. Objective Course Weight 2%
Extending Auto-Tiering to the Cloud For additional, on-demand, offsite storage resources 1.
Building on virtualization capabilities for ExTENCI Carol Song and Preston Smith Rosen Center for Advanced Computing Purdue University ExTENCI Kickoff.
Guide to Operating Systems, 5th Edition
Dag Toppe Larsen UiB/CERN CERN,
Dag Toppe Larsen UiB/CERN CERN,
HTCondor at Syracuse University – Building a Resource Utilization Strategy Eric Sedore Associate CIO HTCondor Week 2017.
3.2 Virtualisation.
Virtual Machines.
Virtualization Meetup Discussion
20409A 7: Installing and Configuring System Center 2012 R2 Virtual Machine Manager Module 7 Installing and Configuring System Center 2012 R2 Virtual.
Guide to Operating Systems, 5th Edition
PerformanceBridge Application Suite and Practice 2.0 IT Specifications
Presentation transcript:

HTCondor and Beyond: Research Computer at Syracuse University Eric Sedore ACIO – Information Technology and Services

Syracuse (OrangeGrid)  Scavenging compute time from ~3000 desktops on campus  Virtual machines running in the background on idle desktops with HTCondor running inside the VM – tunneled to a private HTCondor network via VPN  Condor Virtual Machine Coordinator (CVMC) – interfaces with HTCondor to launch and manage virtual machines  Grown from 6000 to cores over the last year  Added ~1000 dedicated cores

Updates to OrangeGrid  Campus backbone upgrade to 40Gb and building links upgraded to 10Gb where node density is significant  Methodology to support large VM’s (20GB+) on desktop clients  Dynamically build virtual machine based on job requirements (CPU(s), memory)  New controls to manage how many of a job type (with it’s associated VM) may run on each client (due to VM/jobs requiring heavy disk I/O or larger VM’s introducing memory pressure)

Focus Areas 1.Bridging the gap with the researcher  Better understand the researcher’s tool  Assist with scripting the “last mile” - finding the right level of investment  Does more assistance = more scholarly output? 2.Dynamically provision hardware resources  Researchers coming in all shapes and sizes  Compute resources are available to meet most needs, however given the diversity of research and the need for custom environments it is often in the wrong form  Focus on a virtualized research cloud

Chaos!

Research Cloud – backfill, priority, and oversubscription  Attempting to blend single large machines, small clusters of largish machines (100’s), then typically smaller compute nodes to fill in the “cracks”  Resource caps, pools, and weighting to try and place and manage load effectively  Provide “hints” about what work should be prioritized and/or we can let the workloads “fight it out” controlled by the scheduler  “flock of birds” when a large virtual machine (32 cores / 128 GB) goes active on a host as “load balancing” kicks in  Current oversubscription is 3:1 – 4:1 or 5:1 appears possible though contention will become more likely (can we identify who cares if they run a little slower?)

An old, somewhat painful story - VM Management  Three different hypervisors  Oracle VirtualBox - OrangeGrid  VMware ESX – research cloud  Microsoft Hyper-V – research cloud  Four research VM’s distributed across the hypervisors (with multiple versions)  Default Linux node (Ubuntu)  LIGO (SL6)  3D Render Node (Ubuntu)  BLAST Search (Ubuntu)

The Wonderful, Unpredictable World of Research Computing  System Administrator  How many CPU’s, how much memory, how many IOPS, and what type of networking? Give me your requirements…  Do you need backups, how often, is there a time when load is low?  What kind of uptime do you need?  Just 60 terabytes?  Researcher  I’d like to transform my research, how much can I have?  You do backups? Yes, of course I want backups. No, it is unpredictable and might be busy at any time  If it is up when I need it that is fine  Just 60 terabytes

Questions?