Todd Tannenbaum Computer Sciences Department University of Wisconsin-Madison Condor NT Condor ported.

Slides:

Advertisements

Similar presentations

Current methods for negotiating firewalls for the Condor ® system Bruce Beckles (University of Cambridge Computing Service) Se-Chang Son (University of.

Advertisements

CSC 360- Instructor: K. Wu Overview of Operating Systems.

Greg Quinn Computer Sciences Department University of Wisconsin-Madison Condor on Windows.

Condor and GridShell How to Execute 1 Million Jobs on the Teragrid Jeffrey P. Gardner - PSC Edward Walker - TACC Miron Livney - U. Wisconsin Todd Tannenbaum.

Jaime Frey Computer Sciences Department University of Wisconsin-Madison Condor-G: A Case in Distributed.

Scuola Superiore Sant’Anna Project Assignments Operating Systems.

Condor Overview Bill Hoagland. Condor Workload management system for compute-intensive jobs Harnesses collection of dedicated or non-dedicated hardware.

Condor Project Computer Sciences Department University of Wisconsin-Madison Security in Condor.

Printing Terminology. Requirements for Network Printing At least one computer to operate as the print server Sufficient RAM to process documents Sufficient.

Jaeyoung Yoon Computer Sciences Department University of Wisconsin-Madison Virtual Machine Universe in.

Jim Basney Computer Sciences Department University of Wisconsin-Madison Managing Network Resources in.

Jaeyoung Yoon Computer Sciences Department University of Wisconsin-Madison Virtual Machines in Condor.

Zach Miller Condor Project Computer Sciences Department University of Wisconsin-Madison Flexible Data Placement Mechanisms in Condor.

Condor Project Computer Sciences Department University of Wisconsin-Madison Virtual Machines in Condor.

Jaime Frey Computer Sciences Department University of Wisconsin-Madison Virtual Machines in Condor.

Utilizing Condor and HTC to address archiving online courses at Clemson on a weekly basis Sam Hoover 1 Project Blackbird Computing,

Zach Miller Computer Sciences Department University of Wisconsin-Madison What’s New in Condor.

Miron Livny Computer Sciences Department University of Wisconsin-Madison Harnessing the Capacity of Computational.

Alain Roy Computer Sciences Department University of Wisconsin-Madison An Introduction To Condor International.

1 Integrating GPUs into Condor Timothy Blattner Marquette University Milwaukee, WI April 22, 2009.

Todd Tannenbaum Computer Sciences Department University of Wisconsin-Madison What’s New in Condor.

1 Todd Tannenbaum Department of Computer Sciences University of Wisconsin-Madison

Track 1: Cluster and Grid Computing NBCR Summer Institute Session 2.2: Cluster and Grid Computing: Case studies Condor introduction August 9, 2006 Nadya.

Condor Tugba Taskaya-Temizel 6 March What is Condor Technology? Condor is a high-throughput distributed batch computing system that provides facilities.

1 HawkEye A Monitoring and Management Tool for Distributed Systems Todd Tannenbaum Department of Computer Sciences University of.

Hao Wang Computer Sciences Department University of Wisconsin-Madison Security in Condor.

Peter Keller Computer Sciences Department University of Wisconsin-Madison Quill Tutorial Condor Week.

Grid Computing I CONDOR.

Greg Thain Computer Sciences Department University of Wisconsin-Madison cs.wisc.edu Interactive MPI on Demand.

1 The Roadmap to New Releases Todd Tannenbaum Department of Computer Sciences University of Wisconsin-Madison

Rochester Institute of Technology Job Submission Andrew Pangborn & Myles Maxfield 10/19/2015Service Oriented Cyberinfrastructure Lab,

Condor Project Computer Sciences Department University of Wisconsin-Madison A Scientist’s Introduction.

Hao Wang Computer Sciences Department University of Wisconsin-Madison Authentication and Authorization.

Condor: High-throughput Computing From Clusters to Grid Computing P. Kacsuk – M. Livny MTA SYTAKI – Univ. of Wisconsin-Madison

1 The Roadmap to New Releases Todd Tannenbaum Department of Computer Sciences University of Wisconsin-Madison

Todd Tannenbaum Computer Sciences Department University of Wisconsin-Madison Condor RoadMap.

The Roadmap to New Releases Derek Wright Computer Sciences Department University of Wisconsin-Madison

Derek Wright Computer Sciences Department University of Wisconsin-Madison MPI Scheduling in Condor: An.

Todd Tannenbaum Computer Sciences Department University of Wisconsin-Madison Quill / Quill++ Tutorial.

July 11-15, 2005Lecture3: Grid Job Management1 Grid Compute Resources and Job Management.

Tevfik Kosar Computer Sciences Department University of Wisconsin-Madison Managing and Scheduling Data.

Review of Condor,SGE,LSF,PBS

Zach Miller Computer Sciences Department University of Wisconsin-Madison Securing Condor.

APST Internals Sathish Vadhiyar. apstd daemon should be started on the local resource Opens a port to listen for apst client requests Runs on the host.

Condor Project Computer Sciences Department University of Wisconsin-Madison Grids and Condor Barcelona,

Campus grids: e-Infrastructure within a University Mike Mineter National e-Science Centre 14 February 2006.

Derek Wright Computer Sciences Department University of Wisconsin-Madison Condor and MPI Paradyn/Condor.

Peter Couvares Associate Researcher, Condor Team Computer Sciences Department University of Wisconsin-Madison

Nick LeRoy Computer Sciences Department University of Wisconsin-Madison Hawkeye.

Peter F. Couvares Computer Sciences Department University of Wisconsin-Madison Condor DAGMan: Managing Job.

Greg Thain Computer Sciences Department University of Wisconsin-Madison Configuring Quill Condor Week.

MW: A framework to support Master Worker Applications Sanjeev R. Kulkarni Computer Sciences Department University of Wisconsin-Madison

Jaime Frey Computer Sciences Department University of Wisconsin-Madison What’s New in Condor-G.

Dan Bradley Condor Project CS and Physics Departments University of Wisconsin-Madison CCB The Condor Connection Broker.

Miron Livny Computer Sciences Department University of Wisconsin-Madison Condor and (the) Grid (one of.

Condor Project Computer Sciences Department University of Wisconsin-Madison Running Interpreted Jobs.

HTCondor’s Grid Universe Jaime Frey Center for High Throughput Computing Department of Computer Sciences University of Wisconsin-Madison.

Active-HDL Server Farm Course 11. All materials updated on: September 30, 2004 Outline 1.Introduction 2.Advantages 3.Requirements 4.Installation 5.Architecture.

Condor on Dedicated Clusters Peter Couvares and Derek Wright Computer Sciences Department University of Wisconsin-Madison

Greg Quinn Computer Sciences Department University of Wisconsin-Madison Privilege Separation in Condor.

Tutorial: Condor on Windows

HTCondor Security Basics

Condor – A Hunter of Idle Workstation

Chapter 2: System Structures

Basic Grid Projects – Condor (Part I)

The Condor JobRouter.

Condor-G Making Condor Grid Enabled

Condor-G: An Update.

Presentation transcript:

Todd Tannenbaum Computer Sciences Department University of Wisconsin-Madison Condor NT Condor ported to Win32

2 Overview › Intro to Condor NT › What does Condor NT do? › How does Condor NT differ from Condor for Unix? › What are the current limitations of Condor NT? › Future Work

3 Intro to Condor NT › First pre-release at Condor ver › “Deep port” of Condor › Daemons run as a system Service under the LocalSystem account › Shares as much source code with Condor for Unix as possible

4 Condor NT Downloads

5 What can it do? › Almost everything Condor for Unix can…  Submit, run, manage queues of jobs Jobs run “in the background”  Nearly all Condor tools included  ClassAds Full compliment of attributes (load average, RAM, benchmarks, free swap, key/mouse idle times, image size, CPU usage, etc)  Everything needed for a Central Manager

6 What can it do? (cont) › Support for SMP machines › Several security mechanisms (more later…) › Suspend, continue, soft-kill (WM_CLOSE), hard-kill jobs › Correctly manage multi-process jobs › Send notifications › Yada, yada, …

7 What’s missing? › Only VANILLA universe included  No STANDARD, PVM, GLOBUS, SCHEDULER universe  Note: MPI being done on both Unix and Win32 › Ability to run the job as the submitting user › Ability to access shared volumes as the submitting user › So – who does the job run as, how does the job get its files?

8 Job Start on Condor NT › On execute machine, Condor creates  New temporary user account  New temporary working directory  New temporary, non-visible desktop › Permissions (ACLs) set › Files transferred by Condor › Job spawned

9 While Job is Running… › Condor watches the job and updates dynamic attributes about the job in the job ClassAd  Disk usage, cpu usage, … › Enforces the machine owner’s policy

10 On Job Vacate/Exit… › Condor conditionally transfers any output files back to the submit machine  Can be told filenames, or automatically send back files which have changed  File transfers are atomic › Cleanup

11 Some points on shared (network) filesystem access › On Condor Unix, VANILLA requires a shared filesystem  Not true on Condor NT › Condor NT can access a shared filesystem  … but only as user “Guest” or only if the share password is provided by the job

12 › Forwarding credentials problem  Windows NTLM in NT 4.0 can impersonate the peer on a socket, but only one “jump” › On Windows NT, cannot just setuid() Difficulties of running as the user ABC

13 Current Work To Do › Improve situation for access to shared filesystem  As user “condor”, or  As user who submitted the job › Run jobs as the submitting user  On NT 4.0 : store the password, forward it encrypted  On Windows 2000: same or PKI

14 Current Work Todo, Cont. › Windows 2000 support  Current release mostly works on Win2k…  Take advantage of Win2k enhancements › Add in Scheduler Universe  And therefore DAGMan support › Add in the MPI Universe

15 Future Work › Add remaining missing Condor Universes  STANDARD Requires addition of process checkpoint and/or remote system call  GLOBUS Requires Globus Toolkit client libs on Win32  PVM

16 Thank You!