Making Omelets Without Breaking Eggs: Adding Enterprise Features to Condor Jason Stowe.

Slides:



Advertisements
Similar presentations
Digital Edge Solutions Overview Services – Application Support.
Advertisements

Architecture Decision Group Group Organization & Processes April 7, 2015 | Tuesday.
Setting up of condor scheduler on computing cluster Raman Sehgal NPD-BARC.
Sixth Hour Lecture 10:30 – 11:20 am, September 9 Framework for a Software Management Process – Artifacts of the Process (Part II, Chapter 6 of Royce’ book)
DATA CONSOLIDATION AND MANAGEMENT SERBAN ZIRNOVAN ENTERPRISE BUSINESS MANAGER 25 MAY 2015.
Project 2002 A Proposal Application Project 2002 Actions.
8 Systems Analysis and Design in a Changing World, Fifth Edition.
Next Generation Domain-Services in PL-Grid Infrastructure for Polish Science. Numerical Simulations of Metal Forming Production Processes and Cycles by.
1 Alternate Title Slide: Presentation Name Goes Here Presenter’s Name Infrastructure Solutions Division Date GIS Perfct Ltd. Autodesk Value Added Reseller.
© copyright 2014 BMC Software, Inc. DevOps consultant Niek Bartholomeus Going DevOps with BMC.
Software Documentation Written By: Ian Sommerville Presentation By: Stephen Lopez-Couto.
Research Computing with Newton Gerald Ragghianti Nov. 12, 2010.
Release & Deployment ITIL Version 3
Bob Jones, CERN, IT department 4 October Why Procurement The activities within the Helix Nebula initiative have shown that public research organisations.
Microsoft Office Project Portfolio Server
Risk Modeling with Condor at The Hartford Condor Week March 15, 2005 Bob Nordlund The Hartford
OptReg Optimum Time Schedule Generator and Registration System for Courses in a College/Unviersity Along with an optimum Finals Examination Schedule Generator.
Cisco and OpenStack Lew Tucker VP/CTO Cloud Computing Cisco Systems,
Fluxyfox A software project hosting platform. Platform Services  Website on fluxyfox.com (Azure Websites)  Subdomain of fluxyfox.com (DNS)  Linux,
Continuous Delivery Ajey Gore Head of Technology ThoughtWorks India.
Margaret Kubitschek, Solution Architect Sam Brewster, Customer Delivery Manager Dennis Keating, Account Executive Siemens PLM Software19 March 2010 Teamcenter.
06/20/07 Cross University Open-Source Collaboration.
GRACE Project IST EGAAP meeting – Den Haag, 25/11/2004 Giuseppe Sisto – Telecom Italia Lab.
1 Copyright © 2004, Oracle. All rights reserved. Introduction to Oracle Forms Developer and Oracle Forms Services.
Large, Fast, and Out of Control: Tuning Condor for Film Production Jason A. Stowe Software Engineer Lead - Condor CORE Feature Animation.
PCGRID ‘08 Workshop, Miami, FL April 18, 2008 Preston Smith Implementing an Industrial-Strength Academic Cyberinfrastructure at Purdue University.
EARTO – working group on quality issues – 2 nd session Anneli Karttunen, Quality Manager VTT Technical Research Centre of Finland This presentation.
Jason Stowe Condor Week 2009 April 22 nd, Coming to Condor Week since Started as a User.
Copyright © 2012 Axceleon Intellectual Property All rights reserved HPC User Forum, Dearborn MI. Our Focus: Enable HPC solutions in the Cloud for our Customer.
Thinking Outside the Nest Utilizing Enterprise Resources with Condor Bob Nordlund The Hartford Condor Week 2006.
Status report on Lame Delegations (work in progress) George Michaelson DB SIG APNIC17/APRICOT 2004 Feb KL, Malaysia.
Condor In Flight at The Hartford 2006 Transformations Condor Week 2007 Bob Nordlund.
Grid Computing at The Hartford Condor Week 2008 Robert Nordlund
Miron Livny Computer Sciences Department University of Wisconsin-Madison Condor : A Concept, A Tool and.
Virtual Data Grid Architecture Ewa Deelman, Ian Foster, Carl Kesselman, Miron Livny.
WEGIS Infrastructure WorkshopDecember 13, Wisconsin Enterprise GIS (WEGIS) Infrastructure/Architecture Workshop December 13, 2005.
Module 1: Introducing Windows Server 2003 Network Infrastructure Planning, Tools, and Documentation.
Software Development Risk Assessment for Clouds National Technical University of Ukraine “Kiev Polytechnic Institute” Heat and energy design faculty Department.
Mobile Data Analytics v7.1 Architectural Overview Does one size fits all? Mobile Data Analytics v7.1 Disaster recovery strategiesA.
Oracle Warehouse Builder - Beta 1 New Features Jean-Pierre Dijcks.
Easy Access to Grid infrastructures Dr. Harald Kornmayer (NEC Laboratories Europe) Dr. Mathias Stuempert (KIT-SCC, Karlsruhe) EGEE User Forum 2008 Clermont-Ferrand,
© 2005 Altera Corporation © 2006 Altera Corporation Batch Computing at Altera Condor, Quill and The Enterprise.
25 April Unified Cryptologic Architecture: A Framework for a Service Based Architecture Unified Cryptologic Architecture: A Framework for a Service.
2005 GRIDS Community Workshop1 Learning From Cyberinfrastructure Initiatives Grid Research Integration Development & Support
MICROSOFT TESTS /291/293 Fairfax County Adult Education Courses 1477/1478/1479.
Final Implementation of a High Performance Computing Cluster at Florida Tech P. FORD, X. FAVE, K. GNANVO, R. HOCH, M. HOHLMANN, D. MITRA Physics and Space.
NSF Middleware Initiative Purpose To design, develop, deploy and support a set of reusable, expandable set of middleware functions and services that benefit.
Chapter 2 Project Management Methodologies. A project life cycle PlanDesignDevelop Integrate (including test) DeployMaintain They can be iterative and.
Landing in the Right Nest: New Negotiation Features for Enterprise Environments Jason Stowe.
Miron Livny Computer Sciences Department University of Wisconsin-Madison Condor and (the) Grid (one of.
Project Presentation «Project title» for participating in the competition of innovative projects «IT Caspian» in the category «Category title»
Project Presentation «Project title» for participating in selection of innovative projects «Baltic3i 2.0» in the category «Category title» Your country.
Bug Or Feature Submitting Support Requests and Development Ideas.
INRNE's participation in LCG Elena Puncheva Preslav Konstantinov IT Department.
1 Sean Aluoto Anthony Keeley Eric Werner. 2 Project Plan Overview Project Lifecycle model Time line Deliverables Organization plan Risk management Design.
Red Hat Enterprise Linux Presenter name Title, Red Hat Date.
Activities and Perspectives at Armenian Grid site The 6th International Conference "Distributed Computing and Grid- technologies in Science and Education"
© Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice. H2020 Secure ICT Case.
ERA Project Team Meeting Project Management Plan April 23, 2002.
Red Hat, Inc. The Revolution of Choice. Red Hat, Inc. Founded in 1995 –Bob Young, CEO - Co-founder –Marc Ewing, CTO - Co-founder Headquartered in Research.
Introduction to Oracle Forms Developer and Oracle Forms Services
Active Directory Audit | User Logon/Logoff Audit | File Server Audit | Windows Server Audit Printer Audit | Removable Storage Audit | Compliance Reports.
Introduction to Oracle Forms Developer and Oracle Forms Services
Introduction to Oracle Forms Developer and Oracle Forms Services
Systems Analysis – ITEC 3155 Evaluating Alternatives for Requirements, Environment, and Implementation.
Headgroup Meeting Data Centre Migration
Why PC Based Control ?.
Integrated Policy Sales and Medical Screening Solution 2016
Optena: Enterprise Condor
General Services Department (GSD) Asset Management (AM) Project Project Certification Committee Implementation Phase Request October 24, 2019 Duffy.
Presentation transcript:

Making Omelets Without Breaking Eggs: Adding Enterprise Features to Condor Jason Stowe

condor_q 1.0 Community 2.0 Condor += Hooks 3.0 Conversations with Miron 4.0 Configuration w/Pipes 5.0 Progress to date

Condor Community

com·mu·ni·ty

A group of people living … under the same government.

A group of people having common interests: the scientific community

… Sharing, participation, and fellowship.

Community = People

Prior work Condor for movies: CPUs (Linux/OSX) 70+ TB storage Active Community member

Currently: Cycle Computing Condor Advice, Software & Enterprise Support Windows/Linux/OSX

Now work on bigger projects with people I sat CondorWeek2005…

Robert Nordlund, HartfordLife Cutting-edge commercial user

X000’s server VMs, X0000’s workstations TBs storage, Vast IT resources

Commercial Users = sub-community

Share common interests… and resources

- Windows (&Linux/Solaris) - Commercial DB (Oracle) - Large Storage Capacity - Network Infrastructure - Available Tools: JMS, Web clusters, DNS

How to Leverage Enterprise tools for Business Requirements - Disaster Recovery/etc.

Bob Nordlund’s idea: Condor += Hooks

Configuration: Contribute hooks to Condor, no workarounds (like extra daemons used in past)

How do we get this done?

How do we make an omelet, without breaking community eggs?

A Conversation with Miron

Funding

Text Here

Couldn’t industry provide funding for a team of people?

Objectivity/Independence

Condor is Attractive: Open, Innovative, Community

Problem with Large Enterprise Funding Contracts

= Dependence and Potential Conflict of Interest

Needs of the many must outweigh the needs of the few or the one.

What is the optimal way from Miron/Wisconsin’s perspective?

Proposed Solution Wisconsin Responsible for: Architectural Decisions – Final approval for features Code Review/Integration Release Planning Maintenance

Proposed Solution Integrator Responsible for: Wisconsin – Build & Test, architecture feedback, development, code review, testing, and integration Enterprise – requirements, scheduling, & support Enterprise funds feature addition

Proposed Solution

For the new feature: Wisconsin is Architect/Maintainer Integrator is Developer/QA

Intellectual Property

Sharing, participation, and fellowship.

One Unified Condor

IP for Condor Code changes must be donated back to Condor

Plan the work. Work the plan. We got started…

HartfordLife = Enterprise Cycle = Integrator Wisconsin = Governing/Architect

Bob and I called someone we sat next 2005

Ian Chesal, Altera Written Innovative Middleware, Priority Scheduling and Quill (yay!)

Share common interests…

Configuration w/Pipes (CWP)

CONDOR_CONFIG = cat file |

CONDOR_CONFIG = default_file LOCAL_CONDOR_CONFIG = getconfig |

Current Status

condor_status CLAIMED BUSY CLAIMED BUSY BUSY CWP Feature specification – Done NMI Build & Test – Wrapping up CWP Implementation – In progress Testing & Code Review Integration & Release

Condor_History

Community

Enterprise Community

Condor += Hooks

Model for feature addition

if you are a Condor user

Need support with new functionality (Condor += Hooks)

Participate in the Community

Talk with Miron. Talk with me.

(Talk with 2006)

Help the community continue to work well for everyone.

Thank you. Questions?