Nanbor Wang, Balamurali Ananthan Tech-X Corporation Gerald Gieraltowski, Edward May, Alexandre Vaniachine Argonne National Laboratory 2. ARCHITECTURE GSIMF:

Slides:



Advertisements
Similar presentations
Wei Lu 1, Kate Keahey 2, Tim Freeman 2, Frank Siebenlist 2 1 Indiana University, 2 Argonne National Lab
Advertisements

Agile Software Distribution
Components of GIS.
High Performance Computing Course Notes Grid Computing.
A Computation Management Agent for Multi-Institutional Grids
1 Software & Grid Middleware for Tier 2 Centers Rob Gardner Indiana University DOE/NSF Review of U.S. ATLAS and CMS Computing Projects Brookhaven National.
Distributed Application Management Using PLuSH Jeannie Albrecht, Christopher Tuttle, Alex C. Snoeren, and Amin Vahdat UC San Diego CSE {jalbrecht, ctuttle,
CompuNet Grid Computing Milena Natanov Keren Kotlovsky Project Supervisor: Zvika Berkovich Lab Chief Engineer: Dr. Ilana David Spring, /
DataGrid Kimmo Soikkeli Ilkka Sormunen. What is DataGrid? DataGrid is a project that aims to enable access to geographically distributed computing power.
Milos Kobliha Alejandro Cimadevilla Luis de Alba Parallel Computing Seminar GROUP 12.
The Open Grid Service Architecture (OGSA) Standard for Grid Computing Prepared by: Haoliang Robin Yu.
3.1 © 2004 Pearson Education, Inc. Exam Managing and Maintaining a Microsoft® Windows® Server 2003 Environment Lesson 3: Introducing Active Directory.
MCTS Guide to Microsoft Windows Server 2008 Network Infrastructure Configuration Chapter 11 Managing and Monitoring a Windows Server 2008 Network.
SaaS, PaaS & TaaS By: Raza Usmani
A Tour of System Center Configuration Manager Adam Duffy Edina Public Schools.
Web-based Portal for Discovery, Retrieval and Visualization of Earth Science Datasets in Grid Environment Zhenping (Jane) Liu.
Sergey Belov, Tatiana Goloskokova, Vladimir Korenkov, Nikolay Kutovskiy, Danila Oleynik, Artem Petrosyan, Roman Semenov, Alexander Uzhinskiy LIT JINR The.
Client Management. Introduction In a typical organization there are a lot of client machines used for day to day operations Client management is a necessary.
Linux Operations and Administration
CERN - IT Department CH-1211 Genève 23 Switzerland t Monitoring the ATLAS Distributed Data Management System Ricardo Rocha (CERN) on behalf.
Digital Object Architecture
GT Components. Globus Toolkit A “toolkit” of services and packages for creating the basic grid computing infrastructure Higher level tools added to this.
03/27/2003CHEP20031 Remote Operation of a Monte Carlo Production Farm Using Globus Dirk Hufnagel, Teela Pulliam, Thomas Allmendinger, Klaus Honscheid (Ohio.
Grid Resource Allocation and Management (GRAM) Execution management Execution management –Deployment, scheduling and monitoring Community Scheduler Framework.
GIS On The Web: An Overview of ArcIMS. *The easy flow of geographic data can offer real-life solutions in many societal sectors, including municipal government,
Production Data Grids SRB - iRODS Storage Resource Broker Reagan W. Moore
Active Directory Harikrishnan V G 18 March Presentation titlePage 2 Agenda ► Introduction – Active Directory ► Directory Service ► Benefits of Active.
ILDG Middleware Status Chip Watson ILDG-6 Workshop May 12, 2005.
CYBERINFRASTRUCTURE FOR THE GEOSCIENCES Data Replication Service Sandeep Chandra GEON Systems Group San Diego Supercomputer Center.
Virtual Data Grid Architecture Ewa Deelman, Ian Foster, Carl Kesselman, Miron Livny.
NA-MIC National Alliance for Medical Image Computing UCSD: Engineering Core 2 Portal and Grid Infrastructure.
David Adams ATLAS DIAL/ADA JDL and catalogs David Adams BNL December 4, 2003 ATLAS software workshop Production session CERN.
The Global Land Cover Facility is sponsored by NASA and the University of Maryland.The GLCF is a founding member of the Federation of Earth Science Information.
Introduction to Grids By: Fetahi Z. Wuhib [CSD2004-Team19]
13-Oct-2003 Internet2 End-to-End Performance Initiative: piPEs Eric Boyd, Matt Zekauskas, Internet2 International.
6/23/2005 R. GARDNER OSG Baseline Services 1 OSG Baseline Services In my talk I’d like to discuss two questions:  What capabilities are we aiming for.
1 Service Creation, Advertisement and Discovery Including caCORE SDK and ISO21090 William Stephens Operations Manager caGrid Knowledge Center February.
Replica Management Kelly Clynes. Agenda Grid Computing Globus Toolkit What is Replica Management Replica Management in Globus Replica Management Catalog.
Software Engineering Chapter: Computer Aided Software Engineering 1 Chapter : Computer Aided Software Engineering.
Development of e-Science Application Portal on GAP WeiLong Ueng Academia Sinica Grid Computing
Interactive Data Analysis on the “Grid” Tech-X/SLAC/PPDG:CS-11 Balamurali Ananthan David Alexander
Data Manipulation with Globus Toolkit Ivan Ivanovski TU München,
ATLAS-specific functionality in Ganga - Requirements for distributed analysis - ATLAS considerations - DIAL submission from Ganga - Graphical interfaces.
Grid Technologies for Distributed Database Services 3D Project Meeting CERN, May 19, 2005 A. Vaniachine (ANL)
Difference between DBMS and File System
INFSO-RI Enabling Grids for E-sciencE Using of GANGA interface for Athena applications A. Zalite / PNPI.
70-293: MCSE Guide to Planning a Microsoft Windows Server 2003 Network, Enhanced Chapter 6: Planning, Configuring, And Troubleshooting WINS.
1 A Scalable Distributed Data Management System for ATLAS David Cameron CERN CHEP 2006 Mumbai, India.
SQL Server 2012 Session: 1 Session: 4 SQL Azure Data Management Using Microsoft SQL Server.
Site Authorization Service Local Resource Authorization Service (VOX Project) Vijay Sekhri Tanya Levshina Fermilab.
ETICS An Environment for Distributed Software Development in Aerospace Applications SpaceTransfer09 Hannover Messe, April 2009.
Building Preservation Environments with Data Grid Technology Reagan W. Moore Presenter: Praveen Namburi.
Breaking the frontiers of the Grid R. Graciani EGI TF 2012.
EGEE is a project funded by the European Union under contract IST Issues from current Experience SA1 Feedback to JRA1 A. Pacheco PIC Barcelona.
Ansible and Ansible Tower 1 A simple IT automation platform November 2015 Leandro Fernandez and Blaž Zupanc.
Planning an Active Directory Deployment Lesson 1.
SAM architecture EGEE 07 Service Availability Monitor for the LHC experiments Simone Campana, Alessandro Di Girolamo, Nicolò Magini, Patricia Mendez Lorenzo,
A System for Monitoring and Management of Computational Grids Warren Smith Computer Sciences Corporation NASA Ames Research Center.
Scientific Linux Inventory Project (SLIP) Troy Dawson Connie Sieh.
Enabling Grids for E-sciencE Claudio Cherubino INFN DGAS (Distributed Grid Accounting System)
StoRM: a SRM solution for disk based storage systems
Cross-health enterprises Medical Data Management on the EGEE grid
70-293: MCSE Guide to Planning a Microsoft Windows Server 2003 Network, Enhanced Chapter 6: Planning, Configuring, And Troubleshooting WINS.
The Open Grid Service Architecture (OGSA) Standard for Grid Computing
StratusLab Final Periodic Review
StratusLab Final Periodic Review
Study course: “Computing clusters, grids and clouds” Andrey Y. Shevel
Introduction to J2EE Architecture
Module 01 ETICS Overview ETICS Online Tutorials
Overview Activities from additional UP disciplines are needed to bring a system into being Implementation Testing Deployment Configuration and change management.
Presentation transcript:

Nanbor Wang, Balamurali Ananthan Tech-X Corporation Gerald Gieraltowski, Edward May, Alexandre Vaniachine Argonne National Laboratory 2. ARCHITECTURE GSIMF: A Grid Software Installation Management Framework GSIMF architecture is shown in Figure 1. The description of the core components and the sequence of actions are explained below. How GSIMF Works A. Grid Software Catalog Service (GSCS) collects information about the software packages stored in Software Package Repository and builds metadata for every individual package. B, C. The client browses through the Catalog of Software Metadata, selects the software of interest and sends the command to install the software to the Grid Software Installation Manager (GSIM). D, F. GSIM contacts the Grid Software Package Query Service (GSPQS) and after checking that the software is not already installed on the Grid, GSIM delegates the installation processes to the Grid Software Installation Service (GSIS). G, H. The GSIS starts a Software Installation Engine on one of the machines in the Grid through the Gatekeeper. The files needed to start the Installation Engine are pre-staged through the GridFTP server. Both the Gatekeeper and GridFTP servers are provided by the Globus Toolkit. I. The Software Installation Engine installs the software on the Storage Element on a location that is accessible by all the nodes of the Compute Element after taking care of the dependents of the installed software package. In a similar sequence the database-resident data packaged in files can be installed on the Grid. To manage versioned and interdependent software applications and file-based databases over the Grid infrastructure we developed the Grid Software Installation Management Framework (GSIMF). This set of Grid services provide mechanism to install software packages on distributed Grid computing elements, thus automating the software and database installation management process on behalf of the users. The challenge of software installation management in the Grid environment is not unique to the HEP domain. GSIMF can be modified to bring immediate and similar benefit to other application domains that require large-scale software systems needing software installation management tools. By lowering the cost of deploying and maintaining software on the Grid environment through GSIMF, we can push the envelope of Grid computing technologies further to reach new extents. 1. Introduction Physicists need to install their experiment-specific software into the Grid environment before they can start testing the software, making pilot runs, and processing sets of data they wish to analyze. Unlike local computing resources, systems on a Grid are geographically distributed and belong to different organizations, and hence have divergent system hardware and software combinations, as well as configurations, usage and security policies. Maintaining software installations for systems on a Grid is therefore not a trivial task and is often done manually, which is error-prone and time-consuming. Furthermore, Grids are often shared by multiple groups of researchers. What is needed is a software installation management system so that an experiment is not hindered from using an otherwise available resource simply because the necessary software or data are not accessible. To solve this, we’ve developed Grid Software Installation Management Framework (GSIMF) as a set of Grid Services for managing versioned and interdependent software applications and file-based databases over the Grid infrastructure on behalf of users. On the Grid, in addition to the software release files, physicists require access to the database-resident data in files. (An example of these are the ATLAS Database Release files that are decoupled from the software releases.) This task is similar to the installation of the software files performed by GSIMF. We study the applicability of GSIMF for the installation and management of database release files. For that purpose the GSIMF system was deployed on the Open Science Grid (OSG) fabric at the Argonne National Laboratory (Figure 2). Figure 2: Grid installation sequence 1.User opens Software Catalog and GUI client asks for the end point of the catalog service. 2.The input dialog where the user feeds in the catalog service's endpoint. 3.Software Catalog opened. 4.After browsing through the catalog, the user decides to install the DOM software - at which point the user must feed in the end point of the Manager service. 5.There are currently no user software installed on the Grid. 6.Now the DOM software is installed along with its three dependents that are getting installed one after another. 7.DOM and its dependents are installed. 8.Uninstalling DOM software. 9.After DOM and its dependents are uninstalled Architecture 3. Case Study Our GSIMF system is secure as it makes use of the security features available on the Grid Toolkit provided by the Grid Security Infrastructure (Figure 3). Figure 3: Secure Grid installation initialization 1.GUI client starts up. 2.Grid User Proxy expired. GUI client asks user to renew the proxy. 3.Proxy successfully getting created Grid Security 5. Conclusions