Current Globus Developments Jennifer Schopf, ANL.

Slides:



Advertisements
Similar presentations
The Replica Location Service In wide area computing systems, it is often desirable to create copies (replicas) of data objects. Replication can be used.
Advertisements

The future of Globus (Grid meets Cloud) Ian Foster Computation Institute University of Chicago & Argonne National Laboratory.
© 2007 Open Grid Forum Data Management Challenge - The View from OGF OGF22 – February 28, 2008 Cambridge, MA, USA Erwin Laure David E. Martin Data Area.
The Quantum Chromodynamics Grid James Perry, Andrew Jackson, Matthew Egbert, Stephen Booth, Lorna Smith EPCC, The University Of Edinburgh.
18 April 2002 e-Science Architectural Roadmap Open Meeting 1 Support for the UK e-Science Roadmap David Boyd UK Grid Support Centre CLRC e-Science Centre.
Experiences with Massive PKI Deployment and Usage Daniel Kouřil, Michal Procházka Masaryk University & CESNET Security and Protection of Information 2009.
Data Management Expert Panel. RLS Globus-EDG Replica Location Service u Joint Design in the form of the Giggle architecture u Reference Implementation.
NorduGrid Grid Manager developed at NorduGrid project.
High Performance Computing Course Notes Grid Computing.
Andrew McNab - EDG Access Control - 14 Jan 2003 EU DataGrid security with GSI and Globus Andrew McNab University of Manchester
Lightweight Preservation Environment Gary Jackson.
The Community Authorisation Service – CAS Dr Steven Newhouse Technical Director London e-Science Centre Department of Computing, Imperial College London.
A conceptual model of grid resources and services Authors: Sergio Andreozzi Massimo Sgaravatto Cristina Vistoli Presenter: Sergio Andreozzi INFN-CNAF Bologna.
1 Software & Grid Middleware for Tier 2 Centers Rob Gardner Indiana University DOE/NSF Review of U.S. ATLAS and CMS Computing Projects Brookhaven National.
DGC Paris Community Authorization Service (CAS) and EDG Presentation by the Globus CAS team & Peter Kunszt, WP2.
Globus Toolkit 4 hands-on Gergely Sipos, Gábor Kecskeméti MTA SZTAKI
Status of Globus activities within INFN Massimo Sgaravatto INFN Padova for the INFN Globus group
GRID DATA MANAGEMENT PILOT (GDMP) Asad Samar (Caltech) ACAT 2000, Fermilab October , 2000.
The Globus Toolkit Gary Jackson. Introduction The Globus Toolkit is a product of the Globus Alliance ( It is middleware for developing.
Massimo Cafaro GridLab Review GridLab WP10 Information Services Massimo Cafaro CACT/ISUFI University of Lecce, Italy.
GGF Toronto Spitfire A Relational DB Service for the Grid Peter Z. Kunszt European DataGrid Data Management CERN Database Group.
Toni Saarinen, Tite4 Tomi Ruuska, Tite4 Earth System Grid - ESG.
Milos Kobliha Alejandro Cimadevilla Luis de Alba Parallel Computing Seminar GROUP 12.
Globus activities within INFN Massimo Sgaravatto INFN Padova for the INFN Globus group
4b.1 Grid Computing Software Components of Globus 4.0 ITCS 4010 Grid Computing, 2005, UNC-Charlotte, B. Wilkinson, slides 4b.
1 Globus Developments Malcolm Atkinson for OMII SC 18 th January 2005.
Globus 4 Guy Warner NeSC Training.
Kate Keahey Argonne National Laboratory University of Chicago Globus Toolkit® 4: from common Grid protocols to virtualization.
Grid Computing for Real World Applications Suresh Marru Indiana University 5th October 2005 OSCER OU.
The Data Replication Service Ann Chervenak Robert Schuler USC Information Sciences Institute.
Data Management Kelly Clynes Caitlin Minteer. Agenda Globus Toolkit Basic Data Management Systems Overview of Data Management Data Movement Grid FTP Reliable.
OPEN GRID SERVICES ARCHITECTURE AND GLOBUS TOOLKIT 4
Assuring e-Trust always 1 Status of the Validation and Authentication service for TACAR and Grids.
Don Quijote Data Management for the ATLAS Automatic Production System Miguel Branco – CERN ATC
Globus Data Replication Services Ann Chervenak, Robert Schuler USC Information Sciences Institute.
Dynamic Firewalls and Service Deployment Models for Grid Environments Gian Luca Volpato, Christian Grimm RRZN – Leibniz Universität Hannover Cracow Grid.
ARGONNE  CHICAGO Ian Foster Discussion Points l Maintaining the right balance between research and development l Maintaining focus vs. accepting broader.
OSG Middleware Roadmap Rob Gardner University of Chicago OSG / EGEE Operations Workshop CERN June 19-20, 2006.
GT Components. Globus Toolkit A “toolkit” of services and packages for creating the basic grid computing infrastructure Higher level tools added to this.
1 School of Computer, National University of Defense Technology A Profile on the Grid Data Engine (GridDaEn) Xiao Nong
Grid Resource Allocation and Management (GRAM) Execution management Execution management –Deployment, scheduling and monitoring Community Scheduler Framework.
9-May-02D.P.Kelsey, Security Plans, GridPP41 Security: Plans 9 May 2002 GridPP4 meeting, Manchester David Kelsey CLRC/RAL, UK
Grid Status - PPDG / Magda / pacman Torre Wenaus BNL U.S. ATLAS Physics and Computing Advisory Panel Review Argonne National Laboratory Oct 30, 2001.
File and Object Replication in Data Grids Chin-Yi Tsai.
LHCb week, 27 May 2004, CERN1 Using services in DIRAC A.Tsaregorodtsev, CPPM, Marseille 2 nd ARDA Workshop, June 2004, CERN.
CYBERINFRASTRUCTURE FOR THE GEOSCIENCES Data Replication Service Sandeep Chandra GEON Systems Group San Diego Supercomputer Center.
Author - Title- Date - n° 1 Partner Logo EU DataGrid, Work Package 5 The Storage Element.
Globus Replica Management Bill Allcock, ANL PPDG Meeting at SLAC 20 Sep 2000.
09/02 ID099-1 September 9, 2002Grid Technology Panel Patrick Dreher Technical Panel Discussion: Progress in Developing a Web Services Data Analysis Grid.
The Replica Location Service The Globus Project™ And The DataGrid Project Copyright (c) 2002 University of Chicago and The University of Southern California.
Transaction-based Grid Data Replication Using OGSA-DAI Presented by Yin Chen February 2007.
Atlas Grid Status - part 1 Jennifer Schopf ANL U.S. ATLAS Physics and Computing Advisory Panel Review Argonne National Laboratory Oct 30, 2001.
Cole David Ronnie Julio. Introduction Globus is A community of users and developers who collaborate on the use and development of open source software,
DGC Paris WP2 Summary of Discussions and Plans Peter Z. Kunszt And the WP2 team.
AliEn AliEn at OSC The ALICE distributed computing environment by Bjørn S. Nilsen The Ohio State University.
Objective What is RFT ? How does it work Architecture of RFT RFT and OGSA Issues Demo Questions.
System/SDWG Update Management Council Face-to-Face Flagstaff, AZ August 22-23, 2011 Sean Hardman.
Status of Globus activities Massimo Sgaravatto INFN Padova for the INFN Globus group
Accounting in DataGrid HLR software demo Andrea Guarise Milano, September 11, 2001.
Protocols and Services for Distributed Data- Intensive Science Bill Allcock, ANL ACAT Conference 19 Oct 2000 Fermi National Accelerator Laboratory Contributors:
Grid Status - PPDG / Magda / pacman Torre Wenaus BNL DOE/NSF Review of US LHC Software and Computing Fermilab Nov 29, 2001.
The GRIDS Center, part of the NSF Middleware Initiative Grid Security Overview presented by Von Welch National Center for Supercomputing.
Grid Activities in CMS Asad Samar (Caltech) PPDG meeting, Argonne July 13-14, 2000.
DataGrid is a project funded by the European Commission EDG Conference, Heidelberg, Sep 26 – Oct under contract IST OGSI and GT3 Initial.
OSG Status and Rob Gardner University of Chicago US ATLAS Tier2 Meeting Harvard University, August 17-18, 2006.
EGI-InSPIRE RI EGI-InSPIRE EGI-InSPIRE RI EGI Services for Distributed e-Infrastructure Access Tiziana Ferrari on behalf.
Patrick Dreher Research Scientist & Associate Director
Report on GLUE activities 5th EU-DataGRID Conference
Presentation transcript:

Current Globus Developments Jennifer Schopf, ANL

May 6, Some dates… l Globus Toolkit TM V2.0 Final released several weeks ago –Replica Catalog released 10 days ago –MDS 2.2 release in late June (reliability, schemas) l Beta of Replica Location Service (RLS) available to community now l Alpha of Reliable File Transfer Service now available l CAS prototype currently in alpha-release with some external use l Open Grid Services Architecture (OGSA / GT3) announced in February. Targeting an early alpha by GGF5 in Edinburgh. Should be reasonably stable by year end.

May 6, Replica Catalog l Currently supplying Replica Catalog V1.0 and Replica Management V1.0 in GT2 l Based on the LDAP Protocol l Centralized Replica Catalog l Currently in use within GDMP

May 6, Replication l The bad news: –Current replica catalog had scalability and single point of failure problems –LDAPisms made it into the API l The good news: –New distributed catalog is under development in cooperation with EDG (WP2) –The catalog API is mostly hidden behind the management API, so API changes should not be too painful.

May 6, 20025

6 Replication Location Service l Beta of Replica Location Service (RLS) currently available l Working on specifications for Reliable Replication Service –This will likely be OGSA based in it’s first incarnation. l Future thrusts will look at scalability and reliability / fault tolerance.

May 6, Reliable Transfer Service l Service that allows byte streams to be transferred in a reliable manner l Problems are dealt with automatically until resume or meet some “ultimate failure” condition –dropped connections –machine reboots –temporary network outages

May 6, RFT Consists of: l The Transfer Service, which accepts the transfer requests l Transfer Request Client GUI, to submit the transfer requests to service and to receive the status updates of the same. l Transfer Client, is a C binary that actually performs transfers using GridFTP. l Netlogger,to monitor and archive the performance of transfers. l Database, to store the state of all the transfers.

May 6, SC Demo Prototype l A prototype built over current Globus tools was demonstrated at SuperComputing ’01 l

May 6, Current Prototype l Reliable File Transfer Service as a Web Service using SOAP l Using Axis as our SOAP engine and Apache Tomcat as our Webserver l Working on delegating the user's proxy along with the Transfer Request so that the transfers are done basing on user's credentials. l

May 6, Community Authorization Service l Question: How does a large community grant its users access to a large set of resources? –Should minimize burden on both the users and resource providers l Community Authorization Service (CAS) –Community negotiates access to resources –Resource outsources fine-grain authorization to CAS –Resource only knows about “CAS user” credential >CAS handles user registration, group membership… –User who wants access to resource asks CAS for a capability credential >Restricted proxy of the “CAS user” cred., checked by resource

May 6, CAS 1. CAS request, with resource names and operations Community Authorization Service Does the collective policy authorize this request for this user? user/group membership resource/collective membership collective policy information Resource Is this request authorized for the CAS? Is this request authorized by the capability? local policy information 4. Resource reply User 3. Resource request, authenticated with capability 2. CAS reply, with and resource CA info capability

May 6, PPDG, Globus Alphas and ATLAS l PPDG is a deployment oriented project l Part of the PPDG/Globus work is in deploying Globus alpha sw with current experiments for feedback