Andrew McNab - Manchester HEP - 29/30 March 2001 gridmapdir patch Overview of the problem Constraints from local systems Outline of how it works How to.

Slides:



Advertisements
Similar presentations
30-31 Jan 2003J G Jensen, RAL/WP5 Storage Elephant Grid Access to Mass Storage.
Advertisements

24-May-01D.P.Kelsey, GridPP WG E: Security1 GridPP Work Group E Security Development David Kelsey CLRC/RAL, UK
WP2: Data Management Gavin McCance University of Glasgow November 5, 2001.
Single Sign-On with GRID Certificates Ernest Artiaga (CERN – IT) GridPP 7 th Collaboration Meeting July 2003 July 2003.
DataGrid is a project funded by the European Union CHEP 2003 – March 2003 – Grid-based access control – n° 1 Grid-based access control for Unix environments,
Andrew McNab - Manchester HEP - 17 September 2002 Putting Existing Farms on the Testbed Manchester DZero/Atlas and BaBar farms are available via the Testbed.
29 June 2006 GridSite Andrew McNabwww.gridsite.org VOMS and VOs Andrew McNab University of Manchester.
Andrew McNab - Manchester HEP - 24 May 2001 WorkGroup H: Software Support Both middleware and application support Installation tools and expertise Communication.
Overview of local security issues in Campus Grid environments Bruce Beckles University of Cambridge Computing Service.
Andrew McNab - Manchester HEP - 22 April 2002 EU DataGrid Testbed EU DataGrid Software releases Testbed 1 Job Lifecycle Authorisation at your site More.
22-Apr-02D.P.Kelsey, Security, UKHEP Sysman1 Grid Security 22 Apr 2002 UK HEP Sysman Meeting David Kelsey CLRC/RAL, UK
Andrew McNab - Manchester HEP - 2 May 2002 Testbed and Authorisation EU DataGrid Testbed 1 Job Lifecycle Software releases Authorisation at your site Grid/Web.
Andrew McNab - Manchester HEP - 31 January 2002 Testbed Release in the UK Integration Team UK deployment TB1 Job Lifecycle VO: Authorisation VO: GIIS and.
Andrew McNab - Manchester HEP - 22 April 2002 EU DataGrid Testbed EU DataGrid Software releases Testbed 1 Job Lifecycle Authorisation at your site More.
4/2/2002HEP Globus Testing Request - Jae Yu x Participating in Globus Test-bed Activity for DØGrid UTA HEP group is playing a leading role in establishing.
Andrew McNab - EDG Access Control - 14 Jan 2003 EU DataGrid security with GSI and Globus Andrew McNab University of Manchester
Authorization Working Group Report WP6 Meeting 5 March 2002, Paris.
Andrew McNab - Manchester HEP - 6 November Old version of website was maintained from Unix command line => needed (gsi)ssh access.
S/W meeting 18 October 2007RSD 1 Remote Software Deployment Nick West.
/ David GroepSummary of Security Workshop - DataGRID WP4 workshop1 DataGrid Security WS Summary Targets: Identify requirements from WP's Define.
The B A B AR G RID demonstrator Tim Adye, Roger Barlow, Alessandra Forti, Andrew McNab, David Smith What is BaBar? The BaBar detector is a High Energy.
Evaluation of the Globus GRAM Service Massimo Sgaravatto INFN Padova.
Andrew McNab - Manchester HEP - 5 March 2002 SlashGrid (“/grid”) Motivation: dynamic-accounts issues Local storage: implementation alternatives Generalisation:
Andrew McNab - EDG Access Control - 17 Jan 2003 EDG Site Access Control (ie Local Authorisation and Accounts) Andrew McNab, University of Manchester
Andrew McNab - Manchester HEP - 26 June 2001 WG-H / Support status Packaging / RPM’s UK + EU DG CA’s central grid-users file grid “ping”
Andrew McNab - Manchester HEP - 29 January 2002 SlashGrid (“/grid”) Motivation: dynamic-accounts issues Local storage: implementation alternatives Generalisation:
GRID Centralized management of the Globus grid-mapfile Carlo Rocca INFN, Catania.
Andrew McNab - GridPP Security - 24 Feb 2003 GridPP Security Middleware Andrew McNab, University of Manchester
Workload Management WP Status and next steps Massimo Sgaravatto INFN Padova.
Andrew McNab - Manchester HEP - 5 July 2001 WP6/Testbed Status Status by partner –CNRS, Czech R., INFN, NIKHEF, NorduGrid, LIP, Russia, UK Security Integration.
October, Scientific Linux INFN/Trieste B.Gobbo – Compass R.Gomezel - T.Macorini - L.Strizzolo INFN - Trieste.
Section 1: Introducing Group Policy What Is Group Policy? Group Policy Scenarios New Group Policy Features Introduced with Windows Server 2008 and Windows.
03/27/2003CHEP20031 Remote Operation of a Monte Carlo Production Farm Using Globus Dirk Hufnagel, Teela Pulliam, Thomas Allmendinger, Klaus Honscheid (Ohio.
MySQL and GRID Gabriele Carcassi STAR Collaboration 6 May Proposal.
National Computational Science National Center for Supercomputing Applications National Computational Science NCSA-IPG Collaboration Projects Overview.
Andrew McNab - Access Control - 28 May 2002 Access Control and User Management (ie Local Authorisation and Accounts) Andrew McNab, University of Manchester.
Evolution of the Open Science Grid Authentication Model Kevin Hill Fermilab OSG Security Team.
EU DataGrid (EDG) & GridPP Authorization and Access Control User VOMS C CA 2. certificate dn, ca, key 1. request 3. certificate 4. VOMS cred: VO, groups,
Andrew McNabETF Firewall Meeting, NeSC, 5 Nov 2002Slide 1 Firewall issues for Globus 2 and EDG Andrew McNab High Energy Physics University of Manchester.
05/29/2002Flavia Donno, INFN-Pisa1 Packaging and distribution issues Flavia Donno, INFN-Pisa EDG/WP8 EDT/WP4 joint meeting, 29 May 2002.
Section 11: Implementing Software Restriction Policies and AppLocker What Is a Software Restriction Policy? Creating a Software Restriction Policy Using.
First attempt for validating/testing Testbed 1 Globus and middleware services WP6 Meeting, December 2001 Flavia Donno, Marco Serra for IT and WPs.
3-Nov-00D.P.Kelsey, HEPiX, JLAB1 Certificates for DataGRID David Kelsey CLRC/RAL, UK
10-May-01D.P.Kelsey, Security Workshop Summary1 DataGrid Security Workshop 29/30 March 2001 SUMMARY David Kelsey CLRC/RAL, UK
BNL VO Management and Grid Mapfile Generation Brookhaven National Lab.
Samba – Good Just Keeps Getting Better The new and not so new features available in Samba, and how they benefit your organization. Copyright 2002 © Dustin.
User Management: Authentication & Authorization on the NorduGrid Balázs Kónya, AndersWäänänen 3 rd NorduGrid Workshop, 23 May, 2002 Helsinki.
Andrew McNab - Manchester HEP - 11 May 2001 Packaging / installation Ready to take globus from prerelease to release. Alex has prepared GSI openssh.
Leveraging Campus Authentication for Grid Scalability Jim Jokl Marty Humphrey University of Virginia Internet2 Meeting April 2004.
VO management: Progress since Chicago Workshop Vincenzo Ciaschini 23/5/2002 CNAF – Bologna.
Andrew McNab - Manchester HEP - 17 September 2002 UK Testbed Deployment Aim of this talk is to the answer the questions: –“How much of the Testbed has.
Andrew McNabGrid in 2002, Manchester HEP, 7 Jan 2003Slide 1 Grid Work in 2002 Andrew McNab High Energy Physics University of Manchester.
GRID Centralized Management of the Globus grid-mapfile Carlo Rocca, INFN Catania.
National Energy Research Scientific Computing Center (NERSC) CHOS - CHROOT OS Shane Canon NERSC Center Division, LBNL SC 2004 November 2004.
Andrew McNab - Security issues - 17 May 2002 WP6 Security Issues (some personal observations from a WP6 and sysadmin perspective) Andrew McNab, University.
Andrew McNab - Security issues - 4 Mar 2002 Security issues for TB1+ (some personal observations from a WP6 and sysadmin perspective) Andrew McNab, University.
11-Dec-00D.P.Kelsey, Certificates, WP6 meeting, Milan1 Certificates for DataGrid Testbed0 David Kelsey CLRC/RAL, UK
Andrew McNab - Globus Distribution for Testbed 1 Globus Distribution for Testbed 1 Andrew McNab, University of Manchester
Andrew McNab - HTTP/HTTPS extensions HTTP/HTTPS as Grid data transport 6 March 2003 Andrew McNab, University of Manchester
Andrew McNab - Dynamic Accounts - 2 July 2002 Dynamic Accounts in TB1.3 What we could do with what we’ve got now... Andrew McNab, University of Manchester.
Open Science Grid Build a Grid Session Siddhartha E.S University of Florida.
8-Mar-01D.P.Kelsey, Certificates, WP6, Amsterdam1 WP6: Certificates for DataGrid Testbeds David Kelsey CLRC/RAL, UK
The GRIDS Center, part of the NSF Middleware Initiative Grid Security Overview presented by Von Welch National Center for Supercomputing.
10-May-01D.P.Kelsey, WP6 Security1 Certificates/Authorisation for DataGrid Testbeds David Kelsey CLRC/RAL, UK
11-May-01D.P.Kelsey, Security Update1 GRID Security Update David Kelsey CLRC/RAL, UK
Andrew McNabSlashGrid/GFS BOF, GGF9, 7 Oct 2003Slide 1 SlashGrid = “/grid” Andrew McNab High Energy Physics University of Manchester
Dynamic Accounts: Identity Management for Site Operations Kate Keahey R. Ananthakrishnan, T. Freeman, R. Madduri, F. Siebenlist.
Classic Storage Element
Third Party Transfers & Attribute URI ideas
Update on EDG Security (VOMS)
Presentation transcript:

Andrew McNab - Manchester HEP - 29/30 March 2001 gridmapdir patch Overview of the problem Constraints from local systems Outline of how it works How to implement it locally Longer term solutions?

Andrew McNab - Manchester HEP - 29/30 March 2001 Overview of the problem In Globus 1.1.3, grid identities (certificate subjects) are mapped to local Unix usernames via grid- mapfile. For testbeds, either have to create lots of local Unix accounts - lots of administrative overhead Or map everyone to a single user - great potential for conflicts over use of /home etc, problems with accountability

Andrew McNab - Manchester HEP - 29/30 March 2001 Dynamic accounts The obvious solution, but introduces many complications Account creation / management is intimately related to local policies, tools etc Need to respect local site autonomy and minimise the changes required by local sysadmins Instead of trying to produce a long term solution before M9, look at what will be sufficient for now

Andrew McNab - Manchester HEP - 29/30 March 2001 Use pool of accounts Sysadmin creates a pool of normal Unix accounts, with names like gpool001, gpool002, gpool003, … They can use their normal tools to do this, create quotas, Unix group(s) etc. Temporarily lease accounts when presented with a certificate whose subject is in our grid-mapfile Expire the lease “when they are finished” (defined locally)

Andrew McNab - Manchester HEP - 29/30 March 2001 Security and “auditability” Authentification: still have to provide a valid certificate, signed by a CA the local site trusts Authorisation: certificate subjects must still be listed in the local grid-mapfile to get acess “Auditability”: mappings of subjects to local Unix usernames is logged already, so can still tell “who” a particular pool account was

Andrew McNab - Manchester HEP - 29/30 March 2001 Implementation of leasing Want to share files created by gatekeeper, sshd-gsi, gsiftpd "logins" - so want these to share the same database of leases Need some form of locking. Run a lease daemon? Simplest way is to use link(2) with some sort of flag files, and rely on the atomicity of the file system. (Should even work across NFS to synchronise leases between nodes of a cluster or farm)

Andrew McNab - Manchester HEP - 29/30 March 2001 gridmapdir format “Lease database” takes the form of a directory containing empty files, with the same names as the pool usernames A lease is created by making a second link to the username using the subject name (URL-encoded.) Checking return code of link(2) and link count from stat(2) will enforce one-to-one mapping of subjects and pool usernames

Andrew McNab - Manchester HEP - 29/30 March 2001 Patch to Globus All subject->username mapping done by functions in Security/gss-assist/gridmap.c Patch these to map subjects to pool users if their “username” in grid-mapfile is like “.” or “.subpool” Five new functions in gridmap.c implement leasing as described Subpools with privileges, quotas etc are possible: eg.cms will only be mapped to cms001, cms002,...

Andrew McNab - Manchester HEP - 29/30 March 2001 Lease expiration To reuse pool accounts, lease must be terminated somehow - but mechanics very site dependent Probably easiest to run a script from cron to expire leases: Either based on an expiration time (if you can guarantee the job will be finished by that time) Or by job completion flagging the lease as not needed (eg via PBS prologue / epilogue scripts)

Andrew McNab - Manchester HEP - 29/30 March 2001 Advantages of this patch Minimum impact on local systems Minimum changes to Globus Changes are transparent to users and other sites Allows easy local choices about account characteristics and lease expiration

Andrew McNab - Manchester HEP - 29/30 March 2001 Limitations of the patch Sharing of lease “database” via filesystem and NFS is a hack! Termination of leases is messy Need to block submission of cron jobs etc from pool accounts (batch nodes should be doing this already though)

Andrew McNab - Manchester HEP - 29/30 March 2001 Making grid-mapfile Already proposals from INFN and UK about composing grid-mapfile’s based on information published by LDAP. If this is done, then we have all the components needed to avoid manual intervention by all sysadmins every time a new user joins the Grid.

Andrew McNab - Manchester HEP - 29/30 March 2001 Future solutions (1) “Next Version of Globus” will have CAS framework - need to coexist with this “NVoG” will be able to get grid-mapfile info from LDAP Can already get Unix “passwd” info from LDAP on Linux and Solaris (via a PAM) Should we concentrate dynamic account creation or leasing on a “smart” local LDAP auth server?

Andrew McNab - Manchester HEP - 29/30 March 2001 Future solutions (2) An alternative method is to combine account creation / leasing with resource reservation This simplifies the enforcement of lease expiration, since presumably we already enforce process termination, file deletion at end of reservation But has more overhead and complexity than a smart LDAP server that just manages dynamic accounts

Andrew McNab - Manchester HEP - 29/30 March 2001 More information... has a copy of the patch itself, more explanation and some example scripts for managing pool accounts The gridmapdir patch is included in development versions of Globus RPM’s at

Andrew McNab - Manchester HEP - 29/30 March 2001 make-ca-signing-policy Simple script to rebuild ca-signing- policy.conf when CA's are installed or removed Looks for policy.*.conf files in $GLOBUS_INSTALL_PATH/share/certificates Concatenates a header and all the policy files it finds.

Andrew McNab - Manchester HEP - 29/30 March 2001 make-c-s-p: RPM’s When used in a CA RPM, adding or removing a CA just becomes a single rpm command: eg rpm -i ukhepca rpm RPM installs files, then reruns script At uninstall, files removed and script rerun Can deal with multiple CA's in the same RPM (or tar file.)

Andrew McNab - Manchester HEP - 29/30 March 2001 Demonstration: ukhepca Have ukhepca RPM which everyone who needs to trust UK HEP CA can install Separate ukhepca-request RPM which only UK sites install (includes files to generate requests for certs from this CA) has explanation and all the sources necessary to make compatible RPM or tar files for other CA’s

Andrew McNab - Manchester HEP - 29/30 March 2001 Summary Modular method for installing CA info now available Can easily co-exist with non EU Datagrid CA’s Works with RPM or tar file installation Doesn’t do CRL fetching - use NIKHEF proposal? Should installation of a CA define how to fetch its CRL (perhaps by installing a script?)