Presentation on theme: "Andrew McNab - Manchester HEP - 22 April 2002 EU DataGrid Testbed EU DataGrid Software releases Testbed 1 Job Lifecycle Authorisation at your site More."— Presentation transcript:
Andrew McNab - Manchester HEP - 22 April 2002 EU DataGrid Testbed EU DataGrid Software releases Testbed 1 Job Lifecycle Authorisation at your site More EDG and TB information
Andrew McNab - Manchester HEP - 22 April 2002 EU DataGrid Officially started 1st January 2001 Partners: CERN, CNRS, ESA, INFN, NIKHEF, PPARC Other contributions from HEP institutes (eg in NorduGrid countries) and other Grid projects (eg core UK e-Science) Management and software organised into Work Packages: –WP1 Resource Management (“job submission”) –WP2 Data Management –WP3 Information and Monitoring Services –WP4 Fabric Management (eg local installation and management tools) –WP5 Mass Storage –WP6 Testbeds (include Integration and support for the Testbed grid.) –WP7 Networking –WP8,9,10 Applications
Andrew McNab - Manchester HEP - 22 April 2002 Software Releases Have 3 major releases to coincide with three yearly Testbeds 1, 2 and 3 Have minor releases every 2 months, and then patch level releases between those: currently at 1.1.4 (deployed last week) Currently, the only supported platform is RedHat 6.2 on Intel. Software is stored in a central CVS and published via a public HTTP server (http://datagrid.in2p3.fr) in RPM format. This includes EDG-authored software, a distribution of Globus (contributed by GridPP) and any external packages and updates not included in out-of-the-box RedHat 6.2. The official installation procedure is to use LCFG, contributed by Edinburgh and customised by WP4. Once an LCFG server is working at your site, installation of testbed machines is automated (rather like RedHat kickstart.) See Steve’s talk for details.
Authorisation at your site a.k.a “how do I maintain the list of certificate names (people) that can use my Testbed site?” WP6 provides a standard way of publishing lists of certificate names via an LDAP server, and selecting subsets based on group or “Virtual Organisation” (eg experiment) affiliation. gridmapdir patch to Globus provides dynamic user account allocation from a pool. Each LHC experiment maintains a “VO Server” and populates it with the DNs of their members. VO’s also exist for WP6, BaBar and GridPP.
Andrew McNab - Manchester HEP - 22 April 2002 More information Main EDG site is http://www.eu-datagrid.org/ –each Work Package has a website, usually with documents, mailing list archives etc about its software. WP6 Testbed information at http://marianne.in2p3.fr/ –includes links to software repository, User and Installation Guides, bug tracking Bugzilla etc. UK Testbed support: http://www.gridpp.ac.uk/tb-support/ –has info about firstname.lastname@example.org mailing list, Steve’s notes about LCFG and other practical information.
Andrew McNab - Manchester HEP - 22 April 2002 Summary EDG producing middleware components as part of a consistent distribution for testbed sites. Situation evolving rapidly, but central aim of job submission “to the Grid” via a Resource Broker is working. Software available to interested sites, and web and mailing list resources exist for support. See following talks for details.
Andrew McNab - Manchester HEP - 22 April 2002 UK Rollout and Support Plan Aim of this talk is to the answer question “As a site admin, what are the steps between the situation today, and all interested UK sites being part of the Testbed.” Definite predictions limited by uncertain nature of the releases.
Andrew McNab - Manchester HEP - 22 April 2002 “Constituencies” Sysadmins (represented in “Sysman” and by WP6) –Care about the integrity of their site (firewalls etc) and the maintenance load of Grid Testbed equipment; may be under pressure to get a “green dot” on the relevant map. Experiments (represented by GridPP EB) –Want sites up and running for application development and to run data challenges. Esp. concerned about sites hosting their farms. Grid developers (represented by GridPP TB) –Concerned about getting functionality running in UK, esp. at sites where experts are. Local HEP groups (represented on GridPP CB) –Want a transparent process that includes everyone.
Andrew McNab - Manchester HEP - 22 April 2002 UK Deployment Plan Start with UK WP6 people (+ other key experts) –Use email@example.com mailing list, which anyone can join and is archived. Once have some WP6 sites up and a procedure that should work for any site, then ask more sites to test installation procedure, docs etc. Once this has stabilised, invite all interested sites to install Testbed software. –By this point, installation instuctions should be clear and not require previous grid experience, ad-hoc fixes etc. Support will then be provided by tb-support mailing list on best-effort basis and Grid Support Centre with a formal ticket-based system. –(Likely that mailing list will be best place to get a quick answer.) Need to repeat this every 2 months for EDG releases, although not all sites may have commitments (eg from experiments) to do this.
Andrew McNab - Manchester HEP - 22 April 2002 Testbed Joining Procedure Procedure for joining EDG testbed is being defined by WP6. For UK sites, WP6 UK will propose sites to rest of WP6. WP6-UK will provide help with testing UK sites: –Have GridPP VO, Resource Broker and MDS so can add sites to UK Testbed and validate functionality ourselves before trying in the EDG Testbed. We don’t want to propose sites without testing them ourselves; and cautious sites can put themselves up for validation within GridPP without risking “embarrassment” at a European level. –Will use same validation criteria as WP6.
Andrew McNab - Manchester HEP - 22 April 2002 Installation Procedure This needs to be based around LCFG because of complex configuration process, which is published as automatic LCFG configuration objects. Sites will almost certainly need to dedicate machines to be installed this way. LCFG itself has been non-trivial to install and configure. However, once your local LCFG server is working, installing CE etc is automated (similar to RedHat kickstart.) Steve has been installing LCFG at RAL and has written up the procedure. Also contributed updated scripts back to WP6. So the situation is much better now.
Andrew McNab - Manchester HEP - 22 April 2002 More information EDG Testbed talk from earlier today. WP6 website at http://marianne.in2p3.fr/ GridPP Technical Board http://www.gridpp.ac.uk/tb/ firstname.lastname@example.org mailing list http://www.gridpp.ac.uk/tb-support/ has: –mailing list information –Steve’s recipe for LCFG-installing Computing Element, Storage Element, User Interface machine and Worker Node.
Andrew McNab - Manchester HEP - 22 April 2002 Summary UK Deployment Plan largely defined –but depends on timing and quality of EDG releases Testbed joining procedure defined –aim to use UK resources to smooth path for UK sites to join EDG Testbed. Deployment to non-expert sites largely limited by current installation procedures –this has improved a lot and is pretty much ready to go.