The UK National Grid Service Andrew Richards – CCLRC, RAL.

Slides:



Advertisements
Similar presentations
S.L.LloydATSE e-Science Visit April 2004Slide 1 GridPP – A UK Computing Grid for Particle Physics GridPP 19 UK Universities, CCLRC (RAL & Daresbury) and.
Advertisements

The National Grid Service Mike Mineter.
Neil Geddes CCLRC Head of e-Science Director of the UK Grid Operations Support Centre 1.The vision Thing, recent history and Organisation 2.Roles and Relationships.
Data services on the NGS.
NGS Experimental OGSA-DAI Service. What is OGSA-DAI? The Open Grid Services Architecture Data Access and Integration project is concerned with constructing.
Support: Certificates and Helpdesks Andrew Richards (GSC/NGS) – CCLRC, RAL.
INFSO-RI Enabling Grids for E-sciencE EGEE and the National Grid Service Mike Mineter
SWITCH Visit to NeSC Malcolm Atkinson Director 5 th October 2004.
02/07/03 Grid Support Centre 1 UK Grid Support Centre Alistair Mills CLRC e-Science Centre
SCARF Duncan Tooke RAL HPCSG. Overview What is SCARF? Hardware & OS Management Software Users Future.
Peter Berrisford RAL – Data Management Group SRB Services.
Issues with Production Grids Tony Hey Director of UK e-Science Core Programme.
Dr. David Wallom Experience of Setting up and Running a Production Grid on a University Campus July 2004.
The UK National Grid Service Using the NGS. Outline NGS Background Getting Certificates Acceptable usage policies Joining VO’s What resources will be.
Technology on the NGS Pete Oliver NGS Operations Manager.
DAME, EuroGrid WP3 and GEODISE Esa Nuutinen. Introduction Dame, EuroGrid WP3 and GEODISE All are Grid based tools for Engineers. Many times engineers.
15th January, NGS for e-Social Science Stephen Pickles Technical Director, NGS Workshop on Missing e-Infrastructure Manchester, 15 th January, 2007.
ScotGrid: a Prototype Tier-2 Centre – Steve Thorn, Edinburgh University SCOTGRID: A PROTOTYPE TIER-2 CENTRE Steve Thorn Authors: A. Earl, P. Clark, S.
“How to Connect Campus Grids to the NGS” Neil Geddes Director, GOSC The UK's National Grid Service is a project to deploy and operate a grid infrastructure.
CS e-Science & Grid Computing - introduction - What is e-Science? What is the Grid? Grid middleware.
Next Steps Mike Mineter
The National Grid Service User Accounting System Katie Weeks Science and Technology Facilities Council.
Next Steps Guy Warner
Next Steps Mike Mineter
1 st EGEE Conference – April UK and Ireland Partner Dave Kant Deputy ROC Manager.
The National Grid Service Guy Warner.
GGF-16 Athens Production Grid Computing in the UK Neil Geddes CCLRC Director, e-Science.
Production Grids Mike Mineter NeSC-TOE. EU project: RIO31844-OMII-EUROPE 2 Production Grids - examples 1.EGEE: Enabling Grids for e-Science 2.National.
Neil Geddes GridPP-10, June 2004 UK e-Science Grid Dr Neil Geddes CCLRC Head of e-Science Director of the UK Grid Operations Support Centre.
The UK’s Grid Operations Support Centre and National Grid Service Core Components of the UK’s e-Infrstructure Neil Geddes Director, GOSC All Hands Meeting,
Dr Neil Geddes CCLRC Head of e-Science Director of the UK Grid Operations Support Centre.
Stephen Pickles Technical Director, Grid Operations Support Centre University of Manchester Neil Geddes CCLRC Head of e-Science Director of the UK Grid.
RAL Site Report Andrew Sansum e-Science Centre, CCLRC-RAL HEPiX May 2004.
São Paulo Regional Analysis Center SPRACE Status Report 22/Aug/2006 SPRACE Status Report 22/Aug/2006.
SEEK Welcome Malcolm Atkinson Director 12 th May 2004.
The National Grid Service Mike Mineter
GridPP Building a UK Computing Grid for Particle Physics Professor Steve Lloyd, Queen Mary, University of London Chair of the GridPP Collaboration Board.
Next Steps: becoming users of the NGS Mike Mineter
Ruth Pordes November 2004TeraGrid GIG Site Review1 TeraGrid and Open Science Grid Ruth Pordes, Fermilab representing the Open Science.
Michael Doherty RAL UK e-Science AHM 2-4 September 2003 SRB in Action.
Next Steps.
The National Grid Service Mike Mineter.
17/1/20051 NGS Status Stephen Pickles Technical Director, GOSC (with thanks to Andy Richards, NGS Co-ordinator) CERN, 17/1/2005
1 e-Science AHM st Aug – 3 rd Sept 2004 Nottingham Distributed Storage management using SRB on UK National Grid Service Manandhar A, Haines K,
HEP SYSMAN 23 May 2007 National Grid Service Steven Young National Grid Service Manager Oxford e-Research Centre University of Oxford.
December 26, 2015 RHIC/USATLAS Grid Computing Facility Overview Dantong Yu Brookhaven National Lab.
1 The National Grid Service: An Overview Stephen Pickles University of Manchester Technical Director, GOSC Towards an NGS User Induction Course, NeSC,
An Introduction to UK e-Science Anne E Trefethen Deputy Director UK e-Science Core Programme.
Rob Allan Daresbury Laboratory NW-GRID Training Event 26 th January 2007 Next Steps R.J. Allan CCLRC Daresbury Laboratory.
The National Grid Service Mike Mineter.
The National Grid Service Mike Mineter
The Storage Resource Broker and.
The National Grid Service User Accounting System Katie Weeks Science and Technology Facilities Council.
Neil Geddes CCLRC Head of e-Science Director of the UK Grid Operations Support Centre.
National Grid Service and EGEE Dr Andrew Richards Executive Director NGS e-Science Department, CCLRC.
RC ICT Conference 17 May 2004 Research Councils ICT Conference The UK e-Science Programme David Wallace, Chair, e-Science Steering Committee.
UK Grid Operations Support Centre All slides stolen by P.Clarke from a talk given by: Dr Neil Geddes CCLRC Head of e-Science Director of the UK Grid Operations.
1 eScience Grid Environments th May 2004 NESC - Edinburgh Deployment of Storage Resource Broker at CCLRC for E-science Projects Ananta Manandhar.
CNAF - 24 September 2004 EGEE SA-1 SPACI Activity Italo Epicoco.
Operations Support for the UK National Grid Service
Bob Jones EGEE Technical Director
Next Steps.
White Rose Grid Infrastructure Overview
UK Grid: Moving from Research to Production
Stephen Pickles Technical Director, GOSC
Overview of IPB responsibilities in EGEE-III SA1
NGS Oracle Service.
The National Grid Service
The National Grid Service Mike Mineter NeSC-TOE
Presentation transcript:

The UK National Grid Service Andrew Richards – CCLRC, RAL

History  Pre NGS L2G – Level 2 Grid deployed Easter 2003 –contains members from each of the ten UK e-Science Centres and CCLRC plus Centres of Excellence Requirement for dedicated resources  Rollout of NGS NGS Evaluation and Installation May > December 2003 Pre-Production use Started April 2004 (‘Early Bird Users’) Full Production Started – September 2004 (All Hands Meeting 2004 – Nottingham)

Funding –JISC funded £1.06M Hardware ( ) Oxford, White Rose Grid (Leeds) - Compute Cluster Manchester – Data Cluster E-Science Centre funded 420k for additional Data Cluster –JISC funded £900k staff effort including 2.5SY at CCLRC e-Science Centre The e-Science Centre leads and coordinates the project for the JISC funded clusters

Objectives Build on recent advances in grid technology to offer a stable highly available production quality grid service Interoperability with other grids such as those deployed by the Enabling Grids for e- Science in Europe (EGEE) project and the LHC Computing Grid (LCG) To provide the broad user community with access to large scale resources through the grid interface To meet users’ evolving requirements for a production grid service by working with the user community, through the User Group established by the Core Programme To cooperate effectively with the Engineering Task Force and other teams

NGS Today

NGS “Tomorrow” Grid Operation Support Centre Web Services based National Grid Infrastructure

UK e-Infrastructure

NGS Hardware Compute Cluster 64 dual CPU Intel 3.06 GHz (1MB cache) nodes 2GB memory per node 2x 120GB IDE disks (1 boot, 1 data) Gigabit network Myrinet M3F-PCIXD-2 Front end (as node) Disk server (as node) with 2x Infortrend 2.1TB U16U SCSI Arrays (UltraStar 146Z10 disks) PGI compilers Intel Compilers, MKL PBSPro TotalView Debugger RedHat ES 3.0 Data Cluster 20 dual CPU Intel 3.06 GHz nodes 4GB memory per node 2x120GB IDE disks (1 boot, 1 data) Gigabit network Myrinet M3F-PCIXD-2 Front end (as node) 18TB Fibre SAN ( Infortrend F16F 4.1TB Fibre Arrays (UltraStar 146Z10 disks) PGI compilers Intel Compilers, MKL PBSPro TotalView Debugger Oracle 9i RAC Oracle Application server RedHat ES 3.0

NGS Software

NGS Database Service Database Service on CCLRC – RAL and Manchester Sites Oracle 9i RAC (hold license for 10g if/when required) Using OCFS Oracle Application Server 5 node Clustered Database Single node Database for SRB Use of Transparent Application Failover (TAF)

NGS SRB Single instance Oracle 9i for MCAT at CCLRC – RAL, duplicated at Manchester SRB Version 3.2.1, using GSI authentication mechanisms SRB vaults at each of the NGS core sites Single NGS zone for core nodes –Option to use Federation for other zones.

Monitoring BDII Ganglia Nagios

GITS Testing

User Support

NGS Portal

User Registration

‘Early Bird’ Users April 2004

Example Users Projects e-Minerals e-Materials Orbital Dynamics of Galaxies Bioinformatics (using BLAST) GEODISE project UKQCD Singlet meson project Census data analysis MIAKT project e-HTPX project. RealityGrid (chemistry) Users Leeds Oxford UCL Cardiff Southampton Imperial Liverpool Sheffield Cambridge Edinburgh QUB BBSRC CCLRC

User Registration (Process) User Applies (Via Website) Application Submitted to Peer Review Panel Application QC Approved ? Rejected (User Notified) Accepted (User Notified) User added to NGS VO (includes SRB account) User added NGS-USER and NGS-ANNOUNCE Mailing lists

User Example EVE Excitations and Visualisation Project GODIVA Diagnostics Study of Oceanography Data Integrative Biology Simulation of Strain in Soft Tissue under Gravity

Production Status TODAY 4 new core nodes operational 125 Users registered (25 since 1 September ’04) Grid enabled – Globus v2 (VDT distribution v1.2) at present BDII information service (GLUE + MDS Schemas) Data Services – Oracle and SRB Growing base of user applications MyProxy and CA services provided by UK Grid Support Centre VO Management Software – LCG-VO User support: Helpdesk Next… Other Middleware [gLite/OMII etc…] NGS Portal Resource Broker SRB production service

Contact Information NGS Grid Coordinator Andrew Richards: NGS Website Helpdesk (via Grid Support Centre)