INFSO-RI-508833 Enabling Grids for E-sciencE EGEE and the National Grid Service Mike Mineter

Slides:



Advertisements
Similar presentations
Bringing Grid & Web Services Together
Advertisements

OMV Ontology Metadata Vocabulary April 10, 2008 Peter Haase.
Grid Tech Team Certificates, Monitoring, & Firewall September 15, 2003 Chiang Mai, Thailand Allan Doyle, NASA With the help of the entire Grid Tech Team.
18 Copyright © 2005, Oracle. All rights reserved. Distributing Modular Applications: Introduction to Web Services.
1 2 nd Shanghai, 19/02/06 Architecture for Next Generation Grids Kostas Tserpes, NTUA Shanghai, 20th of February 2006.
Designing Services for Grid-based Knowledge Discovery A. Congiusta, A. Pugliese, Domenico Talia, P. Trunfio DEIS University of Calabria ITALY
DG INFSO- Grid Research & Infrastructures: W. Boch, M. Campolargo 1 Delivery of Industrial-strength Grid Middleware: establishing an effective European.
An open source approach for grids Bob Jones CERN EU DataGrid Project Deputy Project Leader EU EGEE Designated Technical Director
GridPP July 2003Stefan StonjekSlide 1 SAM middleware components Stefan Stonjek University of Oxford 7 th GridPP Meeting 02 nd July 2003 Oxford.
Research Infrastructures for e-Science
Tony Doyle GridPP2 Proposal, BT Meeting, Imperial, 23 July 2003.
The National Grid Service Mike Mineter.
The Storage Resource Broker and.
Neil Geddes CCLRC Head of e-Science Director of the UK Grid Operations Support Centre 1.The vision Thing, recent history and Organisation 2.Roles and Relationships.
NGS computation services: API's,
NGS computation services: APIs and.
Research Councils ICT Conference Welcome Malcolm Atkinson Director 17 th May 2004.
Data services on the NGS.
The National Grid Service and OGSA-DAI Mike Mineter
Current status of grids: the need for standards Mike Mineter TOE-NeSC, Edinburgh.
SWITCH Visit to NeSC Malcolm Atkinson Director 5 th October 2004.
VO Support and directions in OMII-UK Steven Newhouse, Director.
02/07/03 Grid Support Centre 1 UK Grid Support Centre Alistair Mills CLRC e-Science Centre
OMII-UK Steven Newhouse, Director. © 2 OMII-UK aims to provide software and support to enable a sustained future for the UK e-Science community and its.
The Storage Resource Broker and.
E-Science Update Steve Gough, ITS 19 Feb e-Science large scale science increasingly carried out through distributed global collaborations enabled.
1 Chapter 11: Data Centre Administration Objectives Data Centre Structure Data Centre Structure Data Centre Administration Data Centre Administration Data.
Issues with Production Grids Tony Hey Director of UK e-Science Core Programme.
High Performance Computing Course Notes Grid Computing.
INFSO-RI Enabling Grids for E-sciencE Concepts of grid computing Guy Warner NeSC Training Team
GEODE Workshop 16 th January 2007 Issues in e-Science Richard Sinnott University of Glasgow Ken Turner University of Stirling.
The UK National Grid Service Using the NGS. Outline NGS Background Getting Certificates Acceptable usage policies Joining VO’s What resources will be.
AHM /09/05 AHM 2005 Automatic Deployment and Interoperability of Grid Services G.Kecskemeti, Yonatan Zetuny, G.Terstyanszky,
Next Steps Mike Mineter
Next Steps Guy Warner
GT Components. Globus Toolkit A “toolkit” of services and packages for creating the basic grid computing infrastructure Higher level tools added to this.
Next Steps Mike Mineter
The National Grid Service Guy Warner.
Production Grids Mike Mineter NeSC-TOE. EU project: RIO31844-OMII-EUROPE 2 Production Grids - examples 1.EGEE: Enabling Grids for e-Science 2.National.
Neil Geddes GridPP-10, June 2004 UK e-Science Grid Dr Neil Geddes CCLRC Head of e-Science Director of the UK Grid Operations Support Centre.
The UK’s Grid Operations Support Centre and National Grid Service Core Components of the UK’s e-Infrstructure Neil Geddes Director, GOSC All Hands Meeting,
Dr Neil Geddes CCLRC Head of e-Science Director of the UK Grid Operations Support Centre.
Stephen Pickles Technical Director, Grid Operations Support Centre University of Manchester Neil Geddes CCLRC Head of e-Science Director of the UK Grid.
GridPP Deployment & Operations GridPP has built a Computing Grid of more than 5,000 CPUs, with equipment based at many of the particle physics centres.
SEEK Welcome Malcolm Atkinson Director 12 th May 2004.
NA-MIC National Alliance for Medical Image Computing UCSD: Engineering Core 2 Portal and Grid Infrastructure.
The National Grid Service Mike Mineter
OGSA-UK: Putting the users first Steven Newhouse OMII Deputy Director.
GRID Overview Internet2 Member Meeting Spring 2003 Sandra Redman Information Technology and Systems Center and Information Technology Research Center National.
Ruth Pordes November 2004TeraGrid GIG Site Review1 TeraGrid and Open Science Grid Ruth Pordes, Fermilab representing the Open Science.
The National Grid Service Mike Mineter.
1 e-Science AHM st Aug – 3 rd Sept 2004 Nottingham Distributed Storage management using SRB on UK National Grid Service Manandhar A, Haines K,
HEP SYSMAN 23 May 2007 National Grid Service Steven Young National Grid Service Manager Oxford e-Research Centre University of Oxford.
1 The National Grid Service: An Overview Stephen Pickles University of Manchester Technical Director, GOSC Towards an NGS User Induction Course, NeSC,
Grid Security work in 2004 Andrew McNab Grid Security Research Fellow University of Manchester.
The National Grid Service Mike Mineter.
The National Grid Service Mike Mineter
Neil Geddes CCLRC Head of e-Science Director of the UK Grid Operations Support Centre.
UK Grid Operations Support Centre All slides stolen by P.Clarke from a talk given by: Dr Neil Geddes CCLRC Head of e-Science Director of the UK Grid Operations.
The UK National Grid Service Andrew Richards – CCLRC, RAL.
The National e-Science Centre. eSI in Edinburgh NeSC Roles National: help coordinate and lead the UK e- Science Programme Community building activities,
Operations Support for the UK National Grid Service
Next Steps.
UK Grid: Moving from Research to Production
Stephen Pickles Technical Director, GOSC
NGS Oracle Service.
The National Grid Service
The National Grid Service Mike Mineter NeSC-TOE
Grid Systems: What do we need from web service standards?
Presentation transcript:

INFSO-RI Enabling Grids for E-sciencE EGEE and the National Grid Service Mike Mineter

Enabling Grids for E-sciencE INFSO-RI EGEE and the National Grid Service EGEE Induction, 8 December 2004, NeSC 2 Acknowledgements This talk was prepared by Mike Mineter of NeSC and includes slides from talks delivered by: –Neil Geddes, GOSC Face-to-Face, NeSC, November 2004 –Andy Richards, GOSC Face-to-Face, NeSC, November 2004 –Tony Hey, AHM 2004, Nottingham,

Enabling Grids for E-sciencE INFSO-RI EGEE and the National Grid Service EGEE Induction, 8 December 2004, NeSC 3 Goals of this module To outline the National Grid Service To summarise its relationship with EGEE

Enabling Grids for E-sciencE INFSO-RI EGEE and the National Grid Service EGEE Induction, 8 December 2004, NeSC 4 Contents Snapshots of the UK e-infrastructure The UK e-Science programme The National Grid Service The NGS and EGEE

Enabling Grids for E-sciencE INFSO-RI EGEE and the National Grid Service EGEE Induction, 8 December 2004, NeSC 5 Snapshots of UK e-infrastructure The JISC view Digital curation Networks –Weve been (mainly) ignoring networks today! –A sign of their success!! Grids

6 The JISC Communities Portals Applications Content Meta Data & Delivery tools Finding /Access tools E-learning Digital librariesE-research Internet AAA Services

7 Digital Curation Centre Actions needed to maintain and utilise digital data and research results over entire life- cycle –For current and future generations of users Digital Preservation –Long-run technological/legal accessibility and usability Data curation in science –Maintenance of body of trusted data to represent current state of knowledge in area of research Research in tools and technologies –Integration, annotation, provenance, metadata, security…..

Enabling Grids for E-sciencE INFSO-RI EGEE and the National Grid Service EGEE Induction, 8 December 2004, NeSC 8 Communicating across 3 dimensions: Space and organisational boundaries: Grids Time : curation Domains of knowledge: semantics (With thanks to Peter Burnhill, EDINA)

Enabling Grids for E-sciencE INFSO-RI EGEE and the National Grid Service EGEE Induction, 8 December 2004, NeSC 9 Snapshots of UK e-infrastructure The JISC view Digital curation Networks –Weve been (mainly) ignoring networks today! –A sign of success!! Grids

10 GEANT UKLight London StarLight Chicago NetherLight Amsterdam CERN CzechLight UK Researchers Extended JANET Development Network Local Research Equipment International Point-of-Access CA*net Abilene JISC £6.5M for UKLight Lambda Network 10Gb/s 2.5Gb/s Existing connections Proposed connections

Enabling Grids for E-sciencE INFSO-RI EGEE and the National Grid Service EGEE Induction, 8 December 2004, NeSC 11 Snapshots of UK e-infrastructure The JISC view Digital curation Networks –Weve been (mainly) ignoring networks today! –A sign of success!! Grids

Enabling Grids for E-sciencE INFSO-RI EGEE and the National Grid Service EGEE Induction, 8 December 2004, NeSC 12 The UK e-Science programme Goal Where we are today Web services and Grids

Enabling Grids for E-sciencE INFSO-RI EGEE and the National Grid Service EGEE Induction, 8 December 2004, NeSC 13 The UK e-Science programme We are attempting to build an infrastructure comprised of a set of middleware services capable of supporting the dynamic 'virtual organisations' required by scientists, engineers and industry. As a shorthand for this core middleware infrastructure I often use the controversial term Grid Professor Tony Hey, September 2004 £250M UK e-Science Initiative

Enabling Grids for E-sciencE INFSO-RI EGEE and the National Grid Service EGEE Induction, 8 December 2004, NeSC 14 UK Core e-Science programme - Situation Today * Leeds Manchester * * Oxford RAL * Level-2 Grid National Grid Service * DL

Tony Hey, AHM Web Services and Grids Computing models developed for sequential machines led to the distributed object model of distributed computing represented by Java and CORBA Experience has shown that the distributed object model ties distributed entities together too tightly Resulted in fragile distributed software systems when going from LANs to WANs Replace distributed objects by services connected by one-way messages and not by request-response messages IT industry has united around Web Services

Tony Hey, AHM The Web Services Magic Bullet Web services Company A (J2EE) Company B (ONE) Company C (.Net)

Tony Hey, AHM WS-I+ profile Web Service Grids: An Evolutionary Approach WS-I Standards that have broad industry support and multiple interoperable implementations Specifications that are emerging from standardisation process and are recognised as being useful Specifications that have/will enter a standardisation process but are not stable and are still experimental

Tony Hey, AHM WS-I+ Grid Interoperability Profile WS-I identifies XSD, WSDL, SOAP, UDDI WS-I+ adds minimum additional capabilities to WS- I to allow development of Grid Services –BPEL and extensions for scientific workflows –WS-Addressing for virtualization of messaging –WS-ReliableMessaging/Reliability to provide basis for fault tolerant and efficient Grid services Expect progress in –WS-ResourceFramework – submitted to OASIS –Notification – dialogue between IT companies –Security – need to understand better relationship of Web Services and Grid approaches –Portlets – generic toolkit for portal construction

Enabling Grids for E-sciencE INFSO-RI EGEE and the National Grid Service EGEE Induction, 8 December 2004, NeSC 19 The NGS and GOSC The NGS is the core UK grid, intended for the production use of computational and data grid resources. NGS is the core service resulting from the UK's e-Science programme. NGS is supported by JISC, and is run by the Grid Operations Centre (GOC). The UK Grid Operations Support Centre is a distributed "virtual centre" providing deployment and operations support for the UK e-Science programme. The core of the GOSC is built around operation of the National Grid Service (NGS). The GOSC will support UK services for user authentication, user authorization and project organization, credential management, resource discovery, access portal and more, to be driven by the user requirements.

Enabling Grids for E-sciencE INFSO-RI EGEE and the National Grid Service EGEE Induction, 8 December 2004, NeSC 20 UK e-Infrastructure LHC ISIS TS2 HPCx + HECtoR Regional and Campus grids Users get common access, tools, information, Nationally supported services, through NGS Integrated internationally VRE, VLE, IE

U of A HPCxHPCx UofD GOSC NGS Core Nodes: Host core services, coordinate integration, deployment and support +free to access resources for all VOs. Monitored interfaces + services NGS Sites: Integrated with NGS, some services/resources available for all VOs Monitored interfaces + services NGS Connected Sites: Integrated with NGS, support for some VOs Monitored interfaces (+security etc.) RAL Oxford Leeds Man. CSARCSAR U of B U of C Commercial Provider PSRE

Enabling Grids for E-sciencE INFSO-RI EGEE and the National Grid Service EGEE Induction, 8 December 2004, NeSC 22 NGS Hardware Compute Cluster 64 dual CPU Intel 3.06 GHz (1MB cache) nodes Data Cluster 20 dual CPU Intel 3.06 GHz nodes 18TB Fibre SAN ( Infortrend F16F 4.1TB Fibre Arrays (UltraStar 146Z10 disks) Oracle 9i RAC Oracle Application server

Enabling Grids for E-sciencE INFSO-RI EGEE and the National Grid Service EGEE Induction, 8 December 2004, NeSC 23 Core NGS –VDT (Globus 2) Middleware –OGSA-DAI implementation (pre-production) –Data Services – Oracle, SRB –Various Applications… GOSC – GSC Supported services for the NGS –MyProxy Service – myproxy.grid-support.ac.uk –BDII / MDS Information Service (Production and Development) –VOM (LCG-VO) Service –Monitoring tools GOSC (GSC, NGS) Developing expertise with EGEE software / middleware – resource broker – and testing gLite NGS Middleware

Enabling Grids for E-sciencE INFSO-RI EGEE and the National Grid Service EGEE Induction, 8 December 2004, NeSC 24 Tomorrow Web Services based National Grid Infrastructure

Enabling Grids for E-sciencE INFSO-RI EGEE and the National Grid Service EGEE Induction, 8 December 2004, NeSC 25 Summary e-infrastructure is being developed and used to support knowledge creation (research), curation, and dissemination In the UK, the National Grid Service provides the middleware services that uses the network infrastructure and enables application services (computation, data, collaboration,…) NGS will interoperate with EGEE Grid Operations Support Centre is the initial source for further information