Presentation is loading. Please wait.

Presentation is loading. Please wait.

The DataGrid Project NIKHEF, Wetenschappelijke Jaarvergadering, 19 December 2002

Similar presentations


Presentation on theme: "The DataGrid Project NIKHEF, Wetenschappelijke Jaarvergadering, 19 December 2002"— Presentation transcript:

1 The DataGrid Project http://www.eu-datagrid.org/ NIKHEF, Wetenschappelijke Jaarvergadering, 19 December 2002 http://www.dutchgrid.nl

2 Presentation “a quatre mains” NIKHEF, Wetenschappelijke Jaarvergadering, 19 December 2002 EDG and the testbedKors Job submission (slides)Jeff Job submission (hands on)David 100 Atlas jobs on the GridStan …… and all this in 20’

3 The Project status  at 2/3 of its lifetime  second EU review February 4 and 5 2003  writing started on a follow-up project in the 6 th FP for 2005  LHC has accepted grid technology for its computing challenge: LCG  EDG software release 1.4 on the testbed  on the testbed: CERN, CNAF, CCIn2P3, NIKHEF, RAL prime sites  currently stress tested by Atlas and CMS with their prod.programs  others, D0, Earth Observ, biologists, etc. are testing as well  EDG tutorials given everywhere, last week at NIKHEF

4 What we will show you  the layout of the testbed  how to submit a job on the Grid  what modules/services are involved in job submission  how to get/look at the output of your job  how to deal with in- and output- files  Security is very important, but will not be shown  We assume Authentication and Authorisation are done  Once authorised a user can access all resources on the grid  Authentication: once a year, Authorisation: once per session

5 Current EDG Testbed CERN Lyon RAL ManchesterNIKHEF Reference site CERN Testbed1 EDG sites NorduGrid 21 sites 8 sites are in Europe About 340 machines are available. Some of them are dual processor. Some machines are only used for EDG. They are split into: - Production - Development NorduGrid is as a Grid infrastructure in the Nordic countries CNAF Tutorial and Core site

6 A 3 Tier Architecture ClientApplication Server Data Server Request Result Data Request User Interface Computing Element/ Worker Nodes Storage Element On the EDG testbed:

7 EDG Logical Machine Types 1.User Interface (UI) 2.Resource Broker (RB) 3.Information Service (IS) 4.Computing Element (CE) n Gatekeeper (Front-end Node) n Worker Nodes (WN) 5.Storage Element (SE) 6.Replica Catalog (RC)

8 Job Submission Scenario UI JDL Logging & Bookkeeping (LB) Resource Broker (RB) Job Submission Service (JSS) Storage Element (SE) Compute Element CE) Information Service (IS) Replica Catalogue (RC)

9 A Job Submission Example UI JDL Logging & Bookkeeping (LB) Resource Broker (RB) Job Submission Service (JSS) Storage Element (SE) Compute Element (CE) Information Service (IS) Replica Catalogue (RC) Job Submit Event Input Sandbox Job Status submitted

10 A Job Submission Example UI JDL Logging & Bookkeeping (LB) Resource Broker (RB) Job Submission Service (JSS) Storage Element (SE) Compute Element (CE) Information Service (IS) Replica Catalogue (RC) Job Status submitted waiting

11 A Job Submission Example UI JDL Logging & Bookkeeping (LB) Resource Broker (RB) Job Submission Service (JSS) Storage Element (SE) Compute Element (CE) Information Service (IS) Replica Catalogue (RC) Job Status submitted waiting ready

12 A Job Submission Example UI JDL Logging & Bookkeeping (LB) Resource Broker (RB) Job Submission Service (JSS) Storage Element (SE) Compute Element (CE) Information Service (IS) Replica Catalogue (RC) Job Status submitted waiting ready BrokerInfo scheduled

13 A Job Submission Example UI JDL Logging & Bookkeeping (LB) Resource Broker (RB) Job Submission Service (JSS) Storage Element (SE) Compute Element (CE) Information Service (IS) Replica Catalogue (RC) Job Status submitted waiting ready scheduled Input Sandbox running

14 A Job Submission Example UI JDL Logging & Bookkeeping (LB) Resource Broker (RB) Job Submission Service (JSS) Storage Element (SE) Compute Element (CE) Information Service (IS) Replica Catalogue (RC) Job Status submitted waiting ready scheduled Job Status running

15 A Job Submission Example UI JDL Logging & Bookkeeping Resource Broker Job Submission Service Storage Element ComputeElement Information Service Replica Catalogue submitted waiting ready scheduled running Job Status done Job Status

16 A Job Submission Example UI JDL Logging & Bookkeeping Resource Broker Job Submission Service Storage Element ComputeElement Information Service Replica Catalogue submitted waiting ready scheduled running done Job Status outputready Output Sandbox

17 A Job Submission Example UI JDL Logging & Bookkeeping (LB) Resource Broker (RB) Job Submission Service (JS) Storage Element (SE) Compute Element (CE) Information Service (IS) Replica Catalogue (RC) Output Sandbox cleared submitted waiting ready scheduled running done Job Status outputready

18 NIKHEF, Wetenschappelijke Jaarvergadering, 19 December 2002 The End

19 Sites Used in this Demo  CERN Production test bed n RB, II, CE, SE and a couple of worker nodes  CNAF Bologna n CE, SE and worker nodes  Rutherford Appleton Lab (GridPP) n CE, SE and worker nodes  CC IN2P3 Lyon n CE and worker nodes  NIKHEF n UI, CE, SE, worker nodes, Replica Catalogue

20 Local Application Test Bed ui02 (a.k.a. tbn08) ce0 2 node18-*.farmnet.nikhef.nl se02 edgmds.dutchgrid. nl lxshare0382 grid-vo.nikhef.nl RC application test bed ui01,ce01, se01 RB IS CERN


Download ppt "The DataGrid Project NIKHEF, Wetenschappelijke Jaarvergadering, 19 December 2002"

Similar presentations


Ads by Google