1. Grid Interoperability
08/05/2018
05/10/2007
Dominique Boutigny
Grid Interoperability
Track: Comp_3
Workshop FJPPL'07

2. Introduction to the Grid model
08/05/2018
Introduction to the Grid model
Nowadays the Grid concept is unavoidable for any application needing significant computing resources
Grid allows to share CPU and storage from several sites operating heterogeneous hardware and software
The software layer which allows sites to exchange computing tasks through the grid is called "Middleware"
A grid can be
CPU oriented (SETI / BOINC)
Data oriented (Storage Resource Broker)
Both (EGEE – W-LCG)
D. Boutigny
05/10/2007

3. The W-LCG grid model T1 (11) T0 T3 (many) T2 (~100) Annecy ICEPP
08/05/2018
The W-LCG grid model
Annecy
ICEPP
Marseille
TRIUMF
FZK
CC-IN2P3
Nantes
T3 (many)
T1 (11)
RAL
ASCC
CNAF
Île de France T0
Brookhaven
PIC
T2 (~100)
NIKHEF
Lyon
Fermilab
NDGF
Strasbourg
Clermont
D. Boutigny
05/10/2007

4. 08/05/2018
Many kind of Grids
The Global Grid Forum web site is mentioning ~45 major different grid organizations
W-LCG is federating resources from 3 different Grids:
EGEE (Europe + Asia + Canada)
OSG (US)
NorduGrid (Nordic countries)
NAREGI (Japan - ?)
Having 1 single grid is unrealistic
One has to deal with several Grids and provide interoperability
From the user point of view
From the sites' point of view
NAREGI (National Research Grid Initiative) is a Grid being developed in Japan
D. Boutigny
05/10/2007

5. 08/05/2018
Project presentation
The LIA "Comp_3" project is proposing to work toward Grid Interoperability
Was an accepted project for the 2006 call
We propose to extend the project for 2007
Work will concentrate mainly on
EGEE / NAREGI interoperability
Crucial for ILC
Will become important for LHC
NAREGI is a huge effort in Japan, and will certainly become a piece of the W-LCG organization
SRB / iRODS data grid (see later)
Implementation
Development
Interoperability with EGEE / NAREGI
NAREGI: billion Yen Extended up to 2009
D. Boutigny
05/10/2007

6. Members Japan France S. Kawabata T. Sasaki G. Iwai K. Murakami Y. Iida
08/05/2018
Members
Japan
S. Kawabata
T. Sasaki
G. Iwai
K. Murakami
Y. Iida
France
D. Boutigny
S. Reynaud
F. Hernandez
J.Y. Nief
D. Boutigny
05/10/2007

7. Activities during the first year
08/05/2018
Activities during the first year
2 workshops
3 days in September 2006 in Lyon – 6 people from Japan
4 days in February 2007 at KEK – 5 people from France
D. Boutigny
05/10/2007

8. 08/05/2018
NAREGI at KEK
Watase-san installed and is maintaining NAREGI middleware at KEK
NAREGI is based on Grid standards defined at the OGF (Open Grid Forum)
NAREGI beta-1 released in May 2006 and installed at KEK
With some help from the NAREGI support team for the last stage
Compute part (6 nodes)
Data grid part (3 nodes)
Tested at KEK with P152 (heavy ions) and Belle simulation
Experience with middleware being built up
D. Boutigny
05/10/2007

9. 08/05/2018
D. Boutigny
05/10/2007

10. Next steps (from Watase-san presentation during last workshop)
08/05/2018
Next steps (from Watase-san presentation during last workshop)
Release of NAREGI b2 in May 2007
Expectations
Easy installation by apt-rpm
Stable and Robust middleware
Interoperation with EGEE/gLite
Job submission, Data exchange, Information
Customization of UI / VO portal with NAREGI Web service interface
Various useful features for application
GridFTP-APT: automatic parallel tuning for GridFTP
GridMPI: MPI jobs linking over sites
Bust job submission
Try to install LHC data processing or simulation on NAREGI
To prove usefulness even in HEP application
Release of NAREGI v. 1.0 in April-May 2008
Expand NAREGI sites to Asia, EU and US in the collaboration for its complementary features
D. Boutigny
05/10/2007

11. Interoperability between EGEE and NAREGI
08/05/2018
Interoperability between EGEE and NAREGI
2 possible approaches
Implement the GIN (Grid Interoperability Now) layer in NAREGI
Defined by the GIN group from the OGF
Short term solution in order to get the Interoperability Now !
Pragmatic approach
Work with longer term standards defined within the OGF
Develop a Meta Scheduler compatible with many Grid implementations
Based on SAGA (Simple API for Grid Applications) "Instead of interfacing directly to Grid Services, the applications can so access basic Grid Capabilities with a simple, consistent and stable API"
and JSDL (Job Submission Description Language)
D. Boutigny
05/10/2007

12. 08/05/2018
GIN
Pushed by KEK, NAREGI has done considerable efforts to implement the GIN layer
Confirmed during our visit to NAREGI in February
"Trying to identify islands of interoperation between production grids and grow those islands"
Developing an interoperation island with EGEE
Common framework for Authentication and VO management
Cross job submission between gLite/EGEE and NAREGI
Data transfer between gLite and Gfarm
Grid resource information service around the world
From NAREGI presentation in 02/07
D. Boutigny
05/10/2007

13. An example of interoperability
08/05/2018
An example of interoperability
GIN-data: Data Management and Movement
Interoperability between NAREGI and EGEE at the data level
Work also on:
GIN-auth GIN-jobs GIN-info GIN-ops
EGEE
NAREGI
NAREGI Client
SRM
Client
Gfarm
API
gLite Client
SRM Client
NAREGI
Metadata Server
LFC
(Metadata Server)
DPM
(SRM Server)
GridFTP
Server
Gfarm
Server
Storage
Storage
D. Boutigny
05/10/2007

14. The SAGA / JSDL approach
08/05/2018
The SAGA / JSDL approach
This approach is being developed at CC-IN2P3 (Sylvain Reynaud)
This interoperability tool is sharing several modules with a software layer which is being developed at CC-IN2P3 in order to easily interface our local batch system to any Grid Computing Element
D. Boutigny
05/10/2007

15. WMS SRM job JSAGA job GridFTP gLite-CE gLite-CE WS-GRAM WS-GRAM
08/05/2018
job
desc.
JDL
delegate selection
& sandbox management
job
RSL
selected
resource
sandbox
planning
JSAGA
gLite
plug-ins
Globus
plug-ins
EGEE
RUGBI
job
WMS
SRM
input
data
GridFTP
gLite-CE
gLite-CE
WS-GRAM
WS-GRAM
firewall
D. Boutigny
05/10/2007

16. Extensible via plug-ins
08/05/2018
Extensible via plug-ins
(Enterprise grid with Local Infrastructure and Services for Applications)
CoG-Core API
internal
(IS
gsiftp, file, http
security
input/output sandbox
Job submission task
Execution environment
control
monitor
(multi-users
best path,
File operation task
Web service task …
login/pwd
PKI
GSI (classic
internal
(IS, QoS, user preferences,
RSS, job-list-match, infosite, Lavoisier)
delegated,
combined
gsiftp, file, http, srm (1.1, 2.1.1), lfn, srb, mailto, worker, (gfarm?), tar, gzip)
SAGA
job desc. translator
resource selection
security
input/output
sandbox
Job submission task
Execution environment
control
monitor
to/from JSDL
(multi-users, parametric jobs, failure tolerance)
best path,
delegated
File operation task
Web service task …
login/pwd
PKI
GSI (classic, VOMS, MyProxy,
X509,
(CAS?))
OpenPlast
gatekeeper, WS-GRAM, ssh
RSL (2&4)
EGEE
CREAM, WMS, (gLite-CE?)
JDL
OSG
VDT-based CE, (Condor-G?)
(VDL?)
NAREGI
GridVM, (Super Scheduler?)
JSDL+ext.
regional
GRIA, (UNICORE?)
local
local, PBS, simulator
OpenPlast
gatekeeper, WS-GRAM, ssh
RSL (2&4)
D. Boutigny
05/10/2007

17. Next steps on NAREGI / EGEE interoperability
08/05/2018
Next steps on NAREGI / EGEE interoperability
Continue work on both directions: GIN and SAGA / JSDL
Try cross job submission on both Grid middleware
Explore data exchange between NAREGI and EGEE
D. Boutigny
05/10/2007

18. The Storage Resource Broker (SRB)
08/05/2018
The Storage Resource Broker (SRB)
SRB is relatively light data grid system developed at SDSC
Considerable experience has been gained at KEK, SLAC, RAL and CC-IN2P3
Heavily used for BaBar data transfer since years (up to 5 TB/day)
Very interesting solution to store and share biomedical data (images)
Advantages
Easy and fast development of applications
Extensibility
Reliability
Easiness of administration
D. Boutigny
05/10/2007

19. Biomedical applications using SRB
08/05/2018
Biomedical applications using SRB
MRI
Siemens MAGNETOM Sonata Maestro Class 1.5 T
DICOM
DICOM
Acquisition
DICOM
SRB
Control PC
push DICOM
Export PC (DICOM server, SRB client)
DICOM
D. Boutigny
05/10/2007

20. iRODS (iRule Oriented Data Systems ) is the SRB successor
08/05/2018
From SRB to iRODS
iRODS (iRule Oriented Data Systems ) is the SRB successor
KEK and CC-IN2P3 are both involved in iRODS developments and tests
Should bring many new functionalities
D. Boutigny
05/10/2007

21. Definition of rules and micro-services
08/05/2018
From SRB to iRODS
iRule Oriented Data Systems
Definition of rules and micro-services
Allows to fully customize the system in order to adapt it to the application
D. Boutigny
05/10/2007

22. SRB-DSI Being developed by Iida-san
08/05/2018
SRB-DSI
Being developed by Iida-san
SRB-DSI is a software layer which allows the Grid world based on Globus to interoperate with SRB
Globus world: data transfer based on GridFTP
SRB: based on its own protocol
Crucial to interoperate the LCG and SRB worlds
D. Boutigny
05/10/2007

23. The SRB-DSI architecture
08/05/2018
The SRB-DSI architecture
edg-gridftp-ls
Scommand
GridFTP
SRB Protocol
(Svr-Interconnection)
globus-url-copy
rac01
GridFTP
rls09
rls10
rsr01
globus-gridftp-server
SRB-DSI
globus-gridftp-server
SRB-DSI
globus-gridftp-server
SRB-DSI
SRB (GSI_AUTH)
SRB (GSI_AUTH)
SRB (GSI_AUTH)
MCAT
srbServer
srbServer
srbServer
POSIX I/O (LOCAL)
HPSS API I/O
POSIX I/O (LOCAL)
“rls09-hpss-hsi”
“rls10-hpss-vfs”
“rsr01-ufs”
External
Disk Sub-sys
hpssfsd
HPSS API I/O
Each DSI accesse to the following SRB resource
gsiftp://rsr01 -> rsr01-ufs
gsiftp://rls09 -> rls09-hpss-hsi
gsiftp://rls10 -> rls10-hpss-vfs
HPSS
D. Boutigny
05/10/2007

24. Next step for SRB / LCG interoperability
08/05/2018
Next step for SRB / LCG interoperability
In order to have LCG and SRB fully interoperable we need to develop an SRB / SRM interface
This will be a common area of work for KEK and CC-IN2P3 in the near future
Iida-san 8 month stay at CC-IN2P3
Then we will explore the possibility to make SRB an alternative for LCG storage
SRB / iRODS is probably a good candidate to store user's files Grid wide  An idea to be explored
D. Boutigny
05/10/2007