Author - Title- Date - n° 1 Partner Logo WP5 Status John Gordon Budapest September 2002

John Gordon – EDG Budapest Workshop 2 Summary u Status of TB1.2 u Near future u Status of TB2 u Future developments u Issues

John Gordon – EDG Budapest Workshop 3 Status of TB1.2 u GDMP staging to MSS - CERN, Lyon, RAL, (NIKHEF/SARA) u manual staging to MSS - CERN, Lyon, RAL, (NIKHEF/SARA) u local direct MSS access – CERN, Lyon, (RAL, NIKHEF/SARA) u Grid authorisation for local direct MSS access – CERN, Lyon u Command line interface to SE metadata u User can interrogate total free space on SE, not per VO u RB cannot schedule to CE near SE with a certain amount of free space

John Gordon – EDG Budapest Workshop 4 Near future (ie pre TB2.0) n GLUE s SE schemas drafted based on existing EDG one s Chance to add improvements s Need more discussion with other m/w WPs n SE auto staging s So user doesn’t have to manually stage new files in GDMP n SE disk space management s Housekeeping to keep disk space available on TB1.2 SE n GetSECosts s File access time estimates for Optor (WP2) s TB1.3 exists. To be integrated with Optor.

John Gordon – EDG Budapest Workshop 5 Summary of SE service u Release 1.0 (demo end Sept, quality end Oct) n Control Interface to handle registration, pinning, reservation(*), staging MSS->disk, ACLs n Implemented on disk and at least Castor u Release 2.0 (end Nov) n More MSS support - Lyon, RAL, SARA, (WP9, WP10) n Tarballs – allows writing large number of small files to MSS in efficient manner n Disk Cache management n Direct GridFTP access to Castor (omit SE disk cache) Direct GridFTP access to Castor u Release 3.0 (end Dec) n GridFTP done through SE s Supporting arbitrary MSS s ACLs applied to transfers too s Date less certain – still investigating several server solutions n RFIO through SE n Posix I/O through SE s should remove need for NFS with subsequent increased robustness, efficiency and allow true space reservation

John Gordon – EDG Budapest Workshop 6 SE Release SE ‘service manager’ will provide basic subset of SRM functionality s Get and Put, possibly Copy s For MSS, Get results in file being staged to disk 2. Hierarchical directory structure possible even if MSS is flat 3. SE filenames can be longer than underlying MSS 4. Remote access to staged files using GridFTP s Thus provides GridFTP access to MSS (in Castor at least) 5. ACL control of access through SE using GACL Combination of 1 and 4 above used by RLS and/or users

John Gordon – EDG Budapest Workshop 7 SE Example in Release 1.0 u User has LFN existing in SE u User pins file u SE (brings it on to disk and) returns URL where it can be found u User uses GridFTP to transfer file (to any site) u OR user accesses file directly (eg by NFS from local job only)

John Gordon – EDG Budapest Workshop 8 Migration Plan u Timing Driven by WP2 u SE 1.0 will allow ReplicaLocationService to transfer files between SEs including MSS (at least Castor) u Register existing files in SE, PFN in RC/RLS unchanged u GDMP can stop staging files to MSS u SE has choice of staying as disk-only SE or becoming cache for MSS u Can then move SE files to MSS and register MSS files in RLS

John Gordon – EDG Budapest Workshop 9 Future developments u RG-GMA information provider u Quotas u OGSA u Further SRM functionality u slashGrid

John Gordon – EDG Budapest Workshop 10 Questions/Problems (1) u Space reservation n API for reservation exists… n …but cannot be honoured unless all access is via SE n this requires Posix I/O in future. n SE-only access may never be acceptable to local site n Current solution is best-efforts reservation – SE will not allow reservation if space does not exist. Could return ‘quality of reservation’ (eg fraction of freespace reserved)

John Gordon – EDG Budapest Workshop 11 Questions/Problems (2) u Authorisation n Is VOMS sufficient? n SE can use LCAS functions in similar way to EDG gatekeeper n We allow ACLs and can set up a standard set for standard roles but who applies them and how are they managed externally? n Replicas seem clear enough but not other files u How does our model of different software at different sites fit with the EDG Software Release Model u How do we handle external packages in the new regime?