1. Turin, IT-CZ JRA1 meeting, 4-5 Nov 2004
Datamat Status Report F. Pacini, G. Avellino Datamat S.p.a. M. Pappalardo INFN CT
EGEE is a project funded by the European Union under contract IST

2. Contents
gLite ‘ported’ UI/GUI/API
UI on afs
WMProxy
Status

3. gLite ‘ported’ UI/GUI (1/3)
Python CLI
Ported to gLite
Installation Guide and rpms available
Tested internally with success
Java GUI
rpms available
Installation Guide ready
Not yet ‘officially’ released due to a seg fault when calling the LB RegisterJob (stack trace circulated on IT/CZ list this week)
Holub not yet integrated as on-going testing is still showing some problems

4. gLite ‘ported’ UI/GUI (2/3)
C++ API (integration with GAS)
Ported to gLite
Installation Guide and rpms available
Usage notes and examples ready
Currently under testing
Works fine for simple jobs and DAGs
Facing problems with the JobCollection (not occurring with the API build from infnforge)
As soon as the JobCollection problem is fixed we’ll pass the stuff to Alien people

5. gLite ‘ported’ UI/GUI (3/3)
UI on afs
edg UI currently available
Planning to pass to the gLite UI in order to ease maintenance
different command naming
difficult two keep the two UI “synchronized”
need more space on afs (at least doubled) to work it in parallel
Can we ask for it?

6. Other activities Matchmaking XML schema for JDL
Just started (this week) to work on the “Strategy Module developer toolkit”
Planned collaboration/meetings with S. Monforte on this
WS-based MM
Issues with ISM
XML schema for JDL
Work on this will re-start after Padova meeting

7. WMProxy (1/8) Main Steps followed:
Identification of the operations to provide (job submition split into a sequence of operations: registration and start)
WS-I compliant WSDL description (now rpc/literal, SHOULD be document/literal)
Implementation of the WMProxy “core” to be independent from the Application Server used
Implementation of the “fault mechanism” with a general WS base fault type as addressed by WS-BaseFaults specifications
Tried gSoap versions: 2.6.0, and 2.7.0
Still some minor issues with namespaces
Can not keep current naming scheme (e.g. glite::wms::wmproxy)

8. WMProxy (2/8)
Current prototype runs as a fastCGI script in an Apache + GridSite container
FastCGI is a language independent, scalable, open extension to CGI that provides high performance and persistence without the limitations of server specific APIs
FastCGI applications use TCP or Unix sockets to communicate with the web server
Faster than CGI: FastCGI applications are persistent. There is no per-request startup and initialization overhead
Abandoned mod_gsoap as it is not maintained by the gSoap team and it has not yet been released Apache 2

9. WMProxy (3/8)
AuthN
Pure SSL clients presenting a X509 proxy credential
mod_gridsite takes care of the client authentication
credential related information are passed to the service through environment variables
Tests successfully carried out with standard proxies
GridSite does not currently support proxies from recent versions of VOMS
A. McNab is working on this

10. WMProxy (4/8) AuthZ User mapping Plans to use LCAS
Will start next week
GridSite provides support for GACL
Could it be enough?
User mapping
Plans to use LCMAPS

11. WMProxy (5/8) Delegation
GridSite provide a cgi script and library for this
cgi tested successfully
Lib tests on-going
Puts delegated credentials in <ServerRoot>/proxycache/
Delegation has to be done before job registration
A delegated proxy identified by a delegationId can be associated to different jobs
Changed jobRegister to take delegationId as input
jobRegister(JDL, delegationId)
WMProxy needs to manage delegated proxies and keep the association to jobs
Associate to each job a copy of the delegated proxy
Link each job to the same proxy file
jobId  delegationId association logged to the LB

12. WMProxy (6/8) Input/Output Sandboxes
ISB extended to allow specification of file located on a remote gridftp server
OSB extended to allow specification of file located on a remote gridftp server
This is done for JDL lib, WMProxy
Needs modifications to the JobWrapper: shall/can we do them?
The mechanism for creating the job-related directories on the WMS node has to be changed
The code should be there already
GridSite provides client/server side libraries for transferring files over https
Currently testing it

13. WMProxy (7/8) Bulk Submission Collections, parametric jobs
Need DAG support in WM
Shared sandbox supported
Needs modification to the JobWrapper
JDL converters written and partially tested
The ‘original’ JDL is always logged to the LB
Converter for partitionable jobs need to be modified to remove dependency from checkpointing

14. WMProxy (8/8) Interaction with LB APIs/Clients
Will rely on LBProxy for logging/querying job info whenever possible
Some details still need to be clarified
APIs/Clients
Successfully tested simple gSoap C++ clients
Will start next week activity on Axis Java clients
Started having a look at SOAPy and to M2Crypto (swig wrapper for OpenSSL)

15. Status (DTMT)
getVersion, jobCancel, getMaxInputSandboxSize, getSandboxDestURI, getTotalQuota, getFreeQuota, jobPurge, getOutputFileList,jobStart and jobSubmit
are done, to be tested
jobRegister
is done and tested for Normal Job and Dag.
to be tested for other kinds of job
jobListMatch
is done, to be tested
this operation is under new implementation in WMProxy “core”

16. Status (DTMT)
getJobTemplate, getCollectionTemplate, getIntParametricJobTemplate, getStringParametricJobTemplate
almost done, API methods for parametric jobs are to be implemented and tested
Work on delegation management started only very recently as the GridSite stuff wasn’t available before
Most of work still to be done for AuthZ/Mapping

17. Status (CT) WMProxy “core”
WMPManager built. AFA concerns new architectural design, objects are written and compiled.
Code WILL NOT build [or at least WILL SEG_FAULT] until all refences to GSISockets objects in Command, CommandFactories and satellite classes are removed.
Tests:
Execution reaches new WMPManager from gSoap server and tries to dispatch command to converted Managers and Dispatchers.
Obviously process seg-faults or dies due to null sockets, wrong client-server and vice-versa command serialization or empty references to old objects.

18. Status (CT) WM Proxy “core” development status
New code mostly completed
Most of the work still to be done for old code stripping and testing
Other activities carried out:
LCG bug Fixing
Grid.it support
Development of new JobListMatch