Presentation is loading. Please wait.

Presentation is loading. Please wait.

1 CHEP 2000, 10.02.2000Roberto Barbera Tests of data management services in EDG 1.2 ALICE Off-line Week, 09-13.09.2002.

Similar presentations


Presentation on theme: "1 CHEP 2000, 10.02.2000Roberto Barbera Tests of data management services in EDG 1.2 ALICE Off-line Week, 09-13.09.2002."— Presentation transcript:

1 1 CHEP 2000, 10.02.2000Roberto Barbera Tests of data management services in EDG 1.2 ALICE Off-line Week, 09-13.09.2002

2 2 Roberto Barbera Outline Data management services in EDG 1.2 GDMP 3.0 EDG RC Interface and EDG Replica Manager A useful user interface Live demo Summary and conclusions Dipartimento di Fisica dell’Università di Catania and INFN Catania - Italy ALICE Collaboration ALICE Off-line Week, 09-13.09.2002

3 3 Roberto Barbera Dipartimento di Fisica dell’Università di Catania and INFN Catania - Italy ALICE Collaboration ALICE Off-line Week, 09-13.09.2002 Data management services GDMP 3.0 (gdmp_*) Globus Replica Manager EDG Replica Catalogue Interface (edg_rc_*) EDG Replica Manager (edg-replica-manager-*) UI/GUI wrappers

4 4 Roberto Barbera Dipartimento di Fisica dell’Università di Catania and INFN Catania - Italy ALICE Collaboration Select a VO export EDG_VO=alice ; source /etc/profile.d/edg-apps.sh the variables $GDMP_CONFIG_FILE and $RC_CONFIG_FILE are correctly set Publish a file/directory gdmp_ping [-a] [-V ] –S [-r ] (Un)subscribe a SE gdmp_host_subscribe [-u] [-c] [-V ] –S -r Copy a local file to a SE globus-url-copy file:/// gsiftp:// / / / GDMP 3.0 (1) ALICE Off-line Week, 09-13.09.2002

5 5 Roberto Barbera Dipartimento di Fisica dell’Università di Catania and INFN Catania - Italy ALICE Collaboration Register a file/directory on the local catalogue gdmp_register_local_file –R [–S ] [-V ] -p / / gdmp_register_local_file –R [–S ] [-V ] -d / / Publish the local catalogue on the RC gdmp_publish_catalogue –C [-V ] [-S ] Replicate a file between two SE’s gdmp_replicate_get –C [-V ] –S -r gdmp_replicate_put –C [-V ] –S -r Remove a file locally and from the RC gdmp_remove_local_file –p / [-V ] [-S ] GDMP 3.0 (2)

6 6 Roberto Barbera Dipartimento di Fisica dell’Università di Catania and INFN Catania - Italy ALICE Collaboration Pros: no need to transmit a proxy with a job can manage both single files and entire directories works in a client-server mode; commands can be issued from UI’s and WN’s and go directly to SE’s Cons: if one of the two services dies the connection breaks registration and publication are asynchronous operations in the next versions of the DataGrid m/w will be replaced by Reptor which will use the Replica Manager API’s Documentation: http://project-gdmp.web.cern.ch/project-gdmp/ GDMP 3.0 (3) ALICE Off-line Week, 09-13.09.2002

7 7 Roberto Barbera Dipartimento di Fisica dell’Università di Catania and INFN Catania - Italy ALICE Collaboration Add and register a local file on the RC edg-replica-manager-copyAndRegisterFile –l -s / / -d / / / [-e] Get the PFN(s) of a LFN edg_rc_getPhysicalFileNames –l Replicate a file between two SE’s edg-replica-manager-replicateFile –l -s / / / -d / / / [-e] Delete a file (both LFN and PFN) edg-replica-manager-deleteFile –l -s / / / EDG RC Interface and EDG Rep. Manager (1)

8 8 Roberto Barbera Dipartimento di Fisica dell’Università di Catania and INFN Catania - Italy ALICE Collaboration Pros: there is no client-server architecture and the commands are executed immediately all the needed commands are there Cons: the syntax is a bit ugly to remember (“-” in edg-replica-manager-* and “_” in edg_rc_*) the error messaging/trapping/handling is quite poor the current version can manage only single files and not entire directories Documentation: http://marianne.in2p3.fr/datagrid/documentation/EDG-Users- Guide.html http://marianne.in2p3.fr/datagrid/documentation/EDG-Users- Guide.html ALICE Off-line Week, 09-13.09.2002 EDG RC Interface and EDG Rep. Manager (2)

9 9 Roberto Barbera Dipartimento di Fisica dell’Università di Catania and INFN Catania - Italy ALICE Collaboration Developed by Andrea Sciabà from CMS on top of edg-replica- manager-* and edg_rc_* commands All commands can be found in one single TAR ball: /afs/infn.it/project/cms/grid/edg-utils.tar Set the default VO once and for all with the command: ln –s $RC_CONFIG_FILE $HOME/.rcrc The following commands are available: edg-ls edg-cd edg-pwd edg-l2p edg-cat edg-put edg-rm edg-copy (will be implemented soon) Documentation: edg- -h gives an usage help of A useful User Interface

10 10 Roberto Barbera Dipartimento di Fisica dell’Università di Catania and INFN Catania - Italy ALICE Collaboration ALICE Off-line Week, 09-13.09.2002

11 11 Roberto Barbera Conclusions and plans Dipartimento di Fisica dell’Università di Catania and INFN Catania - Italy ALICE Collaboration Compared to 1.1.4, data management in EDG version 1.2 has done a big step forward in a very short amount of time Things are not ideal: commands are still quite fragile (poor error trapping and handling) and the syntax is ugly but now all the basic functionality is there and one can really see the grid storage as an extension of the local file system Good UI/GUI are already available and really make the life of non-expert users much easier It’s now time to stress the EDG RC and measure its performances Next tests will now concern MSS interface in EDG ALICE Off-line Week, 09-13.09.2002


Download ppt "1 CHEP 2000, 10.02.2000Roberto Barbera Tests of data management services in EDG 1.2 ALICE Off-line Week, 09-13.09.2002."

Similar presentations


Ads by Google