1. CERN – Roberta Faggian Marque, Jan Fiete Grosse-Oetringhaus GRACE General Meeting, September 2004, Brussels 1 D6.1 Integration with the European DataGrid Infrastructure Roberta Faggian Marque, Jan Fiete Grosse-Oetringhaus (CERN) GRACE General Project Meeting Brussels, 20-21 September 2004

2. CERN – Roberta Faggian Marque, Jan Fiete Grosse-Oetringhaus GRACE General Meeting, September 2004, Brussels 2 D6.1 Table of Contents 1.Introduction 2.Setting the Scene 3.Infrastructure 4.Toolkit 5.Content Sources 6.Conclusions 7.Annexes 8.Glossary 9.References Describe risks, difficulties encountered and major decisions taken Describe the activity performed in collaboration with EDG/EGEE projects

3. CERN – Roberta Faggian Marque, Jan Fiete Grosse-Oetringhaus GRACE General Meeting, September 2004, Brussels 3 D6.1 Setting the Scene 1.Grid Computing 2.The EDG project 3.The EGEE project 4.WP6 Activity 1.Planning 2.Risks identification and management 3.Major decisions taken 4.Collaborations (EDG/EGEE)

4. CERN – Roberta Faggian Marque, Jan Fiete Grosse-Oetringhaus GRACE General Meeting, September 2004, Brussels 4 D6.1 Planning Pag. 13

5. CERN – Roberta Faggian Marque, Jan Fiete Grosse-Oetringhaus GRACE General Meeting, September 2004, Brussels 5 D6.1 Risks Pag. 15

6. CERN – Roberta Faggian Marque, Jan Fiete Grosse-Oetringhaus GRACE General Meeting, September 2004, Brussels 6 D6.1 Major decisions taken 1.Middleware: Usage of LCG2 2.Infrastructure: Integration with GILDA

7. CERN – Roberta Faggian Marque, Jan Fiete Grosse-Oetringhaus GRACE General Meeting, September 2004, Brussels 7 2002 2003 2004 2005 Dec02 Mar03 May03 Jun03 Sep03 EDG technical coordinator presents EDG mw architecture at the GRACE Project Meeting EDG technical coordinator update on EDG rel2 status at the GRACE Project Meeting Participation in the EDG tutorial Support from EDG WP representatives through GRACE Bulletin Board GRACE architecture designed on EDG mw components Review of the architecture doc by EDG ATF representative GRACE technical workshop: architecture review with EDG ATF representative & technical coordination; discussion on open issues GRACE architecture presented at the EDG Project Conference in Heidelberg to ATF Testbed installation started in Turin Oct03 Public discussion mailing-list setup Nov03 Participation in the EDG tutorial Contacts with EGEE representatives Sep02 Requirements Design Validation Evaluation Deployment Basic Tests Implementation Verification Feb05 EDG presentation Update on EDG2 Architecture design study Architecture design review Technical workshop Testbed installation Testbed discussion EGEE first contacts D6.1 Collaborations

8. CERN – Roberta Faggian Marque, Jan Fiete Grosse-Oetringhaus GRACE General Meeting, September 2004, Brussels 8 2002 2003 2004 2005 Jan04 Feb04 Mar04 Apr-May04 Jun04 GLOBUS Grid portal presentation and technical discussion on the implementation Contacts with ARDA and LCG Contact with INFN executive board and technical board Conference calls and technical discussions with INFN representatives on GRACE infrastructure integration Participation to EGEE project presentation and induction course Contacts with EGEE representatives, NA4 and GILDA members, discussion on infrastructure integration Integration in GILDA, usage of a support mailing list for discussion on technical issues Feedback provided informally Participation at the EGEE EGAAP meeting Conference calls with NA4/GILDA on integration issues Jul04 Participation to the EGEE induction course and NA4 open meeting Conference call with NA4/GILDA on grid certification issue, definition of GRACE requirements Aug-Sep04 Position paper on IR over the Grid and D6.1 description of EGEE-GRACE collaboration Collaboration for middleware update Sep02 Requirements Design Validation Evaluation Deployment Basic Tests Implementation Verification Feb05 Grid portal discussions Collaboration with INFN Collaboration with EGEE Integration in GILDA and feedback Collaboration with NA4 and GILDA Collaboration and requirements Feedback to EGEE D6.1 Collaborations

9. CERN – Roberta Faggian Marque, Jan Fiete Grosse-Oetringhaus GRACE General Meeting, September 2004, Brussels 9 D6.1 Table of Contents 1.Introduction 2.Setting the Scene 3.Infrastructure 4.Toolkit 5.Content Sources 6.Conclusions 7.Annexes 8.Glossary 9.References

10. CERN – Roberta Faggian Marque, Jan Fiete Grosse-Oetringhaus GRACE General Meeting, September 2004, Brussels 10 D6.1 Infrastructure 1.Integration with the Grid (GILDA) 2.Sites testing (certification) 3.Conclusions A big effort was necessary for setting up the infrastructure mainly due to the transition from EDG to EGEE and different middleware releases. With the effective support of EGEE NA4 team the set up and integration of GRACE grid nodes was completed successfully.

11. CERN – Roberta Faggian Marque, Jan Fiete Grosse-Oetringhaus GRACE General Meeting, September 2004, Brussels 11 D6.1 Table of Contents 1.Introduction 2.Setting the Scene 3.Infrastructure 4.Toolkit 5.Content Sources 6.Conclusions 7.Annexes 8.Glossary 9.References

12. CERN – Roberta Faggian Marque, Jan Fiete Grosse-Oetringhaus GRACE General Meeting, September 2004, Brussels 12 D6.1 Toolkit 1.Integration with the Grid (GRACE Grid jobs) 2.Testing (integration tests and performance tests) 3.Conclusions GRACE Grid components have been integrated with EGEE mw, “easy-deployment” solution has been adopted, integration tests performed by testval group, performance considerations

13. CERN – Roberta Faggian Marque, Jan Fiete Grosse-Oetringhaus GRACE General Meeting, September 2004, Brussels 13 D6.1 Table of Contents 1.Introduction 2.Setting the Scene 3.Infrastructure 4.Toolkit 5.Content Sources 6.Conclusions 7.Annexes 8.Glossary 9.References

14. CERN – Roberta Faggian Marque, Jan Fiete Grosse-Oetringhaus GRACE General Meeting, September 2004, Brussels 14 D6.1 Content Sources 1.Definition of the CSs of interest for GRACE 2.CSs configuration (see list) 3.CSs configuration tests (automatic scripts) 4.Conclusions Risk of not having enough CS for Computing and Engineering KDs (subscription mechanism not implemented), it has been decided to concentrate on General and Physics KDs

15. CERN – Roberta Faggian Marque, Jan Fiete Grosse-Oetringhaus GRACE General Meeting, September 2004, Brussels 15 D6.1 Missing parts 1.Final performance tests (started last Friday) and considerations

16. CERN – Roberta Faggian Marque, Jan Fiete Grosse-Oetringhaus GRACE General Meeting, September 2004, Brussels 16 GRACE Grid Jobs Testing in GILDA Tests in GILDA testbed (LCG 2.0/2.2) Sandra Application: Includes Text Normalizing and Categorizing One job per search Application submitted in the InputSandbox

17. CERN – Roberta Faggian Marque, Jan Fiete Grosse-Oetringhaus GRACE General Meeting, September 2004, Brussels 17 GRACE Grid Jobs Performances (un-optimized)

18. CERN – Roberta Faggian Marque, Jan Fiete Grosse-Oetringhaus GRACE General Meeting, September 2004, Brussels 18 GRACE Grid Jobs Performance (optimized)

19. CERN – Roberta Faggian Marque, Jan Fiete Grosse-Oetringhaus GRACE General Meeting, September 2004, Brussels 19 GRACE Grid Jobs Performances (details) Text Normalizing Categorizing

20. CERN – Roberta Faggian Marque, Jan Fiete Grosse-Oetringhaus GRACE General Meeting, September 2004, Brussels 20 GRACE Grid Job Outlook Typical search result still needs O(hours) of processing Possible Solution: Job splitting Distribute Text Normalizing across many jobs Merge Results for Categorization Use of Job dependencies model (e.g. DAGMan) Tests in LCG 2.2 with optimized Sandra application ongoing (started on 17 Sep) First test in new EGEE middleware gLite successful