1. EGEE is a project funded by the European Union under contract IST-2003-508833 Generic Applications: strategy, organization, tools and manpower Roberto Barbera NA4 Generic Applications Coordinator 1 st EGAAP Meeting, CERN, 14.06.2004 www.eu-egee.org

2. 1 st EGAAP Meeting, CERN, 14.06.2004 - 2 Contents Introduction to NA4 Generic Applications The NA4 Generic application tools: GENIUS and GILDA Conclusions and outlook

3. 1 st EGAAP Meeting, CERN, 14.06.2004 - 3 NA4 Generic Applications goals Activity NA4 focuses on the identification and support of early-user and established applications for use on the EGEE infrastructure. It has the following objectives:  To identify through the dissemination partners and a well defined integration process a portfolio of early user applications from a broad range of application sectors from academia, industry and commerce.  To support development and production use of all of these applications on the EGEE infrastructure and thereby establish a strong user base on which to build a broad EGEE user community.  To initially focus on two well-defined application areas – Particle Physics and Life sciences. The expected outcome of the activity will be the establishment of a broad portfolio of applications across a wide range of sectors suited to execution on the EGEE infrastructure meeting the needs of a broad collection of user groups from many sectors across Europe as illustrated in Figure (note the timeline for the introduction of each application domain is purely illustrative).

4. 1 st EGAAP Meeting, CERN, 14.06.2004 - 4 NA4 Work Breakdown Structure http://egee-na4.ct.infn.it

5. 1 st EGAAP Meeting, CERN, 14.06.2004 - 5 Gen. App. estimated effort Activity NA4 Total effort (FTE) during 2 years Total effort (PM) during 2 years 1 st year effort (PM) 2 nd year effort (PM) Activity CESNET3.238.419.2 Generic MTA0.89.64.8 Generic DKRZ22412 Generic FhG22412 Generic INFN89648 Generic FOM44824 Generic TOTALS20240120 Generic

6. 1 st EGAAP Meeting, CERN, 14.06.2004 - 6 The transparent grid access local disk StorageElement StorageElementStorageElement ReplicaCatalogue UI dis k ResourceBroker ComputeElementComputeElement VOcolleague VOcolleague

7. 1 st EGAAP Meeting, CERN, 14.06.2004 - 7 The GENIUS hourglass model OS & Net services Basic Services High level GRID middleware ALICEATLASCMSLHCb Applications’ specific layer Other apps GLOBU S toolkit EDG/LCG architecture GENIUS web portal GENIUS ® (Grid Enabled web eNvironment for site Independent User job Submission) [ https://genius.ct.infn.it] INFN/NICE collaboration

8. 1 st EGAAP Meeting, CERN, 14.06.2004 - 8 GENIUS: how it works Apache EnginFrame GENIUS https+java/xml+rfb WEB Browser Use r Inter f Loc al WS the Grid M/W+GSI 3-tier model

9. 1 st EGAAP Meeting, CERN, 14.06.2004 - 9 GENIUS grid settings

10. 1 st EGAAP Meeting, CERN, 14.06.2004 - 10 GENIUS VO selection

11. 1 st EGAAP Meeting, CERN, 14.06.2004 - 11 GENIUS graphic job editor (work in collaboration with DATAMAT)

12. 1 st EGAAP Meeting, CERN, 14.06.2004 - 12 GENIUS graphic workflow editor (integration with TRIANA from GridLab)

13. 1 st EGAAP Meeting, CERN, 14.06.2004 - 13 GENIUS multi job submission

14. 1 st EGAAP Meeting, CERN, 14.06.2004 - 14 GENIUS multi job queue

15. 1 st EGAAP Meeting, CERN, 14.06.2004 - 15 GENIUS data spooler (1/2)

16. 1 st EGAAP Meeting, CERN, 14.06.2004 - 16 GENIUS data spooler (2/2)

17. 1 st EGAAP Meeting, CERN, 14.06.2004 - 17 GENIUS RLS browsing

18. 1 st EGAAP Meeting, CERN, 14.06.2004 - 18 GENIUS data replication

19. 1 st EGAAP Meeting, CERN, 14.06.2004 - 19 GENIUS interactive services

20. 1 st EGAAP Meeting, CERN, 14.06.2004 - 20 GENIUS for PDA (1/2) Home Page Services Remote file browsing Remote file inspection

21. 1 st EGAAP Meeting, CERN, 14.06.2004 - 21 GENIUS for PDA (2/2) GridICE integration RC browsing Job monitoring Job submission

22. 1 st EGAAP Meeting, CERN, 14.06.2004 - 22 GENIUS for cell phone

23. 1 st EGAAP Meeting, CERN, 14.06.2004 - 23 New GENIUS Applications: GATE (1/3)

24. 1 st EGAAP Meeting, CERN, 14.06.2004 - 24 New GENIUS Applications: GATE (2/3)

25. 1 st EGAAP Meeting, CERN, 14.06.2004 - 25 New GENIUS Applications: GATE (3/3)

26. 1 st EGAAP Meeting, CERN, 14.06.2004 - 26 New Applications in EGEE (overview of the process, from I. Bird) Application nominates VO manager Find (CIC) to operate VO server (INFN CNAF of Generic Applications) VO is added to registration procedure Determine access policy:  Propose discussion (body) NA4 + ROC manager group Which sites will accept to run app (funding, political constraints) Need for a test VO? Modify site configs to allow the VO access Negotiate CICs to run VO-specific services:  VO server (see above)  RLS service if required  Resource Brokers (can be some general at CIC and others owned by apps), UIs – general at CIC/ROC – or on apps machines etc  Potentially (if needed) BDII to define apps view of resources Application software installation  Understand application environment, and how installed at sites Many of these issues can be negotiated by NA4/SA1 in a short discussion with the new apps community

27. 1 st EGAAP Meeting, CERN, 14.06.2004 - 27 Resource Allocation policy (from EGEE Technical Annex) Each Resource Centre support many VOs - several application domains.  already true for many centres that participate in existing grid projects – EDG, LCG etc. Initially must stages balance between the resources contributed by the application domains and those that they consume.  many of those resources funded specifically for those application communities.  In first 6 months sufficient resources for initial set of VOs Resource allocation will be made at the VO level.  Establish inter-VO allocation guidelines;  Resource centres may have specific allocation policies that must be taken into account,  Expect some peer review within application domains to inform the allocation process. New resource centres required to satisfy some minimum requirements.  New VO’s should bring a level of additional resources consistent with their requirements.  The project must demonstrate that on balance this level of commitment is less than that required for the user community to perform the same work outside the grid. The difference will come from the access to idle resources of other VOs and resource centres. This is the essence of a grid infrastructure. A site may have additional resources not initially available that may be included later once EGEE is shown to be stable.  This potential is significant. Requirement on middleware (JRA1 et al):  mechanisms for implementing and enforcing resource quotas, allocations and limits. The selection of new VOs and resources  Negotiated and administered by NA4.  Follow e-IRG policies

28. 1 st EGAAP Meeting, CERN, 14.06.2004 - 28 The GILDA home page (http://gilda.ct.infn.it)

29. 1 st EGAAP Meeting, CERN, 14.06.2004 - 29 The GILDA Testbed (academic and commercial sites)

30. 1 st EGAAP Meeting, CERN, 14.06.2004 - 30 The GILDA Certification Authority

31. 1 st EGAAP Meeting, CERN, 14.06.2004 - 31 The GILDA Virtual Organization

32. 1 st EGAAP Meeting, CERN, 14.06.2004 - 32 The GILDA monitoring system (based on GridICE)

33. 1 st EGAAP Meeting, CERN, 14.06.2004 - 33 The GILDA Grid Demonstrator (https://grid-demo.ct.infn.it)

34. 1 st EGAAP Meeting, CERN, 14.06.2004 - 34 The GILDA Tutorials (work in collaboration with EGEE NA3) Next tutorial in Catania on July, 14-16. Registration available! ( http://egee-na4.ct.infn.it/na4_open_meeting )

35. 1 st EGAAP Meeting, CERN, 14.06.2004 - 35 The GILDA Grid Tutor (https://grid-tutor.ct.infn.it)

36. 1 st EGAAP Meeting, CERN, 14.06.2004 - 36 The GILDA Applications: HEP (1/5) (ALICE event simulation and display)

37. 1 st EGAAP Meeting, CERN, 14.06.2004 - 37 The GILDA Applications: EO (2/5) (DEM to VRML converter)

38. 1 st EGAAP Meeting, CERN, 14.06.2004 - 38 The GILDA Applications: EO (3/5) (MERIS data from ENVISAT)

39. 1 st EGAAP Meeting, CERN, 14.06.2004 - 39 The GILDA Applications: EO (4/5) (ASAR data from ENVISAT)

40. 1 st EGAAP Meeting, CERN, 14.06.2004 - 40 The GILDA Applications: ENG (5/5) (3D renderer)

41. 1 st EGAAP Meeting, CERN, 14.06.2004 - 41 Conclusions and outlook NA4 Generic Applications is a key activity in the process of getting new scientific and industrial communities interested and committed to use the continental grid infrastructure built by the EGEE Project. GENIUS is a well established tool which will be fundamental in the process of interfacing new applications with the EGEE middleware hiding its complex internals to non-experts users from new communities. GILDA is a complete suite of grid elements (test-bed, CA, VO, monitoring system, web portal) and applications fully dedicated to dissemination purposes. This could also represent the ideal grid testbed where to start the porting of new generic applications. GILDA is the dissemination tool which will be used by NA3 during courses and tutorials so the important aspect of induction of the grid paradigm to new communities is also covered.