1. 1 www.d4science.eu Tutorial Outline 30’ From Content Management Systems to VREs 50’ Creating a VRE 80 Using a VRE 20’ Conclusions

2. Creating a VRE Pedro Andrade CERN European Organization for Nuclear Research RCDL 2008 10 October 2007 Dubna (Russia) www.d4science.eu

3. 3 Session Outline Introduction Technology  gCube, gCore, gHN, gLite Setting Up VREs  Interfaces & Roles  Infrastructure, VO, and VRE set-up  Effort & How to Start Conclusions Creating a VRE 10 October 2008, Dubna (Russia)

4. 4 www.d4science.eu Introduction Creating a VRE 10 October 2008, Dubna (Russia)

5. 5 www.d4science.eu Introduction Creating a VRE 10 October 2008, Dubna (Russia)

6. 6 www.d4science.eu Introduction One VRE is a time-defined distributed environment to satisfy concrete collaboration needs of distributed user communities VRE users are organized in Virtual Organizations VRE resources are organized in Infrastructures Creating a VRE 10 October 2008, Dubna (Russia)

7. 7 www.d4science.eu Infrastructure Hardware: Storage, Computing Services & Applications: gCube External Collections & Auxiliary Resources: Data, Content, Metadata Schemas, Mappings, Transformation programs Creating a VRE 10 October 2008, Dubna (Russia) A D4Science infrastructure is composed by:

8. 8 www.d4science.eu Infrastructure Creating a VRE 10 October 2008, Dubna (Russia) Site A Site B Site C

9. 9 www.d4science.eu Infrastructure Creating a VRE 10 October 2008, Dubna (Russia) Infrastructure VRE VO

10. 10 www.d4science.eu Technology Creating a VRE 10 October 2008, Dubna (Russia)

11. 11 www.d4science.eu gCube gCube is the system developed by D4Science to create and maintain Virtual Research Environments. gCube is composed by:  Infrastructure Enabling Services  Information Retrieval Services  Information Organization Services  Presentation Services gCube components can be: Services, Libraries, and Portlets Creating a VRE 10 October 2008, Dubna (Russia)

12. 12 www.d4science.eu gCore gCore is a framework developed by D4Science to reduce the complexity of designing and implementing gCube services. gCore is composed by:  Framework: An application framework to consolidate and develop existing/new gCube services  Container: A self-contained software container distributed to facilitate the deployment of gCube services. Based on Java WS-Core (GT4). Creating a VRE 10 October 2008, Dubna (Russia)

13. 13 www.d4science.eu gHN The minimum environment for any gCube node of the infrastructure is the gCube Hosting Node (gHN) The gHN is composed by:  gCore Container  gCore Framework  gCube Infrastructure Enabling Services (partial) Creating a VRE 10 October 2008, Dubna (Russia)

14. 14 www.d4science.eu gHN The gCube Hosting Node main functionality is:  Is the runtime container of gCube services  Provides access to local hardware resources,  Storage systems, instruments, CPU cycles  Grants lifetime management  Mediates service2service interactions  route requests to target service  enforce security and scope policies Creating a VRE 10 October 2008, Dubna (Russia)

15. 15 www.d4science.eu gLite Computational intensive tasks are executed in EGEE nodes running the gLite middleware. EGEE is one the largest grid infrastructure worldwide. It is composed by more than 260 sites (85k CPUs) Several gCube services were designed to interface with the gLite middleware. These interfaces give access to the EGEE infrastructure and consequently increase significantly the computing capabilities of any gCube-based infrastructure. Creating a VRE 10 October 2008, Dubna (Russia)

16. 16 www.d4science.eu Example Creating a VRE 10 October 2008, Dubna (Russia) Infrastructure gHN gLite gHN

17. 17 www.d4science.eu Setting Up VREs Creating a VRE 10 October 2008, Dubna (Russia)

18. 18 www.d4science.eu Overview Creating a VRE 10 October 2008, Dubna (Russia) InfrastructureVOVRE

19. 19 www.d4science.eu Interfaces From the “system administrator” perspective the creation of one gCube-based infrastructure, VO, VRE is done exploiting two main types of interfaces Command Line Interface (CLI)  Used for the installation of gHNs Portal  gCube portal is based on portlets technology (JSR168)  gCube portal runs on GridSphere  Used for the creation and management of VOs and VREs Creating a VRE 10 October 2008, Dubna (Russia)

20. 20 www.d4science.eu Roles VO Admin Resource Owner VRE Designer Infrastructure Admin InfrastructureVOVRE Admin Creating a VRE 10 October 2008, Dubna (Russia)

21. 21 www.d4science.eu Infrastructure Set-up  Install gHN nodes  Deploy Enabling Services  Information System  Software Repository  Populate the SR  Install Portal Creating a VRE 10 October 2008, Dubna (Russia) PortalgHN IS/SR gHN Infrastructure Admin

22. 22 www.d4science.eu VO Set-up Creating a VRE 10 October 2008, Dubna (Russia) gHN DataA DataB gLite  Install gHN nodes  Install gLite nodes  Prepare Collections  Prepare Applications  Register Resources Resource Owner gHN Portal IS/SR MGVI

23. 23 www.d4science.eu VO Set-up Creating a VRE 10 October 2008, Dubna (Russia) gHN DataB gLite  Approves resources  gHNs  Data Collections  Manages users VO Admin DataA gHN Portal IS/SR MGVI

24. 24 www.d4science.eu VRE Set-up Creating a VRE 10 October 2008, Dubna (Russia) gHN DataA DataB gLite  Defines a new VRE  Name  Time Period  Functionalities  Data Collections  Metadata Schema VRE Designer gHN Portal IS/SR MGVI

25. 25 www.d4science.eu  Approves VRE  VRE Created  Services Deployed  Applies modifications  New Running Instances  New Layouts VRE Set-up Creating a VRE 10 October 2008, Dubna (Russia) MGVI gHN DataB gLite Search VRE Admin DataA Portal IS/SR

26. 26 www.d4science.eu Effort SCOPEACTIONTOOLTIME Infrastructure deploy enabling servicesCLI< 1 day install portalCLI< 1 day VO install 1 gHNCLI< 10 min register resources (gHN, data)Portal< 1 min approve resource (gHN, data)Portal< 1 min data import (metadata, indexes)Portalhours manage usersPortal< 10 min VRE define VREPortal< 10 min approve VREPortal< 1 min deploy VREPortal< 2 hour modify VREPortal< 1 hour Creating a VRE 10 October 2008, Dubna (Russia)

27. 27 www.d4science.eu How to Start How can a new user community have it’s own VO/VREs ? 1.By creating a new infrastructure  Different communities can run their own infrastructure  The new community provides all resources 2.By joining an existing infrastructure  D4Science runs a production infrastructure for its two user communities (Earth Monitoring and Fisheries Management)  The new community provides part of the resources Creating a VRE 10 October 2008, Dubna (Russia)

28. 28 www.d4science.eu How to Start InfrastructureVOVRE Infrastructure Admin Resource Owner VO Admin VRE Designer VRE Admin New Infrastructure yes Existing Infrastructure nodependsyes Creating a VRE 10 October 2008, Dubna (Russia)

29. 29 www.d4science.eu How to Start gCube software is available from  http://software.d4science.research-infrastructures.eu/ http://software.d4science.research-infrastructures.eu/ gCube administrator guide:  https://technical.wiki.d4science.research- infrastructures.eu/documentation/index.php/Administrator%27s _Guide https://technical.wiki.d4science.research- infrastructures.eu/documentation/index.php/Administrator%27s _Guide gCube user guide:  https://technical.wiki.d4science.research- infrastructures.eu/documentation/index.php/User%27s_Guide https://technical.wiki.d4science.research- infrastructures.eu/documentation/index.php/User%27s_Guide Creating a VRE 10 October 2008, Dubna (Russia)

30. 30 www.d4science.eu Conclusions A VRE brings together different types of resources through a well defined cost-effective process The creation of a VRE is a simple and easy:  A new VO can join one infrastructure in less then 1 day  A new VRE can be deployed in less then 2 hours  Many automatic deployment & configuration operations managed via the gCube Portal Creating a VRE 10 October 2008, Dubna (Russia)

31. 31 www.d4science.eu Creating a VRE 10 October 2008, Dubna (Russia)

32. 32 www.d4science.eu D4Science Infrastructure Composed by 4 sites  CNR (Pisa, Italy)  NKUA (Athens, Greece)  UNIBASEL (Basel, Switzerland)  ESA (Rome, Italy) All sites providing gHN and gLite nodes  28 machines  13.1 TB disk Creating a VRE 10 October 2008, Dubna (Russia)