Presentation is loading. Please wait.

Presentation is loading. Please wait.

All-in-one graphical tool for grid middleware management Eddy Caron, Abdelkader Amar, Frédéric Desprez, David Loureiro LIP ENS Lyon, INRIA Rhône-Alpes,

Similar presentations


Presentation on theme: "All-in-one graphical tool for grid middleware management Eddy Caron, Abdelkader Amar, Frédéric Desprez, David Loureiro LIP ENS Lyon, INRIA Rhône-Alpes,"— Presentation transcript:

1 All-in-one graphical tool for grid middleware management Eddy Caron, Abdelkader Amar, Frédéric Desprez, David Loureiro LIP ENS Lyon, INRIA Rhône-Alpes, GRAAL project Join work with A. Cedeyn, R. Bolze, Y. Caniou, A. Chis, B. Depardon, J.-S. Gay, G. Lemahec …

2 Summary Introduction DIET short presentation DIET DashBoard DIET tools Workflow tools Grid tool : GRUDU Experiments Conclusion and Future Work

3 Context : Development of a toolbox for deploying ap- plication services providers with a hierarchical archi- tecture for scalability LA MALA Server front end Master Agent Local Agent Client MA Corba or JXTA Main research issues: scheduling, heterogeneity, automatic deployment, interoperability, high performance data transfer and management, monitoring, fault tolerance, genericity of solutions for various applications, static and dynamic analysis of performance, … Validation: Large validation over Grid5000. Interoperability: DIET is compliant with the Grid-RPC standardization for OGF DIET used case: The Decrypthon project - DIET was selected by IBM - Collaborations: RNTL GASP, ACI GRID ASP, TLSE, ACI MD GDS, ANR LEGO, ANR GWENDIA, Grid5000

4 DIET Dashboard DIET hierarchies can be deployed on grid/cluster of nodes In Grid Environments, users need several and complex tools for the management of resources and client/server applications. Can be tougth to deploy a DIET hierarchy in a such a grid environment by hand without high level tools The DIET DashBoard is a set of tools written in Java Provides to the DIET end-user, friendly-user interfaces to design, deploy and monitor the execution of client/server applications Also provides to the grid user tools for the allocation and monitoring resources on Grid'5000

5 DIET Dashboard Extensible set of tools for the DIET community Based on seven tools: DIET designer DIET Mapping tool DIET Deployment tool XML GoDIETGenerator Workflow designer Workflow log service DIET resource tool aka GRUDU DIET Tools Workflow Tools Grid Tools

6 DIET Tools Allows the user to design graphically a DIET hierarchy. Allow the user to map DIET components on the allocated Grid'5000 resources To help the end-user creating hierarchies from existing frameworks based on the reserved ressources. It provides the basic GoDIET operations: open, launch, stop and monitoring for DIET application elements.

7 Workflow Tools Applications viewed as services within DIET Compose services to get a complete application workflow in a drag&drop fashion To monitor workflows execution by displaying the DAG nodes of each workflow and their states. Three states are available: waiting, running and done. Two modes:local and remote

8 Context : Grid'5000 a highly reconfigurable, controlable and monitorable experimental Grid platform. Needed all-in-one GUI client-side tool for the monitoring of the Grid'5000 platform. Grid'5000 Reservation Utility for Deployment Usage Main goals : –Displaying the status of the platform (grid/site/job level) –Resources allocation through the use of OAR (oar v1 & v2 are supported) –Resources monitoring through the use of the Ganglia (site/job nodes) –Deployment management with a GUI for KaDeploy (multiple sites at a time) – A terminal emulator (access frontale/ site frontale/job main node connection) – and a file transfer manager (local/remote and synchronization features) Web:

9 Exp 1: Goals and Protocol of the Experiment Validation of the DIET architecture at large scale over different administrative domains Protocol DIET deployment over a maximum of processors Large number of clients Comparison of the DIET execution times with average local execution times 1 MA, 8 LA, 540 SeDs 2 requests/SeD 1120 clients on 140 machines DGEMM requests (2000x2000 matrices) Simple round-robin scheduling using time_since_last_solve Grid5000 Paravent : 9 s Lilles : 34 s Paraci : 11 s Bordeaux : 33 s Parasol : 33 s Sophia : 40 s Toulouse : 33 s Lyon : 38 s Orsay : 40 s

10 Exp 1 : Results Grid5000

11 Exp 2: Goals and Protocol of the Experiment Validation of the DIET architecture at large scale over different administrative domains in the framework of the LEGO project (ANR CICG05-11) Grid5000 Protocol Get the largest machine reservation on the largest number of Grid'5000 clusters Realize a maximum number of Ramses execution (application developed at the DAPNIA/CEA) Stress DIET over a large number of machine and in a large period of time But also stress Grid' KaDeploy image with DIET and all the mandatory tools 12 clusters on 7 sites : 979 machines for 48 hours 1 MA, 12 LA, 29 SeDs 816 machines Ramses-only

12 Exp 2 : Results Comparing DAPNIA/CEA to DIET/DIET DashBoard/Grid'5000 Ramses Example Output

13 Conclusion and Future Work Conclusion : DIET is a grid middleware designed for scheduling application tasks with a hierarchical architecture The DIET DashBoard provides to DIET users a full-featured framework for experiments on Grid'5000 GRUDU provides to the Grid'5000 community a powerful tool dedicated to the interaction with the grid (monitoring/reservation/deployment etc.) The experiments show how DIET DashBoard/GRUDU can simplify the use of a grid middleware Future work: Support of other Batch Schedulers (like LoadLeveler or SGE) Interaction with other grids (EGEE, DAS3, etc.)

14 Questions... Questions ? Demo at the Exhibition Hall 16: :00


Download ppt "All-in-one graphical tool for grid middleware management Eddy Caron, Abdelkader Amar, Frédéric Desprez, David Loureiro LIP ENS Lyon, INRIA Rhône-Alpes,"

Similar presentations


Ads by Google