1. w w w. h p c - e u r o p a. o r g Single Point of Access to Resources of HPC-Europa Krzysztof Kurowski, Jarek Nabrzyski, Ariel Oleksiak, Dawid Szejnfeld Poznań Supercomputing and Networking Center Cracow Grid Workshop, 14 December 2004

2. w w w. h p c - e u r o p a. o r g Outline HPC-Europa JRA2: Single Point of Access Assumptions & Requirements Architecture Components of the SPA Job Submission Interface Conclusion

3. w w w. h p c - e u r o p a. o r g HPC-Europa HPC-Europa - Pan-European Research infrastructure on High Performance Computing for the Science of 21st century Goal: to provide advanced computational services in an integrated way to the European research community Budget: ~20 mln EURO 14 Partners across Europe Project activities –Transnational Access Programme –Networking Activities –Joint Research Activities (JRA1, JRA2)

4. w w w. h p c - e u r o p a. o r g JRA2: Single Point of Access Motivation –To provide a uniform access to all centers resources, transparently and regardless of user physical location Main objectives –ease of use, –improve availability, –global optimization of resources utilization To achieve these goals –JRA2 builds a HPC-Europa portal providing uniform, flexible and intuitive user access to Grid resources from anywhere –Develops and/or adapts tools and services needed to establish full operational Grid environment –Will develop a meta-broker responsible for users’ access to all consortium’s resources

5. w w w. h p c - e u r o p a. o r g Assumptions & Requirements User-oriented –Uniform, transparent access –Easy to use, intuitive interface –Increased resource availability and access to all centers Provider-oriented –Keep centers autonomy To enable it to use its own chosen middleware To allow local policies Not to weaken center’s security –Optimize global resource usage

6. w w w. h p c - e u r o p a. o r g Accounting & Charging Model Allocation Unit (AU) –1TFlop sustained for 1 hour Kept for each resource provider for every single HPC system Used for 2 purposes: –charging the EC for the use of HPC facilities –limiting the maximum amount of resources a user (or group of users) may utilize The common pool of AUs concept –If a center contributes n AUs to the global infrastructure, then its users get access to n AUs from a common pool Center BCenter A Center C Common pool of AUs n A AUsn B AUs n C AUs n A AUs n B AUs

7. w w w. h p c - e u r o p a. o r g Typical Grid Architecture Grid Portal / Grid Resource Broker HPC center VO

8. w w w. h p c - e u r o p a. o r g HPC-Europa SPA Grid Portal / Grid Resource Broker HPC center Grid Middleware A Grid Middleware B Grid Middleware C Grid Middleware D VO

9. w w w. h p c - e u r o p a. o r g HPC Centers Middleware CenterHigh-level middlewareUnderlying Grid technology LRMS CINECA - UNICORELoadLeveler OpenPBS with MAUI HLRS - UNICOREOpenPBS ERS-NQS PBS Pro CEPBAeNANOS (resource broker) Globus 3.2LoadLeveler OpenPBS NQS EPCCJOSH (JOb Scheduling Hierarchically) Globus 3.2LoadLeveler SGE NTUA GRIA (Grid Resources for Industrial Applications) Condor PSNCGRMS (Grid Resource Management System) Pre-WS Globus 3.2OpenPBS LSF SGE

10. w w w. h p c - e u r o p a. o r g Architecture of the SPA (1 st stage) GridSphere Framework Multi-Grid Services Job submission Data mngmt Resource Information WorkflowAccounting Sofware Repository User Manager Portlets Service Plugins JOSH Plugin GRMS Plugin eNanos Plugin UNICORE Plugin GRIA Plugin Globus MDS Plugin … SPA Authorization Service Software Repository Data Management System Accounting System Information Service

11. w w w. h p c - e u r o p a. o r g Architecture of the SPA GridSphere Framework Multi-Grid Services Job submission Data mngmt Resource Information WorkflowAccounting Sofware Repository User Manager Portlets Service Plugins JOSH Plugin GRMS Plugin eNanos Plugin UNICORE Plugin GRIA Plugin Globus MDS Plugin … SPA Authorization Service Software Repository Data Management System Accounting System Information Service Meta-broker

12. w w w. h p c - e u r o p a. o r g GridSphere GridSphere:The advanced open-source portlet-based portal framework (www.gridsphere.org)www.gridsphere.org Features: –portlet-based (supporting JSR168 standard) –customization mechanism for a wide range of end users –a flexible easy to use interface for users –a model to create pluggable and dynamic application support for portal developers –pluggable access to Grid services using the Portlet Services concept –uniform access to various Grid systems using the Grid Portlets model –set of useful core and Grid portlets –open source Chosen as the HPC-Europa portal on the basis of portals evaluation made

13. w w w. h p c - e u r o p a. o r g Main Services Meta-broker –Discovers and choose resources, and submits job to HPC centers Replica management system –Goal of the HPC-Europa NA3 Accounting System –Historical information about resource usage (including AUs) Information System –Central information indexing service Software Repository –Logical names, meta-data, binaries compiled for various systems, needed environment (preinstalled libraries, environment variables, etc.) Authorization Service –Authorize users’ request, check resource limits

14. w w w. h p c - e u r o p a. o r g Multi-Grid Services Extension of the GridSphere’s Grid Portlets concept by –Interface based on standards and functionality of several Grid systems –Dynamic loading of multiple service implementations (on the basis of a given HPC center) –Remote access Definition of the common interface –For each functionality, e.g. job submission, resource information etc. –Based on standards where possible (e.g. JSDL) –Taking into account both gathered requirements and the functionality of Grid middleware deployed in HPC centers Capability check –description of implemented capabilities in the form of the XML document –used to disable not available options (in portal) or to select sites which can accept given job description (meta-broker)

15. w w w. h p c - e u r o p a. o r g Job Submission Interface (JSI) Job submission operations –submitJob (UNICORE, GRMS, JOSH, eNANOS, GRIA) –cancelJob (UNICORE, GRMS, JOSH, eNANOS, GRIA) –getJobInfo (UNICORE, GRMS, JOSH, eNANOS, GRIA) –findResources (UNICORE, GRMS, eNANOS) –submitJobToBestResource (GRMS, JOSH, eNANOS, GRIA) –findBestResource (JOSH) Data elements descriptions –Job Description XML schema –Job Information XML schema Auxiliary operations –getMiddlewareName –getMiddlewareDesc –getMiddlewareCaps Job states –FINISHED, FAILED, PENDING, QUEUED, RUNNING, CANCELLED, SUSPENDED, WAITING

16. w w w. h p c - e u r o p a. o r g Job Description Based on the GGF Job Submission Description Language (JSDL) specification Subset of JSDL defines the common interface The specification is still evolving

17. w w w. h p c - e u r o p a. o r g Conclusion Benefits of the SPA –Practical: enables scientists to solve their real problems using HPC resources distributed across Europe in a uniform and easy way –Research: interoperability of various grid technologies and middleware, hierarchical model of Grid middleware Open issues –Interoperability of different security models –Global policies concerning usage of AUs by HPC-Europa users