Presentation is loading. Please wait.

Presentation is loading. Please wait.

GLOBUS ACCOUNTING USING GRID-SAFE - DEMO

Similar presentations


Presentation on theme: "GLOBUS ACCOUNTING USING GRID-SAFE - DEMO"— Presentation transcript:

1 GLOBUS ACCOUNTING USING GRID-SAFE - DEMO
Steve Crouch, IGE WP3 Leader GLOBUS ACCOUNTING USING GRID-SAFE - DEMO

2 Key ideas & achievements
Elevator Pitch Problem You have Globus GRAM 5 grid-fronted (multiple) resources You want to know who ran what & where across your site You need to contribute this information to EGI’s central repository (i.e. APEL) Key ideas & achievements Support the ‘accounting’ pipeline Straightforward installation and configuration Easy extensibility, e.g. support multiple heterogeneous computing resources Support for accepted/emerging open standards It’s about ‘who ran what where?’

3 Introduction To Grid-SAFE
Accounting system based on OGF Usage Record & Resource Usage Service Scientific-field agnostic Developed at EPCC, Grid-SAFE project Open standards support in SAFE project Deployed on PRACE, ECDF Eddie cluster UK NES developed batch file processing system for URs IGE updated and extended it Added GT5 parser Integrated GT5 audit record capability Packaged as part of Grid-SAFE for IGE v3.0

4 Grid-SAFE (Site) Architecture
Sub Site A Sub Site B Sub Site n GT5 RM Via scheduled Cron job: Outputs GT5 audit records Batch2UR Via scheduled Cron job: Converts records to URs GridSAFE RUPI Client Via scheduled Cron job: Uploads URs to Grid-SAFE Very extensible – custom implementation classes can be specified for specific tasks e.g. for different standards parsers: OGF UR v1.0, EMI CAR v1.0 Site Aggregate records (APEL MessageFormat v0.2)

5 Grid-SAFE as part of Centralised APEL Ecosystem
APEL CLIENT CENTRAL APEL SERVER Summaries & Job Records Job Records MESSAGE BROKERS – located across Europe (ActiveMQ) REGIONAL APEL SERVER Summaries Summaries plus Summaries Summaries plus EXTERNAL CLIENTS PORTAL Grid-SAFE

6 Testing and consolidation phase
Future Work Testing and consolidation phase Test deployment within LRZ, IGE testbed In-depth testing with centralised APEL Documentation improvements Features Multi-site indentification support Support for additional LRMS platforms Extended reporting in portal Incorporate VOMS VO data LCAS/LCMAPS Batch2UR infrastructure is already there Insertion into GOCDB


Download ppt "GLOBUS ACCOUNTING USING GRID-SAFE - DEMO"

Similar presentations


Ads by Google