UR 1.0 Experiences OGF 24, Singapore.

Slides:



Advertisements
Similar presentations
© 2006 Open Grid Forum GHPN-RG Status update co-chairss:Cees de Laat Dimitra Simeonidou GGF22, Boston, February 2008.
Advertisements

© 2006 Open Grid Forum JSDL 1.0: Parameter Sweeps OGF 23, June 2008, Barcelona, Spain.
© 2006 Open Grid Forum Network Services Interface OGF30: Connection Services Guy Roberts, 27 th Oct 2010.
© 2006 Open Grid Forum Network Services Interface Introduction to NSI Guy Roberts.
© 2006 Open Grid Forum JSDL 1.0: Parameter Sweeps: Examples OGF 22, February 2008, Cambridge, MA.
© 2006 Open Grid Forum GridRPC Interoperability Test Response to comments Yusuke Tanimura.
© 2006 Open Grid Forum OGF19 Federated Identity Rule-based data management Wed 11:00 AM Mountain Laurel Thurs 11:00 AM Bellflower.
© 2007 Open Grid Forum JSDL-WG Session OGF27 – General Session 10:30-12:00, 14 October 2009 Banff, Canada.
©2010Open Grid Forum OGF28 OGSA-DMI Status Chairs: Mario Antonioletti, EPCC Stephen Crouch, Southampton Shahbaz Memon, FZJ Ravi Madduri, UoC.
© 2006 Open Grid Forum Joint Session on Information Modeling for Computing Resources OGF 20 - Manchester, 7 May 2007.
© 2007 Open Grid Forum JSDL-WG Session OGF21 – Activity schema session 17 October 2007 Seattle, U.S.
© 2008 Open Grid Forum Resource Selection Services OGF22 – Boston, Feb
© 2006 Open Grid Forum Network Services Interface OGF29: Working Group Meeting Guy Roberts, 19 th Jun 2010.
© 2007 Open Grid Forum JSDL-WG Session 1 OGF25 – General Session 11:00-12:30, 3 March 2009 Catania.
© 2006 Open Grid Forum JSDL Optional Elements OGF 24 Singapore.
© 2007 Open Grid Forum Data/Compute Affinity Focus on Data Caching.
© 2007 Open Grid Forum OGSA-RUS Specification Update, Adoption and WS-RF Profile Discussions (Molly Pitcher) Morris Riedel (Forschungszentrum Jülich –
© 2006 Open Grid Forum Joint Session on Information Modeling for Computing Resources (OGSA Modeling Activities) OGF 21 - Seattle, 16 October 2007.
© 2009 Open Grid Forum Usage Record Working Group Alignment and Production Profile.
1 ©2013 Open Grid Forum OGF Working Group Sessions Security Area – FEDSEC Jens Jensen, OGF Security Area.
© 2006 Open Grid Forum DCI Federation Protocol BoF Alexander Papaspyrou, TU Dortmund University Open Grid Forum March 15-18, 2010, Munich, Germany.
© 2007 Open Grid Forum Data Grid Management Systems: Standard API - community development Arun Jagatheesan, San Diego Supercomputer Center & iRODS.org.
© 2010 Open Grid Forum Standards All Hands Meeting OGF28, München, March 2010.
© 2006 Open Grid Forum Network Services Interface OGF 32, Salt Lake City Guy Roberts, Inder Monga, Tomohiro Kudoh 16 th July 2011.
© 2010 Open Grid Forum OCCI Status Update Alexander Papaspyrou, Andy Edmonds, Thijs Metsch OGF31.
© 2007 Open Grid Forum JSDL-WG Session OGF22 – General Session (11:15-12:45) 25 February 2008 Boston, U.S.
© 2006 Open Grid Forum FEDSEC-CG Andrew Grimshaw and Jens Jensen.
© 2006 Open Grid Forum Activity Instance Schema Philipp Wieder (with the help of the JSDL-WG) Activity Instance Document Schema BoF Monday, 25 February,
© 2006 Open Grid Forum Network Services Interface OGF 33, Lyon Guy Roberts, Inder Monga, Tomohiro Kudoh 19 th Sept 2011.
© 2006 Open Grid Forum HPC Job Delegation Best Practices Grid Scheduling Architecture Research Group (GSA-RG) May 26, 2009, Chapel Hill, NC, US.
© 2006 Open Grid Forum GridRPC Working Group 15 th Meeting GGF22, Cambridge, MA, USA, Feb
© 2006 Open Grid Forum Network Services Interface CS Errata Guy Roberts, Chin Guok, Tomohiro Kudoh 29 Sept 2015.
© 2006 Open Grid Forum OGSA-WG: EGA Reference Model GGF18 Sept. 12, 4-5:30pm, #159A-B.
© 2006 Open Grid Forum Remote Instrumentation Services in Grid Environment Introduction Marcin Płóciennik Banff, OGF 27 Marcin Płóciennik.
© 2006 Open Grid Forum NML Progres OGF 28, München.
© 2007 Open Grid Forum OGF Management Area Meeting OGF20 7 May, am-12:30pm Manchester, UK.
© 2007 Open Grid Forum Status Reviews and Plans Production Grid Infrastructure (PGI) - WG Morris Riedel et al. Juelich Supercomputing Centre PGI Co-Chair.
© 2006 Open Grid Forum Grid Resource Allocation Agreement Protocol GRAAP-WG working session 1 Thursday, 5 March, 2009 Catania, Sicily.
© 2006 Open Grid Forum VOMSPROC WG OGF36, Chicago, IL, US.
© 2007 Open Grid Forum OGF20 Levels of the Grid Workflow Interoperability OGSA-WG F2F meeting Adrian Toth University of Miskolc NIIF 11 th May, 2007.
© 2006 Open Grid Forum 1 Application Contents Service (ACS) ACS-WG#1 Monday, September 11 10:30 am - 12:00 am (158A-B) ACS-WG#2 Wednesday, September 13.
© 2006 Open Grid Forum Network Services Interface 2015 Global LambdaGrid Workshop Prague Guy Roberts, Chin Guok, Tomohiro Kudoh 28 Sept to 1 Oct 2015.
© 2008 Open Grid Forum Production Grid Infrastructure WG State Model Discussions PGI Team.
© 2007 Open Grid Forum JSDL-WG Session OGF26 – General Session 11:00-12:30, 28 May 2009 Chapel Hill, NC.
© 2010 Open Grid Forum GLUE WG - Introduction OGF30, Brussels – 28 Oct 2010 Sergio Andreozzi (EGI.eu) Balazs Konya (Lund University) Laurence Field (CERN)
Network Services Interface
GGF Intellectual Property Policy
Welcome and Introduction
OGSA EMS Session OGF19 OGSA-WG session #3 30 January, :30pm
RISGE-RG use case template
GridRPC Working Group 13th Meeting
Grid Resource Allocation Agreement Protocol
OGF session PMA, Florence, 31 Jan 2017.
Sharing Topology Information
Network Services Interface
Network Services Interface Working Group
OGSA-Workflow OGSA-WG.
Information Model, JSDL and XQuery: A proposed solution
Network Measurements Working Group
WS Naming OGF 19 - Friday Center, NC.
Activity Delegation Kick Off
SAGA: Java Language Binding
Network Services Interface Working Group
OGSA-RSS-WG EPS Discussion.
Introduction to OGF Standards
SAGA: Java Language Binding
Network Services Interface
Proposed JSDL Extension: Parameter Sweeps
RNS Interoperability and File Catalog Standardization
OGF 40 Grand BES/JSDL Andrew Grimshaw Genesis II/XSEDE
Presentation transcript:

UR 1.0 Experiences OGF 24, Singapore

OGF IPR Policies Apply “I acknowledge that participation in this meeting is subject to the OGF Intellectual Property Policy.” Intellectual Property Notices Note Well: All statements related to the activities of the OGF and addressed to the OGF are subject to all provisions of Appendix B of GFD-C.1, which grants to the OGF and its participants certain licenses and rights in such statements. Such statements include verbal statements in OGF meetings, as well as written and electronic communications made at any time or place, which are addressed to: the OGF plenary session, any OGF working group or portion thereof, the OGF Board of Directors, the GFSG, or any member thereof on behalf of the OGF, the ADCOM, or any member thereof on behalf of the ADCOM, any OGF mailing list, including any group list, or any other list functioning under OGF auspices, the OGF Editor or the document authoring and review process Statements made outside of a OGF meeting, mailing list or other function, that are clearly not intended to be input to an OGF activity, group or function, are not subject to these provisions. Excerpt from Appendix B of GFD-C.1: ”Where the OGF knows of rights, or claimed rights, the OGF secretariat shall attempt to obtain from the claimant of such rights, a written assurance that upon approval by the GFSG of the relevant OGF document(s), any party will be able to obtain the right to implement, use and distribute the technology or works when implementing, using or distributing technology based upon the specific specification(s) under openly specified, reasonable, non-discriminatory terms. The working group or research group proposing the use of the technology with respect to which the proprietary rights are claimed may assist the OGF secretariat in this effort. The results of this procedure shall not affect advancement of document, except that the GFSG may defer approval where a delay may facilitate the obtaining of such assurances. The results will, however, be recorded by the OGF Secretariat, and made available. The GFSG may also direct that a summary of the results be included in any GFD published containing the specification.” OGF Intellectual Property Policies are adapted from the IETF Intellectual Property Policies that support the Internet Standards Process. IPR Notices Note Well for OGF meetings 2

Outline Experience Document Identified Use Cases Objectives Survey Template Call for more use cases and correctness Identified Use Cases APEL/WLCG DGAS/EGEE RUS Accounting Service/UNICORE SGAS/SweGrid Gratia/OSG ARCO/SGE UAS/NGS 3

Experience Document Objectives Use case collection Implementation status Consolidate advanced requirements Guiding to next release (version 2) Reflective to RUS WG 4

Experience Document Execution Process 5

Survey Template Six parts Project Description Usage Metric checklist Extensions (if any) Metering time High-level usage Recommendation to UR2 Roadmap Feedbacks Available at: http://forge.ogf.org/sf/go/artf6130?nav=1 6

Current Status Summarized from JISC report Full version available at (http://www.jisc.ac.uk/media/documents/programmes/einfrastructure/jisc_aum_final_report_wth.pdf) UR-specific version available at (https://forge.gridforum.org/sf/go/artf6130?nav=1) Call for updated information (of identified use cases) Call for more use cases especially for non-CPU accounting 7

Identified Use Case - APEL Accounting Processor for Event Logs Accounting system of WLCG Used for reporting usage statistics Components Log parser R-GMA as publishing protocol Reporting portal 8

Identified Use Case - APEL APEL Workflow 9

Identified Use Case - APEL APEL Workflow 10

Identified Use Case - APEL APEL Workflow 11

Identified Use Case - APEL APEL Workflow 12

Identified Use Case - APEL APEL Workflow 13

Identified Use Case - APEL APEL Workflow 14

Identified Use Case - APEL APEL Workflow 15

Identified Use Case - APEL APEL Workflow 16

Identified Use Case - APEL APEL Workflow 17

APEL Schema & UR 18

Identified Use Case - DGAS Distributed Grid Accounting System Accounting system of EGEE Used of economic accounting (economic authorization, pricing, banking, etc) Components User Interface (UI) Workload Manager Price Authority Home Location Registry (HLR) Sensor 19

Identified Use Case - DGAS Workflow 20

Identified Use Case - DGAS Workflow 21

Identified Use Case - DGAS Workflow 22

Identified Use Case - DGAS Workflow 23

Identified Use Case - DGAS Workflow 24

Identified Use Case - DGAS Workflow 25

Identified Use Case - DGAS Workflow 26

Identified Use Case - DGAS Workflow 27

Identified Use Case - DGAS Workflow 28

Identified Use Case - DGAS Workflow 29

Identified Use Case - DGAS Workflow 30

Identified Use Case - DGAS Workflow 31

DGAS Schema and UR (1) Usage Schema of ATM Client API 32

DGAS Schema and UR (1) DGAS URWG Metering Client Generates OGF-UR (v1) compatible records in XML; With additional extensions that are economic activity specific 33

Identified Use Case – UNICORE Accounting System Used by UNICORE Mainly for real-time job usage monitoring Deployed at a specific site only No aggregation/summarization Component URF Generator Metering and compose usage records RUS Resource Usage Service LLView Usage monitoring application 34

Identified Use Case – UNICORE Accounting System Workflow 35

Identified Use Case – UNICORE Accounting System Workflow 36

Identified Use Case – UNICORE Accounting System Workflow 37

Identified Use Case – UNICORE Accounting System Workflow 38

Identified Use Case – UNICORE Accounting System Workflow 39

Identified Use Case – UNICORE Accounting System Workflow 40

Identified Use Case – UNICORE Accounting System Workflow 41

Identified Use Case – UNICORE Accounting System Workflow 42

Identified Use Case – UNICORE Accounting System Workflow 43

UNICORE Schema and URv1 URv1 compatible Extensions? 44

Identified Use Case - SGAS SweGrid Accounting System Globus accounting component Widely deployed for Nordic sites Mainly for economic accounting Components Job Account Reservation Manager Economic authorization Bank service Banking Logging and Usage Tracking Service RUS implementation for usage query 45

Identified Use Case - SGAS Workflow 46

Identified Use Case - SGAS Workflow 47

Identified Use Case - SGAS Workflow 48

Identified Use Case - SGAS Workflow 49

Identified Use Case - SGAS Workflow 50

Identified Use Case - SGAS Workflow 51

Identified Use Case - SGAS Workflow 52

SGAS Schema and URv1 UR extensions Extension Description OGF UR Mapping VOName Virtual Organization Name /urf:UsageRecord/urf:Resource[@urf:description=“VOName”] 53

Identified Use Case - UAS User Accounting System Used by UK NGS Mainly for usage monitoring against allocated quotas on per user basis Component Jbmdb module Capture use/job mapping info. by parsing globus log files Batch2UR Metering local resource usage UR generator RUS User Accounting Protal 54

Identified Use Case - UAS Workflow 55

Identified Use Case - UAS Workflow 56

Identified Use Case - UAS Workflow 57

Identified Use Case - UAS Workflow 58

Identified Use Case - UAS Workflow 59

Identified Use Case - UAS Workflow 60

Identified Use Case - UAS Workflow 61

Identified Use Case - UAS Workflow 62

Identified Use Case - UAS Workflow 63

Identified Use Case - UAS Workflow 64

UAS schema and URv1 Extensions 65

Identified Use Case - Gratia Accounting system used for OSG Mainly usage reporting Components Probe Metering and generate usage record files Collector Gathering usage records Publisher Web portal 66

Identified Use Case - Gratia Workflow 67

Identified Use Case - Gratia Workflow 68

Identified Use Case - Gratia Workflow 69

Identified Use Case - Gratia Workflow 70

Identified Use Case - Gratia Workflow 71

Identified Use Case - Gratia Workflow 72

Gratia database Model 73

Gratia database Model 74

Identified Use Case - ARCO Accounting and Reporting Console Used specific to Sun Grid Engine Mainly for usage reporting Components DBWriter Metering resource usage Web-based console tool Graphic reporting portal 75

Identified Use Case - ARCO Workflow 76

Identified Use Case - ARCO Workflow 77

Identified Use Case - ARCO Workflow 78

Identified Use Case - ARCO Workflow 79

Identified Use Case - ARCO Workflow 80

ARCO Schema and UR 81

What’s Next? Updates of identified use cases More use cases? Consolidation Document Editing 82

Full Copyright Notice Copyright (C) Open Grid Forum (2008). All Rights Reserved. This document and translations of it may be copied and furnished to others, and derivative works that comment on or otherwise explain it or assist in its implementation may be prepared, copied, published and distributed, in whole or in part, without restriction of any kind, provided that the above copyright notice and this paragraph are included on all such copies and derivative works. The limited permissions granted above are perpetual and will not be revoked by the OGF or its successors or assignees. OGF Full Copyright Notice if necessary 83