1 OSG Accounting Service Requirements Matteo Melani SLAC for the OSG Accounting Activity.

Slides:



Advertisements
Similar presentations
The Next Generation Grid Kostas Tserpes, NTUA Beijing, 22 of June 2005.
Advertisements

Top-Down Network Design Chapter Nine Developing Network Management Strategies Copyright 2010 Cisco Press & Priscilla Oppenheimer.
EGEE-II INFSO-RI Enabling Grids for E-sciencE The gLite middleware distribution OSG Consortium Meeting Seattle,
UCAIug HAN SRS v2.0 Summary August 12, Scope of HAN SRS in the NIST conceptual model.
High Availability Group 08: Võ Đức Vĩnh Nguyễn Quang Vũ
CoreGRID Workpackage 5 Virtual Institute on Grid Information and Monitoring Services Authorizing Grid Resource Access and Consumption Erik Elmroth, Michał.
Network Management Overview IACT 918 July 2004 Gene Awyzio SITACS University of Wollongong.
1 PUNCH PUNCH (Purdue University Network Computing Hubs) is a distributed network-computing infrastructure that allows geographically dispersed users to.
Policy-based Accounting: Accounting Issues Georg Carle, Sebastian Zander, Tanja Zseby GMD FOKUS - German National Research Center for Information Technology.
Maintaining and Updating Windows Server 2008
LHC Experiment Dashboard Main areas covered by the Experiment Dashboard: Data processing monitoring (job monitoring) Data transfer monitoring Site/service.
NOS Objectives, YR 4&5 Tony Rimovsky. 4.2 Expanding Secure TeraGrid Access A TeraGrid identity management infrastructure that interoperates with campus.
Cloud Computing 1. Outline  Introduction  Evolution  Cloud architecture  Map reduce operation  Platform 2.
Thinking about Accounting Matteo Melani SLAC Open Science Grid.
Module 7: Fundamentals of Administering Windows Server 2008.
EGEE ARM-2 – 5 Oct LCG Security Coordination Ian Neilson LCG Security Officer Grid Deployment Group CERN.
Open Science Grid The OSG Accounting System: GRATIA by Philippe Canal (FNAL) & Matteo Melani (SLAC) Mumbai, India CHEP2006.
The Data Grid: Towards an Architecture for the Distributed Management and Analysis of Large Scientific Dataset Caitlin Minteer & Kelly Clynes.
INFSO-RI Enabling Grids for E-sciencE SA1: Cookbook (DSA1.7) Ian Bird CERN 18 January 2006.
LCG and HEPiX Ian Bird LCG Project - CERN HEPiX - FNAL 25-Oct-2002.
INFSO-RI Enabling Grids for E-sciencE Logging and Bookkeeping and Job Provenance Services Ludek Matyska (CESNET) on behalf of the.
Summary of Accounting Discussion at the GDB in Bologna Dave Kant CCLRC, e-Science Centre.
May 8, 20071/15 VO Services Project – Status Report Gabriele Garzoglio VO Services Project – Status Report Overview and Plans May 8, 2007 Computing Division,
A.Guarise – F.Rosso 1 Enabling Grids for E-sciencE INFSO-RI Comprehensive Accounting Views on large computing farms. Andrea Guarise & Felice Rosso.
JSPG: User-level Accounting Data Policy David Kelsey, CCLRC/RAL, UK LCG GDB Meeting, Rome, 5 April 2006.
1 Network Management: SNMP The roots of education are bitter, but the fruit is sweet. - Aristotle.
The Grid System Design Liu Xiangrui Beijing Institute of Technology.
Training and the NGS Mike Mineter
GridPP Deployment & Operations GridPP has built a Computing Grid of more than 5,000 CPUs, with equipment based at many of the particle physics centres.
EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks David Kelsey RAL/STFC,
Chapter 5 McGraw-Hill/Irwin Copyright © 2011 by The McGraw-Hill Companies, Inc. All rights reserved.
GRID Overview Internet2 Member Meeting Spring 2003 Sandra Redman Information Technology and Systems Center and Information Technology Research Center National.
Overview of Privilege Project at Fermilab (compilation of multiple talks and documents written by various authors) Tanya Levshina.
US LHC OSG Technology Roadmap May 4-5th, 2005 Welcome. Thank you to Deirdre for the arrangements.
9-Oct-03D.P.Kelsey, LCG-GDB-Security1 LCG/GDB Security (Report from the LCG Security Group) FNAL 9 October 2003 David Kelsey CCLRC/RAL, UK
INFSO-RI Enabling Grids for E-sciencE EGEE is a project funded by the European Union under contract INFSO-RI Grid Accounting.
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks MSG - A messaging system for efficient and.
Status Organization Overview of Program of Work Education, Training It’s the People who make it happen & make it Work.
LCG workshop on Operational Issues CERN November, EGEE CIC activities (SA1) Accounting: current status
TMS - Cooperation partner of TÜV SÜD EFFECTIVE SERVICE MANAGEMENT based on ISO/IEC & ISO/IEC
DTI Mission – 29 June LCG Security Ian Neilson LCG Security Officer Grid Deployment Group CERN.
2005 GRIDS Community Workshop1 Learning From Cyberinfrastructure Initiatives Grid Research Integration Development & Support
Auditing Project Architecture VERY HIGH LEVEL Tanya Levshina.
EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks APEL CPU Accounting in the EGEE/WLCG infrastructure.
EGI-InSPIRE RI EGI EGI-InSPIRE RI Service Operations Security Policy the new generalised site operations security policy.
Accounting in LCG Dave Kant CCLRC, e-Science Centre.
The GRIDS Center, part of the NSF Middleware Initiative Grid Security Overview presented by Von Welch National Center for Supercomputing.
Site Authorization Service Local Resource Authorization Service (VOX Project) Vijay Sekhri Tanya Levshina Fermilab.
INFSO-RI Enabling Grids for E-sciencE Operations Parallel Session Summary Markus Schulz CERN IT/GD Joint OSG and EGEE Operations.
Open Science Grid OSG Accounting System Matteo Melani SLAC 9/28/05 Joint OSG and EGEE Operations Workshop.
Open Science Grid The OSG Accounting System: GRATIA by Philippe Canal (FNAL), Chris Green (FNAL), Jeff Mack (FNAL), Penelope Constanta (FNAL), John Weigand.
Accounting in LCG Dave Kant CCLRC, e-Science Centre.
TIFR, Mumbai, India, Feb 13-17, GridView - A Grid Monitoring and Visualization Tool Rajesh Kalmady, Digamber Sonvane, Kislay Bhatt, Phool Chand,
DGAS Distributed Grid Accounting System INFN Workshop /05/1009, Palau Giuseppe Patania Andrea Guarise 6/18/20161.
Grid Deployment Technical Working Groups: Middleware selection AAA,security Resource scheduling Operations User Support GDB Grid Deployment Resource planning,
EGI-InSPIRE RI EGI-InSPIRE EGI-InSPIRE RI EGI Services for Distributed e-Infrastructure Access Tiziana Ferrari on behalf.
OSG VO Security Policies and Requirements Mine Altunay OSG Security Team July 2007.
Enabling Grids for E-sciencE Claudio Cherubino INFN DGAS (Distributed Grid Accounting System)
DGAS Accounting – toward national grid infrastructures HPDC workshop on Monitoring, Logging and Accounting, (MLA) in production Grids 10/06/2009, Munich.
15-Jun-04D.P.Kelsey, LCG-GDB-Security1 LCG/GDB Security Update (Report from the LCG Security Group) CERN 15 June 2004 David Kelsey CCLRC/RAL, UK
EGEE is a project funded by the European Union under contract INFSO-RI DGAS Grid accounting L.Gaido on behalf of A.Guarise LCG Workshop November.
JRA1 Middleware re-engineering
Bob Jones EGEE Technical Director
JRA3 Introduction Åke Edlund EGEE Security Head
POW MND section.
The OSG Accounting System: GRATIA
Leigh Grundhoefer Indiana University
Ian Bird LCG Project - CERN HEPiX - FNAL 25-Oct-2002
gLite The EGEE Middleware Distribution
Presentation transcript:

1 OSG Accounting Service Requirements Matteo Melani SLAC for the OSG Accounting Activity

2 Who are we? The team Matteo Melani – SLAC Philippe Canal – Fermilab Sudhir Borra –Fermilab

3 And we are talking to Ian Foster, Frank Siebenlist – Globus Sebastien Goasguen –TeraGrid David Kant – LCG Andrea Guarise - EGEE

4 What are the Activity Goals? To provide the OSG stakeholders with a reliable and accurate set of views of the Grid resources usage. The Grid Accounting Project will: design (or choose) the accounting data model ensure the necessary meters and collectors are in place at the resource provider sites, define and deploy repositories and access tools for the reporting and analysis of the grid wide accounting information ensure interoperability with other Grids (LCG, TeraGrid,...)

5 Project Charter OSG Document 131:

6 What are we doing? Just finish the Requirements document OSG Accounting Service Requirements v1.0 - Just released! Working at the Design Architecture Overview Document (DRAFT in preparation) Talking to the stakeholders OSG stakeholders Other Grids stakeholders: LCG, TeraGrid, EGEE, Globus… Reviewing other Accounting Systems DGAS, APEL, SGAS GGF groups RUS/UR/GESA/OGSA-WGs, IETF’s AAA, Telecommunications Network

7 Why a Requirements doc? Verba volant, scripta manent Define the Accounting System scope Establish a common accounting model and terminology so that we can understand each other and we can communicate with OSG stakeholders and other Grids stakeholders Understand OSG needs so that: do not build what we do not need and want reuse what is out there Accounting is a fairly new topic in distributed systems and in IT

8 VO Management System Grid Service Grid wide Accounting System Grid User VO Manger Accounting Sys. Admin, Resourc e Manager Admin s. manag es uses Subscribe to VO Gets VO info Grid Wide Monitoring System Grid Access Service Grid Service OSG Grid Services Site Accounting system Site Monitoring System Storage Resources Network Resources Software Resources OSG Monitoring Service OSG Accounting Service OSG Auth. & Auth. Infrastructure Grid Manager uses Site administration domain & Computing Environment uses Accounting System Scope

9 Main Functionalities (1) The ability to collect resources and services usage data at each resources and services provider site. The ability to combine authentication, authorization and resource usage data related to a Grid user request to produce detailed accounting records. The ability to store and manage accounting records and accounting data. The ability to present accounting records in tabular format at the Grid wide and site level

10 Main Functionalities (2) The ability to apply various (statistical) functions to analysis accounting records and data to facilitate the spotting of trends and patterns in the usage of resources and services. The ability to present the results of this analysis with graphical views. The ability to support auditing processes by storing the raw usage data and maintaining links between the accounting records and the raw usage data used to generate them.

11 Main Functionalities (3) No user charging system, No resources or services pricing No support for an economic model for resource allocation But we have to keep them in mind!

12 System Properties(1) Interoperability The Accounting System should leverage existing standards to maximize interoperability with other Grids and Accounting Services. Fault Tolerance The Accounting System must reduce as much as possible usage data and accounting records loss. The Accounting System must be resilient to temporary communication failures over LAN and WAN. The Accounting System must be resilient to the failure of one of its component.

13 System Properties(2) Security The Accounting System will guarantee integrity and non– repudiation of the accounting records at the site level. The Accounting System must protect accounting information using secure communication channels (mutual authentication, message integrity, confidentiality) and access control lists. Scalability and Performance Not really an issue Other The Accounting System should leverage existing tools and infrastructures to solve related problems.

14 Open Questions How do we measure resource usage? Specific metrics What are the specific graphs and tabular views the stakeholders want? What (and how) Authentication & Authorization information the OSG infrastructure can supply? DN-UID mapping issue Template account

15 What are your accounting needs?

16 Accounting &Monitoring Monitoring Accounting Logging Auditing