APEL Storage Accounting

Slides:



Advertisements
Similar presentations
Accounting Update Dave Kant Grid Deployment Board Nov 2007.
Advertisements

Storage Accounting John Gordon, STFC GDB June 2012.
EGI-InSPIRE RI EGI-InSPIRE EGI-InSPIRE RI EG recent developments T. Ferrari/EGI.eu ADC Weekly Meeting 15/05/
EGI-InSPIRE RI EGI-InSPIRE EGI-InSPIRE RI GPGPU Accounting John Gordon STFC 09/04/2013 EGI CF – Accounting and Billing1.
Summary of Accounting Discussion at the GDB in Bologna Dave Kant CCLRC, e-Science Centre.
Monitoring the Grid at local, national, and Global levels Pete Gronbech GridPP Project Manager ACAT - Brunel Sept 2011.
Grid Lab About the need of 3 Tier storage 5/22/121CHEP 2012, The need of 3 Tier storage Dmitri Ozerov Patrick Fuhrmann CHEP 2012, NYC, May 22, 2012 Grid.
ARC Accounting John Gordon. Limitations Resilience – Religious objection to using the BDII for service discovery so only one message broker is hardcoded.
Steve Traylen PPD Rutherford Lab Grid Operations PPD Christmas Lectures Steve Traylen RAL Tier1 Grid Deployment
Multicore Accounting John Gordon, STFC-RAL WLCG MB, July 2015.
GDB March User-Level, VOMS Groups and Roles Dave Kant CCLRC, e-Science Centre.
EGI-InSPIRE RI EGI-InSPIRE EGI-InSPIRE RI Enforcement of the personal data retention policy Peter Solagna, EGI.eu WLCG.
EGI-InSPIRE RI EGI-InSPIRE EGI-InSPIRE RI Global Accounting in the Grid and Cloud John Gordon, STFC HEPiX, Beijing.
Storage Accounting John Gordon, STFC GDB March 2013.
EMI INFSO-RI Accounting John Gordon (STFC) APEL PT Leader.
Local Job Accounting Cristina del Cano Novales STFC-RAL.
Accounting Update John Gordon and Stuart Pullinger January 2014 GDB.
Accounting non-Grid Use John Gordon Management Board 7/6/2007.
APEL Cloud Accounting Status and Plans APEL Team John Gordon.
EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks APEL CPU Accounting in the EGEE/WLCG infrastructure.
LCG WLCG Accounting: Update, Issues, and Plans John Gordon RAL Management Board, 19 December 2006.
LCG Introduction John Gordon, STFC GDB July8th 2009.
LCG Accounting Update John Gordon, CCLRC-RAL WLCG Workshop, CERN 24/1/2007 LCG.
LCG User Level Accounting John Gordon CCLRC-RAL LCG Grid Deployment Board October 2006.
Accounting in LCG/EGEE Can We Gauge Grid Usage via RBs? Dave Kant CCLRC, e-Science Centre.
LCG Accounting/Reporting John Gordon, STFC MB November 9 th 2011.
The National Grid Service User Accounting System Katie Weeks Science and Technology Facilities Council.
EGI-InSPIRE RI EGI-InSPIRE EGI-InSPIRE RI EGI-InSPIRE APEL for Accounting John Gordon, Stuart Pullinger STFC.
EGI-InSPIRE RI EGI-InSPIRE EGI-InSPIRE RI Accounting Requirements Stuart Pullinger STFC 09/04/2013 EGI CF – Accounting.
Installation Accounting Status Flavia Donno CERN/IT-GS WLCG Management Board, CERN 28 October 2008.
Accounting John Gordon WLC Workshop 2016, Lisbon.
APEL Architecture Alison Packer. Overview Grid jobs accounting tool APEL Client software - installed in sites (CEs, gLite- APEL node) APEL Server accepts.
WLCG Accounting Task Force Update Julia Andreeva CERN GDB, 8 th of June,
EGI-InSPIRE RI EGI-InSPIRE EGI-InSPIRE RI Storage Accounting John Gordon, STFC OMB August 2013.
EGI-InSPIRE RI EGI-InSPIRE EGI-InSPIRE RI Accounting Requirements Stuart Pullinger STFC 09/04/2013 EGI CF – Accounting.
LCG Accounting Update John Gordon, CCLRC-RAL 10/1/2007.
John Gordon EMI TF and EGI CF March 2012 Accounting Workshop.
EGI-InSPIRE RI EGI-InSPIRE EGI-InSPIRE RI EGI Services for Distributed e-Infrastructure Access Tiziana Ferrari on behalf.
EGI-InSPIRE RI EGI-InSPIRE EGI-InSPIRE RI Regional tools use cases overview Peter Solagna – EGI.eu On behalf of the.
Accounting Update John Gordon. Outline Multicore CPU Accounting Developments Cloud Accounting Storage Accounting Miscellaneous.
Storage Accounting John Gordon STFC GDB, Lyon 6 th April2011 GDB January 2012.
Accounting Update Dave Kant, John Gordon RAL Javier Lopez, Pablo Rey Mayo CESGA.
EGI-InSPIRE RI EGI-InSPIRE EGI-InSPIRE RI APEL Regional Accounting Alison Packer (STFC) Iván Díaz Álvarez (CESGA) APEL.
EGI-InSPIRE RI EGI-InSPIRE EGI-InSPIRE RI Metrics Portal Development Update.
May pre GDB WLCG services post EGEE Josva Kleist Michael Grønager Software Coord NDGF Director CERN, May 12 th 2009.
HTCondor Accounting Update
Daniele Bonacorsi Andrea Sciabà
GridPP37, Ambleside Adrian Coveney (STFC)
Gridpp37 – 31/08/2016 George Ryall David Meredith
John Gordon STFC OMB 26 July 2011
The New APEL Client Will Rogers, STFC.
WLCG Resources Reporting
WLCG Accounting Task Force Update Julia Andreeva CERN IT on behalf of the WLCG Accounting Task Force GDB
Benchmarking Changes and Accounting
POW MND section.
GOCDB Update 27/05/ Me: Working on GOCDB 3 days a week
Update on Plan for KISTI-GSDC
Raw Wallclock in APEL John Gordon, STFC-RAL
JRA1.4 - Account for different resource types
Proposal for obtaining installed capacity
Accounting Requirements
WLCG Accounting Task Force Update Julia Andreeva CERN WLCG Workshop 08
Cristina del Cano Novales STFC - RAL
WLCG and support for IPv6-only CPU
John Gordon (STFC) APEL PT Leader
New Types of Accounting Beyond CPU
GLOBUS ACCOUNTING USING GRID-SAFE - DEMO
Accounting Repository
APEL as a Global Accounting Repository
User Accounting Integration Spreading the Net.
Presentation transcript:

APEL Storage Accounting Pre-GDB – 2017-09-12 APEL Storage Accounting John Gordon, STFC 2017-09-12 Pre-GDB on Storage

Summary APEL storage accounting is available for dCache and DPM which covers most sites Records LogicalCapacityUsed per VO/Group/Role and displays max/min/avg per month About 30 sites are now sending storage accounting records to APEL Data viewable in the old development Accounting Portal: http://accounting-devel.egi.eu/storage.php EGI plans to move this into production RSN

Recent Updates Added Role/Group to record Added new GOCDB servicetype eu.egi.storage.accounting to identify publishing hosts Moved to production broker queue and SSL Correct portal averaging

Current Storage Sites

Site View

All Sites Plots

All Sites Plots

LHC VOs Just like CPU, one can use the tree on the left to navigate among NGIs and Sites.

Next Steps Move to production Campaign to get dpm/dcachesites publishing Increase range of storage systems supported Straightforward script to query database and fill record template Ingest JSON files produced by sites E.g ATLAS or WLCG standard format APEL has demonstrated it can combine data from a variety of sources to give a global view. Developed pull model for IndigoDataCloud and Dataset accounting as well as the traditional push model of grid cpu over broker network.

Thank You Questions?