EGI-InSPIRE RI EGI-InSPIRE EGI-InSPIRE RI Accounting Old and New Requirements John Gordon Revised 22/3/12

EGI-InSPIRE RI Regional Accounting Repo: Keep local the accounting data for specific regional VOs –Regional accounting repo in the roadmap, available by the end of 2012 –Client already has a filter for which VOs to publish. Regionalised repository will have the same. Regional Accounting Repo Local Data 2

EGI-InSPIRE RI Retrieve NGI accounting data Foreign usage vs national usage on CESGA portal Request of Italian userDN accounting data NGI user accounting views Usage of an NGI by users belonging to other countries 3

EGI-InSPIRE RI Torsten led a VT to gather requirements for an NGI Report URL? – ble_of_Contents_for_the_EGI_Usage_Reporthttps://wiki.egi.eu/wiki/VT_Inter_NGI_Usage_Report#Proposed_Ta ble_of_Contents_for_the_EGI_Usage_Report New one just started to investigate the feasibility of the requirements. – Many of this bunch of requirements are covered by the requirements for this report. SPG working on a policy revisions that would support an additional role. Still need clarification: Should an NGI Manager see worldwide use of their country’s users, or All users using their national resources? NGI Report Technical Forum, Lyon

EGI-InSPIRE RI User level accounting to the VO Resource Manager –Operations involved, not only for JRA1 –Sites not publishing UserDNs. Support Accounting Portal: get all users data from the VO manager view –Support Retrieve accounting data aggregated per User DN, VOMS group and role, site - (under discussion) I believe that all this information is already provided in.csv form. Is this correct or are you also asking for different or extended views as well as XML output. b) I think there is a related requirement to extend the lists to show more than just the top ten Users, Groups, etc. Data for VO Manager 5

EGI-InSPIRE RI Requirements from the SA1 Survey 6

EGI-InSPIRE RI Accounting of MPI jobs, which we consider very important for the sites, is not reliable –Already in the JRA1.4 activities –Still haven’t agreed what the portal should show. We also need a reliable storage accounting, we are not certain that this is provided by the accounting portal –I am certain that it is not. –Already in the JRA1.4 activities MPI & Storage 7

EGI-InSPIRE RI A users ‐ per ‐ country view (nationality view) is needed by the funding agencies. I would like to see an NGI_Manager role that is able to get accounting data for all sites in his/her responsibility up to Users DN so that we are able to extract valuable data from catch all VOs –Already covered by several RT tickets Users per-Country View 8

EGI-InSPIRE RI The data which was sent from the site can be seen from the web page after one or more days according to the load of the accounting servers. –Job data needs to be summarised in the repository before sending to the portal. This takes many hours. We will look at optimising in the new infrastructure Graphs and interaction should need to be evolved towards new web technologies; The user interfaces is much overloaded, but the GUI answers fast. We did not see a CSV export function Optimize for mobile access. Optimizations 9

EGI-InSPIRE RI More explanation/documentation would be needed to better understand displayed figures It is still hard to setup a national instance Optimizations 2 10

EGI-InSPIRE RI Current Roadmap Technical Forum, Lyon Tasks (Repository)Planned completion time New SSM-based infrastructure in production03/12 on target-ish Receiving Test Storage Records04/12 Receiving test cloud records04/12 Achieved 03/12 Database migration06/12 SGAS blocker? Emi-apel client using SSM released11/12 Regional distribution of repository12/12 Tasks (Portal)Planned completion time Accounting Portal v4.1 (Deneb)  VO scope views v1.  Regional Accounting portal.  Generic REST XML endpoints. 30/04/12 Accounting Portal v4.2 (Electra):  Contributed CPUs view.  Parallel Job accounting. 31/10/12