1. www.egi.eu EGI-InSPIRE RI-261323 EGI-InSPIRE www.egi.eu EGI-InSPIRE RI-261323 Accounting Old and New Requirements John Gordon Revised 22/3/12

2. www.egi.eu EGI-InSPIRE RI-261323 Regional Accounting Repo: Keep local the accounting data for specific regional VOs - https://rt.egi.eu/rt/Ticket/Display.html?id=2798 https://rt.egi.eu/rt/Ticket/Display.html?id=2798 –Regional accounting repo in the roadmap, available by the end of 2012 –Client already has a filter for which VOs to publish. Regionalised repository will have the same. Regional Accounting Repo Local Data 2

3. www.egi.eu EGI-InSPIRE RI-261323 Retrieve NGI accounting data - https://rt.egi.eu/rt/Ticket/Display.html?id=3304 https://rt.egi.eu/rt/Ticket/Display.html?id=3304 Foreign usage vs national usage on CESGA portal - https://rt.egi.eu/rt/Ticket/Display.html?id=1603 https://rt.egi.eu/rt/Ticket/Display.html?id=1603 Request of Italian userDN accounting data - https://rt.egi.eu/rt/Ticket/Display.html?id=2723 https://rt.egi.eu/rt/Ticket/Display.html?id=2723 NGI user accounting views - https://rt.egi.eu/rt/Ticket/Display.html?id=3425 https://rt.egi.eu/rt/Ticket/Display.html?id=3425 Usage of an NGI by users belonging to other countries 3

4. www.egi.eu EGI-InSPIRE RI-261323 Torsten led a VT to gather requirements for an NGI Report URL? –https://wiki.egi.eu/wiki/VT_Inter_NGI_Usage_Report#Proposed_Ta ble_of_Contents_for_the_EGI_Usage_Reporthttps://wiki.egi.eu/wiki/VT_Inter_NGI_Usage_Report#Proposed_Ta ble_of_Contents_for_the_EGI_Usage_Report New one just started to investigate the feasibility of the requirements. –https://wiki.egi.eu/wiki/VT_Feasibility_Usage_Reporthttps://wiki.egi.eu/wiki/VT_Feasibility_Usage_Report Many of this bunch of requirements are covered by the requirements for this report. SPG working on a policy revisions that would support an additional role. Still need clarification: Should an NGI Manager see worldwide use of their country’s users, or All users using their national resources? NGI Report Technical Forum, Lyon 2011-09-204

5. www.egi.eu EGI-InSPIRE RI-261323 User level accounting to the VO Resource Manager https://rt.egi.eu/rt/Ticket/Display.html?id=3070 https://rt.egi.eu/rt/Ticket/Display.html?id=3070 –Operations involved, not only for JRA1 –Sites not publishing UserDNs. Support Accounting Portal: get all users data from the VO manager view - https://rt.egi.eu/rt/Ticket/Display.html?id=3209 https://rt.egi.eu/rt/Ticket/Display.html?id=3209 –Support Retrieve accounting data aggregated per User DN, VOMS group and role, site - https://rt.egi.eu/rt/Ticket/Display.html?id=3303 (under discussion) https://rt.egi.eu/rt/Ticket/Display.html?id=3303 I believe that all this information is already provided in.csv form. Is this correct or are you also asking for different or extended views as well as XML output. b) I think there is a related requirement to extend the lists to show more than just the top ten Users, Groups, etc. Data for VO Manager 5

6. www.egi.eu EGI-InSPIRE RI-261323 Requirements from the SA1 Survey 6

7. www.egi.eu EGI-InSPIRE RI-261323 Accounting of MPI jobs, which we consider very important for the sites, is not reliable –Already in the JRA1.4 activities –Still haven’t agreed what the portal should show. We also need a reliable storage accounting, we are not certain that this is provided by the accounting portal –I am certain that it is not. –Already in the JRA1.4 activities MPI & Storage 7

8. www.egi.eu EGI-InSPIRE RI-261323 A users ‐ per ‐ country view (nationality view) is needed by the funding agencies. I would like to see an NGI_Manager role that is able to get accounting data for all sites in his/her responsibility up to Users DN so that we are able to extract valuable data from catch all VOs –Already covered by several RT tickets Users per-Country View 8

9. www.egi.eu EGI-InSPIRE RI-261323 The data which was sent from the site can be seen from the web page after one or more days according to the load of the accounting servers. –Job data needs to be summarised in the repository before sending to the portal. This takes many hours. We will look at optimising in the new infrastructure Graphs and interaction should need to be evolved towards new web technologies; The user interfaces is much overloaded, but the GUI answers fast. We did not see a CSV export function Optimize for mobile access. Optimizations 9

10. www.egi.eu EGI-InSPIRE RI-261323 More explanation/documentation would be needed to better understand displayed figures It is still hard to setup a national instance Optimizations 2 10

11. www.egi.eu EGI-InSPIRE RI-261323 Current Roadmap Technical Forum, Lyon 2011-09-2011 Tasks (Repository)Planned completion time New SSM-based infrastructure in production03/12 on target-ish Receiving Test Storage Records04/12 Receiving test cloud records04/12 Achieved 03/12 Database migration06/12 SGAS blocker? Emi-apel client using SSM released11/12 Regional distribution of repository12/12 Tasks (Portal)Planned completion time Accounting Portal v4.1 (Deneb)  VO scope views v1.  Regional Accounting portal.  Generic REST XML endpoints. 30/04/12 Accounting Portal v4.2 (Electra):  Contributed CPUs view.  Parallel Job accounting. 31/10/12