DORII review Deployment and management of production infrastructure SA2 Ioannis Liabotis Greek Research and Technology Network - GRNET October 21, 2009, Munich

 Introduction to SA2  Objectives  Deliverables and Milestones  Activities and Schedule  SA2 Activities and Work performed  Action Points  Conclusions Outline 2

 SA2: Deployment and management of production infrastructure  Duration: 30M, from M1 to M30  PMs: Funded 66, Unfunded 26  Partners: Introduction InstituteEffort in PMsInstituteEffort in PMs PSNC5CSIC5 CNIT22ELETTRA5 EUCENTRE5OGS5 ECOHYDROS5GRNET9 UC5 3

 To create, operate, support and manage of a production quality grid infrastructure integrating computational, storage and instrument resources  To describe an operational layer on top of existing Grid infrastructures, which will allow for easy integration of instruments and relevant applications with the Grid  To assemble a new testbed infrastructure by incorporating and exploiting existing expertise and experience in deploying, supporting and operating prototype instrumentation grids  To integrate scientific instrumentation and sensors and deploy them on the available infrastructure  To co-ordinate and manage the relationships with resource and network providers, through negotiation of service-level agreements, and to negotiate with wider grid communities  To keep a production level infrastructure to be able to support the daily work of selected DORII scientific communities Objectives 4

 DSA2.1 Analysis of technical and functional requirements (M5) - Done  DSA2.2 Description of the framework of the management infrastructure (M10) – Done  MSA2.1 Infrastructure for applications and instrumentation (First Version) (M10)– Done  DSA2.3 Deployment and test of selected applications on the infrastructure (M13) - Done  MSA2.2 First Deployment of applications on the infrastructure (M13) - Done Deliverables and Milestones 5

 DSA2.3.a Deployment Deployment and test of selected applications on the infrastructure - Update (M18) - Done  MSA 2.3 Infrastructure for applications and instrumentation (Second Version) (M18) – Done  DSA2.4. Final description of the deployed management infrastructure (M24) – Do be done  Define the final framework for a production instrumentation infrastructure

 TSA2.1: Analysis of Existing Resources (CNIT, GRNET) - Finished  TSA2.2: Definition of the framework of the support and management infrastructure (CNIT, GRNET) - Finished  TSA2.3: Implementation and management of testbeds (CNIT, GRNET, PSNC, CSIC, ELETTRA, EUCENTRE, OGS, ECOHYDROS, UC) - Ongoing  TSA2.4: Finalisation of the framework of the support and management infrastructure (CNIT, GRNET) - Ongoing Overall schedule 7

 Earthquake Community  Actuators - eucentre (ncss) - a set of actuators and sensors of the building simulator  Seismic sensors - eucentre (eews) - a set of sensor that will be distributed in a hot zone Instrument Resources (1/3) 8

 Environmental Community  FLOATS, GLIDERS - ogs (ocom-moon) - 4 floats, 1 glider  Cameras -UC (horus-bench) - 2 cameras  Water Reservoir sensors – CSIC (echohydros) 3 sensors Instrument Resources (2/3) 9

 Experimental Science Community  SAXS: Small Angle X-ray Scattering -ELETTRA  XRD: X-Ray Diffraction - ELETTRA  SYRMEP: SYnchrotron Radiation for MEdical Physics - ELETTRA  Demos: elettra (demo) - 3 robots, 1 robocam Instrument Resources (3/3) 10

Infrastructure Status – Computational and Storage Resources  Support the vo.dorii.eu catch-all VO  Other DORII Related VOs supported in various sites in Italy and Spain  Ihydra  ienvmod  gridats  lights.infn.it 11

Core Services

vo.dorii.eu Members (at M13) 13

vo.dorii.eu Members (at M20)

Number of Users per application

vo.dorii.eu Usage – Number of Jobs * MPI & parametric Jobs not accounted 16

IE Accounting  Design for IE accounting The total number of IE users (by time interval, by time) The total number of hours in which an IE has been used (by time interval and/or by an user) How many actions have been executed on the IE (by time interval, by a user, by an action type and by whichever mix of previous filters) Instrument/sensor system administrator Total number of IM users (by time interval, by time) How many times a specific attribute/parameter has been read/wrote (by time interval and/or by a user) How many times a specific command has been executed (by time interval and/or by a user) How many times an IM has been locked (by time interval and/or by a user) How many hours an IM has been locked (by time interval and/or by a user) The total number of hours in which an IM has been used (by time interval and/or by a user) 18

Resource Availability  Computational and Storage resources availability ~ 90%  IE Resources availability:  Job success rate ~ 97% 19

Users Perspective Evaluatiom

Integration with Network Resource Provisioning  Collaborate closely with SA1 to identify network related problems  Use of Helpdesk  Use of Network Monitoring tools  Liaison with NRENs 21

Future Plans  Long Term  Continue the infrastructure operations and provide services to DORII users  Finalize the design of the management framework or the e-Infrastructure  Short Term  Deploy Secondary VOMS Server  Provide IE accounting data on a periodic basis  HelpDesk is not used  Installation of OpenMPI in all HG sites (almost ready)  This task took a long time  Register DORII VO to CIC portal  Perform infrastructure evaluation? 22

Thank you!  Questions? 23