1. FP6−2004−Infrastructures−6-SSA-026409 www.eu-eela.org E-infrastructure shared between Europe and Latin America Grid Monitoring Tools Alexandre Duarte CERN IT-GD-OPS Pedro Rausch IF – UFRJ Lost Island – 30.11.2006

2. FP6−2004−Infrastructures−6-SSA-026409 E-infrastructure shared between Europe and Latin America Outline Monitoring and Operational tools –SAM  framework  sensors –SAM Admin Portal

3. FP6−2004−Infrastructures−6-SSA-026409 E-infrastructure shared between Europe and Latin America SAM -- Overview Grid service-level monitoring framework successor of SFT used in Grid Operations VO-based submissions –VO-specific tests services tested currently: CE, gCE SE RB sBDII BDII FTS LFC JobWrapper tests

4. FP6−2004−Infrastructures−6-SSA-026409 E-infrastructure shared between Europe and Latin America Central SAM submissions Official EELA submissions –Production + Certification sites –eela (+ edteam) –job submitted every hour –https://sam.eu-eela.org/sam/sam.pyhttps://sam.eu-eela.org/sam/sam.py SAM Admin Portal (work in progress) –eela –on-demand –Production + Certification sites

5. FP6−2004−Infrastructures−6-SSA-026409 E-infrastructure shared between Europe and Latin America SAM Portal

6. FP6−2004−Infrastructures−6-SSA-026409 E-infrastructure shared between Europe and Latin America SAM Internals framework structure –client  submission framework (developed by CERN team)  sensors developed by different contributors + CERN team tests: plug-in modules –server  web services  portal Oracle DB accessed by web services static (GOCDB) + dynamic (BDIIs) info

7. FP6−2004−Infrastructures−6-SSA-026409 E-infrastructure shared between Europe and Latin America Sensors – CE, gCE, SE, SRM CE, gCE –job submission  UI → RB → CE → WN chain –CA certificates (on WN) –software middleware version (WN) –replica management  lcg-utils  default SE + 3 rd party replication –RGMA, Apel, etc. SE, SRM –UI ↔ SE/SRM  lcg-utils (LFC)

8. FP6−2004−Infrastructures−6-SSA-026409 E-infrastructure shared between Europe and Latin America Sensors – LFC, FTS LFC –lfc-ls + create file in /grid/ FTS –BDII entry check –listing channels  glite-transfer-channel-list (ChannelManagement service) –transfer test (in development):  submitting transfer jobs between SRMs in all Tier0 and Tier1 sites (N-N testing)  checking the status of jobs  Note! The test is relying on availability of SRMs in sites

9. FP6−2004−Infrastructures−6-SSA-026409 E-infrastructure shared between Europe and Latin America Standalone sensors – BDII, RB sBDII (Gstat) –accessibility –sanity checks top-level BDIIs (Gstat) –accessibility –reliability of data (number of entries) RB –jobs submission  UI → important RBs → “reliable” CEs –time of matchmaking

10. FP6−2004−Infrastructures−6-SSA-026409 E-infrastructure shared between Europe and Latin America JobWrapper tests JobWrapper –requested by experiments, also useful in operations –testing all WNs  SAM always tests just an arbitrary one –tests executed by CE wrapper script –test results  passed to the job  published to the SAM DB –test code  core scripts in the release  tests on software area (signed tarball) –soon in PPS

11. FP6−2004−Infrastructures−6-SSA-026409 E-infrastructure shared between Europe and Latin America SAM Admin Portal https://monitoring.egee.man.poznan.pl/admin2 –on-demand SAM submission –easy to use –target site selection –used by: ROCs: certification of a site ROCs, site admins, CODs: speed up debugging We will try to have it for EELA too.

12. FP6−2004−Infrastructures−6-SSA-026409 E-infrastructure shared between Europe and Latin America SAM Admin Portal

13. FP6−2004−Infrastructures−6-SSA-026409 E-infrastructure shared between Europe and Latin America gstat (Sinica) –http://goc.grid.sinica.edu.tw/gstat/http://goc.grid.sinica.edu.tw/gstat/ –Information System (BDII) monitoring –response time, consistency (sanity), completeness –site-BDII + top-level BDII –aggregated and detailed views –plots (history) –refreshed in every 5 mins (non- intrusive)

14. FP6−2004−Infrastructures−6-SSA-026409 E-infrastructure shared between Europe and Latin America gstat

15. FP6−2004−Infrastructures−6-SSA-026409 E-infrastructure shared between Europe and Latin America GOCDB –https://goc.grid-support.ac.uk/gridsite/gocdb2/index.phphttps://goc.grid-support.ac.uk/gridsite/gocdb2/index.php –central database to store static site information –all EGEE sites have to register –contact, security contact, certification status, site type –scheduled maintainence –used by monitoring tools –SAM DB → SAM, FCR, Availability calc. script that generates top-level BDII config file operations management tools

16. FP6−2004−Infrastructures−6-SSA-026409 E-infrastructure shared between Europe and Latin America GOCDB