SEE-GRID-SCI Regional Grid Infrastructure: Resource for e-Science Regional eInfrastructure development and results IT’10, Zabljak, Montenegro, 25 Feb 2010 Dr. Antun Balaz Institute of Physics Belgrade The SEE-GRID-SCI initiative is co-funded by the European Commission under the FP7 Research Infrastructures contract no

Regional eInfrastructure development and results, IT’10, Zabljak, Montenegro, February 25, 2010 Overview Regional Grid infrastructure development Core Grid services Management of eInfrastructure Usage of regional Grid infrastructure Regional resources for e-Science collaboration

Regional eInfrastructure development and results, IT’10, Zabljak, Montenegro, February 25, 2010 Infrastructure development (1) History available at History available at

Regional eInfrastructure development and results, IT’10, Zabljak, Montenegro, February 25, 2010 Infrastructure development (2) SEE-GRID-SCI infrastructure contains currently the following resources:  Total CPUs: more than 3000  Storage: more than 450 TB  44 sites in SEE-GRID-SCI production  Typical machine configuration: dual or quad-core CPUs, with 1GB of RAM per CPU core; many sites with 64-bit architecture

Regional eInfrastructure development and results, IT’10, Zabljak, Montenegro, February 25, 2010 Core services  Catch-all Certification Authority  enables regional sites to obtain user and host certificates  Virtual Organisation Management Service (VOMS),  For each scientific community deployed in two instances for failover  Supporting groups and roles  Workload management service (glite-WMS/LB) and Information Services (BDII)  For each scientific community deployed in several instances for failover  Logical File Catalogue (LFC)  For each scientific community deployed in several instances for failover  MyProxy  Supports certificate renewal for all deployed WMS/RB services  For each scientific community deployed in several instances for failover  File Transfer Service (FTS)  Used in production  Relational Grid Monitoring Architecture (R-GMA) Registry and Schema  SEE-GRID accounting publisher, with support for MPI jobs accounting  AMGA Metadata Catalogue

Regional eInfrastructure development and results, IT’10, Zabljak, Montenegro, February 25, 2010 Core services map

Regional eInfrastructure development and results, IT’10, Zabljak, Montenegro, February 25, 2010 Infrastructure management

Regional eInfrastructure development and results, IT’10, Zabljak, Montenegro, February 25, 2010 Operational/monitoring tools (1) Hierarchical Grid Site Management (HGSM) (+interface to GOCDB) – Turkey BBMSAM Service Availability Monitoring + extensions – Bosnia and Herzegovina with Serbia support Helpdesk + NMTT (+ interoperation with EGEE-SEE and GGUS + intergration with Nagios) – Romania with CERN support SEE-GRID GoogleEarth – Turkey + ic.ac.uk Global Grid Information Monitoring System (GStat) – ASGC, Taiwan R-GMA and Accounting Portal – Bulgaria Nagios - Bulgaria Real Time Monitor (RTM) – ic.ac.uk and Turkey (HGSM) MONitoring Agents using a Large Integrated Services Architecture (MonALISA) – Romania What is at the Grid (WatG) – Serbia WMSMON tool – Serbia Pakiti – Greece GSSVA (security-enabled Pakiti extension) – SZTAKI SEE-GRID Wiki with detailed information for site administrators

Regional eInfrastructure development and results, IT’10, Zabljak, Montenegro, February 25, 2010 Operational/monitoring tools (2) Static Database: HGSM  Static database containing all relevant data about all SEE-GRID-SCI sites  Synchronized with the real situation Monitoring  BBmSAM  Portal that provides access to the database of SAM tests results  Central tools for identification of operational problems  Provides SLA metrics

Regional eInfrastructure development and results, IT’10, Zabljak, Montenegro, February 25, 2010 Operational/monitoring tools (3)  Gstat  Central tool for monitoring of the information system of SEE-GRID-SCI infrastructure  Nagios  Collection of alarms raised by various tools  In the future, automatic creation of Helpdesk tickets will be implemented  Pakiti  Helps the system administrator keeping multiples machines up-to- date and prevent unpatched machines to be kept silently on the network.  GSSVA (JRA1)

Regional eInfrastructure development and results, IT’10, Zabljak, Montenegro, February 25, 2010 Operational/monitoring tools (4)  WMSMON  Aggregated and detailed status view of all monitored WMS services  Links to the appropriate troubleshooting guides  Real Time Monitor  Using satellite imagery from NASA, these clients display the SEE-GRID-SCI as it is geographically spread over the region  Googlemap  MonaLisa

Regional eInfrastructure development and results, IT’10, Zabljak, Montenegro, February 25, 2010 Operational/monitoring tools (5) Helpdesk: OneOrZero  Central reference point for tracking of all operational and user problems  Identified problems are reported through the Helpdesk and assigned to the appropriate supported  NMTT (JRA1) Accounting portal  Collects the accounting data from all SEE-GRID-SCI sites through apel MPI-enabled accounting publisher developed by the project  Provides aggregated accounting data by site, country, institution, application Operations wiki

Regional eInfrastructure development and results, IT’10, Zabljak, Montenegro, February 25, 2010 Infrastructure usage (1)

Regional eInfrastructure development and results, IT’10, Zabljak, Montenegro, February 25, 2010 Infrastructure usage (2)

Regional eInfrastructure development and results, IT’10, Zabljak, Montenegro, February 25, 2010 Infrastructure usage (3) Overall accounting: Base CPU years  SEE-GRID-SCI VOs: Base CPU years (9.87%)  EGEE VOs: Base CPU years (27.06%)  National VOs: Base CPU years (63.06%) SEE-GRID-SCI VOs supported on all sites  ENV: 5.81 Base CPU years  METEO: 5.17 Base CPU years  SEISMO: 0.13 Base CPU years Number of jobs for SEE-GRID-SCI VOs: around 500k

Regional eInfrastructure development and results, IT’10, Zabljak, Montenegro, February 25, 2010 Regional resources for e- Science collaboration Grid eInfrastructure is by far the largest computing and storage resource available in the South Eastern Europe However, it is only a resource for e-Science collaboration in the region and on the pan-European level Significant usage demonstrates already established research collaboration in various scientific fields  Meteorology  Seismology  Environmental sciences All partners from the region are very open for further cooperation  Computer science  Physics  Chemistry…