Monitoring and Information Services Technical Group Report Mark L. Green, Ph.D. Co-Chair, Monitoring and Information Services Technical Group
Outline Current State VDT 1.3.6 Validation OSG 0.1.6 Validation From MIS standpoint looks good Buffalo has a problem with 64-bit machine OSG 0.1.6 Validation GIP/MDS Configuration Digesting GIP documentation and Schema specification Need to form documentation for proper configuration Script based Should static information GIP requires be part of OSG minimum monitoring requirements? Ongoing work Currently formulating Roadmap for OSG MIS with the LCG/EGEE Grid Deployment Team
Need for MIS-CI Activity Formation Outline Monitoring and Information Services - Core Infrastructure (MIS-CI) The Monitoring and Information Services Technical Group has determined the need for a well defined MIS-CI Activity. This has also been discussed with several other Technical Groups and Activities including Deployment, Operations, Interoperable and Provisioning. We have identified several potential interested contributors for the Activity already. The Activity co-chairs are (pending formal acceptance): Mark L. Green LCG Representative (Markus, Laurence, Software Development Team Member)
MIS-CI Scope MIS-CI Information Gathering Scope Gatekeeper Statistics Fine Grain Load Information Memory Processes Etc. Service Statistics Gatekeeper GridFTP SRM Site Functional Tests VO Based Disk Utilization Batch Job Statistics Worker Node Validation
MIS-CI Scope MIS Compute Element and Storage Element Resource Repository Lightweight with minimal resource loading and requirements Self monitoring Expandable Common schema with unique name space Virtual organization based aggregation Timestamps
MIS-CI Scope MIS Compute Element and Storage Element Information Gathering Lightweight information gathering Self monitoring Expandable Modular design Cron based implementation
MIS-CI Scope MIS Compute Element and Storage Element Information Gathering Lightweight information gathering Self monitoring Expandable Modular design Cron based implementation
MIS-CI Mission Re-design the proposed MIS-CI system architecture to include the following capabilities: Inter-operational with European EGEE Grid Inter-operational with partner grids TeraGrid SURA SHARCNET Etc. Expand and submit current OSG minimum monitoring requirements documents Incorporate storage resource monitoring
MIS-CI Architecture SQL-Lite Database Remote VO Historical Repository Local Backup User Resource Gatekeeper jobmanager-mis -profile (default) jobs gridftp diskspace -accounting policy environment software VO statistics security Discovery Service MIS-CI Profiles Schema Eval Cron Self- Monitor accounting ? MIS-CI Consumer Throttling MIS-CI Resource Throttling Custom Remote Repository Grid Scheduler OSG Auditing/Accounting
MIS-CI Level of Effort Indiana GOC Binghamton LCG/EGEE Grid Deployment Center for Computational Research SUNY Buffalo Stakeholder 1.5 FTE Indiana GOC 0.5 FTE Binghamton 1.0 FTE LCG/EGEE Grid Deployment 0.25 FTE (pending) Others Estimated requirement 2.0 FTE