Somsak Sriprayoonskul, Nopparat Nopkuat, Putchong Uthayopas, Sugree Phatanapherom ThaiGrid, Thailand Cindy Zheng, SDSC.

Slides:



Advertisements
Similar presentations
PRAGMA – TeraGrid – AIST Interoperation Testing Philip Papadopoulos.
Advertisements

Building a CFD Grid Over ThaiGrid Infrastructure Putchong Uthayopas, Ph.D Department of Computer Engineering, Faculty of Engineering, Kasetsart University,
Resources WG Update PRAGMA 9 Hyderabad. Status (in 1 slide) Applications QMMD (AIST) Savannah (MU) iGAP (SDSC, AIST) Middleware Gfarm (AIST) Community.
Reports from Resource Breakout PRAGMA 16 KISTI, Korea.
Resources WG Report Back. Account Creation Complaint –Too difficult to obtain user account on all resources Observations –Just ask Cindy and she will.
Resource WG Update PRAGMA 14 Mason Katz, Yoshio Tanaka, Cindy Zheng.
Resource WG Update PRAGMA 8 Singapore. Routine Use - Users make a system work.
PRAGMA 15 (10/24/2008) Resources Group Pacific Rim Application and Grid Middleware Assembly Resources.
17 th October, 2006PRAGMA 11, Beautiful Osaka, Japan COMPLAINTS TO RESOURCE GROUP Habibah A Wahab, Suhaini Ahmad, Nur Hanani Che Mat School of Pharmaceutical.
Resource WG Update PRAGMA 14 Mason Katz, Yoshio Tanaka, Cindy Zheng.
Resource WG PRAGMA Mason Katz, Yoshio Tanaka, Cindy Zheng.
Resource WG Report. Projects Applications EOL Ninf-G Climate model GridBlast GOC Gangla / SCMSWeb => Uniform Database Goodness Status map (e.g. IVDGL)
GIN Testbed Status 5/11/2006 Peter Arzberger, Cindy Zheng
TeraGrid Deployment Test of Grid Software JP Navarro TeraGrid Software Integration University of Chicago OGF 21 October 19, 2007.
Test harness and reporting framework Shava Smallen San Diego Supercomputer Center Grid Performance Workshop 6/22/05.
S UMMER I NTERNSHIP Douglas Drobny Idaho National Laboratory High Performance Computing.
McFarm: first attempt to build a practical, large scale distributed HEP computing cluster using Globus technology Anand Balasubramanian Karthik Gopalratnam.
Sponsored by the National Science Foundation Systematic Experimentation Case Study: Virtual Router Failure Restoration Xuan Liu UMKC/GENI Project Office.
Condor and GridShell How to Execute 1 Million Jobs on the Teragrid Jeffrey P. Gardner - PSC Edward Walker - TACC Miron Livney - U. Wisconsin Todd Tannenbaum.
CompuNet Grid Computing Milena Natanov Keren Kotlovsky Project Supervisor: Zvika Berkovich Lab Chief Engineer: Dr. Ilana David Spring, /
Maintaining and Updating Windows Server 2008
The SAM-Grid Fabric Services Gabriele Garzoglio (for the SAM-Grid team) Computing Division Fermilab.
SmartLog X 3 TEAM Basic SmartLog X 3 TEAM Basic DescoEMIT.com USER STATUS USER EDIT TEST LOG ADMIN TEST MACHINE SCHEDULE INSTALL System Requirements:
Sponsored by the National Science Foundation Configuration Management For Experimenters: Ansible Hands-On Sarah Edwards, GPO.
So, Jung-ki Distributed Computing System LAB School of Computer Science and Engineering Seoul National University Implementation of Package Management.
Nightly Releases and Testing Alexander Undrus Atlas SW week, May
E-VLBI Software Suite & DRAGON Interoperability Chet Ruszczyk, Jason Soohoo.
Module 7: Fundamentals of Administering Windows Server 2008.
03/27/2003CHEP20031 Remote Operation of a Monte Carlo Production Farm Using Globus Dirk Hufnagel, Teela Pulliam, Thomas Allmendinger, Klaus Honscheid (Ohio.
Transparent Grid Enablement Using Transparent Shaping and GRID superscalar I. Description and Motivation II. Background Information: Transparent Shaping.
TRASC Globus Application Launcher VPAC Development Team Sudarshan Ramachandran.
Grid Computing I CONDOR.
Presents computation Grid Harness the power of Windows, Unix, Linux and Mac OS/X machines.
ThaiGrid: Current Status Vara Varavithya Dept. of Electrical Engineering King Mongkut's Inst. of Tech. North Bangkok, Thailand
CYBERINFRASTRUCTURE FOR THE GEOSCIENCES Data Replication Service Sandeep Chandra GEON Systems Group San Diego Supercomputer Center.
Routine-Basis Experiments in PRAGMA Grid Testbed Yusuke Tanimura Grid Technology Research Center National Institute of AIST.
The huge amount of resources available in the Grids, and the necessity to have the most up-to-date experimental software deployed in all the sites within.
What’s New in WatchGuard XCS v9.1 Update 1. WatchGuard XCS v9.1 Update 1  Enhancements that improve ease of use New Dashboard items  Mail Summary >
Putchong Uthayopas, Sugree Phatanapherom, Nopparat Noppakuat, and Maneerat Suriyapiboonwattana Thai National Grid Center Software Industry Promotion Agency(SIPA),
Tool Integration with Data and Computation Grid GWE - “Grid Wizard Enterprise”
Maintaining and Updating Windows Server Monitoring Windows Server It is important to monitor your Server system to make sure it is running smoothly.
Enabling Grids for E-sciencE System Analysis Working Group and Experiment Dashboard Julia Andreeva CERN Grid Operations Workshop – June, Stockholm.
 Apache Airavata Architecture Overview Shameera Rathnayaka Graduate Assistant Science Gateways Group Indiana University 07/27/2015.
Nguyen Tuan Anh. VN-Grid: Goals  Grid middleware (focus of this presentation)  Tuan Anh  Grid applications  Hoai.
Sept, 2015 How to Choose Collection Options for Smart Net Total Care.
SC2008 (11/19/2008) Resources Group Pacific Rim Application and Grid Middleware Assembly Reports.
David Adams ATLAS DIAL: Distributed Interactive Analysis of Large datasets David Adams BNL August 5, 2002 BNL OMEGA talk.
1 Grid Activity Summary » Grid Testbed » CFD Application » Virtualization » Information Grid » Grid CA.
MySQL and GRID status Gabriele Carcassi 9 September 2002.
INFSO-RI Enabling Grids for E-sciencE ARDA Experiment Dashboard Ricardo Rocha (ARDA – CERN) on behalf of the Dashboard Team.
Korea Workshop May GAE CMS Analysis (Example) Michael Thomas (on behalf of the GAE group)
Super Computing 2000 DOE SCIENCE ON THE GRID Storage Resource Management For the Earth Science Grid Scientific Data Management Research Group NERSC, LBNL.
Tool Integration with Data and Computation Grid “Grid Wizard 2”
EGI-InSPIRE RI EGI-InSPIRE EGI-InSPIRE RI How to integrate portals with the EGI monitoring system Dusan Vudragovic.
EGI-InSPIRE RI EGI-InSPIRE EGI-InSPIRE RI Ops Portal New Requirements.
SAN DIEGO SUPERCOMPUTER CENTER Welcome to the 2nd Inca Workshop Sponsored by the NSF September 4 & 5, 2008 Presenters: Shava Smallen
Cloud Computing project NSYSU Sec. 1 Demo. NSYSU EE IT_LAB2 Outline  Our system’s architecture  Flow chart of the hadoop’s job(web crawler) working.
Gennaro Tortone, Sergio Fantinel – Bologna, LCG-EDT Monitoring Service DataTAG WP4 Monitoring Group DataTAG WP4 meeting Bologna –
4000 Imaje 4020 – Software Imaje 4020 – Content ■ Content of Chapter Software: 1. Flash Up 2. Netcenter 3. FTP 4. Active X 5. XCL commands 6. Exercise.
Digital Media SEAGF Somsak Sriprayoonsakul Thai National Grid Center
Experiment No. 13 Presented by, Mr. Satish Pise. Write a shell script which checks disk space and store the value to the variable and display it. #!/bin/sh.
Simulation Production System Science Advisory Committee Meeting UW-Madison March 1 st -2 nd 2007 Juan Carlos Díaz Vélez.
IBM Control Desk Enabling the Enterprise App Store –
Maintaining and Updating Windows Server 2008 Lesson 8.
TIFR, Mumbai, India, Feb 13-17, GridView - A Grid Monitoring and Visualization Tool Rajesh Kalmady, Digamber Sonvane, Kislay Bhatt, Phool Chand,
April, 2016 How to Choose Collection Options for Smart Net Total Care.
SCMSWeb: Now and Then Putchong Uthayopas Sugree Phatanapherom
Interfacing SCMSWeb with Condor-G – A Joint PRAGMA-Condor Effort.
Extending SCMSWeb 3rd PRAGMA Institute Hand-on Resources II
Initial job submission and monitoring efforts with JClarens
Presentation transcript:

Somsak Sriprayoonskul, Nopparat Nopkuat, Putchong Uthayopas, Sugree Phatanapherom ThaiGrid, Thailand Cindy Zheng, SDSC

Motivation for software cataloging Challenges Which machines install software you want to use? Which software has been installed on one machine

Software Cataloging Requirement Single point of access to software cataloging information Automatic update for a known software with minimal administrative effort Presentation of software availability status that is easy to access Website Section Monitoring > SWCatalog

Software Catalog Local Software Information Local Software Information

Software Cataloging process Grid Software Catalog Grid Software Catalog Globus job submission Probe

Software Cataloging process Master software cataloging service on GOC. Globus is used as a software information collection mechanism Use globus-job-run to invoke the client probe. Probe investigate the setup on each system dynamically Return information using name:version:path format. Storing software information in GOC Provide service to access all the collected data In CSV and XML format

Information provided List of machine that install one software List of software on one system

Available software probes Amber Autodock Intel C/C++/Fortran compiler NAMD Ninf

Demo Software Probe

Alert Service Alert checks probe information everyday to find failure on grid service. Send message to cluster admin when grid service is not available. send message to admin for 3 days then stop to prevent the spam.

Bandwidth Monitoring Measuring bandwidth among sites in PRAGMA Use Iperf to measure current bandwidth Iperf probe provided by SCMSWeb Probe information in XML format will distributed to every node

Bandwidth Section on Probe XML <probe bandwidth_mbps=" " bandwidth="9.31" bandwidth_unit="Kbits/sec" bandwidth_kbps="9.31" bandwidth_bps=" " return_code="0" last_timed_out=" " last_fail="0.0" num_fail="0" last_pass=" " num_pass="216" num_timed_out="7" return_string="PASS" src_name="ABAC" src_org="AU_TH" dest_name="SutGrid" dest_org="" name="sutgrid.sut.ac.th" target="sutgrid.sut.ac.th" objectclass="SceObject,SceProbe,Iperf" subobjtype="Iperf" command="iperf -c sutgrid.sut.ac.th -p 15001" >

Bandwidth Measurement Output Bandwidth Matrix URL Section Monitoring > Bandwidth Bandwidth Graph Show current bandwidth and history Display graph, chart and radar chart Not install on PRAGMA yet

Software Probe Example Ninf-g probe NAMD_PATH=`which namd2 2> /dev/null` if [ "$?" = 0 ]; then NAMD_VERSION=`namd2 2> /dev/null | egrep "^Info: NAMD" | sed \ "s/Info: NAMD \([0-9.]*\) for.*/\1/g"` echo "namd:$NAMD_VERSION:$NAMD_PATH" fi ICC_PATH=`which icc 2> /dev/null` if [ "$?" = 0 ]; then ICC_VERSION=`icc -V 2>&1| egrep "Version" | sed \ "s/.*Version[[:space:]]*\([0-9.]*\)[[:space:]]*Build.*/\1/g"` echo "intel_c_compiler:$ICC_VERSION:$ICC_PATH" fi Intel C Compiler probe

Formats for SW catalog data CSV Host\Softwares,amber,namd,aut odock4,intel_c_compiler,intel _fortran_compiler,ninf-g ASGC,X,X,X,8.1;/prj/intel/00/bin /icc,8.1;/prj/intel/00/bin/ifort, 2.4.0;/prj/ng-2.4.0/bin Syntagma,X,X,X,9.0;/opt/intel/c c/9.0/bin/icc,9.0;/opt/intel/fc /9.0/bin/ifort,2.4.0;/opt/ng/bi n... XML /prj/intel/00/bin/icc /prj/intel/00/bin/ifort /prj/ng-2.4.0/bin