WMS LB topBDII Installation and Configuration Emilio Mastriani (mastriani@dmi.unict.it) Mexico City, Mexico Latin America 2 2010 - Joint GISELA/EPIKH School for Grid Site Administrators Mexico, 10.11.2010 1

WMS LB The Workload Management System (WMS) is the gLite service that allows users to submit jobs, and performs all tasks required to execute them, without exposing the user to the complexity of the Grid. The Logging and Bookkeeping service (LB) tracks jobs in terms of event (important points of job life, e.g. submission, finding a matching CE, starting execution etc.) gathered from various WMS components as well as Ces. The Berkeley Database Information Index (BDII) consists of two or more standard LDAP databases that are populated by an update process. The update process obtains LDIF from either doing an ldapsearch on LDAP URLs or by running a local script that generates LDIF. The LDIF is then inserted into the LDAP database. 2 2 2

gLite WMS Architecture 3 3

gLite WMS Architecture Acts as the portal for accepting all external requests to the workload manager. Job submission, cancellation expressed via a JDL 4 4

Workload Management System The Workload Management System (WMS) consists of a set of Grid middleware components in charge of distributing and managing jobs across Grid resources Purpose of the Workload Manager (WM) is to accept and satisfy requests for job management coming from its clients The WM hands over the job to an appropriate Computing Element (CE) for execution taking into account requirements and the preferences expressed in the job description. The decision on which resource should be used is the outcome of the so called matchmaking process 5 5

GILDA VM source The instructions provided in this presentation assume that you are going to use a machine with Scientific Linux 4.8 installed. Virtual Machine image (GILDA VM Base_SLC4._i386) available at: https://gilda.ct.infn.it/VirtualServices.html 6 6 6

Connecting to the VM ssh root@yourvm.netw.mx Password: GildaVM.10 The IP's and hostnames are: 132.247.129.[100 to 120] = host100.unam.mx to host120.unam.mx 21 IP's and 132.247.129.[133 to 135] = host133.unam.mx to host135.unam.mx 3 IP's ssh root@yourvm.netw.mx Password: GildaVM.10 7

Repository settings Initial steps: cd /etc/yum.repos.d/ ; rm dag.repo Download extra repo: Download internal repo Copy the gilda utils: wget http://grid018.ct.infn.it/mrepo/repos/gilda.repo -O /etc/yum.repos.d/gilda.repo export MREPO="http://132.247.129.92/mrepo/repos/others/" EXTRA="cern-extra cern-rhaps2 cern-testing cern-update cern dag jpackage lcg-ca" for name in $EXTRA; do wget $MREPO/$name.repo -O /etc/yum.repos.d/$name.repo; done REPOS="glite-bdii glite-lb glite-wms" export MREPO="http://132.247.129.92/mrepo/repos/GILDA/sl4_i386/" for name in $REPOS; do wget $MREPO/$name.repo -O /etc/yum.repos.d/$name.repo; done To get a full mirror of GILDA repository: wget -mp -nH -np http://grid018.ct.infn.it/mrepo/ Follows a brief explanations of the used parameters: -m This option is used to make mirrors. This means that the next time the command will be issued it will download just the updated files rather than the whole site again. -p It will include other elements like images to correctly show the mirrored web pages -nH This command avoids to create the subdirectories: ‘grid018.ct.infn.it/rep’ onthe destination Follows a brief explanations of the used parameters:-mThis option is used to make mirrors. This means that the next time the command will be issued it will download just the updated files rather than the whole site again.-pIt will include other elements like images to correctly show the mirrored web pages -nHThis command avoids to create the subdirectories: ‘grid018.ct.infn.it/rep’ onthe destination Then replace baseurl filed in any .repo file inside repos/ directorty #!/bin/bash # # Change repo host MREPO_FROM=http://grid018.ct.infn.it/mrepo MREPO_TO=http://grid-test-54.trigrid.it/mrepo MREPO_FROM_ESCAPE=$(echo $MREPO_FROM | sed s/'\/'/'\\\/'/g) MREPO_TO_ESCAPE=$(echo $MREPO_TO | sed s/'\/'/'\\\/'/g) for repo in $(ls -1 *.repo) do echo $repo mv $repo $repo.todo cat $repo.todo | sed s/"${MREPO_FROM_ESCAPE}"/"${MREPO_TO_ESCAPE}"/g > $repo rm -f $repo.todo done 8 8 8

System requirements Please check: If you have a valid hostname To verify, type: hostname -f To edit the hostname: vim /etc/hosts vim /etc/hostname vim /etc/sysconfig/network hostname <pc_name> 9 9 9

NTP Setting Install ntp: yum install ntp -y Set ntp server: ntpdate cronos.cenam.mx Add it to the automatic boot and start the server /sbin/chkconfig ntpd on /sbin/service ntpd start 10 10 10

yum install gilda_utils -y Then update your host: yum clean all Install CAs on ALL profiles: yum install lcg-CA -y Gilda utils: yum install gilda_utils -y 11 11

yum install glite-WMS -y yum install glite-BDII -y WMS install: yum install glite-WMS -y LB install: yum install glite-BDII -y 12 12

Certificates management Download your HOST certificate from WEB url: http://argan.nucleares.unam.mx/mrepo/Gilda/CERTS/hosts/ Move those in the right path copy your hostcert to /etc/grid-security/hostcert.pem copy your hostpem to /etc/grid-security/hostkey.pem Give them the right permissions chmod 400 /etc/grid-security/hostkey.pem chmod 644 /etc/grid-security/hostcert.pem [root@cerist04 ~]# ll /etc/grid-security/ total 32 drwxr-xr-x 2 root root 20480 Jun 27 12:08 certificates -rw-r--r-- 1 root root 887 Jun 16 10:02 hostcert.pem -r-------- 1 root root 887 Jun 16 10:02 hostkey.pem drwxr-xr-x 2 root root 4096 Jun 27 11:21 vomsdir 13 13

site-info.def Copy the ig-site-info.def script template Open your own site-info.def and customize it: cp /opt/glite/yaim/examples/siteinfo/site-info.def /opt/glite/yaim/examples/siteinfo/mysite-info.def vi /opt/glite/yaim/examples/siteinfo/mysite-info.def 14 14

WMS-LB Configuration (1/3) WMS Configuration (vi /opt/glite/yaim/examples/siteinfo/mysite-info.def) INSTALL_ROOT=/opt MYSQL_PASSWORD=secret PX_HOST=myproxy.ct.infn.it //set your proxy WMS_HOST=gildaXX.ihep.ac.cn //set your wms hostname SITE_NAME=gildaxx.ihep.ac.cn //set your sitename SITE_EMAIL=ma@ihep.ac.cn BDII_HOST=gilda02.ihep.ac.cn //set your bdii host (same name) VOS="gilda"  Add gilda here ######### # gilda # VO_GILDA_VOMS_CA_DN="/C=IT/O=INFN/OU=Host/L=Catania/CN=voms.ct.infn.it" VO_GILDA_SW_DIR=$VO_SW_DIR/gilda VO_GILDA_DEFAULT_SE=$DPM_HOST VO_GILDA_STORAGE_DIR=$CLASSIC_STORAGE_DIR/gilda VO_GILDA_VOMS_SERVERS="voms://voms.ct.infn.it:8443/voms/gilda?/gilda" VO_GILDA_VOMSES="gilda voms.ct.infn.it 15001 /C=IT/O=INFN/OU=Host/L=Catania/CN=voms.ct.infn.it gilda" 15 15

WMS-LB Configuration (2/3) vi /opt/glite/yaim/examples/siteinfo/services/glite-wms LB_HOST="gildaXX.ihep.ac.cn:9000" //set the same name GLITE_WMS_LCGMON_FILE="/var/log/wms_lcgmon.log" Copy the gilda profiles inside ig ones cat /opt/glite/yaim/etc/gilda/gilda_ig-groups.conf >> /opt/glite/yaim/examples/ig-groups.conf cat /opt/glite/yaim/etc/gilda/gilda_ig-users.conf >> /opt/glite/yaim/examples/ig-users.conf Check the contents by: cat /opt/glite/yaim/examples/ig-groups.conf | grep gilda "/gilda/ROLE=SoftwareManager":::sgm: "/gilda/grelc/das/*":gilda::: "/gilda":::: Location, Meeting title, dd.mm.yyyy 16 16

yum install glite-LB -y WMS-LB and BDII Configuration (3/3) LB install: yum install glite-LB -y Edit BDII configuration file: vi /opt/glite/yaim/examples/siteinfo/services/glite-bdii_site CONFIGURE /opt/glite/yaim/bin/yaim -c -s /opt/glite/yaim/examples/siteinfo/mysite-info.def -n glite-WMS -n glite-LB glite-BDII 17 17

Testing WMS-LB and BDII From a UI enter export the : GLITE_WMS_WMPROXY_ENDPOINT and submit a job!!! export GLITE_WMS_WMPROXY_ENDPOINT=https://YOURWMSHOSTNAME:7443/glite_wms_wmproxy_server From your WMS execute : /etc/init.d/gLite status [root@host120 ~]# netstat -pane | grep 2170 tcp 0 0 0.0.0.0:2170 0.0.0.0:* LISTEN 152 237491 5907/bdii-fwd [acce tcp 0 0 127.0.0.1:35203 127.0.0.1:2170 TIME_WAIT 0 0 - 18 18

Thanks and References Thanks to everybody for your attention Expecial thanks to Luciano for his help in the building UP of a working GILDA repo for 32 bit Reference: INFNGrid installation http://igrelease.forge.cnaf.infn.it/doku.php?id=doc:guides:install-3_1 19 19 19