Presentation is loading. Please wait.

Presentation is loading. Please wait.

WMS LB topBDII Installation and Configuration

Similar presentations


Presentation on theme: "WMS LB topBDII Installation and Configuration"— Presentation transcript:

1 WMS LB topBDII Installation and Configuration
Emilio Mastriani Mexico City, Mexico Latin America Joint GISELA/EPIKH School for Grid Site Administrators Mexico, 1

2 WMS LB The Workload Management System (WMS) is the gLite service that allows users to submit jobs, and performs all tasks required to execute them, without exposing the user to the complexity of the Grid. The Logging and Bookkeeping service (LB) tracks jobs in terms of event (important points of job life, e.g. submission, finding a matching CE, starting execution etc.) gathered from various WMS components as well as Ces. The Berkeley Database Information Index (BDII) consists of two or more standard LDAP databases that are populated by an update process. The update process obtains LDIF from either doing an ldapsearch on LDAP URLs or by running a local script that generates LDIF. The LDIF is then inserted into the LDAP database. 2 2 2

3 gLite WMS Architecture
3 3

4 gLite WMS Architecture
Acts as the portal for accepting all external requests to the workload manager. Job submission, cancellation expressed via a JDL 4 4

5 Workload Management System
The Workload Management System (WMS) consists of a set of Grid middleware components in charge of distributing and managing jobs across Grid resources Purpose of the Workload Manager (WM) is to accept and satisfy requests for job management coming from its clients The WM hands over the job to an appropriate Computing Element (CE) for execution taking into account requirements and the preferences expressed in the job description. The decision on which resource should be used is the outcome of the so called matchmaking process 5 5

6 GILDA VM source The instructions provided in this presentation assume that you are going to use a machine with Scientific Linux 4.8 installed. Virtual Machine image (GILDA VM Base_SLC4._i386) available at: 6 6 6

7 Connecting to the VM ssh root@yourvm.netw.mx Password: GildaVM.10
The IP's and hostnames are: [100 to 120] = host100.unam.mx to host120.unam.mx IP's and [133 to 135] = host133.unam.mx to host135.unam.mx IP's ssh Password: GildaVM.10 7

8 Repository settings Initial steps: cd /etc/yum.repos.d/ ; rm dag.repo
Download extra repo: Download internal repo Copy the gilda utils: wget -O /etc/yum.repos.d/gilda.repo export MREPO=" EXTRA="cern-extra cern-rhaps2 cern-testing cern-update cern dag jpackage lcg-ca" for name in $EXTRA; do wget $MREPO/$name.repo -O /etc/yum.repos.d/$name.repo; done REPOS="glite-bdii glite-lb glite-wms" export MREPO=" for name in $REPOS; do wget $MREPO/$name.repo -O /etc/yum.repos.d/$name.repo; done To get a full mirror of GILDA repository: wget -mp -nH -np Follows a brief explanations of the used parameters: -m This option is used to make mirrors. This means that the next time the command will be issued it will download just the updated files rather than the whole site again. -p It will include other elements like images to correctly show the mirrored web pages -nH This command avoids to create the subdirectories: ‘grid018.ct.infn.it/rep’ onthe destination Follows a brief explanations of the used parameters:-mThis option is used to make mirrors. This means that the next time the command will be issued it will download just the updated files rather than the whole site again.-pIt will include other elements like images to correctly show the mirrored web pages -nHThis command avoids to create the subdirectories: ‘grid018.ct.infn.it/rep’ onthe destination Then replace baseurl filed in any .repo file inside repos/ directorty #!/bin/bash # # Change repo host MREPO_FROM= MREPO_TO= MREPO_FROM_ESCAPE=$(echo $MREPO_FROM | sed s/'\/'/'\\\/'/g) MREPO_TO_ESCAPE=$(echo $MREPO_TO | sed s/'\/'/'\\\/'/g) for repo in $(ls -1 *.repo) do echo $repo mv $repo $repo.todo cat $repo.todo | sed s/"${MREPO_FROM_ESCAPE}"/"${MREPO_TO_ESCAPE}"/g > $repo rm -f $repo.todo done 8 8 8

9 System requirements Please check: If you have a valid hostname
To verify, type: hostname -f To edit the hostname: vim /etc/hosts vim /etc/hostname vim /etc/sysconfig/network hostname <pc_name> 9 9 9

10 NTP Setting Install ntp:
yum install ntp -y Set ntp server: ntpdate cronos.cenam.mx Add it to the automatic boot and start the server /sbin/chkconfig ntpd on /sbin/service ntpd start 10 10 10

11 yum install gilda_utils -y
Then update your host: yum clean all Install CAs on ALL profiles: yum install lcg-CA -y Gilda utils: yum install gilda_utils -y 11 11

12 yum install glite-WMS -y yum install glite-BDII -y
WMS install: yum install glite-WMS -y LB install: yum install glite-BDII -y 12 12

13 Certificates management
Download your HOST certificate from WEB url: Move those in the right path copy your hostcert to /etc/grid-security/hostcert.pem copy your hostpem to /etc/grid-security/hostkey.pem Give them the right permissions chmod 400 /etc/grid-security/hostkey.pem chmod 644 /etc/grid-security/hostcert.pem ~]# ll /etc/grid-security/ total 32 drwxr-xr-x 2 root root Jun 27 12:08 certificates -rw-r--r-- 1 root root Jun 16 10:02 hostcert.pem -r root root Jun 16 10:02 hostkey.pem drwxr-xr-x 2 root root Jun 27 11:21 vomsdir 13 13

14 site-info.def Copy the ig-site-info.def script template
Open your own site-info.def and customize it: cp /opt/glite/yaim/examples/siteinfo/site-info.def /opt/glite/yaim/examples/siteinfo/mysite-info.def vi /opt/glite/yaim/examples/siteinfo/mysite-info.def 14 14

15 WMS-LB Configuration (1/3)
WMS Configuration (vi /opt/glite/yaim/examples/siteinfo/mysite-info.def) INSTALL_ROOT=/opt MYSQL_PASSWORD=secret PX_HOST=myproxy.ct.infn.it //set your proxy WMS_HOST=gildaXX.ihep.ac.cn //set your wms hostname SITE_NAME=gildaxx.ihep.ac.cn //set your sitename BDII_HOST=gilda02.ihep.ac.cn //set your bdii host (same name) VOS="gilda"  Add gilda here ######### # gilda # VO_GILDA_VOMS_CA_DN="/C=IT/O=INFN/OU=Host/L=Catania/CN=voms.ct.infn.it" VO_GILDA_SW_DIR=$VO_SW_DIR/gilda VO_GILDA_DEFAULT_SE=$DPM_HOST VO_GILDA_STORAGE_DIR=$CLASSIC_STORAGE_DIR/gilda VO_GILDA_VOMS_SERVERS="voms://voms.ct.infn.it:8443/voms/gilda?/gilda" VO_GILDA_VOMSES="gilda voms.ct.infn.it /C=IT/O=INFN/OU=Host/L=Catania/CN=voms.ct.infn.it gilda" 15 15

16 WMS-LB Configuration (2/3)
vi /opt/glite/yaim/examples/siteinfo/services/glite-wms LB_HOST="gildaXX.ihep.ac.cn:9000" //set the same name GLITE_WMS_LCGMON_FILE="/var/log/wms_lcgmon.log" Copy the gilda profiles inside ig ones cat /opt/glite/yaim/etc/gilda/gilda_ig-groups.conf >> /opt/glite/yaim/examples/ig-groups.conf cat /opt/glite/yaim/etc/gilda/gilda_ig-users.conf >> /opt/glite/yaim/examples/ig-users.conf Check the contents by: cat /opt/glite/yaim/examples/ig-groups.conf | grep gilda "/gilda/ROLE=SoftwareManager":::sgm: "/gilda/grelc/das/*":gilda::: "/gilda":::: Location, Meeting title, dd.mm.yyyy 16 16

17 yum install glite-LB -y
WMS-LB and BDII Configuration (3/3) LB install: yum install glite-LB -y Edit BDII configuration file: vi /opt/glite/yaim/examples/siteinfo/services/glite-bdii_site CONFIGURE /opt/glite/yaim/bin/yaim -c -s /opt/glite/yaim/examples/siteinfo/mysite-info.def -n glite-WMS -n glite-LB glite-BDII 17 17

18 Testing WMS-LB and BDII
From a UI enter export the : GLITE_WMS_WMPROXY_ENDPOINT and submit a job!!! export GLITE_WMS_WMPROXY_ENDPOINT= From your WMS execute : /etc/init.d/gLite status ~]# netstat -pane | grep 2170 tcp : :* LISTEN /bdii-fwd [acce tcp : : TIME_WAIT 18 18

19 Thanks and References Thanks to everybody for your attention
Expecial thanks to Luciano for his help in the building UP of a working GILDA repo for 32 bit Reference: INFNGrid installation 19 19 19


Download ppt "WMS LB topBDII Installation and Configuration"

Similar presentations


Ads by Google