1. FP6−2004−Infrastructures−6-SSA-026409 www.eu-eela.org E-infrastructure shared between Europe and Latin America BDII Server Installation and Configuration Tony Calanducci INFN Catania First EELA Grid tutorial for users and system administrators Madrid, 20-24th February 2006

2. FP6−2004−Infrastructures−6-SSA-026409 E-infrastructure shared between Europe and Latin America First EELA Grid tutorial for users and system administrators 2 Outline Information System Overview How to install a BDII Server BDII customization and references

3. FP6−2004−Infrastructures−6-SSA-026409 E-infrastructure shared between Europe and Latin America First EELA Grid tutorial for users and system administrators 3 Information System Overview The Information System (IS) provides information about grid resources and their actual status. Computing and Storage resources at a site report their static and dynamic status information via GRISes (Grid Resource Information Server) –one per grid element At each site an element called GIIS (Grid Index Information Server) collects information from all the site GRISes –one per grid site The BDII (Berkley Database Information Index) queries the GIISes (of different sites) and acts as a cache storing information about the Grid status in its database.

4. FP6−2004−Infrastructures−6-SSA-026409 E-infrastructure shared between Europe and Latin America First EELA Grid tutorial for users and system administrators 4 Each site can run a BDII. It collects the information coming from the GIISs At each site, a site GIIS collects the information given by the GRISs Local GRISes run on CEs and SEs at each site and report dynamic and static information Abbreviations: BDII: Berkeley DataBase Information Index GIIS: Grid Index Information Server GRIS: Grid Resource Information Server From LCG2.3.0 site GIIS has been replaced by “local” BDII IS Components: GRISs, GIISs and BDII

5. FP6−2004−Infrastructures−6-SSA-026409 E-infrastructure shared between Europe and Latin America First EELA Grid tutorial for users and system administrators 5 The IS in LCG RB Local GRIS SE Local GRIS CE Local GRIS BDII-A BDII-B SE Local GRIS SE Local GRIS CE Local GRIS SE Local GRIS BDII-C CE Local GRIS CE Site GIIS CE Local GRIS CE Site GIIS CE Local GRIS CE Site GIIS Site 1 Site 2 Site 3

6. FP6−2004−Infrastructures−6-SSA-026409 E-infrastructure shared between Europe and Latin America First EELA Grid tutorial for users and system administrators 6 BDII Users and other Grid services (such as the RB) can interrogate BDIIs to get information about the Grid status. Each BDII collects information from the site GIISes (or local BDII) defined in a configuration file, which it accesses through a web interfaces. Every two minutes a cron-job runs a script and collects information (pull model) from all the GIIS (local BDII) listed in the configuration file

7. FP6−2004−Infrastructures−6-SSA-026409 E-infrastructure shared between Europe and Latin America First EELA Grid tutorial for users and system administrators 7 BDII Server Installation

8. FP6−2004−Infrastructures−6-SSA-026409 E-infrastructure shared between Europe and Latin America First EELA Grid tutorial for users and system administrators 8 Installation Pre-requisites Start from a fresh install of SLC 3.0.x Verify that apt is installed and properly configured: rpm -qa | grep apt Install apt if necessary: rpm -ivh http://linuxsoft.cern.ch/cern/slc30X/i386/SL/RPMS/apt-0.5.15cnc6- 8.SL.cern.i386.rpmhttp://linuxsoft.cern.ch/cern/slc30X/i386/SL/RPMS/apt-0.5.15cnc6- 8.SL.cern.i386.rpm Java SDK is required to install almost any LCG/gLite grid service. Due to license issues, it is not found in the LCG repositories. So please download and install a release of Sun Java SDK >= 1.4.2_08 from http://java.sun.com/j2se/1.4.2/download.html http://java.sun.com/j2se/1.4.2/download.html chmod +x j2sdk-1_4_2_10-linux-i586-rpm.bin./j2sdk-1_4_2_10-linux-i586-rpm.bin rpm -ivh j2sdk-1_4_2_10-linux-i586.rpm Preparing... ########################################### [100%] 1:j2sdk ########################################### [100%]

9. FP6−2004−Infrastructures−6-SSA-026409 E-infrastructure shared between Europe and Latin America First EELA Grid tutorial for users and system administrators 9 Node Syncronization with NTP Syncronization among all LCG nodes is mandatory. It can be achieved by the NTP protocol and a time server Install ntp if not already available for your system: – apt-get install ntp Add your time server in /etc/ntp.conf – restrict mask 255.255.255.255 nomodify notrap noquery – server –(you can use ntp-1.infn.it – IP 193.206.144.10 ) Edit /etc/ntp/step-tickers adding your(s) time server(s) hostname If you are running a firewall, you will have to allow inbound comminication on the NTP port: -A INPUT -s -p udp --dport 123 -j ACCEPT Activate the ntpd service with the following commands:  ntpdate  service ntpd start  chkconfig ntpd on –You can check ntpd’s status with :  ntpq -p

10. FP6−2004−Infrastructures−6-SSA-026409 E-infrastructure shared between Europe and Latin America First EELA Grid tutorial for users and system administrators 10 YAIM Installation YAIM is a set of bash scripts used to install and easily configure the LCG middleware on the target machine Ensure you FQDN is properly set – hostname –f Find the latest YAIM version at http://www.cern.ch/grid- deployment/gis/yaim/http://www.cern.ch/grid- deployment/gis/yaim/ Download it using wget – wget http://www.cern.ch/grid- deployment/gis/yaim/lcg-yaim-2.7.0-3.noarch.rpm Install using – rpm -ivh lcg-yaim-2.7.0-3.noarch.rpm

11. FP6−2004−Infrastructures−6-SSA-026409 E-infrastructure shared between Europe and Latin America First EELA Grid tutorial for users and system administrators 11 Site Configuration File All the configuration values to sites have to be configured in a site configuration file using key-value pairs. This file is shared among all the different LCG node types. So edit once and keep it in a safe place Create a copy of /opt/lcg/yaim/examples/site-info.def template (coming from the lcg-yaim RPM) to your reference directory for the installation (e.g. /root): – cp /opt/lcg/yaim/examples/site-info.def /root/my- site-info.def The general syntax of the file is a sequence of bash-like assignments of variables ( =, no spaces are allowed around =). A good syntax test for your site configuration file is to try to source it manually running the command: – source my-site-info.def

12. FP6−2004−Infrastructures−6-SSA-026409 E-infrastructure shared between Europe and Latin America First EELA Grid tutorial for users and system administrators 12 BDII Server related variables BDII_HOST=gil03.ciemat.es BDII_HTTP_URL=“http://grid018.ct.infn.it/fileadmin/bdii/ gilda-bdii-update.conf”http://grid018.ct.infn.it/fileadmin/bdii/ gilda-bdii-update.conf –list of the GIIS (or local BDII) from which the BDII server fetches the information –In this example, we are using the GIISes of all the GILDA sites

13. FP6−2004−Infrastructures−6-SSA-026409 E-infrastructure shared between Europe and Latin America First EELA Grid tutorial for users and system administrators 13 Installation and configuration scripts Start the download and installation of all the needed package using the following command: –/opt/lcg/yaim/scripts/install_node /root/my-site-info.def lcg-BDII Start the configuration of the BDII according the information provided into the my-site-info.def with: –/opt/lcg/yaim/scripts/configure_node /root/my-site-info.def BDII

14. FP6−2004−Infrastructures−6-SSA-026409 E-infrastructure shared between Europe and Latin America First EELA Grid tutorial for users and system administrators 14 Test your fresh new BDII Server Issue an ldapsearch to check if BDII is correctly publishing sites informations: – ldapsearch -x -h gil03.ciemat.es -p 2170 -b 'mds-vo-name=local,o=grid‘ Or Use LDAP Browser to test your BDII. You can download it from: – http://www-unix.mcs.anl.gov/~gawor/ldap/index.html http://www-unix.mcs.anl.gov/~gawor/ldap/index.html Or Log into a LCG User Interface machine and use lcg- infosites: – export LCG_GFAL_INFOSYS=gild03.ciemant.es – lcg-infosites --vo gilda se

15. FP6−2004−Infrastructures−6-SSA-026409 E-infrastructure shared between Europe and Latin America First EELA Grid tutorial for users and system administrators 15 BDII customization BDII configuration files can be found in /opt/bdii/etc: –bdii.conf: BDII_PORT_READ=2170 BDII_PORTS_WRITE="2171 2172 2173" BDII_USER=edguser BDII_BIND=mds-vo-name=local,o=grid BDII_PASSWD=23385 BDII_SEARCH_FILTER='(|(objectClass=GlueSchemaVersion)(objectClass=Glu eTop))' BDII_SEARCH_TIMEOUT=30 BDII_BREATHE_TIME=60  -- every 2 minutes BDII cache is refreshed BDII_AUTO_UPDATE=yes  - set to no if you want to create a static list of GIIS BDII_AUTO_MODIFY=yes BDII_DIR=/opt/bdii/ BDII_UPDATE_URL=http://grid018.ct.infn.it/fileadmin/bdii/gilda-bdii- update.conf BDII_UPDATE_LDIF=http://goc.grid- support.ac.uk/gridsite/bdii/BDII/www/bdii-update.ldif SLAPD=/usr/sbin/slapd SLAPADD=/usr/sbin/slapadd

16. FP6−2004−Infrastructures−6-SSA-026409 E-infrastructure shared between Europe and Latin America First EELA Grid tutorial for users and system administrators 16 BDII customization (II) Example: –Change BDII_UPDATE_URL to:  http://grid-deployment.web.cern.ch/grid-deployment/gis/lcg2- bdii/dteam/lcg2-all-sites.conf http://grid-deployment.web.cern.ch/grid-deployment/gis/lcg2- bdii/dteam/lcg2-all-sites.conf –Restart the service with: /etc/init.d/bdii restart –Give a look to the new information published by the service /opt/bdii/etc/bdii-update.conf contains the list of GIIS:... INFN-CATANIA ldap://grid010.ct.infn.it:2170/mds-vo-name=infn- catania,o=grid # 2.6.0 INFN-CNAF ldap://grid011f.cnaf.infn.it:2170/mds-vo-name=infn- cnaf,o=grid # 2.6.0 INFN-PADOVA ldap://gilda-ce-01.pd.infn.it:2170/mds-vo-name=infn- padova,o=grid # 2.6.0 IISAS-BRATISLAVA ldap://dgt01.ui.savba.sk:2170/mds-vo-name=iisas- gilda,o=grid # 2.6.0 ULA-MERIDA ldap://grid006.cecalc.ula.ve:2170/mds-vo-name=ula- merida,o=grid …

17. FP6−2004−Infrastructures−6-SSA-026409 E-infrastructure shared between Europe and Latin America First EELA Grid tutorial for users and system administrators 17 BDII Log Files and References BDII log files –/opt/bdii/var/bdii.log BDII Documentation: –http://lfield.home.cern.ch/lfield/cgi- bin/wiki.cgi?area=bdii&page=documentationhttp://lfield.home.cern.ch/lfield/cgi- bin/wiki.cgi?area=bdii&page=documentation –https://uimon.cern.ch/twiki/bin/view/LCG/BdiiNotes Information System Trouble Shooting Guide –http://lfield.home.cern.ch/lfield/trouble.htmlhttp://lfield.home.cern.ch/lfield/trouble.html