1. 12th EELA Tutorial for Users and System Administrators www.eu-eela.org E-infrastructure shared between Europe and Latin America BDII Server Installation Yubiryn Ramírez G. ULA – Venezuela. 12 EELA Tutorial Users and System Administrators. Lima, 27.09.2007

2. E-infrastructure shared between Europe and Latin America Lima, 12th EELA Tutorial, 24.09.2007 2 This presentation is based on LCG and gLite manuals and previous EELA tutorials

3. E-infrastructure shared between Europe and Latin America Lima, 12th EELA Tutorial, 24.09.2007 3 Outline Information System Overview How to install a BDII Server BDII customization and references

4. E-infrastructure shared between Europe and Latin America Lima, 12th EELA Tutorial, 24.09.2007 4 Information System Overview The Information System (IS) provides information about grid´s resources and their actual status.

5. E-infrastructure shared between Europe and Latin America Lima, 12th EELA Tutorial, 24.09.2007 5 Information System Levels Resource level: Grid Resource Information Server (GRIS) –One GRIS on top of each CE, SE, RB, MyProxy (no WNs). –Sensors and scripts get status of concrete resources statically (e.g. GlueCEUniqueID) or dynamically (e.g. GlueCEStateWaitingJobs) Site level: Grid Index Information Server (GIIS) –Compiles all the information of the different GRISs in a site. –LCG-2 recommends using a BDII instead of a GIIS  Improves robustness and stability.  Called the site BDII. Top level: Berkeley DB Information Index (BDII) –Keeps all Grid information about the VOs (generally only one). –Stores information from local BDIIs or GIISs in its database. –Only queries sites that are included in a configuration file.

6. E-infrastructure shared between Europe and Latin America Lima, 12th EELA Tutorial, 24.09.2007 6 BDII Users and other Grid services (such as the RB) can query BDIIs to get information about the Grid status. Each BDII collects information from the site GIISes (or local BDII) defined in a configuration file, which is accessed through a web interfaces. Every two minutes a cron-job runs a script and collects information (pull model) from all the GIISes (local BDII) listed in the configuration file.

7. E-infrastructure shared between Europe and Latin America Lima, 12th EELA Tutorial, 24.09.2007 7 BDII Each site can run a BDII. It collects the information coming from the BDIIs/GIISs At each site, a site GIIS collects the information given by the GRISs Local GRISs run on CE, SE, RB, MyProxy at each site and report dynamic and static information Abbreviations: BDII: Berkeley DataBase Information Index GIIS: Grid Index Information Server GRIS: Grid Resource Information Server From LCG2.3.0 site GIIS has been replaced by “site” BDII

8. E-infrastructure shared between Europe and Latin America Lima, 12th EELA Tutorial, 24.09.2007 8 BDII RB Local GRIS SE Local GRIS CE Local GRIS BDII-A BDII-B SE Local GRIS SE Local GRIS CE Local GRIS SE Local GRIS BDII-C Site 1 Site 2 Site 3 Site BDII

9. E-infrastructure shared between Europe and Latin America Lima, 12th EELA Tutorial, 24.09.2007 9 Installing BDII Server

10. E-infrastructure shared between Europe and Latin America Lima, 12th EELA Tutorial, 24.09.2007 10 Preliminary and common steps Start from an instalation of SLC 3.0.8 Install JAVA SDK Check the hostname Install and configure ntp daemon Install X.509 host certificates /etc/grid-security and check their file permissions. Install the latest version of glite-yaim Install the middleware

11. E-infrastructure shared between Europe and Latin America Lima, 12th EELA Tutorial, 24.09.2007 11 Pre-requisites (1) Start from the base machine you installed in the INTRODUCTORY tutorial Verify that these packages are installed and properly configured: –Java SDK –Ntp daemon –Latest version of glite-yaim

12. E-infrastructure shared between Europe and Latin America Lima, 12th EELA Tutorial, 24.09.2007 12 Pre-requisites (2) Check the hostname hostmane -f Install X.509 host certificates /etc/grid-security and check their file permissions. -rw-r--r-- 1 root root1127Jun 14 12:27 hostcert.pem -r-------- 1 root root887 Jun 14 12:28 hostkey.pem

13. E-infrastructure shared between Europe and Latin America Lima, 12th EELA Tutorial, 24.09.2007 13 Glite and Gilda Metapackages MatapackageNode typeDescription Glite-BDIIBDIIA top level BDII GILDA_ig_BDII Gilda BDII GILDA_ig_RB_BDII Gilda RB + BDII Usual combinación: RB and BDII CE and BDII: doesn´t work

14. E-infrastructure shared between Europe and Latin America Lima, 12th EELA Tutorial, 24.09.2007 14 site-info.def All the configuration values to sites have to be configured in a site configuration file using key-value pairs. This file is shared among all the different gLite node types. So edit once and keep it in a safe place Create a copy of /opt/glite/yaim/examples/site-info.def template (coming from the glite-yaim-core package) to your reference directory for the installation (e.g. /root/siteinfo): cp /opt/glite/yaim/examples/site-info.def /root/siteinfo/site- info.def

15. E-infrastructure shared between Europe and Latin America Lima, 12th EELA Tutorial, 24.09.2007 15 site-info.def A good syntax test for your site configuration file is to try to source it manually running the command: source site-info.def The configuration is stored in a directory structure which will be extended in the near future. Currently the following files are used: site-info.def file and the vo.d directory.

16. E-infrastructure shared between Europe and Latin America Lima, 12th EELA Tutorial, 24.09.2007 16 vo.d directory The /root/siteinfo/vo.d directory Each file name in this directory has to be the lower-cased version of e VO name defined in site-info.def. The matching file should contain the definitions for that VO and will overwrite the ones which are defined in site-info.def. SW_DIR=$VO_SW_DIR/eela DEFAULT_SE=$CLASSIC_HOST STORAGE_DIR=$CLASSIC_STORAGE_DIR/eela

17. E-infrastructure shared between Europe and Latin America Lima, 12th EELA Tutorial, 24.09.2007 17 site-info.def fields BDII_FCR: URL of the Freedom of Choice for Resources. (Web interface that provides a facility for VOs to modify resources list available for them on a BDII level, based on their own decision or Sites Functional Test (SFT) results) BDII_HOST: BDII Hostname. BDII_HTTP_URL: List of the GIIS (or site BDII) from which the BDII server fetches the information

18. E-infrastructure shared between Europe and Latin America Lima, 12th EELA Tutorial, 24.09.2007 18 site-info.def fields BDII_REGIONS: List of nodes publishing information on the BDII. BDII_REGIONS="CE SE RB LFC VOBOX PX FTS MON“ BDII_CE_URL="ldap://$CE_HOST:2135/mds-vo-name=local,o=grid" BDII_SE_URL="ldap://$CLASSIC_HOST:2135/mds-vo- name=local,o=grid" … BDII_FTS_URL="ldap://$FTS_HOST:2170/mds-vo- name=resource,o=grid" BDII_MON_URL="ldap://$MON_HOST:2135/mds-vo- name=local,o=grid"

19. E-infrastructure shared between Europe and Latin America Lima, 12th EELA Tutorial, 24.09.2007 19 Modify site-info.def Modify your site-info.def and edit this fields: BDII_HOST=limaXX.ring.pucp.edu.pe BDII_HTTP_URL=“http://grid018.ct.infn.it/fileadmin/bdii /gilda-bdii-update.conf”http://grid018.ct.infn.it/fileadmin/bdii /gilda-bdii-update.conf

20. E-infrastructure shared between Europe and Latin America Lima, 12th EELA Tutorial, 24.09.2007 20 Installation and Configuration Install the node /opt/glite/yaim/bin/yaim -i -s /root/siteinfo/site- info.def -m glite-BDII Configure the node /opt/glite/yaim/bin/yaim -c -s /root/siteinfo/site- info.def -n BDII

21. E-infrastructure shared between Europe and Latin America Lima, 12th EELA Tutorial, 24.09.2007 21 Firewall configuration Be sure that your firewall is open for bdii listening port 2170: In /etc/sysconfig/iptables add: -A RH-Firewall-1-INPUT -m state --state NEW -m tcp -p tcp --dport 2170 -j ACCEPT service iptables restart

22. E-infrastructure shared between Europe and Latin America Lima, 12th EELA Tutorial, 24.09.2007 22 BDII Server Testing & Customization

23. E-infrastructure shared between Europe and Latin America Lima, 12th EELA Tutorial, 24.09.2007 23 BDII testing Issue an ldapsearch to check if BDII is correctly publishing sites informations: ldapsearch -x -h -p 2170 -b 'mds-vo- name=local,o=grid‘ Log into a LCG User Interface machine and use lcg- infosites: export LCG_GFAL_INFOSYS= :2170 lcg-infosites --vo gilda ce

24. E-infrastructure shared between Europe and Latin America Lima, 12th EELA Tutorial, 24.09.2007 24 BDII customization BDII configuration file can be found in: /opt/bdii/etc/bdii.conf

25. E-infrastructure shared between Europe and Latin America Lima, 12th EELA Tutorial, 24.09.2007 25 BDII customization (2) BDII_PORT_READ=2170 BDII_PORTS_WRITE="2171 2172 2173" BDII_USER=edguser BDII_BIND=mds-vo-name=local,o=grid BDII_PASSWD=26082 BDII_SEARCH_FILTER='(|(objectClass=GlueSchemaVersion)(objectClass =GlueTop))' BDII_SEARCH_TIMEOUT=30 BDII_BREATHE_TIME=60  every 2 minute BDII cache is refreshed BDII_AUTO_UPDATE=yes  the list of GIIS is dynamic (no=static) BDII_AUTO_MODIFY=no BDII_DIR=/opt/bdii/ BDII_UPDATE_URL=http://grid018.ct.infn.it/fileadmin/bdii/glite-bdii- update.conf BDII_UPDATE_LDIF=http:// SLAPD=/usr/sbin/slapd SLAPADD=/usr/sbin/slapadd

26. E-infrastructure shared between Europe and Latin America Lima, 12th EELA Tutorial, 24.09.2007 26 BDII customization (3) BDII log files in: /opt/bdii/var/bdii.log

27. E-infrastructure shared between Europe and Latin America Lima, 12th EELA Tutorial, 24.09.2007 27 BDII customization (4) Example: –Change BDII_UPDATE_URL to: http://grid-deployment.web.cern.ch/grid-deployment/gis/lcg2- bdii/dteam/lcg2-all-sites.conf –Restart the service with: /etc/init.d/bdii restart –Give a look to the new information published by the service

28. E-infrastructure shared between Europe and Latin America Lima, 12th EELA Tutorial, 24.09.2007 28 BDII customization (5) The file /opt/bdii/etc/bdii-update.conf contains the list of GIIS:... INFN-CATANIA ldap://grid010.ct.infn.it:2170/mds-vo- name=infn-catania,o=grid # 2.6.0 INFN-CNAF ldap://grid011f.cnaf.infn.it:2170/mds-vo- name=infn-cnaf,o=grid # 2.6.0 INFN-PADOVA ldap://gilda-ce-01.pd.infn.it:2170/mds- vo-name=infn-padova,o=grid # 2.6.0 IISAS-BRATISLAVA ldap://dgt01.ui.savba.sk:2170/mds- vo-name=iisas-gilda,o=grid # 2.6.0 ULA-MERIDA ldap://grid006.cecalc.ula.ve:2170/mds-vo- name=ula-merida,o=grid

29. E-infrastructure shared between Europe and Latin America Lima, 12th EELA Tutorial, 24.09.2007 29 References LCG-2 User Guide https://edms.cern.ch/file/454439//LCG-2-UserGuide.html gLite 3.0 User Guide https://edms.cern.ch/file/722398/1.1/gLite-3-UserGuide.pdf gLite 3.0 Generic Installation and Configuration Guide http://grid-deployment.web.cern.ch/grid-deployment/documentation/LCG2- Manual-Install/ YAIM 3.1.1 guide for sysadmins https://twiki.cern.ch/twiki/bin/view/LCG/YaimGuide311 BDII Documentation: https://twiki.cern.ch/twiki//bin/view/EGEE/BDII https://twiki.cern.ch/twiki/bin/view/LCG/BdiiNotes