1. Gianni Pucciani Wed 27 January 2010 IT-GT-SL meeting Certification tests and automation

2. Outline Testing during certification Yaimgen vnode-ygen.sh autotest.sh more automation... 2 IT-GT-SL meeting 27 January 2010

3. Testing during certification https://twiki.cern.ch/twiki/bin/view/EGEE/HowToCerti fyAPatch https://twiki.cern.ch/twiki/bin/view/EGEE/HowToCerti fyAPatch A set of mandatory tests for each service is available on CVS: https://twiki.cern.ch/twiki/bin/view/EGEE/SA3Testing In most cases (at least in all DM components) running tests means: 1. cvs co XXX; cd XXX 2. Edit a few lines in XXX-certconfig 3. Run XXX-certtest.sh 3 IT-GT-SL meeting 27 January 2010

4. Yaimgen Not only Yaim (site-info.def) file generation. Deploy a service ready to test within the CTB, relying on vNode images. Main entry: www.cern.ch/yaimgenwww.cern.ch/yaimgen 4 IT-GT-SL meeting 27 January 2010

5. Yaimgen: usage (new) [gpucciani@pcwww06 yaimgen]#./yaimgen.sh -h Usage: yaimgen.sh -f [-l ] yaimgen.sh -r -n [-p ] [-y ] [-l ] yaimgen.sh -u [-l ] Parameters: = a file specifying all parameters. E.g.: yaimgen.in = a file where to log all actions. Default is yaimgen.log = a yaimgen function to call = one of prod,pps,cert = a node type. Can be used more than once repeating -n = a patch number. Can be used more than once repeating -p = an alternative yaim target than the one specified in config-.sh Examples: yaimgen.sh -f in/glite-BDII_site.in yaimgen.sh -u yg_setup_testuser yaimgen.sh -r prod -n glite-UI -p 9998 -p 9999 -l myout.log yaimgen.sh -r prod -n glite-BDII -y glite-BDII_site -p 9997 To open a ticket: https://svnweb.cern.ch/trac/yaimgen/newticket 5 IT-GT-SL meeting 27 January 2010

6. Yaimgen: architecture [gpucciani@pcwww06 yaimgen]# ls -l total 120 -rw-r--r-- 1 gpucciani gucciani 974 Jan 13 13:29 ChangeLog drwxr-xr-x 3 gpucciani gucciani 4096 Jan 21 14:55 config -rw-r--r-- 1 gpucciani gucciani 10870 Jan 13 16:46 functions.sh drwxr-xr-x 3 gpucciani gucciani 4096 Jan 13 13:29 in drwxr-xr-x 3 gpucciani gucciani 4096 Jan 14 15:48 postconfig drwxr-xr-x 3 gpucciani gucciani 4096 Jan 21 15:30 preconfig -rw-r--r-- 1 gpucciani gucciani 2260 Jan 13 13:29 README drwxr-xr-x 3 gpucciani gucciani 4096 Jan 19 16:39 test -rwxr-xr-x 1 gpucciani gucciani 276 Jan 13 13:29 transfer.sh -rw-r--r-- 1 gpucciani gucciani 932 Jan 13 13:29 yaimgen.conf -rw-r--r-- 1 gpucciani gucciani 927 Jan 13 13:29 yaimgen.in -rwxr-xr-x 1 gpucciani gucciani 18513 Jan 13 17:09 yaimgen.sh 6 IT-GT-SL meeting 27 January 2010

7. vnode-ygen.sh script Link vNode CLI with Yaimgen [gpucciani@pcwww06 vnodeygen]#./vnode-ygen.sh -h Usage:./vnode-ygen.sh -i [-r ] [-n ] [-p ] [-y ] [-f ] [-h|--help] Arguments: -Mandatory = the image name {SL4-32-DH|SL4-64-DH|SL5-64-DH}. -Optional = one of prod,pps,cert. = a node type. Can be used more than once repeating -n. = a patch number. Can be used more than once repeating -p. = an alternative yaim target than the default one. = an input file that will be used to call yaimgen. When using this option all the other options but -i are discarded. Examples:./vnode-ygen.sh -i SL4-32-DH -r prod -n glite-UI./vnode-ygen.sh -i SL5-64-DH -r prod -n glite-BDII -y glite-BDII_site./vnode-ygen.sh -i SL4-64-DH -r cert -n glite-WN -p 3456./vnode-ygen.sh -i SL5-64-DH -f my-glite-WN.in 7 IT-GT-SL meeting 27 January 2010

8. autotest.sh script Login on a client machine a run some tests as testuser [gpucciani@pcwww06 vnodeygen]#./autotest.sh -h Usage:./autotest.sh -v -t [-t ] [--fts ] [--dcache ] [--dpm ] [--castor ] [--storm ] [--lfc ] [--myproxy ]./autotest.sh -l (list available tests) the virtual machine where tests will be run = a test label. It can be specified more than once repeating -t = specify a different FTS server than the CTB one = specify a different DCACHE host than the CTB one = specify a different DPM host than the CTB one = specify a different CASTOR host than the CTB one = specify a different STORM host than the CTB one = specify a different LFC host than the CTB one = specify a different MYPROXY host than the CTB one 8 IT-GT-SL meeting 27 January 2010

9. autotest.sh script: available tests [gpucciani@pcwww06 vnodeygen]#./autotest.sh -l Available tests: ftscli lfc myproxy dcache-srm-client gfal lcg_utils lcg_utils_cross s2 9 IT-GT-SL meeting 27 January 2010

10. Client vs. Server tests IT-GT-SL meeting 27 January 2010 10 Not clearly separated in CVS right now. Server tests could be run automatically after deploying a service with Yaimgen. Client tests can be run with autotest.sh.

11. Getting addicted to automation... IT-GT-SL meeting 27 January 2010 11 What is left for a totally automated certification? Testing bug fixes... no way  From Savannah information to vnode-ygen.sh and autotest.sh. [gpucciani@pcwww06 vnodeygen]#./scli2vysa.sh -h Usage:./scli2vysa.sh [-h|--help]"

12. scli2vysa.sh script example IT-GT-SL meeting 27 January 2010 12 >./scli2vysa.sh 3093 Using SCLIDIR: /home/gpucciani/scli/trunk Getting data for patch 3093 Summary is: [LCMAPS] pep-c client for x86_64 on SL5 Status is: In certification OS is: SL5 Arch is: x86_64 Affected metapackages is: glite-GLEXEC_wn glite-CREAM Patch(es) depending on this one: 3076 3394 Patch(es) on the same host: 3394 Patch(es) on different host: 3076 Machine 1:./vnode-ygen.sh -i SL5-64-DH -r prod -n glite-GLEXEC_wn -p 3093 -p 3394 Machine 2:./vnode-ygen.sh -i SL5-64-DH -r prod -n glite-CREAM -p 3093 - p 3394

13. ETICS integration IT-GT-SL meeting 27 January 2010 13 Is it necessary? Ok, I volunteer as guinea pig for investigating within the DM PT. Are you sure? Does it look feasible? Are you sure? yes no yes

14. Questions? IT-GT-SL meeting 27 January 2010 14