1. Alexandre Duarte Gustavo Wagner Francisco Brasileiro Walfredo Cirne Multi-Environment Software Testing on the Grid Universidade Federal de Campina Grande - Brasil

2. ISSTA 2006 There are applications with very time consuming test phases –Rothermel, Untch, and Chu (7 weeks) – Smart Alarms (36 hours) Configuration mistakes in software installation are the major reasons for computer system errors –Pointed by Brown and Patterson in 2001 –Observed in two surveys we have conducted with the grid community along the last years Motivation

3. ISSTA 2006 Motivation Grid applications are supposed to be correctly executed on highly heterogeneous and dynamic environment Traditional ways to qualify test processes are based on code coverage metrics

4. ISSTA 2006 Speeding up Test Execution Distribute Select Prioritize

5. ISSTA 2006 Dealing with Configuration Mistakes Build several different test environments –Expensive –Time consuming –Does not cover different user and administrative policies

6. ISSTA 2006 Agenda Motivation To present a solution to test grid applications How to describe a test of a grid application Conclusions and Future Work

7. ISSTA 2006 Environmental Coverage Development environments are controlled Test applications designed to run on heterogeneous environments in a set of different production environments

8. ISSTA 2006 GridUnit Speeds up test execution by exploring the high levels of parallelism provided by the grid Provides a way to detect configuration mistakes by exploring the heterogeneous nature of the grid: –Shared by multiple users –Without a centralized control unit –Composed by multiple administrative domains (virtual organizations)

9. ISSTA 2006 GridUnit Architecture

10. ISSTA 2006 InGriD Builds environments in grid machines Manages all environments deployed in the grid It is an extension of Smart Framework for Work Group (SmartFrog), developed by HP Labs –Deal with grid machines

11. ISSTA 2006 InGriD Architecture

12. ISSTA 2006 InGriD and a Grid: How it works... Requirements: environment = seghidro... Job Description File Broker Peer Site 1Site 2Site N Machines with seghidro environment

13. ISSTA 2006 Testing a Real Application The application creates a web album from a set of digital images –Time consuming Photo editing is independent from each other Grid nodes have: –Sun JVM 5.0 and JRockit 5.0 –Intel Pentium 4 and Intel Itanium 2 –4 environments

14. ISSTA 2006 Running the Tests Environment Description InGriD JUnit Automated Tests + Test Session Spec. GridUnit Grid

15. ISSTA 2006 1. Environment Specifications

16. ISSTA 2006 2. Test Session Specification

17. ISSTA 2006 OurGrid Largest computation grid in production in Brazil today –About 30 organizations (UFCG, USP, PUC-RS, UFPE, PUC- Minas, UFF, UFPB, UFBA, UCB, LNCC, UNISANTOS,...)  300 machines

18. ISSTA 2006 GridUnit + OurGrid Does not require any source code modification Open Source Free to use and free to join

19. ISSTA 2006 Screenshot – Green Bar

20. ISSTA 2006 Screenshot – Red Bar

21. ISSTA 2006 Screenshot – Gray Bar

22. ISSTA 2006 Conclusions and Future Work We presented a proposal of a solution to improve the confidence of heterogeneous environment applications –InGriD: to describe and deploy test environments –GridUnit: to coordinate and monitor execution of test sets Environmental coverage metric is complementary and orthogonal to test coverage metrics Formalization of the environmental coverage metric for software testing

23. 谢谢 - Thank you – Obrigado Merci – Danke – Arigato - Gracias Additional Information: Alexandre Duarte – alex@dsc.ufcg.edu.br Gustavo Wagner – gugawag@gmail.com Francisco Brasileiro – fubica@dsc.ufcg.edu.br Walfredo Cirne – walfredo@dsc.ufcg.edu.br http://gridunit.sourceforge.net http://sourceforge.net/projects/ingrid-project http://www.ourgrid.org