1. 6 February 2009 ©2009 Cesare Pautasso | www.pautasso.info 1 JOpera and XtremWeb-CH in the Virtual EZ-Grid Cesare Pautasso Faculty of Informatics University of Lugano (USI), Switzerland http://www.pautasso.info

2. wet lab processing Extract raw spot intensities in vitro in silico Variablility and error assessment Significance assessment Annotate and normalize data likelihood for differential expression for each gene 1 spot = 1 gene Expression level: Green: A > B Red: A < B Black: A = B Condition A Condition B Cell population Image processing Data Preprocessing Determine Expression Pattern Determine parameters for error model Clustering MicroArray Scanner Virtual Laboratory Workflow

3. 6 February 2009 ©2009 Cesare Pautasso | www.pautasso.info 3 Building Virtual Laboratories

4. 6 February 2009 ©2009 Cesare Pautasso | www.pautasso.info 4 Building Virtual Laboratories

5. 6 February 2009 ©2009 Cesare Pautasso | www.pautasso.info 5 Grid Workflow Management Provide the scientist with a platform that takes care of all data handling and record keeping chores so that the user can concentrate on the science and not computer science “ Make it easy to build Grid applications composed of multiple jobs ”

6. 6 February 2009 ©2009 Cesare Pautasso | www.pautasso.info 6 JOpera: Grid Workflow for Eclipse

7. 6 February 2009 ©2009 Cesare Pautasso | www.pautasso.info 7 Drag, Drop and Connect

8. 6 February 2009 ©2009 Cesare Pautasso | www.pautasso.info 8 Run, Monitor, Steer and Debug

9. 6 February 2009 ©2009 Cesare Pautasso | www.pautasso.info 9 A Growing User Community Swiss Institute of Bioinformatics, Swiss National Supercomputing Center, Purdue University, National Center for Supercomputing Applications, Singapore Management University, McGill University, University of Kent, SINTEF (Norway), IWU Fraunhofer (Germany), University of Nebraska…

10. 6 February 2009 ©2009 Cesare Pautasso | www.pautasso.info 10  High Level Workflow Language  Data and Control Aspects (Visual Representation)  Recursion, Iteration, Parallelism and Pipelining  Open and Extensible Component Model  Run existing code without changes  Synchronous, Asynchronous, and Streaming interaction  Web services support (Axis, WSIF)  Secure access to remote file systems and hosts (SSH)  Easy to integrate with existing schedulers (e.g. Condor) Why Users Like JOpera

11. 6 February 2009 ©2009 Cesare Pautasso | www.pautasso.info 11  High Level Workflow Language  Data and Control Aspects (Visual Representation)  Recursion, Iteration, Parallelism and Pipelining  Open and Extensible Component Model  Run existing code without changes  Synchronous, Asynchronous, and Streaming interaction  Web services support (Axis, WSIF)  Secure access to remote file systems and hosts (SSH)  Easy to integrate with existing schedulers (e.g. Condor)  Strong Eclipse Foundation  Platform Independent (Eclipse/Java)  Flexible, Extensible, Modular and Embeddable Why Users Like JOpera

12. 6 February 2009 ©2009 Cesare Pautasso | www.pautasso.info 12 Combine in the same workflow jobs implemented using an open and extensible set of technologies SSH SQL JOpera Workflow WSDL Human Java Snippets Methods XML XSLT XPath Condor Extensible Component Model

13. 6 February 2009 ©2009 Cesare Pautasso | www.pautasso.info 13 SSH SQL JOpera Workflow WSDL Human Java Snippets Methods XML XSLT XPath Condor JOpera processes are automatically published to clients using a variety of access protocols Web Clients WS Clients Eclipse RCP Clients REST JavaWSDL Sharing Workflows as a Service

14. 6 February 2009 ©2009 Cesare Pautasso | www.pautasso.info 14 SSH SQL JOpera Workflow WSDL Human Java Snippets Methods XML XSLT XPath Condor Develop a new adapter for the submission of jobs to XtremWeb-CH Grid middleware (WP3 - Task 3.1) JOpera in the Virtual EZ-Grid Project XWeb CH

15. 6 February 2009 ©2009 Cesare Pautasso | www.pautasso.info 15 1. Definition of job submission parameters based on the API of XtremWeb-CH 2. Development of a JOpera adapter plugin to connect the two systems: Start the job by submitting it to the Grid middleware Monitor the job execution Retrieve the job results (and its success/failure outcome) 3. Evaluate and test the integrated system on the Virtual EZ-Grid infrastructure JOpera and XtremWeb-CH

16. 6 February 2009 ©2009 Cesare Pautasso | www.pautasso.info 16  Swiss National Grid Deployment  ARC/Nordugrid Job Submission  Virtual EZGrid: Integration with XWebCH  Grid Portal for Workflow Monitoring  New Scientific Workflow Applications  Computational Chemistry Workflows  Web 2.0 Mashup Development  RESTful Web Service Composition  Pipelined processing over RSS Feeds Roadmap 2009

17. 6 February 2009 ©2009 Cesare Pautasso | www.pautasso.info 17 Free Download http://www.jopera.org/latest More Information http://www.jopera.org/docs/publications