1. www.see-grid-sci.eu SEE-GRID-SCI The SEE-GRID-SCI initiative is co-funded by the European Commission under the FP7 Research Infrastructures contract no. 211338 ESIP Environment Oriented Satellite Image Processing Platform (Middleware Extension) Dorian Gorgan, Victor Bacu Teodor Stefanut, Denisa Rodila Technical University of Cluj-Napoca Romania JRA1 Application-Specific Service Description 10 September 2009

2. JRA1 Application-Specific Services and Middleware Extensions - Introductory Presentation2/28 Primary contact Dorian Gorgan dorian.gorgan@cs.utcluj.ro Technical University of Cluj-Napoca UTCN, third party SEE-GRID-SCI partner acronym Romania Current status  Beta Expected availability  1 st April 2010 Licensing status  GPL 3 ESIP Platform

3. JRA1 Application-Specific Services and Middleware Extensions - Introductory Presentation3/28 ESIP Platform Description ESIP - Environment Oriented Satellite Image Processing Platform Area(s) of usage  Environment oriented applications using data provided through Grid based satellite image processing Description  ESIP provides a Grid based software platform for satellite image processing and experiments this approach on pilot environmental applications. It is a collection of services available in Web and Grid applications. ESIP will be extended to a larger production Grid infrastructure by processing real data for SEE regions  The Environment oriented Satellite Data Processing Platform (ESIP) is developed through the SEE-GRID-SCI (SEE-GRID eInfrastructure for regional eScience) project (2008-2010), funded by the European Commission.

4. JRA1 Application-Specific Services and Middleware Extensions - Introductory Presentation4/28 ESIP Related References Wiki ESIP http://wiki.egee-see.org/index.php/JRA1_Commonalities Wiki GreenView http://wiki.egee-see.org/index.php/GreenView

5. JRA1 Application-Specific Services and Middleware Extensions - Introductory Presentation5/28 Partners and User Communities Identified SEE-GRID-SCI partners and communities  ESIP Platform development, and Methodological Approach for ESIP based application development Partners: 1. Technical University of Cluj-Napoca (UTCN), ESIP coordinator 2. National Center for Information Technology (NCIT) Bucharest 3. West University of Timisoara (UVT) 4. ICI Bucharest, national coordinator and SEE-GRID-SCI partner  ESIP is used to develop the GreenView application Partners: 1. UTCN, NCIT, UVT, and ICI (Romania) 2. Eötvös Loránd University (ELU) from Budapest (Hungary) 3. Research and Educational Networking Association of Moldova (RENAM) Other related usages  The main beneficiaries of this VO are Government Organizations, Environment Agencies, Hydrological Institutes, and Research Groups involved in environment supervision and behavior prediction of natural phenomena, especially in vegetation related studies

6. JRA1 Application-Specific Services and Middleware Extensions - Introductory Presentation6/28 Grid Infrastructure: middleware (gLite) ESIP Platform: service oriented architecture; collection of services providing creation, execution, and scheduling of the jobs; job resource management; access to image database; file transfer; data replication; workflow based execution; image processing. Applications: environmental applications based on process description graphs. Environmental Data Image and Spatial Data Process Description Grid Infrastructure ESIP Platform Application Oriented Level GreenView Appl.Other Env Appl’s... Functional levels

7. JRA1 Application-Specific Services and Middleware Extensions - Introductory Presentation7/28 Architecture Server component – represented by WebServices Client component – API used to develop client applications (web or desktop based applications) User oriented level application – a set of user interaction supported components (EditorIC, ManagerIC, ViewerIC) Application level – combines the editor, manager, and viewer related functionality into complex functionalities Client Java API User oriented application level ViewerICEditorICManagerIC Applications Client GRID Infrastructure ViewerWSExecutorWSEditorWSManagerWS Server

8. JRA1 Application-Specific Services and Middleware Extensions - Introductory Presentation8/28 ESIP functional levels WebService level (first implementation)  EditorWS, ManagerWS, ExecutorWS, ViewerWS Application oriented level (Interaction Supported Components) (work in progress)  EditorIC, ManagerIC, ViewerIC Application level (first implementation of a subset of the GreenView application components)  Editor Application, Manager Application, Viewer Application  Complex application (e.g. GreenView)

9. JRA1 Application-Specific Services and Middleware Extensions - Introductory Presentation9/28 Service supported functionality EditorWS  Provides information about the available resources (e.g. lists of operations, sub-graphs, services, satellite image types, data types etc)  WSDL URL: gPEditorWS http://gisheo01.mediogrid.utcluj.ro:8185/gPEditor/gPEditorWSService?wsdl ManagerWS  Provides information about workflow (i.e. PDG, IPDG)  Fetch and upload resources (e.g. workflow, operators, services, sub-graphs, data)  WSDL URL: gPManagerWS http://gisheo01.mediogrid.utcluj.ro:8185/gPManager/gPManagerWSService?wsdl Reference: Wiki ESIP (http://wiki.egee-see.org/index.php/JRA1_Commonalities)

10. JRA1 Application-Specific Services and Middleware Extensions - Introductory Presentation10/28 Service supported functionality ExecutorWS  Executes the instantiated workflows (IPDGs) over the Grid  Monitor the execution of the workflows  WSDL URL: gPExecutorV02gLite http://gisheo01.mediogrid.utcluj.ro:8185/gPExecutorV0.2gLite/gPExecutorWSgLiteV02S ervice?wsdl ViewerWS  Get and format the input and output data (e.g. initial and processed satellite images) Reference: Wiki ESIP (http://wiki.egee-see.org/index.php/JRA1_Commonalities)

11. JRA1 Application-Specific Services and Middleware Extensions - Introductory Presentation11/28 Interaction supported functionality Components used to build up the application’s complex functionality EditorIC  Support the user’s editing operations for the workflow development ManagerIC  Instantiate workflow for particular satellite data  Manage the model resources (e.g. operators, services, sub-graphs, satellite data) ViewerIC  Display the input and output data (e.g. initial and processed satellite images) on the client site  Get and display the monitoring data

12. JRA1 Application-Specific Services and Middleware Extensions - Introductory Presentation12/28 ESIP grid workflow description ESIP aims to provide a flexible diagrammatical description solution for image processing workflow by defining PDG patterns Workflows or PDG (Process Description Graph)  represented as DAGs  describes the execution workflow and dependencies between tasks Input data – satellite spectral bands Nodes – resources, operators, sub-graphs, services Abstract PDG – used to define the workflow Instantiated PDG  can be scheduled and executed  must be mapped onto a physical satellite image

13. JRA1 Application-Specific Services and Middleware Extensions - Introductory Presentation13/28 Water detection algorithm (Gond) Bands: NIR, RED Bands: NIR, SWIR

14. JRA1 Application-Specific Services and Middleware Extensions - Introductory Presentation14/28 Process Description Graphs Graph nodes: Resources Operators Services Sub-graphs Input OP1 S1 SG Input OP2 OP3 S2 Output

15. JRA1 Application-Specific Services and Middleware Extensions - Introductory Presentation15/28 Image Processing Operators Experiments on TIFF format satellite image oriented operators: Add, Subtract, Multiply, Divide, AddConst, SubtractConst, MultiplyConst, LogicAnd, LogicOr, LogicXor, LogicNot, Blur, Sharpen, EdgeDetection, ThresholdFilter, MeanValue, HistogramEq, HistogramScale, Blend, PseudoColoring, Dilation, Erosion, Opening, and Closing Reference: http://wiki.egee-see.org/index.php/JRA1_Commonalities

16. JRA1 Application-Specific Services and Middleware Extensions - Introductory Presentation16/28 Web Service Composition Design and implement a business workflow architectural model which allows the extension of the workflow description and execution tools in the Grid environment with Web service based computation nodes  Automatic discovery of Web services  Automatic binding of Web services  Semantic annotation  Composition of Web services based on templates  Automatic invocation of composed Web services from a Grid environment The extension of workflow description and execution process is needed for defining a hyper-graph structure in a Grid environment having as computation nodes  Operators  Sub-graphs  Web services

17. JRA1 Application-Specific Services and Middleware Extensions - Introductory Presentation17/28 Workflow Example

18. JRA1 Application-Specific Services and Middleware Extensions - Introductory Presentation18/28 Solution Composition of Web services in two major phases:  Automatically searching the Web services  UDDI private repository  Semantic annotation  Automatically binding the information of selected Web services to predefined templates used for BPEL business process creation and instantiation

19. JRA1 Application-Specific Services and Middleware Extensions - Introductory Presentation19/28 System Architecture

20. JRA1 Application-Specific Services and Middleware Extensions - Introductory Presentation20/28 Dissemination Participation to the Regional Environmental Science Workshop, Sofia, May 6-8, 2009. Presentations: 1. Victor Bacu, Dorian Gorgan, Teodor Stefanut, "GreenView”. Reference: SEEGRIDSCI-NA4-RO-001- GreenView_EnvVO-a-2009-05-07.ppt 2. Victor Bacu, Dorian Gorgan, Teodor Stefanut, "ESIP Platform”. Reference: SEEGRIDSCI-JRA1-RO- 001-ESIP-a-2009-05-07.ppt Participation to SCICOM09 - 7th International Conference on "Large-Scale Scientific Computations", 4-8 June, 2009, Sozopol, Bulgaria.Presentation: 1. Dorian Gorgan, Teodor Stefanut, Victor Bacu, Danut Mihon, Denisa Rodila, “Grid based Environment Application Development Methodology” Participation to HiPerGRID - 3rd International Workshop on High Performance Grid Middleware, 28 May, 2009, Bucharest. Presentation: 1. Victor Bacu, Teodor Stefanut, Denisa Rodila, Dorian Gorgan, “Process Description Graph Composition by gProcess Platform" Participation to the Student Scientific Communication Session, 22 May 2009, Technical University of Cluj-Napoca. Presentations: 1. Denisa Rodila, Victor Bacu, Dorian Gorgan, “Integration of Satellite Image Operators as Workflows in the gProcess Application” 2. Danut Mihon, Dorian Gorgan, Victor Bacu, Teodor Stefanut, "Grid Based Environment Application Development- Green View"

21. JRA1 Application-Specific Services and Middleware Extensions - Introductory Presentation21/28 Papers to Conferences 1. Gorgan, D., Bacu, V., Stefanut, T., Rodila, D., "Grid based Satellite Image Processing Platform for Earth Observation Applications Development". IDAACS'2009 - IEEE Fifth International Workshop on "Intelligent Data Acquisition and Advanced Computing Systems: Technology and Applications", 21-23 September 2009, Rende, Cosenza, Italy (2009) 2. Gorgan, D., Stefanut, T., Bacu, V., Mihon, D., “Grid based Environment Application Development Methodology”, SCICOM09 - 7th International Conference on "Large-Scale Scientific Computations", 4-8 June, Sozopol, Bulgaria, (to be published in LNCS, 2009) 3. Bacu V., Stefanut T., Rodila D., Gorgan D., “Process Description Graph Composition by gProcess Platform”. HiPerGRID - 3rd International Workshop on High Performance Grid Middleware, 28 May, Bucharest. Proceedings of CSCS-17 Conference, Vol.2. ISSN 2066-4451, pp. 423-430, (2009) 4. Rodila D., Bacu V., Gorgan D., “Integration of Satellite Image Operators as Workflows in the gProcess Application”. ICCP2009, 27 Aug, 2009 Cluj-Napoca (accepted for publication)

22. JRA1 Application-Specific Services and Middleware Extensions - Introductory Presentation22/28 5. Mihon D., Bacu V., Stefanut T., Gorgan D., “Grid Based Environment Application Development – GreenView Application”. ICCP2009 - IEEE 5th International Conference on Intelligent Computer Communication and Processing, 27 Aug, 2009 Cluj-Napoca (accepted for publication). 6. Denisa D. Rodila, Victor Bacu, Dorian Gorgan, "Semantic Annotation based Service Composition for Grid Workflow Description and Execution". SYNASC Symposium, 26-29, September 2009, Timisoara, (Accepted for publication in IEEE Computer Press) 7. Gorgan D., "Earth Science Application Development Methodology by ESIP and gProcess Platforms". Abstract sent for the workshop "Federation and interoperability of Earth Science Digital Repositories: data discovery, access and visualization" within the Conference EGEE'09 - Uniting our strengths to realise a sustainable European grid, 21-25 Sept, Barcelona (2009)

23. JRA1 Application-Specific Services and Middleware Extensions - Introductory Presentation23/28 Users, Results, Plans for Future Possible long-term developments  The ESIP Platform and the set of tools and components from the Application Oriented Level could be used in:  Development of other environmental and geographical data based applications in SEE and CE regions  Development of tools and application required by other related European projects such as EnviroGRIDS, http://www.envirogrids.net/  Basic software platform for related national programmes from the SEE and CE regions  Center for Ecological-Noosphere Studies of National Academy of Sciences of the Republic of Armenia - CENS NAS RA  Development of environment applications. For instance, soil pollution by heavy metals  Data access services to data repositories provided by the GENESI-DR Project

24. JRA1 Application-Specific Services and Middleware Extensions - Introductory Presentation24/28 Developing plan

25. JRA1 Application-Specific Services and Middleware Extensions - Introductory Presentation25/28 Thanks for attending!