SCI-BUS is supported by the FP7 Capacities Programme under contract nr RI Workflow-Oriented Science Gateway for Astrophysical Visualization Eva Sciacca M. Bandieramonte, U. Becciani, A. Costa, M. Krokos, P. Massimino, C. Petta, C. Pistagna, S. Riggi and F. Vitello

Motivations Several TBs are often generated by modern cosmological simulations and large-scale astrophysical observations are stored in archives. Such large data volumes pose significant challenges in terms of data analysis, storage and access; a critical step forward in understanding, interpreting and verifying their intrinsic characteristics can be achieved trough visualization.  DCIs access Multiple users need to share visualization experiences, by interacting simultaneously with astrophysical datasets giving feedback on what other participants are doing/seeing.  Collaborative environment The reproduction of specific visualization results is a challenging task as selecting suitable visualization parameters may not be a straightforward process.  Workflow-driven application

SCI-BUS Project SCI-BUS aims to create a generic- purpose gateway technology as a toolset to provide seamless access to major computing, data and networking infrastructures and services in Europe.

Outline  Background Science Gateway Workflow System WSPGrade/gUse  VisIVO Science Gateway Visualization and Analysis Tools Portlets and workflows  VisIVO Mobile  Case Study  Results

Science Gateway It is a community-developed set of tools, applications, and data collections that are integrated via a portal or a suite of applications. Gateways provide access to a variety of capabilities including workflows, visualization, resource discovery and job execution services.

What is a Workflow? A workflow consists of a sequence of connected steps Scientific workflows allows scientists to model, design, execute, debug, re-configure and re-run their analysis and visualization pipelines. Part of the established scientific method is to create a record of the origins of a result: how it was obtained, datasets and experimental methods used, machine calibrations and parameters, etc. Such information is useful for a scientist to interpret their workflow results and for other scientists to establish trust in the experimental result and re-use all the computational pipeline.

Workflows The skeleton of a workflow is represented by a Graph. Jobs denote the activities, which envelop insulated computations Channels are directed edges of a graph, directed from the output ports towards the input ports.

WSPgrade/gUse (grid and cloud User Support Environment) is a DCI virtualization environment providing a scalable set of high- level services by which interoperation between DCIs and user communities can be achieved. The WS-PGRADE Portal is a web portal of the gUSE. It supports development and submission of distributed applications executed on the computational resources of various distributed computing infrastructures including clusters, grids and clouds. A web application framework constructed of functional units called portlets.

VisIVO Science Gateway The VisIVO Science Gateway is designed as a workflow enabled grid portal that is wrapped around WS-PGRADE providing visualization and data management services to the scientific community. The gateway offers role-based authorization modules and supports login with user name and password. Advanced User, can develop and configure workflow. All gUse functionalities are available. Standard User uses Workflow developed by a “workflow developer” through an ASM.

Architecture

Visualization and Analysis Tools 11 Local or Remote (URL) User Data VBT: VisIVO Binary Table VisIVO Importer VisIVO Filters VisIVO Viewer New VBT

Navigation -- Zoom -- Palette -- Algorithms -- Data selection -- Picker op. Visualization

Portlets…

… and workflows

VisIVO Mobile

A short demo View the demo HEREHERE

A case study: Muon Portal 17 The Project: Exploring the container content searching for nuclear material (uranium, plutonium) Prototype  muon track deviation Compute: coordinates and deviation angle that the muon track has when high-Z material element is in the path.

Results

Workflow

Filtered Dataset (Threshold filtering) Un-Filtered Dataset Input Dataset POCA Dataset Processing

Isosurface Images Filtered Dataset Un-Filtered Dataset

Panoramic Movies Filtered Dataset Un-Filtered Dataset

Filtered Dataset Tomographic Images Un-Filtered Dataset

Conclusions A workflow-oriented gateway allows scientists to share their analysis workflows and identify best practices for investigating their datasets. More importantly, they can automate workflows for repeated analysis with changed parameters. This way scientists can focus on their core scientific discoveries as opposed to spending time in data analysis on inadequate resources. Through the shareable workflows and reusable portlets of the gateway, not just astrophysicists but also other scientific fields scientists can exploit the developed technologies.

Thank you for your attention!

Development Tools A free, open-source Integrated Development Environment for software developers. A web application framework for Rich Internet Applications. It features a robust server-side architecture. It offers a large collection of UI components such as Buttons, Tables, Trees and Layouts. The components use events, listeners and data binding to communicate with each other and with the business logic.

VisIVO DCI Infrastructure -Trigrid Cluster - AMD Dual Opteron GHz, 14 Blades with 4 cores with 8 GB RAM / Blade (52 CPU core) - Total storage: 3.7 TB (lsf) -2 X Server Intel Xeon GHz, Dual-Core, 2 GB RAM - Total storage: 23 TB -Server Intel Xeon GHz, Dual-Core, 2 GB RAM - Total storage: 8 TB -Hybrid system cpu-GPU, N 2: Intel(R) Xeon(R) CPU 2.40GHz, 24 GB RAM DDR NVIDIA TESLA C2070, 448 cuda core + 6 GBRam -COMETA grid – gLite nodes ~1500 CPU/core (250 hosted at INAF-OACT) AMD Dual Opteron GHz (jdl) VisIVO Gateway: Infrastructures