BalticGrid-II Project EGEE UF’09 Conference, , Catania Partner’s logo Framework for Grid Applications Migrating Desktop Framework for Grid Applications Bartek Palak Poznan Supercomputing and Networking Center

EGEE UF’09 Conference, , Catania2 Outline Guiding principles Product timeline Migrating Desktop functionality Support for grid applications System architecture Integration with Kepler workflow system Users and developers support Conclusions

EGEE UF’09 Conference, , Catania3 Guiding principles „To bring HPC resources to user’s desktop and allow users to focus on their research” Environment that intermediates between user and infrastructure Intuitive user interface - similar to Windows/KDE Easy extendable framework based on idea of plug-ins Web application accessible independently on the user location Set of tools that:  Provide intuitive access to computing resources  Allows easy management of „grid data” Open source

EGEE UF’09 Conference, , Catania4 Migrating Desktop outlook

EGEE UF’09 Conference, , Catania5 Product timeline Migrating Desktop in EU projects:  2002 – 2005: CrossGrid  2005 – 2008: BalticGrid  2006 – 2008: int.eu.grid  : BalticGrid-II  : Euforia Other achievements:  Chosen as key component of the CrossGrid project  Demo “Running interactive and parallel applications on the Grid - Visualization of Plasma Particles in Fusion Devices“ was the winner of the prize “Best On-Line Demo of EGEE User Forum 2007”  Added to RESPECT programme

EGEE UF’09 Conference, , Catania6 Main features Single sign-on (x.509 certificates, VOMS extensions) Simple integration with grid applications based on OSGi plugins Support for batch and interactive jobs (i2glogin) Handling of sequential and parallel applications (OpenMPI support) Open architecture based on OSGi plug-ins Visualization of partial results Built-in tools:  Grid Commander - file manager  Job Wizard - job defining  Job Monitor  SSH, VNC consoles

EGEE UF’09 Conference, , Catania7 File management GridCommander Intuitive file manager Easy access to grid resources Transparent support for LFC, FTP, GridFTP, SFTP, etc… Provided also as an independent web application Built-in file viewers and editors Open architecture (plug-ins)

EGEE UF’09 Conference, , Catania8 Job Submission Wizard Tool for easy job defining Specifying general job parameters Defining specific job parameters Choosing input/output files Support for interactive jobs Job defining

EGEE UF’09 Conference, , Catania9 Job monitoring Job Monitor Intuitive tracking of submitted jobs Real time steering of interactive jobs Processing of job outcome  Access to partial results  Visualization of output files

EGEE UF’09 Conference, , Catania10 Integration with applications No changes in applications are needed Only the way of submittion is changed Simplest case Simplest case  Requires no additional effort  Most of applications can be run using MD standard mechanisms Enhanced integration  Makes submission more intuitive  Requires implementation of plug-ins

EGEE UF’09 Conference, , Catania11 System architecture Client-server application Migrating Desktop Client  Network application  Rich GUI java client  Based on OSGi plug-ins Roaming Access Server  Based on web services  One point access to various infrastructures  Supported infrastructures – gLite (BalticGrid) – Unicore (Euforia) – i2g (int.eu.grid)‏ – ARC (BalticGrid-II) ?

EGEE UF’09 Conference, , Catania12 Migrating Desktop plug-ins Motivations  Easy extension of the framework  Standardization of integration with „third party” modules  Making Migrating Desktop not so „heavy”  Integration points between Migrating Desktop and applications  To give to integrated modules easy access to resources Migrating Desktop plug-ins  Set of OSGi bundles with well-defined interface, described by XML file and loaded on demand from a network

EGEE UF’09 Conference, , Catania13 OSGi OSGi  Open Services Gateway Initiative  OSGi™ Alliance  More than 35 companies from various areas (Sun, IBM, Ericsson, Nokia, Philips, BMW, etc.)  Technology designed to provide a general-purpose, secure, and managed Java framework supporting the deployment of extensible and downloadable modules known as bundles that usual provide services - a collection of interfaces and their implementations.  Standard with several implementations (Equinox, Knoplerfish, etc)  Used as engine for open source Eclipse IDE

EGEE UF’09 Conference, , Catania14 MD in FP7 Euforia project EUFORIA (EU Fusion fOR Iter Applications) Main goal:  To schedule jobs on the grid and HPC together with jobs running on other computing facilities Objectives:  Launch and control jobs in a transparent manner for the users.  Data transfers and visualizations required at run time  Intermediate access the experimental and simulated data.  Integration with EFDA ITM-TF tools (UAL – Universal Access Layer)‏  Middleware connectivity for Kepler Workflow  Scheduler notification tools

EGEE UF’09 Conference, , Catania15 Kepler workflow system integration KEPLER workflow system  a free-software system for designing and executing scientific workflows Integration works performed within EU Euforia project Objectives of integration:  Transparent scheduling of scientific workflows on the grid and HPC infrastructure  Execution of interactive tasks on grid Developed KEPLER actors provide  Communication with RAS  Execution of basic actions

EGEE UF’09 Conference, , Catania16 Running jobs via Kepler

EGEE UF’09 Conference, , Catania17 MD in BalticGrid-II project The EU BalticGrid Second Phase project Main goal:  Providing an advanced interface for accessing project services and resources Objectives:  Development of user-level services for accessing grid data  Support for advanced applications Pilot aplications  SemTi-Kamols – Semantic language parser of Latvian language  CoPS - The Complex Comparison of Protein Structures supported by grid

EGEE UF’09 Conference, , Catania18 Users & developers support Web pages:  Product information  Succesful use cases Manuals  Installation guides  Aplications enhanced integration procedures Tutorials  Support for educational events (like summer schools) HelpDesk  Mailing list:  Bugtracking system JIRA:

EGEE UF’09 Conference, , Catania19 Conclusions Migrating Desktop Intuitive interface that hides complexity of the grid middleware Successfully used in several EU projects Most of applications need no integration to be run Open architecture allows to submit jobs to various infrastructures Integration with Kepler workflow orchestrator enables submission of scientific workflows to HPC Support both for users and developers provided

EGEE UF’09 Conference, , Catania20 Additional information Product homepage  Int.eu.grid  BalticGrid  EUFORIA  PSNC  CVS Repository – source code  The OSGi Alliance 

EGEE UF’09 Conference, , Catania21 Thank you for your attention!