DORII Joint Research Activities DORII Joint Research Activities Status and Progress 6 th All-Hands-Meeting (AHM) Alexey Cheptsov on behalf of the JRA , Stuttgart, Germany

JRA Status & Progress (since ) OUTLINE Introduction. JRA task planning DORII Middleware architecture, status and progress Final edition of the architecture User requested features and improvements Progress of integration and adaptation tasks The final release Open issues and further actions Road map for the next steps Middleware components Achieving of the production level by the applications on the e-Infrastructure Oncoming events Conclusions

Time planning of JRA tasks Introduction JRA task planning DJRA1.5Application evaluation (NA3)

Middleware Architecture Status & Progress Middleware architecture. Final edition Main features IE middleware extends gLite by allowing interconnection of instruments with the infrastructure Common Library collects together classes and interfaces for obtaining access to the underlying gLite services (+ IE) VCR act as a central user front-end to the e-Infrastructure, allowing resource browsing, job management etc. WfMS provides a means for designing and management of the application workflow Visualization and interactivity providing components integrated with VCR greatly extend application support within the e-Infrastructure Open MPI and MPI-Start components support parallel MPI applications

Middleware Architecture Status & Progress Application evaluation. Middleware improvements requested Performance minimize overhead caused by Common Library  storage operations optimization of applications coming from dedicated HPCs  OPATM-BFM simulation model (OCON-MOON) Features requested parametric job support interactivity considerable improvement of the user front-end (VCR) enhanced visualization ImageJ GVid for scientific visualization enabling new features (e.g. App Man) support of new workflows

Middleware Architecture Status & Progress Progress of integration and adaptation tasks Instrument Element a template for development of a custom Instrument Manager improved documentation several enhancements according to the release plan:  Proxy delegation procedure updated to latest version (GLite 1.3.0) compatible with the DORII Common Library.  GridFTP get method is now implemented as: server passive / client active All of the user requirements are met

Middleware Architecture Status & Progress Progress of integration and adaptation tasks Common Library eliminates the need of gLite-UI to be installed offers simple client-side API for accessing gLite + IE services deployed on the infrastructure equipped with a single access point for the user-side middleware – a CL client some components have been extracted from OSGi bundles  better performance storage operations simplified installation procedure for both client and user sides development was successful

Middleware Architecture Status & Progress Progress of integration and adaptation tasks VCR module based (main module, instruments, remote desktop, logbook etc.) adopts Common Library for accessing gLite services simplifies the module installation includes new Application Manager runs interactive jobs using i2glogin supports visualization with GVid etc. WfMS client’s launcher integration required much more efforts as expected

Middleware Architecture Status & Progress Progress of integration and adaptation tasks WfMS Based on CL Persistent for user sessions Scenario files kept in database Graphical monitoring for submitted workflows Remote File Dialog for browsing files on SE Browsing of BDII (CE, SE, IE, IM) from workflow’s blocks development was successful

Middleware Architecture Status & Progress Progress of integration and adaptation tasks GVid Java applet for visualization of scientific data (e.g. NetCDF) Improved NetCDF support Both software and hardware rendering from grid WNs supported Application GVid Server Web Browser GVid Client Java Applet glogin development was successful

Middleware Architecture Status & Progress Progress of integration and adaptation tasks Glogin Java version implemented (removing dependencies on gLite-UI and Eclipse) interactive gLite job support

Middleware Architecture Status & Progress Progress of integration and adaptation tasks Open MPI improved MPI-IO functionality support of PNetCDF library integration with performance analysis tools (Vampir, Valgrind) enhanced profiling possibilities thanks to PERUSE interface Message P1P2P32 Collectionofinput netCDFfiles Collectionofoutput netCDFfiles … I/Ooperations -passing communication

Middleware Architecture Status & Progress Progress of integration and adaptation tasks MPI-Start A special tarball added for running on grid sites where there is no installation of MPI-Start Improved file redistribution for non-shared FS

Middleware Architecture Status & Progress The Final Release presented in DJRA1.5 (submitted on March 1) supported by GForge evaluated by the Integration Team

Middleware Architecture Status & Progress The Final Release. Source code management system (subversion) Bug trackers File release system

Middleware Architecture Status & Progress The Final Release. Evaluation (ITeam) previous evaluation current evaluation Tester feedback is serious contribution to JRA developments

Middleware Architecture Status & Progress Open issues and further actions Middleware integration VCR + CL VCR + GVid … Deployment and use on the infrastructure Application support for achieving the production level

Middleware Architecture Status & Progress e-Infrastructure Storage Resources User area Constant data User Frontend/VCR Remote Instrument Experiment set up data Data from CINECA Computing resources INGV / CINECA INGV / CINECA IM

Middleware Architecture Status & Progress Next development steps IE – none specific VCR AppMan improvement: integration of GVid, use of java i2glogin documentationto be discussed CL docs, manuals, svn structure clean upmid May LFC functionality WfMS Visualization panel inside editor separate worflow updaters to independent threads end of April bug fixes MPI tools releasing version 1.0 of MPI-Startend of April