PEPC 2003, Geneva, , PROGRESS Computing Portal Poznań Supercomputing and Networking Center (PSNC) Poland Poland Cezary Mazurek

PEPC 2003, Geneva, , PSNC Activity  Operator of the Polish National Research and Education Network POL-34/622  Operator of the Poznań Metropolitan Area Network POZMAN  HPC Center  Systems and Network Security Center  R&D Center for New Generation Networks, Grids and Portals

PEPC 2003, Geneva, , PIONIER National Programme GRID-enabled Applications Communication Application Geographical information applications EnvironmentManagement Application Distance Learning Application Internet Access Aided Learning Application Computational Science Application Advanced Network Services (Middleware) Optical Network Advanced Research Specialized Infrastructure

PEPC 2003, Geneva, , PIONIER Network

PEPC 2003, Geneva, ,

PEPC 2003, Geneva, , PIONIER Projects  PROGRESS  Access environment to computational services performed by cluster of SUNs  iTV  System for providing an audio-visual stream over Polish Optical Internet enabling the interactive television  LDAP  Deployment of LDAP Protocol in the National Research and Education Network POL-34/622  VLAB  High Performance Computing and Visualisation for Virtual Laboratory Applications

PEPC 2003, Geneva, , PROGRESS  Duration: December 2001 – May 2003  Deployment: June 2003-December 2003  Project Partners  SUN Microsystems Poland  PSNC IBCh Poznań  Cyfronet AMM, Kraków  Technical University Łódź  Co-funded by The State Committee for Scientific Research (KBN) and SUN Microsystems Poland

PEPC 2003, Geneva, , PROGRESS  Project is testbed oriented  Three bioX applications will be enabled within the grid-portal architecture  Two of them are already available  Distributed cluster of SF6800 is a pilot testbed installation  Dedicated channels through PIONIER network (1 Gb/s) will come in the 3Q2003  Tools and services for grid processing and data management in PROGRESS grid-portal framework

PEPC 2003, Geneva, , PROGRESS Architecture

PEPC 2003, Geneva, , PROGRESS Communication SGE HTTP/HTTPS Portal Grid Broker Webservice FTP HTTP/HTTPS Service Provider Grid FTP Webservice

PEPC 2003, Geneva, , PROGRESS  Pilot installation Poznan-Krakow  3 SUN Fire 6800 Poznań: SUN Fire Link  2 Data Servers  Front-end for portal access  Distributed processing in distributed framework

PEPC 2003, Geneva, , PROGRESS Testbed

PEPC 2003, Geneva, , PROGRESS testbed Frontend Computing Data management Data storage Portal Server SGE EE HPC Cluster Tools Globus Aplication Server Certification Server Oracle SRS Database SRS Database Aplication Server Certification Server Oracle SGE EE HPC Cluster Tools Globus

PEPC 2003, Geneva, , PROGRESS testbed Fibre Channel 1Gb/s Ethernet SF 6800 SF V880 SF 280R SB 1000 SE T3/T3+ Management Fast Ethernet

PEPC 2003, Geneva, , PROGRESS – BioX Applications  DNA Assembly BranchBound1  DNA Assembly Heuristic2  DNA Assembly Heuristic3  Prediction of protein secondary structure - module A1  Prediction of protein secondary structure - module A2  Prediction of protein secondary structure - module B  Prediction of protein secondary structure - module C  Prediction of protein secondary structure - module D Logical workflow applications: LAD – learning: A1->B->C LAD – testing: A2->D

PEPC 2003, Geneva, , PROGRESS Architecture

PEPC 2003, Geneva, , PROGRESS HPC Window  GRID user interfaces are independent of the information processing layer  bioX computational portal  Migrating Desktop application  The PROGRESS HPC Portal is the user interface for the PROGRESS grid access environment

PEPC 2003, Geneva, , PROGRESS  4 – tier architecture for grid-portal environment

PEPC 2003, Geneva, , PROGRESS Service Provider

PEPC 2003, Geneva, , PROGRESS Content Provider Webservice Session Bean Entity Beans SOAP SOAP/XML Computing Portal GRID Service Provider  Content Provider  Data presentation  User interaction  Service Provider  Realization of services functions  Services data storage and access

PEPC 2003, Geneva, , PROGRESS Portal  PROGRESS computational portal  Accessing applications collected in the application factory  Forming and running jobs  Accessing data stored in the Data Management System  Providing information services  The PROGRESS Portal is equipped with 5 portlets (content providers) interacting with the user on behalf of PROGRESS services. These portlets are:  My jobs  My data  News  Applications  Management

PEPC 2003, Geneva, , PROGRESS Grid services  Job submission service  creating, building, submitting, monitoring execution and analyzing results of grid jobs (“My jobs” portlet)  Application management service  adding and configuring applications in the GSP application factory (“Applications” portlet); “virtual application” management under development  Provider management service  keeping up-to-date information on services available in the grid service provider (“Management” portlet)  Informational services  news service – reading short messages illustrated with web links (“News” portlet); multiple instances; other informational services under development – “Discussion”, “Links” portlets)  Data management  uploading and downloading files, file system tree management (“My data” portlet)

PEPC 2003, Geneva, , Web services communication HPC Portal Grid Service Provider Data Management System Grid Resource Broker saveJob() getApplications() saveTaskOfJob() saveStdOfTask() submitJob() getUserJobs() getJobStatus() listUserDirectory() addUserFile() getUserFileLocation() submitJob() changeJobStatus()

PEPC 2003, Geneva, , Authentication and access control  Authentication: username+password, LDAP based user database  Authorization - 2 levels:  portlet access control – performed by the portal framework  grid services authorization – RAD based authorization module  Single Sign-On – enabled by the identity server

PEPC 2003, Geneva, , Authentication, authorization and SSO in PROGRESS Portal Grid service provider Identification server RAD Logon Authentication Request Method invocation Token validation Authorization of resource access

PEPC 2003, Geneva, , PROGRESS Grid broker  Grid Broker in Progress:  Job submission, monitoring and controlling  Different scheduling and resource management strategies  Flexible job description language (XRSL)  Heterogeneous and service based environment

PEPC 2003, Geneva, , PROGRESS Grid Broker

PEPC 2003, Geneva, , Grid broker Resources Resources & ServicesBroker Globus SGE Information System (GIS) Resources Monitoring Portal + request description XRSL (XML/RSL)

PEPC 2003, Geneva, , PROGRESS Data Management System  Provides seamless access to data and information for grid computing  Uses metadata repository for describing stored data  Stores data on various media such as files, tapes and databases

PEPC 2003, Geneva, , PROGRESS Data Management System Data Broker Data Storage Mirror & Proxy Data Storage Metadata Management SRS WS GASS FTP Grid FTP (...) Clients Portal Grid broker Migrating desktop

PEPC 2003, Geneva, , PROGRESS Security  Intrusion Detection System (IDS)  Advanced security mechanisms that are destined to detect, possibly in real time, unauthorized security attempts, security breaches and attacks.  One of the tasks realized in the PROGRESS project is VALKYRIE IDS for Solaris operating system.  VALKYRIE IDS: is a host based system, passively monitors protected infrastructure, uses misuse detection approach for analysis, works continuously.

PEPC 2003, Geneva, , VALKYRIE IDS  Module for monitoring operating system events (kernel level module)  Expert system module for analyzing system events stream and for attack detection  GUI console for system operator

PEPC 2003, Geneva, , PROGRESS Security Oracle IPLANET Solarisglobus grid engine SCM Expert System Module GUI Portal protection PCSS Firewall System

PEPC 2003, Geneva, , PROGRESS Migrating Desktop  Alternative user interface to GRID resources;  Layout analogous to „windows based” operating systems GUI, like e.g. Windows, KDE, Gnome, etc. – can be more intuitive for some users;  Possibility of working with different grid projects (integrated also with CrossGRID project co-funded by EU);

PEPC 2003, Geneva, , Migrating Desktop Functionality  Graphic User Interface (GUI) management;  User profile management;  File transfer management;  Job configuration and submition;  Job execution monitoring;  Handling links to local files and applications;  Handling links to remote files;

PEPC 2003, Geneva, , Migrating Desktop – main window

PEPC 2003, Geneva, , PROGRESS PROGRESS at Supercomputing 2002, Baltimore, USA

PEPC 2003, Geneva, , PROGRESS Portal

PEPC 2003, Geneva, , PROGRESS – job list

PEPC 2003, Geneva, , PROGRESS – job menu

PEPC 2003, Geneva, , PROGRESS – job tasks

PEPC 2003, Geneva, , PROGRESS – task requirements

PEPC 2003, Geneva, , PROGRESS – data management

PEPC 2003, Geneva, , PROGRESS – application factory

PEPC 2003, Geneva, , PROGRESS - news

PEPC 2003, Geneva, , PROGRESS  Conclusions  The PROGRESS project has provided components and services for flexible grid-portal environment, which might be deployed in other projects and environments  PROGRESS team has been working on additional functionality for Solaris OS in the area of checkpointing and security

PEPC 2003, Geneva, , PROGRESS Thank you !