Www.epikh.eu The EEPIKH Project (Exchange Programme to advance e-Infrastructure Know-How) Giuseppe Andronico, on behalf of Giuseppe LA ROCCA INFN Catania.

Slides:



Advertisements
Similar presentations
CHEP 2000, Roberto Barbera Roberto Barbera (*) GENIUS: a Web Portal for the GRID Meeting Grid.it, Bologna, (*) work in collaboration.
Advertisements

Building Portals to access Grid Middleware National Technical University of Athens Konstantinos Dolkas, On behalf of Andreas Menychtas.
ETSI Grid – Sophia Antipolis – 2005/05/24 A-WARE summary for ETSI Andrea Rodolico CTO, NICE srl, Italy.
The GENIUS Grid Portal Giuseppe LA ROCCA INFN Catania
1 CHEP 2000, Roberto Barbera Recent grid activities at INFN Catania (*) HEPiX/HEPNT 2002, Catania, (*) work in collaboration with.
 Copyright NICE srl, 2008 Workshop finale dei Progetti Grid del PON "Ricerca" Beppe Ugolotti, CEO
The EPIKH Project (Exchange Programme to advance e-Infrastructure Know-How) gLite Grid Services Abderrahman El Kharrim
FP6−2004−Infrastructures−6-SSA E-infrastructure shared between Europe and Latin America The GENIUS Grid portal Moisés Hernández.
a Web interface for the GRID world Alice Off-line Meeting Erice (TP) - Italy, Sept 26th, 2000.
E-science grid facility for Europe and Latin America The GENIUS Grid Portal Riccardo Bruno INFN Catania
Slide 1 of 9 Presenting 24x7 Scheduler The art of computer automation Press PageDown key or click to advance.
INFSO-RI Enabling Grids for E-sciencE The GENIUS grid portal Roberto Barbera University of Catania and INFN Science Gateways Workshop.
Apache Airavata GSOC Knowledge and Expertise Computational Resources Scientific Instruments Algorithms and Models Archived Data and Metadata Advanced.
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE07 Conference, Budapest, Hungary, 1-5 October ’07 Douglas McKinley
EGEE is a project funded by the European Union under contract IST GENIUS and EnginFrame Roberto Barbera Univ. of Catania and INFN SEE-GRID.
Riccardo Bruno INFN.CT Sevilla, Sep 2007 The GENIUS Grid portal.
The EPIKH Project (Exchange Programme to advance e-Infrastructure Know-How) Grid Engine Riccardo Rotondo
 Copyright NICE srl, 2006 New Ideas for Computing Environments EnginFrame as framework for Grid enabled Web portals on Industrial and research contexts.
FP6−2004−Infrastructures−6-SSA E-infrastructure shared between Europe and Latin America GENIUS server installation and configuration.
INFSO-RI Enabling Grids for E-sciencE The GENIUS Grid portal Tony Calanducci INFN Catania - Italy First Latin American Workshop.
EGEE is a project funded by the European Union under contract IST The GENIUS portal Roberto Barbera University of Catania and INFN SEE-GRID.
 Copyright NICE srl, 2006 New Ideas for Computing Environments The Grid Portal for Industry and Research Alberto Falzone, Andrea Rodolico NICE srl
CHEP 2000, Giuseppe Andronico Grid portal based data management for Lattice QCD data ACAT03, Tsukuba, work in collaboration with A.
E-science grid facility for Europe and Latin America The GENIUS Grid Portal Giuseppe LA ROCCA INFN Catania
The huge amount of resources available in the Grids, and the necessity to have the most up-to-date experimental software deployed in all the sites within.
EGEE is a project funded by the European Union under contract IST The GENIUS portal Roberto Barbera University of Catania and INFN First Latinamerican.
FP6−2004−Infrastructures−6-SSA E-infrastructure shared between Europe and Latin America The GENIUS Grid Portal Roberto Barbera Univ.
Enabling Grids for E-sciencE EGEE-III INFSO-RI Using DIANE for astrophysics applications Ladislav Hluchy, Viet Tran Institute of Informatics Slovak.
Migrating Desktop Marcin Płóciennik Marcin Płóciennik Kick-off Meeting, Santander, Graphical.
Enabling Grids for E-sciencE GENIUS and EnginFrame: A successful EGEE technology transfer Ing. Beppe Ugolotti NICE srl
Convert generic gUSE Portal into a science gateway Akos Balasko 02/07/
The GENIUS Grid Portal : some success stories! Giuseppe LA ROCCA INFN Catania Joint EGEE and SEE-GRID.
The GENIUS Portal Nicola Venuti – Livia Torterolo NICE srl Geneva, , 2nd Tutorial for Health e-Child Project New Ideas for Computing Environments.
Getting started DIRAC Project. Outline  DIRAC information system  Documentation sources  DIRAC users and groups  Registration with DIRAC  Getting.
E-infrastructure shared between Europe and Latin America GENIUS PORTAL Valeria Ardizzone INFN-Catania 1° EELA Grid School Itacuruçà Island, State of Rio.
EGEE is a project funded by the European Union under contract IST GENIUS and EnginFrame Roberto Barbera EGEE NA4 Generic Applications coordinator.
Glite. Architecture Applications have access both to Higher-level Grid Services and to Foundation Grid Middleware Higher-Level Grid Services are supposed.
EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Application Porting INFN Giuseppe.
INFSO-RI Enabling Grids for E-sciencE GILDA and GENIUS Guy Warner NeSC Training Team An induction to EGEE for GOSC and the NGS NeSC,
Development of e-Science Application Portal on GAP WeiLong Ueng Academia Sinica Grid Computing
EGI-InSPIRE RI EGI-InSPIRE RI A new “lightweight” Crypto Library for supporting an Advanced Grid Authentication Process.
The EPIKH Project (Exchange Programme to advance e-Infrastructure Know-How) The Egyptian Grid Infrastructure Maha Metawei
Application Specific Module Tutorial Zoltán Farkas, Ákos Balaskó 03/27/
EGEE is a project funded by the European Union under contract IST Enabling bioinformatics applications to.
Click to edit Master title style Click to edit Master text styles Second level Third level Fourth level Fifth level Technical Training 1 EGEE Conference.
Grid Execution Management for Legacy Code Architecture Exposing legacy applications as Grid services: the GEMLCA approach Centre.
EGEE is a project funded by the European Union under contract IST GENIUS and GILDA: a status report Roberto Barbera NA4 Generic Applications.
Breaking the frontiers of the Grid R. Graciani EGI TF 2012.
IST E-infrastructure shared between Europe and Latin America The GILDA t-Infrastructure and the GENIUS portal Christian Grunfeld,
FESR Consorzio COMETA - Progetto PI2S2 Il portale grid: GENIUS Alberto Falzone NICE srl Consorzio COMETA – Progetto PI2S2 Tutorial.
The GENIUS Grid Portal Giuseppe LA ROCCA INFN Catania ACGRID-II School 2-14 November 2009 Kuala Lumpur - Malaysia.
EGEE is a project funded by the European Union under contract IST GENIUS and GILDA Guy Warner NeSC Training Team Induction to Grid Computing.
REST API to develop application for mobile devices Mario Torrisi Dipartimento di Fisica e Astronomia – Università degli Studi.
Consorzio COMETA - Progetto PI2S2 UNIONE EUROPEA The GENIUS Grid Portal and robot certificates Giuseppe LA ROCCA
Antonio Fuentes RedIRIS Barcelona, 15 Abril 2008 The GENIUS Grid portal.
Enabling Grids for E-sciencE Portals and Workflows: GENIUS and TRIANA Alberto Falzone NICE srl Bioinfogrid Meeting Bari,
The EPIKH Project (Exchange Programme to advance e-Infrastructure Know-How) gLite Grid Introduction Salma Saber Electronic.
FESR Trinacria Grid Virtual Laboratory Il portale GENIUS, EnginFrame e strumenti per il calcolo distribuito Alberto Falzone, Beppe Ugolotti.
GENIUS and EnginFrame GENIUS and EnginFrame: status and perspective The GENIUS Grid Portal: status and perspective Andrea Rodolico NICE srl
EGI-InSPIRE RI EGI-InSPIRE EGI-InSPIRE RI EGI solution for high throughput data analysis Peter Solagna EGI.eu Operations.
Operations Management Board 19th Dec. 2013
Giuseppe LA ROCCA INFN - Catania, Italy
The GENIUS portal Roberto Barbera University of Catania and INFN
GENIUS and EnginFrame: what’s next in the Grid Portal business
The GENIUS portal and the GILDA t-Infrastructure
How To Integrate an Application on Grid
Grid Engine Diego Scardaci (INFN – Catania)
The GILDA t-Infrastructure and the GENIUS portal
Il Portale GENIUS Alberto Falzone NICE srl Primo Tutorial TriGrid VL
Presentation transcript:

The EEPIKH Project (Exchange Programme to advance e-Infrastructure Know-How) Giuseppe Andronico, on behalf of Giuseppe LA ROCCA INFN Catania The GENIUS Grid Portal

Introduction GENIUS/EnginFrame: new version 4.1 VOMS Proxy Init Service Robot Certificates Summary and Conclusions Outline

Grid technology allows users to share a wide pletora of distributed computational resources regardless of their geographical location. Virtual services are exposed to the users through rather complex Command Line Interfaces or API languages. Grid security is indeed based on the Public Key Infrastructure (PKI) of X.509 certificates and the procedure to get and manage those certificates is unfortunately not straightforward; Up to now, the high security policy required to access distributed computing resources has been a rather big limiting factor when trying to broaden the usage of Grids into a wide community of users; + + Introduction

User has to adhere to a Virtual Organization (VO) User needs an account on one of the trusted User Interface (UI) + + = Grid portals provide an added value to make Grids more appealing for non-expert users.

A grid portal: why and how It can be accessed from everywhere and by “everything” (desktop, laptop, PDA, cell phone). It can keep the same user interface to several back-ends. It must be redundantly “secure” at all levels: – 1) secure for web transactions, – 2) secure for user credentials, – 3) secure for user authentication, – 4) secure at VO/VOMS level. All available grid services must be incorporated in a logic way, just “one mouse click away”. Its layout must be easily understandable and user friendly. 5

Grid Portal Benefits A Grid Portal improves usability of Grids – Lowering end-user requirements for accessing the Grid – Hiding the complexity of data and job services management in the Grid A Grid Portal improves utilization of Grids – Making the Grid (r)evolution transparent to the end-user – Providing an appealing user-friendly Web interface – Enforcing Grid utilization policies

Interactive Applications Intranet Clients Win LX UXMac Grid / Compute Farm Internal Users Batch Applications Storage and Data Grid Portal / Gateway Project Managers Client Apps Standard protocols Licenses Home Users The Grid Portal / Gateway

Introduction GENIUS/EnginFrame: new version 4.1 VOMS Proxy Init Service Robot Certificates Summary and Conclusions

What is EnginFrame ? It is a web-based technology able to expose Grid services running on Grid infrastructures It allows organizations to provide application- oriented computing and data services to both users (via Web browsers) and applications (via SOAP/WSDL and/or RSS) ‏ It’s a Grid gateway It greatly simplifies the development of Web Portals exposing computing services that can run on a broad range of different computational Grid systems

Spoolers HTML page Custom plugin Script Browser SDF XML EnginFrame Server HTML XSLT Grid Compute Farm Grid Compute Farm MetaFrame + NFuse MetaFrame + NFuse Application Server Application Server EnginFrame Agent Execute Service Req XML output Service Req User Authorize Groups, ACLs XML Layout XSL Service Submission EnginFrame Working Environment

gzip sample maximum medium none EF_SPOOLER_NAME="gzip $file” export EF_SPOOLER_NAME ${EF_ROOT}/plugins/lsf/bin/bsub -o output.txt gzip -$level \"$FILE\” Service example

Who does use EnginFrame? Mechanical – Ferrari, Audi, BMW, FIAT Auto, Elasis, Magneti Marelli, P+Z, Swagelok, Toyota, TRW Manufacturing – Bridgestone, Procter & Gamble, Galileo Avionica Oil&Gas – Slavneft, Schlumberger, TOTAL, VNIIGaz Electronics – STMicroelectronics, Accent, SensorDynamics, Motorola Biotech – ENEA, EGEE LS community Telecom – Telecom Italia Research – INFN, ASSC, CCLRC, CERN, CILEA, CINECA, CNR, CNRS/IN2P3, ENEA, FzU, ICI, IFAE, ITEP, JSC G.G.M., KU Leuven, SSC-Russia, SDSC Education – Dresda University, Ferrara University, ITU, Messina University, Politecnico of Milan, Technische Universit ä t Dresden, Trinity College Dublin, Salerno University, S-PACI

What is GENIUS ? GENIUS is a powerful Grid Portal that allows scientists to exploit Grid resources only using a conventional Web browser It has been built on top of the EnginFrame framework It’s a gateway to European EGEE Project middle-ware It allows to expose gLite-enabled applications via Web- browser as well as Web Services

What is GENIUS ?

GENIUS: Grid Preferences

GENIUS: Job Submission 16

GENIUS: Job Submission 17

Code for Job Queue management rewritten using GridML tags GENIUS: Job(s) Queue

New Confirmation Message! GENIUS: Job Retrieving

GENIUS: Data Spooler

Tight VNC GENIUS: Interactive Services

GENIUS: Data Management 22 Local Browse on laptop Remote Browse on UI (GENIUS Server) Extended Remote File Browse on LFC Catalog

23 Extended Multiple Remote File Browsing on Catalog! GENIUS: Data Management

24 GENIUS: Workflow

25 GENIUS: Workflow

26 GENIUS: Workflow

27 GENIUS: Workflow

28 GENIUS: Workflow

29 GENIUS: Workflow

Introduction GENIUS/EnginFrame: new version 4.1 VOMS Proxy Init Service Robot Certificates Summary and Conclusions

VOMS Proxy Init Service A CAPTCHA Code is required to start the VOMS Proxy Applet for the proxy initialization The Java plugin or higher is mandatory required.

Jointly developed by NICE and INFN Catania VOMS Proxy Init Service

Introduction GENIUS/EnginFrame: new version 4.1 VOMS Proxy Init Service Robot Certificates Summary and Conclusions

Robot certificates in a nutshell Robot certificates have been introduced to permit users, who are not familiar with deal personal certificates and don’t belong to any VOs, to experience the Grid paradigm for research activity and reduce the initial barriers. –They are extremely useful for instance to automate grid service monitoring, data processing production, distributed data collection systems. –Basically these certificates can be used to identify a person responsible for an unattended service or process acting as client and/or server.

Robot certificates in a nutshell In order to strong reduce the risks to have the portal certificate compromised the INFN CA decided to issue this new certificate on board of the Aladdin eToken PRO 32K smart card. Each smart card can support several robot certificates: one for each application user wants to share with the other. – An user’s PIN is prompted every time user try to read the certificate stored on the smart card to generate a proxy. – A first prototype of Grid Portal using robot certificate to generate an user’s proxy has been successfully designed.

1. ask for a service 2. create a proxy with the robot certificate 5. get the results 3. execute action 4. get output 2’,3’. track user User Admin The GENIUS Portal & Robot Certificates

The Users Tracking System (UTS) ACL-based services that enable easier access control customization for users not belonging to any group!

Porting the „MrBayes” application to Grid Case study from CNR - ITB

General Introduction MrBayes is a program for the Bayesian estimation of phylogeny. Bayesian inference of phylogeny is based on the posterior probability distribution of trees, which is the probability of a tree conditioned on the observations. – To approximate the posterior probability distribution of trees MrBayes uses a simulation technique called Markov Chain Monte Carlo (or MCMC). The program takes as input a character matrix in a NEXUS file format. The output is several files with the parameters that were sampled by the MCMC algorithm. The application is CPU demanding, especially if the MPI version of the software is used.

Phylogenetic analysis on large scale WMS LFC Catalog SE Robot Certificate UI + GENIUS Portal Job Submission Tool GRID

JST characteristics Job Submission Tool: is driven by the concept of “Task” as the applications are – Each task could be independent or could be described as depended from another “Task” – Each task is described by a “status” – The task is executed by a wrapper that takes care of monitoring the task:  If the task is correctly executed the wrapper can change the status of the task from “Free” to “Done”  If a single step on the job execution fails, the whole task is considered failed and automatically rescheduled JST tool takes care of submitting jobs, retrieving the output and monitoring the status of each task It is able to deal with accidental failure of grid services It is possible to change at run time the priority of each task/application

Web Interfaces & Video

Introduction GENIUS/EnginFrame: new version 4.1 VOMS Proxy Init Service Robot Certificates Summary and Conclusions

GENIUS offers the following advantages: it is a complete production-ready environment which combines the concepts of “user portal” and “science portal”; absolutely no client software needs to be installed on the user’s workstation apart from the web browser with its usual plug-ins like Java (at least JRE or higher); it provides a new unique tool to authorize users, in a very strong secure way, into the grid environment with or without VOMS support as well, easy to use; it includes support for both single and composite jobs (including DAG’s); interactive analysis and web access to personal spooling areas are possible; environment and settings customizable for the users; security for data management and sessions.

References NICE web-site EnginFrame Framework GENIUS Portal GENIUS Repository at GENIUS based on gLite at tutor.ct.infn.ithttps://glite- tutor.ct.infn.it GENIUS Installation GENIUS Repository at Write an message to italy.com or for an account request to download the GENIUS