CHEP 2000, 10.02.2000Roberto Barbera Roberto Barbera () The GENIUS Grid Portal Portals & Portlets 2003, Edinburgh, 14.07.2003 () work in collaboration.

Slides:

Advertisements

Similar presentations

CHEP 2000, Roberto Barbera NA3, NA4, and NA5 activities Milano, Università di Catania and INFN Catania - Italy ALICE Collaboration.

Advertisements

CHEP 2000, Roberto Barbera Roberto Barbera (*) GENIUS: a Web Portal for the GRID Meeting Grid.it, Bologna, (*) work in collaboration.

ATLAS/LHCb GANGA DEVELOPMENT Introduction Requirements Architecture and design Interfacing to the Grid Ganga prototyping A. Soroko (Oxford), K. Harrison.

Data Management Expert Panel - WP2. WP2 Overview.

1 CHEP 2000, Roberto Barbera Recent grid activities at INFN Catania (*) HEPiX/HEPNT 2002, Catania, (*) work in collaboration with.

CHEP 2000, Roberto Barbera The AliEn GENIUS interface ALICE Offline Week, CERN, Università di Catania and INFN Catania - Italy ALICE.

FP7-INFRA Enabling Grids for E-sciencE EGEE Induction Grid training for users, Institute of Physics Belgrade, Serbia Sep. 19, 2008.

1 CHEP 2000, Roberto Barbera Tests of data management services in EDG 1.2 ALICE Off-line Week,

EGEE is a project funded by the European Union under contract IST GENIUS and GILDA Roberto Barbera EGEE NA4 Generic Applications coordinator.

A conceptual model of grid resources and services Authors: Sergio Andreozzi Massimo Sgaravatto Cristina Vistoli Presenter: Sergio Andreozzi INFN-CNAF Bologna.

FP6−2004−Infrastructures−6-SSA E-infrastructure shared between Europe and Latin America The GENIUS Grid portal Moisés Hernández.

DataGrid Kimmo Soikkeli Ilkka Sormunen. What is DataGrid? DataGrid is a project that aims to enable access to geographically distributed computing power.

EGEE is a project funded by the European Union under contract IST GENIUS and EnginFrame Roberto Barbera Univ. of Catania and INFN SEE-GRID.

Riccardo Bruno INFN.CT Sevilla, Sep 2007 The GENIUS Grid portal.

DIRAC Web User Interface A.Casajus (Universitat de Barcelona) M.Sapunov (CPPM Marseille) On behalf of the LHCb DIRAC Team.

CHEP 2000, Roberto Barbera Roberto Barbera (*) The GENIUS grid portal CHEP 2003, (*) work in collaboration with A. Falzone and.

5 November 2001F Harris GridPP Edinburgh 1 WP8 status for validating Testbed1 and middleware F Harris(LHCb/Oxford)

Workload Management WP Status and next steps Massimo Sgaravatto INFN Padova.

EGEE is a project funded by the European Union under contract IST Generic Applications: strategy, organization, tools and manpower Roberto.

FP6−2004−Infrastructures−6-SSA E-infrastructure shared between Europe and Latin America GENIUS server installation and configuration.

INFSO-RI Enabling Grids for E-sciencE The GENIUS Grid portal Tony Calanducci INFN Catania - Italy First Latin American Workshop.

EGEE is a project funded by the European Union under contract IST The GENIUS portal Roberto Barbera University of Catania and INFN SEE-GRID.

CHEP 2000, Giuseppe Andronico Grid portal based data management for Lattice QCD data ACAT03, Tsukuba, work in collaboration with A.

Computational grids and grids projects DSS,

QCDGrid Progress James Perry, Andrew Jackson, Stephen Booth, Lorna Smith EPCC, The University Of Edinburgh.

Grid Workload Management & Condor Massimo Sgaravatto INFN Padova.

Grid Workload Management Massimo Sgaravatto INFN Padova.

Training and the NGS Mike Mineter

IST E-infrastructure shared between Europe and Latin America The GILDA t-Infrastructure and the GENIUS portal Domenico Vicinanza,

Induction: Additional features of GENIUS 18 May Some additional features of GENIUS EGEE is funded by the European Union under contract IST

EGEE is a project funded by the European Union under contract IST The GENIUS portal Roberto Barbera University of Catania and INFN First Latinamerican.

K.Harrison BNL, 7 May 2002 Overview of GANGA – First steps towards GANGA – Outline of required functionality – Some existing technology – Conclusions.

FP6−2004−Infrastructures−6-SSA E-infrastructure shared between Europe and Latin America The GENIUS Grid Portal Roberto Barbera Univ.

Introduction to Grid Computing Ed Seidel Max Planck Institute for Gravitational Physics

June 24-25, 2008 Regional Grid Training, University of Belgrade, Serbia Introduction to gLite gLite Basic Services Antun Balaž SCL, Institute of Physics.

GRID Overview Internet2 Member Meeting Spring 2003 Sandra Redman Information Technology and Systems Center and Information Technology Research Center National.

E-infrastructure shared between Europe and Latin America GENIUS PORTAL Valeria Ardizzone INFN-Catania 1° EELA Grid School Itacuruçà Island, State of Rio.

EGEE is a project funded by the European Union under contract IST Presentation of NA4 Generic Applications Roberto Barbera NA4 Generic Applications.

EGEE is a project funded by the European Union under contract IST GENIUS and EnginFrame Roberto Barbera EGEE NA4 Generic Applications coordinator.

EGEE-0 / LCG-2 middleware Practical.

INFSO-RI Enabling Grids for E-sciencE GILDA and GENIUS Guy Warner NeSC Training Team An induction to EGEE for GOSC and the NGS NeSC,

Development of e-Science Application Portal on GAP WeiLong Ueng Academia Sinica Grid Computing

EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Grid2Win : gLite for Microsoft Windows Roberto.

Introduction to Portals.

Grid Workload Management (WP 1) Massimo Sgaravatto INFN Padova.

The DataGrid Project NIKHEF, Wetenschappelijke Jaarvergadering, 19 December 2002

EGEE is a project funded by the European Union under contract IST GENIUS and GILDA: a status report Roberto Barbera NA4 Generic Applications.

Tutorial on Science Gateways, Roma, Catania Science Gateway Framework Motivations, architecture, features Riccardo Rotondo.

EGEE-II INFSO-RI Enabling Grids for E-sciencE Overview of gLite, the EGEE middleware Mike Mineter Training Outreach Education National.

IST E-infrastructure shared between Europe and Latin America The GILDA t-Infrastructure and the GENIUS portal Christian Grunfeld,

EGEE is a project funded by the European Union under contract IST GENIUS and GILDA Guy Warner NeSC Training Team Induction to Grid Computing.

Claudio Grandi INFN Bologna Virtual Pools for Interactive Analysis and Software Development through an Integrated Cloud Environment Claudio Grandi (INFN.

REST API to develop application for mobile devices Mario Torrisi Dipartimento di Fisica e Astronomia – Università degli Studi.

Antonio Fuentes RedIRIS Barcelona, 15 Abril 2008 The GENIUS Grid portal.

The EPIKH Project (Exchange Programme to advance e-Infrastructure Know-How) gLite Grid Introduction Salma Saber Electronic.

EGEE is a project funded by the European Union under contract IST The GENIUS portal Assaf Gottlieb University of Tel Aviv EGEE tutorial, Ra’anana,

EGEE is a project funded by the European Union under contract IST The GILDA Project and the GENIUS portal Roberto Barbera University of Catania.

Grid2Win Porting of gLite middleware to Windows XP platform

The GENIUS portal Roberto Barbera University of Catania and INFN

Grid2Win: Porting of gLite middleware to Windows XP platform

CMS report from FNAL demo week Marco Verlato (INFN-Padova)

The European DataGrid Project Team

GENIUS: A Portal for Computing Grids

Report on GLUE activities 5th EU-DataGRID Conference

EGEE Middleware: gLite Information Systems (IS)

The GENIUS portal and the GILDA t-Infrastructure

The GENIUS Security Services

The GILDA t-Infrastructure and the GENIUS portal

Il Portale GENIUS Alberto Falzone NICE srl Primo Tutorial TriGrid VL

Presentation transcript:

CHEP 2000, Roberto Barbera Roberto Barbera (*) The GENIUS Grid Portal Portals & Portlets 2003, Edinburgh, (*) work in collaboration with A. Falzone and A. Rodolico Università di Catania and INFN Catania - Italy ALICE Collaboration and DataGrid Project

Roberto Barbera Outline Introduction Motivations Current status Real use made by the Experiments Summary and conclusions Università di Catania and INFN Catania - Italy ALICE Collaboration and DataGrid Project Portals & Portlets 2003, Edinburgh,

Roberto Barbera Università di Catania and INFN Catania - Italy ALICE Collaboration and DataGrid Project The Grid: networked data processing centres and ”middleware” software as the “glue” of resources. Researchers perform their activities regardless geographical location, interact with colleagues, share and access data Scientific instruments and experiments provide huge amount of data The Grid vision

Roberto Barbera The Grid metaphor Università di Catania and INFN Catania - Italy ALICE Collaboration and DataGrid Project Portals & Portlets 2003, Edinburgh,

DataGrid job submission work-flowReplicaCatalogue UI JDL Logging & Book-keeping ResourceBroker Job Submission Service StorageElement ComputeElement InformationService Job Status DataSets info Author. &Authen. Job Submit Event Job Query Job Status Input “sandbox” Input “sandbox” + Broker Info Globus RSL Output “sandbox” Job Status Publish grid-proxy-init Expanded JDL SE & CE info Università di Catania and INFN Catania - Italy ALICE Collaboration and DataGrid Project Roberto Barbera

Università di Catania and INFN Catania - Italy ALICE Collaboration and DataGrid Project EDG m/w has been released but… EDG software (Globus, UI, JDL, WP2, WP3, etc.) contains tens of commands/switches which also have their own logical sequences. Browsing Grid VO “directories” (users, RC’s, DB’s, etc.) requires LDAP “speaking” and tomorrow could require SQL “speaking”. “User gridification” is a tough task for a “rookie”  this does not fit with the claim that “grids” are for everybody and that grid computing will be as easy as surfing the Internet ? Furthermore, all this holds for DataGrid. What will happen when other grids’ software (especially UI’s) will come up (PPDG, iVDGL, etc.) ? Will users have to learn tens of “grid dialects” ? Today “grid computing” is a rather complicated experience for un- experienced user only possible at selected machines (UI’s)  this does not fit with the claim that one could do “grid computing” even from a PDA ? Is there any way to set-up a “user-friendly” grid ? Portals & Portlets 2003, Edinburgh,

Roberto Barbera A web portal: why and how ? It can be accessed from everywhere and by “everything” (desktop, laptop, PDA, WAP phone). It can keep the same user interface to several back-ends (grid “dialects”  command-line UI’s). It must be redundantly “secure” at all levels: 1) secure for web transactions, 2) secure for user credentials, 3) secure for user authentication, 4) secure at VO level. All available grid services must be incorporated in a logic way, just “one mouse click away”. Its layout must be easily understandable and user friendly. Roberto Barbera Università di Catania and INFN Catania - Italy ALICE Collaboration and DataGrid Project Portals & Portlets 2003, Edinburgh,

Roberto Barbera A little bit of history graphic interface to LSF (multi) clusters for ALICE jobs simple but effective web portal to submit ALICE jobs to the grid using EnginFrame and GLOBUS 2002-now official grant of the INFN Grid Project to collaborate with NICE srl to integrate in a web portal all services offered by the DataGrid middleware Università di Catania and INFN Catania - Italy ALICE Collaboration and DataGrid Project Portals & Portlets 2003, Edinburgh,

Roberto Barbera GENIUS ® (Grid Enabled web eNvironment for site Independent User job Submission) [ INFN/NICE collaborationhttps://genius.ct.infn.it OS & Net services Basic Services High level GRID middleware ALICEATLASCMSLHCb Applications’ specific layer Other apps GLOBU S toolkit DataGRID architecture GENIUS web portal Università di Catania and INFN Catania - Italy ALICE Collaboration and DataGrid Project Portals & Portlets 2003, Edinburgh,

Roberto Barbera GENIUS : how it works Apache EnginFrame GENIUS https+java/xml+rfb WEB Browser ED G UI Loc al WS the Grid EDG+GSI 3-tier model Roberto Barbera Università di Catania and INFN Catania - Italy ALICE Collaboration and DataGrid Project

Roberto Barbera GENIUS show: the main page Università di Catania and INFN Catania - Italy ALICE Collaboration and DataGrid Project

Roberto Barbera GENIUS show: OS authentication Università di Catania and INFN Catania - Italy ALICE Collaboration and DataGrid Project

Roberto Barbera GENIUS show: file services Università di Catania and INFN Catania - Italy ALICE Collaboration and DataGrid Project

Roberto Barbera GENIUS show: grid authentication MyProxy authentication ! Università di Catania and INFN Catania - Italy ALICE Collaboration and DataGrid Project

Roberto Barbera Grid authentication with MyProxy ED G UI Loc al WS Roberto Barbera MyProx y Server GENIU S Server (EDG UI) grid-proxy-init myproxy-init any grid service myproxy-get-delegation output the Grid execution WEB Browser Università di Catania and INFN Catania - Italy ALICE Collaboration and DataGrid Project

Roberto Barbera VO Selection Università di Catania and INFN Catania - Italy ALICE Collaboration and DataGrid Project

Roberto Barbera RB Selection Università di Catania and INFN Catania - Italy ALICE Collaboration and DataGrid Project

Roberto Barbera Università di Catania and INFN Catania - Italy ALICE Collaboration and DataGrid Project Graphic job description (1/3) In collaboration with DATAMAT, Italy

Roberto Barbera Università di Catania and INFN Catania - Italy ALICE Collaboration and DataGrid Project Graphic job description (2/3) In collaboration with DATAMAT, Italy

Roberto Barbera Università di Catania and INFN Catania - Italy ALICE Collaboration and DataGrid Project Graphic job description (3/3) In collaboration with DATAMAT, Italy

Roberto Barbera Single-jobs: CE selection Università di Catania and INFN Catania - Italy ALICE Collaboration and DataGrid Project

Roberto Barbera Multi-jobs (1/7) Università di Catania and INFN Catania - Italy ALICE Collaboration and DataGrid Project

Roberto Barbera Università di Catania and INFN Catania - Italy ALICE Collaboration and DataGrid Project Multi-jobs (2/7)

Roberto Barbera Università di Catania and INFN Catania - Italy ALICE Collaboration and DataGrid Project Multi-jobs (3/7)

Roberto Barbera Università di Catania and INFN Catania - Italy ALICE Collaboration and DataGrid Project Multi-jobs (4/7)

Roberto Barbera Università di Catania and INFN Catania - Italy ALICE Collaboration and DataGrid Project Multi-jobs (5/7)

Roberto Barbera Università di Catania and INFN Catania - Italy ALICE Collaboration and DataGrid Project Multi-jobs (6/7)

Roberto Barbera Università di Catania and INFN Catania - Italy ALICE Collaboration and DataGrid Project Multi-jobs (7/7)

Roberto Barbera Università di Catania and INFN Catania - Italy ALICE Collaboration and DataGrid Project GENIUS show: file publication

Roberto Barbera Università di Catania and INFN Catania - Italy ALICE Collaboration and DataGrid Project GENIUS show: file publication

Roberto Barbera Università di Catania and INFN Catania - Italy ALICE Collaboration and DataGrid Project GENIUS show: file publication

Roberto Barbera Università di Catania and INFN Catania - Italy ALICE Collaboration and DataGrid Project GENIUS show: file publication

Roberto Barbera Università di Catania and INFN Catania - Italy ALICE Collaboration and DataGrid Project GENIUS show: file publication

Roberto Barbera Università di Catania and INFN Catania - Italy ALICE Collaboration and DataGrid Project GENIUS show: file browsing

Roberto Barbera Università di Catania and INFN Catania - Italy ALICE Collaboration and DataGrid Project GENIUS show: file browsing

Roberto Barbera Università di Catania and INFN Catania - Italy ALICE Collaboration and DataGrid Project GENIUS show: file browsing

Roberto Barbera Università di Catania and INFN Catania - Italy ALICE Collaboration and DataGrid Project GENIUS show: file inspection

Roberto Barbera Università di Catania and INFN Catania - Italy ALICE Collaboration and DataGrid Project GENIUS show: file replication

Roberto Barbera Università di Catania and INFN Catania - Italy ALICE Collaboration and DataGrid Project GENIUS show: file replication

Roberto Barbera Università di Catania and INFN Catania - Italy ALICE Collaboration and DataGrid Project GENIUS show: file replication

Roberto Barbera Università di Catania and INFN Catania - Italy ALICE Collaboration and DataGrid Project GENIUS show: file downloading

Roberto Barbera Università di Catania and INFN Catania - Italy ALICE Collaboration and DataGrid Project GENIUS show: file downloading

Roberto Barbera Università di Catania and INFN Catania - Italy ALICE Collaboration and DataGrid Project GENIUS show: file downloading

Roberto Barbera Università di Catania and INFN Catania - Italy ALICE Collaboration and DataGrid Project GENIUS show: file downloading

Roberto Barbera Università di Catania and INFN Catania - Italy ALICE Collaboration and DataGrid Project GENIUS show: file downloading

Roberto Barbera Università di Catania and INFN Catania - Italy ALICE Collaboration and DataGrid Project GENIUS show: file downloading

Roberto Barbera Università di Catania and INFN Catania - Italy ALICE Collaboration and DataGrid Project Testbed browsing (1/2)

Roberto Barbera Testbed browsing (2/2) Università di Catania and INFN Catania - Italy ALICE Collaboration and DataGrid Project

Roberto Barbera GENIUS P2P services (new!) Università di Catania and INFN Catania - Italy ALICE Collaboration and DataGrid Project

Roberto Barbera GENIUS and GridICE monitoring Università di Catania and INFN Catania - Italy ALICE Collaboration and DataGrid Project

Roberto Barbera Università di Catania and INFN Catania - Italy ALICE Collaboration and DataGrid Project ALICE: interactive analysis

Roberto Barbera Università di Catania and INFN Catania - Italy ALICE Collaboration and DataGrid Project US (courtesy of L. Vaccarossa) EU ATLAS: “GLUE” job submission

Roberto Barbera Università di Catania and INFN Catania - Italy ALICE Collaboration and DataGrid Project (courtesy of L. Vaccarossa) ATLAS: interactive analysis

Roberto Barbera Università di Catania and INFN Catania - Italy ALICE Collaboration and DataGrid Project (courtesy of M. Verlato) CMS grid integration schema Portals & Portlets 2003, Edinburgh,

Roberto Barbera Università di Catania and INFN Catania - Italy ALICE Collaboration and DataGrid Project (courtesy of M. Verlato) CMS: GENIUS/Impala integration

Roberto Barbera Università di Catania and INFN Catania - Italy ALICE Collaboration and DataGrid Project (courtesy of M. Verlato) CMS: GENIUS/BOSS integration

Roberto Barbera Università di Catania and INFN Catania - Italy ALICE Collaboration and DataGrid Project BaBar: GENIUS/AFS interface

Roberto Barbera Università di Catania and INFN Catania - Italy ALICE Collaboration and DataGrid Project BaBar: multi-job submission

Roberto Barbera Università di Catania and INFN Catania - Italy ALICE Collaboration and DataGrid Project BaBar: multi-job queue

Roberto Barbera GENIUS show: Earth Ob. app. Università di Catania and INFN Catania - Italy ALICE Collaboration and DataGrid Project

Roberto Barbera Università di Catania and INFN Catania - Italy ALICE Collaboration and DataGrid Project GENIUS show: Biomed. app.

Roberto Barbera Present status Current implementation of GENIUS includes more than 100 services. Among them: secure web transactions, user authentication and authorization; grid authentication with MyProxy ! remote interaction with the user’s and “grid” file system; interfaces for job submission/control, data management, VO servers, and monitoring systems; several Resource Brokers and VO’s available; persistent (user level) book-keeping and spooler system; secure interactive analysis with TightVNC full support for “parallel” multi-jobs (“sequential” ones easy to implement) web guided job description (in collaboration with DATAMAT) P2P services added with ChatEverywhere CVS available ! New and very easy installation procedure Several installations of GENIUS in Italy and worldwide (Czech Rep., France, Portugal, Russia, Spain, Taiwan, etc.) GENIUS is the official Portal of the GriDis Project for dissemination ( Almost 80 people trained during May-Junehttp://web.datagrid.cnr.it/GriDis/jsp/index.jsp Roberto Barbera Università di Catania and INFN Catania - Italy ALICE Collaboration and DataGrid Project

Roberto Barbera Università di Catania and INFN Catania - Italy ALICE Collaboration and DataGrid Project Future devel. and activities GENIUS is one of the grid portals officially included in the GGF Grid Portal Manifesto and the GENIUS Team is involved into the GGF GCE-RG working group. PDA version available soon. New style sheets already defined Possibility to create “skins” for different “look&feel”’s (in collaboration with CNR) Interface to EDG 2.0: work will start next week and continue during July-August Full integration with GriDis’ “grid on demand” Integration of new specific VO services. Graphic creation of new services Integration of VOMS/VOX and DGAS tools for AAA Close look at the technology of portlets as containers of grid services (see how to match them with GENIUS services) Integration of graphic job workflow creators. Discussions ongoing between Catania, Datamat, FhG and CNR (first meeting in Rome on July, 29)

Roberto Barbera Università di Catania and INFN Catania - Italy ALICE Collaboration and DataGrid Project FAQ’s…and answers (1) Q: I want to use GENIUS. Do I have to pay for it ? free A: No. GENIUS is “open source” and the underlying portal framework EnginFrame is free for the education and research communities. Q: I want to use GENIUS. Do I need any software running on my laptop ? A: No client software needs to be installed apart from the web browser. GENIUS can really be accessed from everywhere. Q: Do I have to be afraid about cached password sent over the web ? A: Access passwords are securely “streamed” only when needed and then destroyed. Only temporary sessions are possible. Q: Can new authentication methods implemented into GENIUS ? A: Of course. Kerberos V is a good example. EnginFrame is already compliant with Kerberos authentication.

Roberto Barbera Università di Catania and INFN Catania - Italy ALICE Collaboration and DataGrid Project FAQ’s…and answers (2) Q: I want to add a new VO to GENIUS and customize new services for that VO. How can I do that ? A: A new VO can be added to GENIUS in just minutes. New VO specific services can be added just modifying only two files: an XML file and a shell script. Q: Can I use GENIUS to interface other m/w’s ? A: Yes. Although GENIUS is currently based on the DataGrid middleware(w/ and w/o GLUE extensions), it can be very easily interfaced to others. A direct interface to the Globus Toolkit already exists and another one to Condor is in progress. Q: How can I start downloading/using GENIUS ? A: Go to the reference site click on “GENIUS CVS available” and follow the instructions. Portals & Portlets 2003, Edinburgh,

Roberto Barbera Università di Catania and INFN Catania - Italy ALICE Collaboration and DataGrid Project Summary and conclusions GENIUS, notwithstanding its “youth”, is “well on track” and seems to have a recognized present and a promising future It tries to merge the concepts of “user portal” and “science portal” and can easily evolve into a “problem solving environment” GENIUS is not only intended for a scientist day-by-day use. It has expressly been included in the EU EGEE Proposal as a dissemination and tutoring tool for non expert users (in the last 2 months, during the Catania and Rome EDG Tutorials, almost 80 people have been trained to use it) All GENIUS services (also those not shown here) can be “seen” at the URL: gallery