Presentation is loading. Please wait.

Presentation is loading. Please wait.

CHEP 2000, 10.02.2000Giuseppe Andronico Grid portal based data management for Lattice QCD data ACAT03, Tsukuba, 02.12.2003 work in collaboration with A.

Published byJessie Morton Modified over 8 years ago

Similar presentations

Presentation on theme: "CHEP 2000, 10.02.2000Giuseppe Andronico Grid portal based data management for Lattice QCD data ACAT03, Tsukuba, 02.12.2003 work in collaboration with A."— Presentation transcript:

1 CHEP 2000, 10.02.2000Giuseppe Andronico Grid portal based data management for Lattice QCD data ACAT03, Tsukuba, 02.12.2003 work in collaboration with A. Falzone and R. Barbera Università di Catania and INFN Catania - Italy ILDG and DataGrid Project

2 Roberto Barbera Giuseppe Andronico Outline Introduction Grid and GENIUS ILDG Metadata Workgroup GENIUS implementation Future developments Università di Catania and INFN Catania - Italy ILDG and DataGrid Project ACAT03, Tsukuba, 02.12.2003

3 Giuseppe Andronico The Grid metaphor Università di Catania and INFN Catania - Italy ILDG and DataGrid Project ACAT03, Tsukuba, 02.12.2003

4 DataGrid job work-flowReplicaCatalogue UI JDL Logging & Book-keeping ResourceBroker Job Submission Service StorageElement ComputeElement InformationService Job Status DataSets info Author. &Authen. Job Submit Event Job Query Job Status Input “sandbox” Input “sandbox” + Broker Info Globus RSL Output “sandbox” Job Status Publish grid-proxy-init Expanded JDL SE & CE info Giuseppe Andronico Università di Catania and INFN Catania - Italy ILDG and DataGrid Project

5 Roberto Barbera A web portal: why and how ? It can be accessed from everywhere and by “everything” (desktop, laptop, PDA, WAP phone). It can keep the same user interface to several back-ends (grid “dialects”  command-line UI’s). It must be redundantly “secure” at all levels: 1) secure for web transactions, 2) secure for user credentials, 3) secure for user authentication, 4) secure at VO level. All available grid services must be incorporated in a logic way, just “one mouse click away”. Its layout must be easily understandable and user friendly. Università di Catania and INFN Catania - Italy ILDG and DataGrid Project ACAT03, Tsukuba, 02.12.2003 Giuseppe Andronico

6 GENIUS ® (Grid Enabled web eNvironment for site Independent User job Submission) [https://genius.ct.infn.it] INFN/NICE collaborationhttps://genius.ct.infn.it OS & Net services Basic Services High level GRID middleware ALICEATLASCMSLHCb Applications’ specific layer Other apps GLOBU S toolkit DataGRID architecture GENIUS web portal ACAT03, Tsukuba, 02.12.2003 Giuseppe Andronico Università di Catania and INFN Catania - Italy ILDG and DataGrid Project

7 Roberto Barbera GENIUS : how it works Apache EnginFrame GENIUS https+java/xml+rfb WEB Browser ED G UI Loc al WS the Grid EDG+GSI Giuseppe Andronico Università di Catania and INFN Catania - Italy ILDG and DataGrid Project 3-tier model

8 Grid authentication with MyProxy Giuseppe Andronico ED G UI MyPro xy Server grid-proxy-init myproxy-init myproxy-get-delegation Loc al WS GENIU S Server (EDG UI) any grid service output WEB Browser the Grid execution Università di Catania and INFN Catania - Italy ILDG and DataGrid Project

9 Università di Catania and INFN Catania - Italy ILDG and DataGrid Project Giuseppe Andronico ACAT03, Tsukuba, 02.12.2003 Upon initiative of Prof. Richard Kenway ILDG people Tomoteru Yoshie (Japan) Convener Chris Maynard (UK) Paul Coddington (Australia) Jim Simone (USA - SciDAC) Robert Edwards (USA - SciDAC) Giuseppe Andronico (Italy) Dirk Pleiter (Germany) Balint Joo (UK) http://www.lqcd.org/ildg/tiki-index.php ILDG International Lattice Data Group

10 Università di Catania and INFN Catania - Italy ILDG and DataGrid Project Giuseppe Andronico ACAT03, Tsukuba, 02.12.2003 ILDG Configurations as LQCD resources Different algorithms and implementations Different data file format Standardize metadata to describe configurations: Management Implementation Configuration

11 Università di Catania and INFN Catania - Italy ILDG and DataGrid Project Giuseppe Andronico ACAT03, Tsukuba, 02.12.2003 ILDG XML for metadata Last draft at Lattice 2003, Tsukuba (hep-lat/0309029) Evolving with LQCD people contribution

12 Università di Catania and INFN Catania - Italy ILDG and DataGrid Project Giuseppe Andronico ACAT03, Tsukuba, 02.12.2003 XML to SQL

13 Università di Catania and INFN Catania - Italy ILDG and DataGrid Project Giuseppe Andronico ACAT03, Tsukuba, 02.12.2003 Software PERL scripts DOM parser Storing procedure Several DB querying procedures All this is handles from GENIUS

14 Università di Catania and INFN Catania - Italy ILDG and DataGrid Project Giuseppe Andronico ACAT03, Tsukuba, 02.12.2003 GENIUS

15 Università di Catania and INFN Catania - Italy ILDG and DataGrid Project Giuseppe Andronico ACAT03, Tsukuba, 02.12.2003 Selecting VO

16 Università di Catania and INFN Catania - Italy ILDG and DataGrid Project Giuseppe Andronico ACAT03, Tsukuba, 02.12.2003 The VO page

17 Università di Catania and INFN Catania - Italy ILDG and DataGrid Project Giuseppe Andronico ACAT03, Tsukuba, 02.12.2003 Storing a configuration

18 Università di Catania and INFN Catania - Italy ILDG and DataGrid Project Giuseppe Andronico ACAT03, Tsukuba, 02.12.2003 Storing a configuration

19 Università di Catania and INFN Catania - Italy ILDG and DataGrid Project Giuseppe Andronico ACAT03, Tsukuba, 02.12.2003 A trial search

20 Università di Catania and INFN Catania - Italy ILDG and DataGrid Project Giuseppe Andronico ACAT03, Tsukuba, 02.12.2003 The result

21 Università di Catania and INFN Catania - Italy ILDG and DataGrid Project Giuseppe Andronico ACAT03, Tsukuba, 02.12.2003 Show metadata info

22 Roberto Barbera Giuseppe Andronico Summary and conclusions (1/2) ILDG is defining a metadata XML structure to help LQCD people to share their work The Grid offers a proper tool to physically sharing the files world wide in a secure way We implemented a trial service to: Store configurations Search between configuration by querying XML informations Show the search result and, potentially, download the data GENIUS offers a quick and simple way to build a WEB interface to these services to simplify their use GENIUS is the targeted Grid-portal for Generic Applications in EGEE-NA4 (kick-off meeting in Paris on Dec 18) Università di Catania and INFN Catania - Italy ILDG and DataGrid Project

23 Università di Catania and INFN Catania - Italy ILDG and DataGrid Project Giuseppe Andronico ACAT03, Tsukuba, 02.12.2003 Future developments XML to SQL mapping XML database test Advanced search engine Summary and conclusions (2/2)

Download ppt "CHEP 2000, 10.02.2000Giuseppe Andronico Grid portal based data management for Lattice QCD data ACAT03, Tsukuba, 02.12.2003 work in collaboration with A."

Similar presentations

CHEP 2000, 10.02.2000Roberto Barbera NA3, NA4, and NA5 activities Milano, 19.03.2004 Università di Catania and INFN Catania - Italy ALICE Collaboration.

CHEP 2000, Roberto Barbera NA3, NA4, and NA5 activities Milano, Università di Catania and INFN Catania - Italy ALICE Collaboration.
CHEP 2000, 10.02.2000Roberto Barbera Roberto Barbera (*) GENIUS: a Web Portal for the GRID Meeting Grid.it, Bologna, 14.02.2003 (*) work in collaboration.

CHEP 2000, Roberto Barbera Roberto Barbera (*) GENIUS: a Web Portal for the GRID Meeting Grid.it, Bologna, (*) work in collaboration.
The Quantum Chromodynamics Grid James Perry, Andrew Jackson, Matthew Egbert, Stephen Booth, Lorna Smith EPCC, The University Of Edinburgh.

The Quantum Chromodynamics Grid James Perry, Andrew Jackson, Matthew Egbert, Stephen Booth, Lorna Smith EPCC, The University Of Edinburgh.
UKQCD GridPP NeSCAC Irving, 4/2/041 9 th GridPP Collaboration Meeting QCDgrid: Status and Future Alan Irving University of Liverpool.

UKQCD GridPP NeSCAC Irving, 4/2/041 9 th GridPP Collaboration Meeting QCDgrid: Status and Future Alan Irving University of Liverpool.
ATLAS/LHCb GANGA DEVELOPMENT Introduction Requirements Architecture and design Interfacing to the Grid Ganga prototyping A. Soroko (Oxford), K. Harrison.

ATLAS/LHCb GANGA DEVELOPMENT Introduction Requirements Architecture and design Interfacing to the Grid Ganga prototyping A. Soroko (Oxford), K. Harrison.
Data Management Expert Panel - WP2. WP2 Overview.

Data Management Expert Panel - WP2. WP2 Overview.
1 CHEP 2000, 10.02.2000Roberto Barbera Recent grid activities at INFN Catania (*) HEPiX/HEPNT 2002, Catania, 18.04.2002 (*) work in collaboration with.

1 CHEP 2000, Roberto Barbera Recent grid activities at INFN Catania (*) HEPiX/HEPNT 2002, Catania, (*) work in collaboration with.
CHEP 2000, 10.02.2000Roberto Barbera The AliEn GENIUS interface ALICE Offline Week, CERN, 10.03.2003 Università di Catania and INFN Catania - Italy ALICE.

CHEP 2000, Roberto Barbera The AliEn GENIUS interface ALICE Offline Week, CERN, Università di Catania and INFN Catania - Italy ALICE.
FP7-INFRA-222667 Enabling Grids for E-sciencE www.eu-egee.org EGEE Induction Grid training for users, Institute of Physics Belgrade, Serbia Sep. 19, 2008.

FP7-INFRA Enabling Grids for E-sciencE EGEE Induction Grid training for users, Institute of Physics Belgrade, Serbia Sep. 19, 2008.
EGEE is a project funded by the European Union under contract IST-2003-508833 GENIUS and GILDA Roberto Barbera EGEE NA4 Generic Applications coordinator.

EGEE is a project funded by the European Union under contract IST GENIUS and GILDA Roberto Barbera EGEE NA4 Generic Applications coordinator.
10 April 2003Deploy Grid in Israel Universities1 Deploy Grid testbed in Israel universities Lorne Levinson David Front Weizmann Institute.

10 April 2003Deploy Grid in Israel Universities1 Deploy Grid testbed in Israel universities Lorne Levinson David Front Weizmann Institute.
FP6−2004−Infrastructures−6-SSA-026409 www.eu-eela.org E-infrastructure shared between Europe and Latin America The GENIUS Grid portal Moisés Hernández.

FP6−2004−Infrastructures−6-SSA E-infrastructure shared between Europe and Latin America The GENIUS Grid portal Moisés Hernández.
Basic Grid Job Submission Alessandra Forti 28 March 2006.

Basic Grid Job Submission Alessandra Forti 28 March 2006.
Web-based Portal for Discovery, Retrieval and Visualization of Earth Science Datasets in Grid Environment Zhenping (Jane) Liu.

Web-based Portal for Discovery, Retrieval and Visualization of Earth Science Datasets in Grid Environment Zhenping (Jane) Liu.
INFSO-RI-508833 Enabling Grids for E-sciencE www.eu-egee.org The GENIUS grid portal Roberto Barbera University of Catania and INFN Science Gateways Workshop.

INFSO-RI Enabling Grids for E-sciencE The GENIUS grid portal Roberto Barbera University of Catania and INFN Science Gateways Workshop.
QCDgrid Technology James Perry, George Beckett, Lorna Smith EPCC, The University Of Edinburgh.

QCDgrid Technology James Perry, George Beckett, Lorna Smith EPCC, The University Of Edinburgh.
EGEE is a project funded by the European Union under contract IST-2003-508833 GENIUS and EnginFrame Roberto Barbera Univ. of Catania and INFN SEE-GRID.

EGEE is a project funded by the European Union under contract IST GENIUS and EnginFrame Roberto Barbera Univ. of Catania and INFN SEE-GRID.
Riccardo Bruno INFN.CT Sevilla, 10-14 Sep 2007 The GENIUS Grid portal.

Riccardo Bruno INFN.CT Sevilla, Sep 2007 The GENIUS Grid portal.
DIRAC Web User Interface A.Casajus (Universitat de Barcelona) M.Sapunov (CPPM Marseille) On behalf of the LHCb DIRAC Team.

DIRAC Web User Interface A.Casajus (Universitat de Barcelona) M.Sapunov (CPPM Marseille) On behalf of the LHCb DIRAC Team.
ILDG5QCDgrid1 QCDgrid status report UKQCD data grid Chris Maynard.

ILDG5QCDgrid1 QCDgrid status report UKQCD data grid Chris Maynard.

Similar presentations

Ads by Google