Short update on the latest gLite status

Slides:



Advertisements
Similar presentations
INFSO-RI Enabling Grids for E-sciencE Workload Management System and Job Description Language.
Advertisements

EGEE-II INFSO-RI Enabling Grids for E-sciencE The gLite middleware distribution OSG Consortium Meeting Seattle,
FP7-INFRA Enabling Grids for E-sciencE EGEE Induction Grid training for users, Institute of Physics Belgrade, Serbia Sep. 19, 2008.
The EPIKH Project (Exchange Programme to advance e-Infrastructure Know-How) gLite Grid Services Abderrahman El Kharrim
Makrand Siddhabhatti Tata Institute of Fundamental Research Mumbai 17 Aug
INFSO-RI Enabling Grids for E-sciencE Logging and Bookkeeping and Job Provenance Services Ludek Matyska (CESNET) on behalf of the.
FP6−2004−Infrastructures−6-SSA IPv6 and Grid Middleware: the EUChinaGRID experience Gabriella Paolini – GARR Valentino.
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks gLite IPv6 compliance project tests Further.
INFSO-RI Enabling Grids for E-sciencE Workload Management System Mike Mineter
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Security and Job Management.
June 24-25, 2008 Regional Grid Training, University of Belgrade, Serbia Introduction to gLite gLite Basic Services Antun Balaž SCL, Institute of Physics.
CEOS WGISS-21 CNES GRID related R&D activities Anne JEAN-ANTOINE PICCOLO CEOS WGISS-21 – Budapest – 2006, 8-12 May.
Getting started DIRAC Project. Outline  DIRAC information system  Documentation sources  DIRAC users and groups  Registration with DIRAC  Getting.
INFSO-RI Enabling Grids for E-sciencE gLite Data Management and Interoperability Peter Kunszt (JRA1 DM Cluster) 2 nd EGEE Conference,
1 Grid2Win: porting of gLite middleware to Windows Dario Russo INFN Catania
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks The GILDA t-Infrastructure Roberto Barbera.
Glite. Architecture Applications have access both to Higher-level Grid Services and to Foundation Grid Middleware Higher-Level Grid Services are supposed.
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE Site Architecture Resource Center Deployment Considerations MIMOS EGEE Tutorial.
FP6−2004−Infrastructures−6-SSA E-infrastructure shared between Europe and Latin America Alexandre Duarte CERN IT-GD-OPS UFCG LSD 1st EELA Grid School.
FP6−2004−Infrastructures−6-SSA E-infrastructure shared between Europe and Latin America Grid2Win: Porting of gLite middleware to.
EGEE is a project funded by the European Union under contract IST VO box: Experiment requirements and LCG prototype Operations.
EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Grid2Win : gLite for Microsoft Windows Roberto.
Testing and integrating the WLCG/EGEE middleware in the LHC computing Simone Campana, Alessandro Di Girolamo, Elisa Lanciotti, Nicolò Magini, Patricia.
DIRAC Pilot Jobs A. Casajus, R. Graciani, A. Tsaregorodtsev for the LHCb DIRAC team Pilot Framework and the DIRAC WMS DIRAC Workload Management System.
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks The LCG interface Stefano BAGNASCO INFN Torino.
EGI-InSPIRE RI EGI-InSPIRE EGI-InSPIRE RI Mario Reale – GARR NetJobs: Network Monitoring Using Grid Jobs.
13th EELA Tutorial, La Antigua, 18-19, October E-infrastructure shared between Europe and Latin America FP6−2004−Infrastructures−6-SSA
SAM Status Update Piotr Nyczyk LCG Management Board CERN, 5 June 2007.
Consorzio COMETA - Progetto PI2S2 UNIONE EUROPEA Grid2Win : gLite for Microsoft Windows Elisa Ingrà - INFN.
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Job Management Claudio Grandi.
SAM architecture EGEE 07 Service Availability Monitor for the LHC experiments Simone Campana, Alessandro Di Girolamo, Nicolò Magini, Patricia Mendez Lorenzo,
The EPIKH Project (Exchange Programme to advance e-Infrastructure Know-How) gLite Grid Introduction Salma Saber Electronic.
Enabling Grids for E-sciencE Work Load Management & Simple Job Submission Practical Shu-Ting Liao APROC, ASGC EGEE Tutorial.
The EPIKH Project (Exchange Programme to advance e-Infrastructure Know-How) Overveiw of the gLite middleware Yaodong Cheng
EGI-InSPIRE RI EGI-InSPIRE EGI-InSPIRE RI EGI solution for high throughput data analysis Peter Solagna EGI.eu Operations.
WLCG IPv6 deployment strategy
Gri2Win: Porting gLite to run under Windows XP Platform
Grid2Win: Porting of gLite middleware to Windows platform
Grid2Win Porting of gLite middleware to Windows XP platform
Grid Computing: Running your Jobs around the World
gLite: status and perspectives
Claudio Grandi – JRA1 Activity Manager INFN and CERN
Practical: The Information Systems
Claudio Grandi (INFN and CERN)
gLite Grid Services Salma Saber
GDB 8th March 2006 Flavia Donno IT/GD, CERN
Comparison of LCG-2 and gLite v1.0
BOSS: the CMS interface for job summission, monitoring and bookkeeping
BOSS: the CMS interface for job summission, monitoring and bookkeeping
f f FermiGrid – Site AuthoriZation (SAZ) Service
Grid2Win: Porting of gLite middleware to Windows XP platform
Introduction to Grid Technology
Grid2Win: Porting of gLite middleware to Windows XP platform
BOSS: the CMS interface for job summission, monitoring and bookkeeping
Grid Services Ouafa Bentaleb CERIST, Algeria
Job workflow Pre production operations:
TCG Discussion on CE Strategy & SL4 Move
Gri2Win: Porting gLite to run under Windows XP Platform
Mario Reale – IGI / GARR Lyon, Sept 19, 2011
Interoperability & Standards
Grid2Win: Porting of gLite middleware to Windows XP platform
Data Management cluster summary
Overview of the EGEE project and the gLite middleware
EGEE Middleware: gLite Information Systems (IS)
The GENIUS portal and the GILDA t-Infrastructure
Overview of gLite Middleware
gLite The EGEE Middleware Distribution
Site availability Dec. 19 th 2006
Installation/Configuration
Presentation transcript:

Short update on the latest gLite status EGEE SA2/EuChinaGRID/ETICS FtF meeting Roma, 19-20 Feb,2007 Mario Reale – mario.reale@garr.it

Outline Content facts & numbers gLite middleware status OpSys, gL Version, updates bugs and issues LCG PPS ( gLite) next developments EGEE SA2/EUChinaGRID WP2/ETICS FtF Meeting – Feb 19-20, 2007 , Roma

gLite deployment modules gLite release 3.0 currently provides 21 modules: VOMS oracle, mysql VO management server UI Combined gLite and LCG User Interface WMS Workload Management System server LCG-LB LCG Resource Broker LB Logging and Bookkeeping server glite-CE, LCG-CE gL and LCG Computing Elements WN Combined gLite and LCG standard Worker Node (WN) PX gLite proxy server MON (RGMA) RGMA monitoring collector server MON-e2eMonit RGMA and network e2e monitoring BD-II Berkeley Database Information Index LFC LCG File Catalog FTA File Transfer Agent ( oracle, mysql) FTS File Transfer Server SE classic / dCache SRM SE / dCache gdbm SRM SE DPM SRM SE (disk, mysql, oracle) VOBOX Virtual Organization box EGEE SA2/EUChinaGRID WP2/ETICS FtF Meeting – Feb 19-20, 2007 , Roma

gLite users Through the gLite middleware a user can : Register to a Virtual Organization be authenticated, be authorized, get credentials for jobs and data transfers Submit and Manage GRID jobs Use JDL files via CLI or portals/GUIs, submit jobs or job collections, submit DAGs, submit parametric jobs, get job related information, cancel single jobs or sets/collections, retrieve the output Require specific resources or input files for the jobs he/she’s sending Automatically renew his/her proxy if required for long lasting jobs Transfer files from different locations from a WN to a Storage Element From different Storage Elements based on different architectures Register the produced or replicated files in a Catalog for his/her VO Directly or indirectly query this file catalog Query the GRID information system and get a snapshot of the available resources EGEE SA2/EUChinaGRID WP2/ETICS FtF Meeting – Feb 19-20, 2007 , Roma

gLite middleware status Operating System User Interface and Worker Nodes ported to Scientific Linux CERN 4 All other modules/services still running under SLC 3 gLite Version The current (Feb 5 , 2007) version is 3.0.2 Update 13 moved away from a “Big Bang” release updates for each component released individually http://glite.web.cern.ch/glite/packages/R3.0/updates.asp Outstanding bugs & issues Currently 23 outstanding bugs and issues monitored https://savannah.cern.ch/bugs/index.php?go_report=Apply&group=jra1mdw&func=browse&set=custom&msort=0&report_id=144&advsrch=0&summary=&assigned_to=0&priority=6&severity=0&submitted_by=0&resolution_id=0&category_id=0&status_id=1&bug_id=&history_search=0&history_field=0&history_event=modified&history_date_dayfd=19&history_date_monthfd=6&history_date_yearfd=2006&chunksz=50#options EGEE SA2/EUChinaGRID WP2/ETICS FtF Meeting – Feb 19-20, 2007 , Roma

EGEE SA2/EUChinaGRID WP2/ETICS FtF Meeting – Feb 19-20, 2007 , Roma

LCG Pre Production Service Latest gLite is deployed one the LCG Pre-Production Service 22 active sites monitored trough SAM https://lcg-sam.cern.ch:8443/sam-pps/sam.py?sensors=CE CiC (Communication Interfaces for Central operations) –on-Duty send reports on PPS status to the ROC Global User Support through the GGUS portal www.ggus.org EGEE SA2/EUChinaGRID WP2/ETICS FtF Meeting – Feb 19-20, 2007 , Roma

LCG Pre-Production Service

gLite developments Porting to Scientific Linux CERN 4.0 in progress WNs already moved to SLC 4.0 All other gLite services still built for SLC 3 SLC 4 release will be called gLite 3.1 Porting the gLite middleware (JRA1) to IPv6: Developers aware of this need Formal commitment to the issue No concrete timescale defined Other matters ( porting to ia64 and SLC4) came first EGEE SA2/EUChinaGRID WP2/ETICS FtF Meeting – Feb 19-20, 2007 , Roma

further gLite developments Complete the migration to VDT 1.3.x Complete the migration to fully supported 64-bit architecture Improve manageability (start/stop/... and standard log files) Reduce dependencies on external components to make gLite more “Lite” Hooks for local/global monitoring (new Monitoring working group) Continue work on making all services VOMS-aware Including activities in the Job Priorities WG Decouple bulk submission from DAGMan Support the deployment of Job Provenance to optimize the use of L&B Support for all LRMSs present on PS in BLAH/gLiteCE Complete support to SRM v2.2 Complete the new Encrypted Data Storage based on GFAL/LFC Complete and test glexec on WNs Increase the use of Service Discovery in all services Collaboration with EUChinaGrid on IPv6 compliance EGEE SA2/EUChinaGRID WP2/ETICS FtF Meeting – Feb 19-20, 2007 , Roma

glexec glexec is a thin layer to change unix credentials much simpler than the gatekeeper doesn’t require to run as root all the time based on GRID identity and attribute information takes in input a certificate chain with VOMS extensions user program name and arguments to run checks authorization aquires local credentials enforces the local credentials on the process glexec deployment on WNs is related to the VO handling of pilot jobs pilot jobs are small scripts downloading real jobs EGEE SA2/EUChinaGRID WP2/ETICS FtF Meeting – Feb 19-20, 2007 , Roma

Summary gLite is about to be ported to SLC 4 and 64-bit will continue to be deployed on the LCG PPS for the experiments and applications to experience its latest version useful to keep an eye to understand immediatley latest gLite issues There’s no well defined timeline for the porting to IPv6 just a formal declaration of interest from JRA-1 still  interesting developments are coming in all its components gLite is still a moving target EGEE SA2/EUChinaGRID WP2/ETICS FtF Meeting – Feb 19-20, 2007 , Roma