Middleware Roadmap for GridPP3 R.Middleton GridPP16- QMUL.

Slides:



Advertisements
Similar presentations
Slide 1 Steve Lloyd Grid Brokering Meeting - 4 Dec 2006 GridPP Steve Lloyd Queen Mary, University of London Grid Brokering Meeting December 2006.
Advertisements

GridPP9 – 5 February 2004 – Data Management DataGrid is a project funded by the European Union GridPP is funded by PPARC GridPP2: Data and Storage Management.
INFSO-RI Enabling Grids for E-sciencE Information and Monitoring Status and Plans GridPP16, QMUL, 29 Jun 2006 Steve.
GLite adoption and opportunities for collaboration with industry Tony Doyle Distributed Computing Workshop Westminster, 21 May 2008.
29 June 2006 GridSite Andrew McNabwww.gridsite.org VOMS and VOs Andrew McNab University of Manchester.
GLite Status Stephen Burke RAL GridPP 13 - Durham.
Grid Computing - DCC/FCUP
EGEE-II INFSO-RI Enabling Grids for E-sciencE The gLite middleware distribution OSG Consortium Meeting Seattle,
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE Middleware Claudio Grandi (INFN – Bologna) Workshop Commissione.
EU-IndiaGrid (RI ) is funded by the European Commission under the Research Infrastructure Programme Sergio Fantinel (INFN-Padova/LNL)
FP7-INFRA Enabling Grids for E-sciencE EGEE Induction Grid training for users, Institute of Physics Belgrade, Serbia Sep. 19, 2008.
 Contributing >30% of throughput to ATLAS and CMS in Worldwide LHC Computing Grid  Reliant on production and advanced networking from ESNET, LHCNET and.
Plateforme de Calcul pour les Sciences du Vivant SRB & gLite V. Breton.
The EPIKH Project (Exchange Programme to advance e-Infrastructure Know-How) gLite Grid Services Abderrahman El Kharrim
EGEE-II INFSO-RI Enabling Grids for E-sciencE Slides based on material from Sergio Andreozzi INFN-CNAF and from Pedro.
EGEE-II INFSO-RI Enabling Grids for E-sciencE Based on material by Sergio Andreozzi INFN-CNAF OMII-Europe All-Hands.
IST E-infrastructure shared between Europe and Latin America Overview of gLite Middleware Pedro Henrique Rausch Bello Instituto.
Makrand Siddhabhatti Tata Institute of Fundamental Research Mumbai 17 Aug
OSG Middleware Roadmap Rob Gardner University of Chicago OSG / EGEE Operations Workshop CERN June 19-20, 2006.
Grid Interoperability Shootout GridPP and NGS UK e-Science All Hands Meeting, Nottingham 2007 J Jensen, G Stewart, M Viljoen, D Wallom, S Young (contact.
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Security and Job Management.
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks JRA1 summary Claudio Grandi EGEE-II JRA1.
EGEE-II INFSO-RI Enabling Grids for E-sciencE JRA1 in EGEE II Claudio Grandi (INFN and CERN) EGEE II Transition Meeting.
GLite – An Outsider’s View Stephen Burke RAL. January 31 st 2005gLite overview Introduction A personal view of the current situation –Asked to be provocative!
CEOS WGISS-21 CNES GRID related R&D activities Anne JEAN-ANTOINE PICCOLO CEOS WGISS-21 – Budapest – 2006, 8-12 May.
Owen SyngeTitle of TalkSlide 1 Storage Management Owen Synge – Developer, Packager, and first line support to System Administrators. Talks Scope –GridPP.
FP6−2004−Infrastructures−6-SSA E-infrastructure shared between Europe and Latin America gLite Overview Roberto Barbera Univ. of.
Deployment issues and SC3 Jeremy Coles GridPP Tier-2 Board and Deployment Board Glasgow, 1 st June 2005.
INFSO-RI Enabling Grids for E-sciencE gLite Data Management and Interoperability Peter Kunszt (JRA1 DM Cluster) 2 nd EGEE Conference,
1 Andrea Sciabà CERN Critical Services and Monitoring - CMS Andrea Sciabà WLCG Service Reliability Workshop 26 – 30 November, 2007.
INFSO-RI Enabling Grids for E-sciencE EGEE Middleware reengineering Claudio Grandi – JRA1 Activity Manager - INFN EGEE Final EU.
Glite. Architecture Applications have access both to Higher-level Grid Services and to Foundation Grid Middleware Higher-Level Grid Services are supposed.
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE Site Architecture Resource Center Deployment Considerations MIMOS EGEE Tutorial.
Site Validation Session Report Co-Chairs: Piotr Nyczyk, CERN IT/GD Leigh Grundhoefer, IU / OSG Notes from Judy Novak WLCG-OSG-EGEE Workshop CERN, June.
Enabling Grids for E-sciencE gLite for ATLAS Production Simone Campana, CERN/INFN ATLAS production meeting May 2, 2005.
FP6−2004−Infrastructures−6-SSA E-infrastructure shared between Europe and Latin America Alexandre Duarte CERN IT-GD-OPS UFCG LSD 1st EELA Grid School.
SAM Sensors & Tests Judit Novak CERN IT/GD SAM Review I. 21. May 2007, CERN.
INFSO-RI Enabling Grids for E-sciencE gLite Middleware Status Frédéric Hemmer, JRA1 Manager, CERN On behalf of JRA1.
Grid Security work in 2004 Andrew McNab Grid Security Research Fellow University of Manchester.
Baseline Services Group Report LHCC Referees Meeting 27 th June 2005 Ian Bird IT/GD, CERN.
INFSO-RI Enabling Grids for E-sciencE /10/20054th EGEE Conference - Pisa1 gLite Configuration and Deployment Models JRA1 Integration.
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE Middleware reengineering Claudio Grandi (INFN – Bologna) EGEE Final.
LCG Accounting Update John Gordon, CCLRC-RAL WLCG Workshop, CERN 24/1/2007 LCG.
LCG User Level Accounting John Gordon CCLRC-RAL LCG Grid Deployment Board October 2006.
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks The LCG interface Stefano BAGNASCO INFN Torino.
SAM Database and relation with GridView Piotr Nyczyk SAM Review CERN, 2007.
Middleware Status Markus Schulz, Oliver Keeble, Flavia Donno Oxana Smirnova (ARC) Alain Roy (OSG) ~~~ LCG-LHCC Mini Review 1 st July 2008.
EGEE-II INFSO-RI Enabling Grids for E-sciencE middleware status and plans Claudio Grandi (INFN and CERN) John White.
INFSO-RI Enabling Grids for E-sciencE Upcoming Releases Markus Schulz CERN SA1 15 th June 2005.
EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Etienne Dublé - CNRS/UREC EGEE SA2 Mario.
Enabling Grids for E-sciencE EGEE-III-INFSO-RI EGEE and gLite are registered trademarks Francesco Giacomini JRA1 Activity Leader.
SAM Status Update Piotr Nyczyk LCG Management Board CERN, 5 June 2007.
Status of gLite-3.0 deployment and uptake Ian Bird CERN IT LCG-LHCC Referees Meeting 29 th January 2007.
J Jensen/J Gordon RAL Storage Storage at RAL Service Challenge Meeting 27 Jan 2005.
First South Africa Grid Training June 2008, Catania (Italy) OVERVIEW of the gLite COMPONENTS Marcello Iacono Manno FIRST.
1 Grid security Services and Support Vincenzo Ciaschini, INFN CNAF V INFN-GRID workshop 18-20/12/2006.
INFSO-RI Enabling Grids for E-sciencE EGEE Middleware Claudio Grandi (INFN – Bologna) EGEE-NAREGI meeting March 20-22,
The EPIKH Project (Exchange Programme to advance e-Infrastructure Know-How) gLite Grid Introduction Salma Saber Electronic.
Enabling Grids for E-sciencE EGEE-III INFSO-RI EGEE and gLite are registered trademarks Francesco Giacomini JRA1 Activity Leader.
EGEE Data Management Services
Service Availability Monitoring
JRA1 Middleware Re-engineering Status Report
LCG Service Challenge: Planning and Milestones
GDB 8th March 2006 Flavia Donno IT/GD, CERN
gLite Middleware Status
Slides contributed by EGEE Team
Short update on the latest gLite status
Based on material by Sergio Andreozzi INFN-CNAF
Site availability Dec. 19 th 2006
Presentation transcript:

Middleware Roadmap for GridPP3 R.Middleton GridPP16- QMUL

29th June 2006 Middleware Roadmap - GridPP3 Outline GridPP3 Goals for MSN Software for exploitation Areas –Data Management –Storage –WMS, Portal, R-T Map –InfoMon –Security –Networking

29th June 2006 Middleware Roadmap - GridPP3 MSN Goals GridPP1 Prototype testbeds & prototype code GridPP2 Production develop & deploy GridPP3 Exploitation support & maintain Important –interoperability with peer grids –gradual transition to common standards –…and fix the holes ! Criteria –mission critical –support UK products… our contribution to the wider picture –where leverage is high

29th June 2006 Middleware Roadmap - GridPP3 Software for Exploitation LCG BDII R-GMA FTS DPM LFC LCG-UTILS GFAL LCG-RB/LB (called RB) LCG-CE (called CE) VOMS MYPROXY APEL Client libs Monitoring tools VOBOX(s) LCG BDII R-GMA FTS DPM LFC LCG-UTILS GFAL LCG-RB/LB (called RB) LCG-CE (called CE) VOMS MYPROXY APEL Client libs Monitoring tools VOBOX(s) gLite-1.5 BDII R-GMA FTS DPM LFC Firemen gLite-I/O Crypted data Hydra AMGA DGAS GPBOX gLite-WLMS/LB Glite-CE VOMS Client libs MYPROXY gLite-1.5 BDII R-GMA FTS DPM LFC Firemen gLite-I/O Crypted data Hydra AMGA DGAS GPBOX gLite-WLMS/LB Glite-CE VOMS Client libs MYPROXY gLite-3.0 BDII R-GMA FTS DPM LFC LCG-UTILS GFAL VOMS MYPROXY APEL Monitoring tools VOBOXs LCG-RB/LB (called RB) LCG-CE (called CE) gLite-WLMS/LB Glite-CE Client libs gLite-3.0 BDII R-GMA FTS DPM LFC LCG-UTILS GFAL VOMS MYPROXY APEL Monitoring tools VOBOXs LCG-RB/LB (called RB) LCG-CE (called CE) gLite-WLMS/LB Glite-CE Client libs Affects Uis and WNs Requires duplicated services Ack: Marcus Schulz

29th June 2006 Middleware Roadmap - GridPP3 Data Management Critical to effective work on LCG –LFC, FTS, … Unsolved issues –e.g. replication management Bespoke solutions (4 times over !) Chaotic analysis –aint seen nothing yet Development –but important !

29th June 2006 Middleware Roadmap - GridPP3 Storage Maturity DPM, dCache, CASTOR –Responsible for SRM2 interface to CASTOR –Responsible other utilities (scripts), monitoring, accounting Drive Storage Group Reduce diversity over time 0 years6m un tested Simple ~1year Globus wuftpd Large rewrite CASTOR -1 years0 yearsSimple ~1year Java simple ~10 years dCache 0 years~1 year DPM SRM 2.2SRM 2.1SRM 1.1Grid FTP Disk cache

29th June 2006 Middleware Roadmap - GridPP3 WMS Accumulating performance data Regarded as important by EGEE Growth area in chasing job efficiency

29th June 2006 Middleware Roadmap - GridPP3 Portal / R-T Map Portal –Essential for small experiments R-T Map –widespread use –this is reality

29th June 2006 Middleware Roadmap - GridPP3 InfoMon R-GMA, Service Discovery, GLUE Schema Support for all EGEE/LCG not just UK GridView APEL CMS, ATLAS (?) DILIGENT, GridCC, …

29th June 2006 Middleware Roadmap - GridPP3 Security Operational Security The UK VOMS Service GridSite –website e.g. GridPP, GOC, Grid-Ireland –GACL e.g WMProxy, Logging & Bookkeeping –mod_gridsite e.g parsing VOMS attributes, … Vulnerabilities –analysis, tracking, resolution, disclosure, … Policy –certificates, AUP, …

29th June 2006 Middleware Roadmap - GridPP3 Networking Monitoring –understand operations … know whats going on –underpinning… Communicating HEP Requirements

29th June 2006 Middleware Roadmap - GridPP3 Effort Roadmap