Applications Area Issues RWL Jones GridPP16 QMUL 28 th June 2006.

Slides:



Advertisements
Similar presentations
S.L.LloydATSE e-Science Visit April 2004Slide 1 GridPP – A UK Computing Grid for Particle Physics GridPP 19 UK Universities, CCLRC (RAL & Daresbury) and.
Advertisements

GridPP July 2003Stefan StonjekSlide 1 SAM middleware components Stefan Stonjek University of Oxford 7 th GridPP Meeting 02 nd July 2003 Oxford.
GridPP9 – 5 February 2004 – Data Management DataGrid is a project funded by the European Union GridPP is funded by PPARC GridPP2: Data and Storage Management.
Applications Area Issues RWL Jones GridPP13 – 5 th June 2005.
B A B AR and the GRID Roger Barlow for Fergus Wilson GridPP 13 5 th July 2005, Durham.
User Board - Supporting Other Experiments Stephen Burke, RAL pp Glenn Patrick.
Metadata Progress GridPP18 20 March 2007 Mike Kenyon.
Forschungszentrum Karlsruhe in der Helmholtz-Gemeinschaft Torsten Antoni – LCG Operations Workshop, CERN 02-04/11/04 Global Grid User Support - GGUS -
Applications Area Issues RWL Jones Deployment Team – 2 nd June 2005.
Ian M. Fisk Fermilab February 23, Global Schedule External Items ➨ gLite 3.0 is released for pre-production in mid-April ➨ gLite 3.0 is rolled onto.
LHC Experiment Dashboard Main areas covered by the Experiment Dashboard: Data processing monitoring (job monitoring) Data transfer monitoring Site/service.
LCG Milestones for Deployment, Fabric, & Grid Technology Ian Bird LCG Deployment Area Manager PEB 3-Dec-2002.
LHCC Comprehensive Review – September WLCG Commissioning Schedule Still an ambitious programme ahead Still an ambitious programme ahead Timely testing.
EGEE is a project funded by the European Union under contract IST JRA1 Testing Activity: Status and Plans Leanne Guy EGEE Middleware Testing.
5 November 2001F Harris GridPP Edinburgh 1 WP8 status for validating Testbed1 and middleware F Harris(LHCb/Oxford)
ATLAS and Grid Computing RWL Jones GridPP 13 5 th July 2005.
Applications Review RWL Jones GridPP12. ATLAS Risks: –Delayed middleware, raid changes in framework, competition Progress –New GANGA version (first deliverable)
RLS Tier-1 Deployment James Casey, PPARC-LCG Fellow, CERN 10 th GridPP Meeting, CERN, 3 rd June 2004.
CHEP – Mumbai, February 2006 The LCG Service Challenges Focus on SC3 Re-run; Outlook for 2006 Jamie Shiers, LCG Service Manager.
CERN IT Department CH-1211 Genève 23 Switzerland t EIS section review of recent activities Harry Renshall Andrea Sciabà IT-GS group meeting.
QCDGrid Progress James Perry, Andrew Jackson, Stephen Booth, Lorna Smith EPCC, The University Of Edinburgh.
1 st December 2003 JIM for CDF 1 JIM and SAMGrid for CDF Mòrag Burgon-Lyon University of Glasgow.
ATLAS and GridPP GridPP Collaboration Meeting, Edinburgh, 5 th November 2001 RWL Jones, Lancaster University.
Dan Tovey, University of Sheffield GridPP: Experiment Status & User Feedback Dan Tovey University Of Sheffield.
GridPP18 Glasgow Mar 07 DØ – SAMGrid Where’ve we come from, and where are we going? Evolution of a ‘long’ established plan Gavin Davies Imperial College.
GridPP3 Project Management GridPP20 Sarah Pearce 11 March 2008.
22 nd September 2003 JIM for CDF 1 JIM and SAMGrid for CDF Mòrag Burgon-Lyon University of Glasgow.
CCRC’08 Weekly Update Jamie Shiers ~~~ LCG MB, 1 st April 2008.
Dan Tovey, University of Sheffield User Board Overview Dan Tovey University Of Sheffield.
GLite – An Outsider’s View Stephen Burke RAL. January 31 st 2005gLite overview Introduction A personal view of the current situation –Asked to be provocative!
GridPP Building a UK Computing Grid for Particle Physics Professor Steve Lloyd, Queen Mary, University of London Chair of the GridPP Collaboration Board.
The Experiments – progress and status Roger Barlow GridPP7 Oxford 2 nd July 2003.
LCG EGEE is a project funded by the European Union under contract IST LCG PEB, 7 th June 2004 Prototype Middleware Status Update Frédéric Hemmer.
Owen SyngeTitle of TalkSlide 1 Storage Management Owen Synge – Developer, Packager, and first line support to System Administrators. Talks Scope –GridPP.
…building the next IT revolution From Web to Grid…
Metadata Mòrag Burgon-Lyon University of Glasgow.
1 LHCb on the Grid Raja Nandakumar (with contributions from Greig Cowan) ‏ GridPP21 3 rd September 2008.
Grid User Interface for ATLAS & LHCb A more recent UK mini production used input data stored on RAL’s tape server, the requirements in JDL and the IC Resource.
ATLAS is a general-purpose particle physics experiment which will study topics including the origin of mass, the processes that allowed an excess of matter.
15 December 2015M. Lamanna “The ARDA project”1 The ARDA Project (meeting with the LCG referees) Massimo Lamanna CERN.
Worldwide Protein Data Bank wwPDB Common D&A Project November 24, 2009 November 24, 2009 Steering Committee Project Update.
INFSO-RI Enabling Grids for E-sciencE ARDA Experiment Dashboard Ricardo Rocha (ARDA – CERN) on behalf of the Dashboard Team.
System/SDWG Update Management Council Face-to-Face Flagstaff, AZ August 22-23, 2011 Sean Hardman.
A. Aimar - EP/SFT LCG - Software Process & Infrastructure1 SPI Software Process & Infrastructure for LCG Project Overview LCG Application Area Internal.
Plans for Service Challenge 3 Ian Bird LHCC Referees Meeting 27 th June 2005.
Julia Andreeva on behalf of the MND section MND review.
The GridPP DIRAC project DIRAC for non-LHC communities.
12 March, 2002 LCG Applications Area - Introduction slide 1 LCG Applications Session LCG Launch Workshop March 12, 2002 John Harvey, CERN LHCb Computing.
ATLAS-specific functionality in Ganga - Requirements for distributed analysis - ATLAS considerations - DIAL submission from Ganga - Graphical interfaces.
MND review. Main directions of work  Development and support of the Experiment Dashboard Applications - Data management monitoring - Job processing monitoring.
Last update: 03/03/ :37 LCG Grid Technology Area Quarterly Status & Progress Report SC2 February 6, 2004.
EGEE is a project funded by the European Union under contract IST ARDA Project Status Massimo Lamanna ARDA Project Leader NA4/HEP Cork, 19.
Enabling Grids for E-sciencE INFSO-RI Enabling Grids for E-sciencE Gavin McCance GDB – 6 June 2007 FTS 2.0 deployment and testing.
Distributed Analysis Tutorial Dietrich Liko. Overview  Three grid flavors in ATLAS EGEE OSG Nordugrid  Distributed Analysis Activities GANGA/LCG PANDA/OSG.
8 August 2006MB Report on Status and Progress of SC4 activities 1 MB (Snapshot) Report on Status and Progress of SC4 activities A weekly report is gathered.
David Adams ATLAS ATLAS Distributed Analysis and proposal for ATLAS-LHCb system David Adams BNL March 22, 2004 ATLAS-LHCb-GANGA Meeting.
CERN - IT Department CH-1211 Genève 23 Switzerland t Grid Reliability Pablo Saiz On behalf of the Dashboard team: J. Andreeva, C. Cirstoiu,
The GridPP DIRAC project DIRAC for non-LHC communities.
Status of gLite-3.0 deployment and uptake Ian Bird CERN IT LCG-LHCC Referees Meeting 29 th January 2007.
GridPP2 Data Management work area J Jensen / RAL GridPP2 Data Management Work Area – Part 2 Mass storage & local storage mgmt J Jensen
ARDA Massimo Lamanna / CERN Massimo Lamanna 2 TOC ARDA Workshop Post-workshop activities Milestones (already shown in December)
12 March, 2002 LCG Applications Area - Introduction slide 1 LCG Applications Session LCG Launch Workshop March 12, 2002 John Harvey, CERN LHCb Computing.
Acronyms GAS - Grid Acronym Soup, LCG - LHC Computing Project EGEE - Enabling Grids for E-sciencE.
DØ Grid Computing Gavin Davies, Frédéric Villeneuve-Séguier Imperial College London On behalf of the DØ Collaboration and the SAMGrid team The 2007 Europhysics.
EGEE Middleware Activities Overview
POW MND section.
Database Readiness Workshop Intro & Goals
Readiness of ATLAS Computing - A personal view
LCG Operations Centres
Monitoring of the infrastructure from the VO perspective
Presentation transcript:

Applications Area Issues RWL Jones GridPP16 QMUL 28 th June 2006

Overview All projects moving towards Service Phases –LHC experiments engaged in Service and commissioning challenges –BaBar has grid simulation service –D-Zero delivering simulation, reconstruction and analysis –QCDGrid devloping and serving a community Headline issues –Tier 1 resources were insufficient in 05Q4 and 06Q1 Some improvements now How do we handle an experiment requesting an incompatible system? –Data movement and managementis the current hot topic for the LHC experiments FTS response LFC performance

ATLAS Focussed on the ATLAS Distributed Analysis and the GANGA front end. Critical path Significant feedback from early adopters rapid feature enhancements in 06Q2. The major sticking point is the deployment of the ATLAS Distributed Data Management. –This is well integrated into the OSG sites (reflecting the origin of the developer effort), but has proven more problematic in the LCG. The DA effort has inevitably reduced the ATLAS input into the Production tools –GANGA is now being taken-up by the production team as their front-end. –ATLAS-wide deficiency in production tools; other FAs have been asked to address this as well. On hardware, the shortage of Tier 1 capacity, and especially the reduction of disk capacity, caused significant problems. Tier 1 activity at RAL effectively stopped for 10 days because of shortage of disk space. Lancaster has been an effective temporary relief site..

GANGA Tensions from serving two masters reduced Release with job-building delivered in March 2006; this is later than planned Release to support a range of application) is changed to be due in October 2006, keeping in step with the Data Challenge release cycle. –Delayed deliverable will take on-board some metadata access secondary deliverables. End-user feedback from LHCb is good. The ATLAS situation is not so good, as the DDM delays (see above) have restricted the usability. This is a matter of urgency for 06Q2.

LHCb Excellent reporting The ARDA metadata interface Significant testing and feedback, and is fully deployed and reported. (3.2.2 complete). AMGA based version under development, along with a GANGA plug-in to use it. Other metadata interfaces, including AMI from ATLAS have been A new DIRAC release streamlines both production and analysis jobs, and security has been enhanced; the release completes

CMS Some changes in deliverables because LCG will now handle low-level data transfers & architectural changes in BOSS that no longer split job preparation from monitoring and tracking. Big activity in SC exercises. Tim Barass has been very active, but he has left for a job outside of HEP. IC have been working on an XML-based architecture prototype for BOSS. However, the project leader has suspended the line of development, and IC is mow working on the CLI and API. There have been problems with the PhEDEx deployment at IC, now fixed; other important services have been deployed. Would still wish to see if there are common tools/projects possible

BaBar Uneven reporting here The simulation reporting is skeletal! to say the least. The simulation production seems on track however. A new temporary hire at SLAC will add to the analysis effort. Analysis commentary is long but undigested More on technologies used would help

SAMGrid/D0 RunJob deliverables have been completed but not yet demonstrated. The full chain tests were expected in April. The UK RAC has been working well, although manual submission has been required as the automated interface, which was just being rolled-out at IC at the end of the quarter. The associated monitoring deliverable is completed.

QCDGrid QCDGrid releases in October 05 and May 06 –October release includes significant QCDML enhancements Lots of work on implementing local instances of ILDG Metadata catalogue interface as a web service –Some local difficulties bring in UK resources Major review of support systems Still question of whether we can share common technologies here

PhenoGrid No deliverables were due this quarter. There was a release of GENSER containing Herwig++ Substantial progress on Herwig++ / FORM job submission Progress now being made, after a difficult 05Q4

Portal/Monitor Monitor –Displayed at Supercomputing 05, CHEP06 –New monitor version –3-D graphics, Google-map functionality Portal –Portal toolkit released in January –Lots of work on VOMS proxies –Support for CALICE and T2K Already good synergies with projects like ESLEA

Next 06Q2 reports due by 7 th July!