Experiment Support CERN IT Department CH-1211 Geneva 23 Switzerland www.cern.ch/i t DBES CVMFS deployment status Ian Collier – STFC Stefan Roiser – CERN.

Slides:



Advertisements
Similar presentations
Owen SyngeDCache Slide 1 D-Cache Status Report Owen Synge.
Advertisements

ATLAS Installation System 2 (status update) Alessandro De Salvo A. De Salvo – 28 May 2013 Status.
ATLAS Tier-3 in Geneva Szymon Gadomski, Uni GE at CSCS, November 2009 S. Gadomski, ”ATLAS T3 in Geneva", CSCS meeting, Nov 091 the Geneva ATLAS Tier-3.
Operations Coordination Team Maria Girone, CERN IT-ES GDB 10 th October 2012.
Operations Coordination Team Maria Girone, CERN IT-ES Kick-off meeting 24 th September 2012.
Delivering Experiment Software to WLCG sites A new approach using the CernVM Filesystem (cvmfs) Ian Collier – RAL Tier 1 HEPSYSMAN.
Cloud & Virtualisation Update at the RAL Tier 1 Ian Collier Andrew Lahiff STFC RAL Tier 1 HEPiX, Lincoln, NEBRASKA, 17 th October 2014.
New VOMS servers campaign GDB, 8 th Oct 2014 Maarten Litmaath IT/SDC.
CVMFS AT TIER2S Sarah Williams Indiana University.
Experiment Support CERN IT Department CH-1211 Geneva 23 Switzerland t DBES News on monitoring for CMS distributed computing operations Andrea.
Experiment Support CERN IT Department CH-1211 Geneva 23 Switzerland t DBES WLCG operations: communication channels Andrea Sciabà WLCG operations.
CERN - IT Department CH-1211 Genève 23 Switzerland t Monitoring the ATLAS Distributed Data Management System Ricardo Rocha (CERN) on behalf.
CERN IT Department CH-1211 Genève 23 Switzerland t Tier0 Status Tony Cass (With thanks to Miguel Coelho dos Santos & Alex Iribarren) LCG-LHCC.
BINP/GCF Status Report BINP LCG Site Registration Oct 2009
CERN IT Department CH-1211 Genève 23 Switzerland t EIS section review of recent activities Harry Renshall Andrea Sciabà IT-GS group meeting.
Introduction to CVMFS A way to distribute HEP software on cloud Tian Yan (IHEP Computing Center, BESIIICGEM Cloud Computing Summer School.
SRM 2.2: status of the implementations and GSSD 6 th March 2007 Flavia Donno, Maarten Litmaath INFN and IT/GD, CERN.
Experiment Support CERN IT Department CH-1211 Geneva 23 Switzerland t DBES P. Saiz (IT-ES) AliEn job agents.
CERN IT Department CH-1211 Genève 23 Switzerland t Internet Services Job Monitoring for the LHC experiments Irina Sidorova (CERN, JINR) on.
Experiment Support CERN IT Department CH-1211 Geneva 23 Switzerland t DBES PhEDEx Monitoring Nicolò Magini CERN IT-ES-VOS For the PhEDEx.
CERN IT Department CH-1211 Geneva 23 Switzerland t Storageware Flavia Donno CERN WLCG Collaboration Workshop CERN, November 2008.
Configuration Management with Cobbler and Puppet Kashif Mohammad University of Oxford.
Experiment Support CERN IT Department CH-1211 Geneva 23 Switzerland t DBES Successful Common Projects: Structures and Processes WLCG Management.
Support in setting up a non-grid Atlas Tier 3 Doug Benjamin Duke University.
RAL Site Report Castor Face-to-Face meeting September 2014 Rob Appleyard, Shaun de Witt, Juan Sierra.
Machine/Job Features Update Stefan Roiser. Machine/Job Features Recap Resource User Resource Provider Batch Deploy pilot Cloud Node Deploy VM Virtual.
Experiment Support CERN IT Department CH-1211 Geneva 23 Switzerland t DBES Changes in PD2P replication strategy S. Campana (CERN IT/ES) on.
Virtualised Worker Nodes Where are we? What next? Tony Cass GDB /12/12.
CERN - IT Department CH-1211 Genève 23 Switzerland t Oracle Real Application Clusters (RAC) Techniques for implementing & running robust.
CERN IT Department CH-1211 Genève 23 Switzerland t Frédéric Hemmer IT Department Head - CERN 23 rd August 2010 Status of LHC Computing from.
Information System Status and Evolution Maria Alandes Pradillo, CERN CERN IT Department, Grid Technology Group GDB 13 th June 2012.
Marco Cattaneo LHCb computing status for LHCC referees meeting 14 th June
Grid Technology CERN IT Department CH-1211 Geneva 23 Switzerland t DBCF GT DPM Collaboration Motivation and proposal Oliver Keeble CERN On.
Jens G Jensen RAL, EDG WP5 Storage Element Overview DataGrid Project Conference Heidelberg, 26 Sep-01 Oct 2003.
Report from the WLCG Operations and Tools TEG Maria Girone / CERN & Jeff Templon / NIKHEF WLCG Workshop, 19 th May 2012.
The WLCG Service from a Tier1 Viewpoint Gareth Smith 7 th July 2010.
Experiment Support CERN IT Department CH-1211 Geneva 23 Switzerland t DBES GGUS Ticket review T1 Service Coordination Meeting 2010/10/28.
CERN - IT Department CH-1211 Genève 23 Switzerland t High Availability Databases based on Oracle 10g RAC on Linux WLCG Tier2 Tutorials, CERN,
Catalin Condurache STFC RAL Tier-1 GridPP OPS meeting, 10 March 2015.
WLCG Planning Issues GDB June Harry Renshall, Jamie Shiers.
Using CVMFS to serve site software Sarah Williams Indiana University 2/01/121.
Grid Technology CERN IT Department CH-1211 Geneva 23 Switzerland t DBCF GT Upcoming Features and Roadmap Ricardo Rocha ( on behalf of the.
CERN IT Department CH-1211 Geneva 23 Switzerland t WLCG Operation Coordination Luca Canali (for IT-DB) Oracle Upgrades.
Experiment Support CERN IT Department CH-1211 Geneva 23 Switzerland t DBES Andrea Sciabà Hammercloud and Nagios Dan Van Der Ster Nicolò Magini.
Testing CernVM-FS scalability at RAL Tier1 Ian Collier RAL Tier1 Fabric Team WLCG GDB - September
1 Cloud Services Requirements and Challenges of Large International User Groups Laurence Field IT/SDC 2/12/2014.
SL5 Site Status GDB, September 2009 John Gordon. LCG SL5 Site Status ASGC T1 - will be finished before mid September. Actually the OS migration process.
CernVM-FS Infrastructure for EGI VOs Catalin Condurache - STFC RAL Tier1 EGI Webinar, 5 September 2013.
Enabling Grids for E-sciencE INFSO-RI Enabling Grids for E-sciencE Gavin McCance GDB – 6 June 2007 FTS 2.0 deployment and testing.
New solutions for large scale functional tests in the WLCG infrastructure with SAM/Nagios: The experiments experience ES IT Department CERN J. Andreeva.
Experiment Support CERN IT Department CH-1211 Geneva 23 Switzerland t DBES Andrea Sciabà Ideal information system - CMS Andrea Sciabà IS.
WLCG Operations Coordination Andrea Sciabà IT/SDC 10 th July 2013.
Feedback from CMS Andrew Lahiff STFC Rutherford Appleton Laboratory Contributions from Christoph Wissing, Bockjoo Kim, Alessandro Degano CernVM Users Workshop.
LCG Issues from GDB John Gordon, STFC WLCG MB meeting September 28 th 2010.
CERN IT Department CH-1211 Geneva 23 Switzerland t Distributed Database Operations Workshop November 17 th, 2010 Przemyslaw Radowiecki CERN.
CMS: T1 Disk/Tape separation Nicolò Magini, CERN IT/SDC Oliver Gutsche, FNAL November 11 th 2013.
Database Project Milestones (+ few status slides) Dirk Duellmann, CERN IT-PSS (
CERN IT Department CH-1211 Geneva 23 Switzerland t ES 1 how to profit of the ATLAS HLT farm during the LS1 & after Sergio Ballestrero.
WLCG Operations Coordination report Maria Alandes, Andrea Sciabà IT-SDC On behalf of the WLCG Operations Coordination team GDB 9 th April 2014.
The RAL PPD Tier 2/3 Current Status and Future Plans or “Are we ready for next year?” Chris Brew PPD Christmas Lectures th December 2007.
CernVM-FS – Best Practice to Consolidate Global Software Distribution Catalin CONDURACHE, Ian COLLIER STFC RAL Tier-1 ISGC15, Taipei, March 2015.
Considerations on Using CernVM-FS for Datasets Sharing Within Various Research Communities Catalin Condurache STFC RAL UK ISGC, Taipei, 18 March 2016.
CERN - IT Department CH-1211 Genève 23 Switzerland t Service Level & Responsibilities Dirk Düllmann LCG 3D Database Workshop September,
DB Questions and Answers open session (comments during session) WLCG Collaboration Workshop, CERN Geneva, 24 of April 2008.
Experiment Support CERN IT Department CH-1211 Geneva 23 Switzerland t DBES Author etc Alarm framework requirements Andrea Sciabà Tony Wildish.
CERN IT Department CH-1211 Genève 23 Switzerland t DPM status and plans David Smith CERN, IT-DM-SGT Pre-GDB, Grid Storage Services 11 November.
CVMFS Alessandro De Salvo Outline  CVMFS architecture  CVMFS usage in the.
WLCG IPv6 deployment strategy
Virtualization and Clouds ATLAS position
Presentation transcript:

Experiment Support CERN IT Department CH-1211 Geneva 23 Switzerland t DBES CVMFS deployment status Ian Collier – STFC Stefan Roiser – CERN

CERN IT Department CH-1211 Geneva 23 Switzerland t ES Content CVMFS recap Deployment status / experiment FAQs for deployment CVMFS next steps 11 July '12I Collier, S Roiser2

CERN IT Department CH-1211 Geneva 23 Switzerland t ES CVMFS recap 11 July '12I Collier, S Roiser3

CERN IT Department CH-1211 Geneva 23 Switzerland t ES Atlas deployment status 11 July '12I Collier, S Roiser4 78 out of 104 WLCG/OSG sites deployed CVMFS –Cern and all Tier 1 sites migrated Deployment by Tier Level Deployment by Cloud * T2D – T2 with better network connectivity

CERN IT Department CH-1211 Geneva 23 Switzerland t ES Info for sites supporting Atlas Using two repositories –/cvmfs/atlas.cern.ch – the “normal” sw repository –/cvmfs/atlas-conddb.cern.ch Recommendation to use CVMFS at all sites –Plan to have all sites migrated by Q Obstacle at remaining sites often lack of disk space on WNs –Current requirement for small local shared area to be dropped in the future 11 July '12I Collier, S Roiser5

CERN IT Department CH-1211 Geneva 23 Switzerland t ES LHCb deployment status 36 of 86 WLCG sites have deployed CVMFS –Cern and all Tier 1 sites are migrated –Good part of Tier 2 sites (LHCb has no Tier 3s) Possibility to follow deployment at /go/H8rd (updated weekly) /go/H8rd 11 July '12I Collier, S Roiser6 CVMFS deployed Other FS deployed

CERN IT Department CH-1211 Geneva 23 Switzerland t ES Info for sites supporting LHCb LHCb officially requests all sites supporting the VO to deploy CVMFS (squid + WNs) LHCb uses two worker node mount points –/cvmfs/lhcb.cern.ch – the “normal” sw repository –/cvmfs/lhcb-conddb.cern.ch – fast conditions !! New !! Deployed so far at all but one T1 sites. For T2s please install if not done yet Tier 2 sites with CVMFS will be preferred for extra workload –e.g. end of year data reprocessing or other CPU intensive computations 11 July '12I Collier, S Roiser7

CERN IT Department CH-1211 Geneva 23 Switzerland t ES CMS deployment status 5 Tier 2 sites have currently migrated CMS encourages sites to move to CVMFS –Wanted to wait for “hot” ICHEP period to be over –Now rolling out at T1s as well Now “hardening” procedures to install software releases on the master and critical service procedures CMS CVMFS info (inc. deployment) – mpOpsCVMFShttps://twiki.cern.ch/twiki/bin/view/CMSPublic/Co mpOpsCVMFS –Will be added to VO card soon 11 July '12I Collier, S Roiser8

CERN IT Department CH-1211 Geneva 23 Switzerland t ES CVMFS next steps / releases Client with shared cache is in testing –Should reduce overall cache space requirement Improved server software in development –New backend based on a union file system no separate read-write copy, possibility of distributing change set processing – Stratum 0s for other VOs in deployment now (eg at RAL) A client that can be NFS exported is being looked at (very problematic) Mac OS X Client 11 July '12I Collier, S Roiser9

CERN IT Department CH-1211 Geneva 23 Switzerland t ES CVMFS FAQs I’m site admin and would like to install CVMFS, where shall I look for info? – –CVMFS Technical Report: –Many sites & VOs have their own guides/channels Eg What are the channels I should subscribe to get more info / updates on CVMFS? I have an issue with CVMFS, who should I contact? –Start with 11 July '12I Collier, S Roiser10

CERN IT Department CH-1211 Geneva 23 Switzerland t ES Thanks for additional input Jarka Schovancova Alessandro de Salvo Christoph Wissing Oliver Gutsche Marco Cattaneo Maarten Litmaath 11 July '12I Collier, S Roiser11