HEPiX Summary Fall 2014 – Lincoln, Nebraska Martin Bly.

Slides:



Advertisements
Similar presentations
 Contributing >30% of throughput to ATLAS and CMS in Worldwide LHC Computing Grid  Reliant on production and advanced networking from ESNET, LHCNET and.
Advertisements

HEPiX Autumn Meeting 2014 University of Nebraska, Lincoln 2 Arne Wiebalck Liviu Valsan Borja Aparicio Wiebalck, Valsan,
CERN IT Department CH-1211 Geneva 23 Switzerland t T0 report WLCG operations Workshop Barcelona, 07/07/2014 Maite Barroso, CERN IT.
CERN IT Department CH-1211 Genève 23 Switzerland t Summary of the HEPiX Autumn 2013 Meeting Arne Wiebalck Afroditi Xafi Thomas Oulevey CERN.
HEPiX Catania 19 th April 2002 Alan Silverman HEPiX Large Cluster SIG Report Alan Silverman 19 th April 2002 HEPiX 2002, Catania.
UCL Site Report Ben Waugh HepSysMan, 22 May 2007.
RAL Site Report HEPiX Fall 2013, Ann Arbor, MI 28 Oct – 1 Nov Martin Bly, STFC-RAL.
A. Mohapatra, HEPiX 2013 Ann Arbor1 UW Madison CMS T2 site report D. Bradley, T. Sarangi, S. Dasu, A. Mohapatra HEP Computing Group Outline  Infrastructure.
Status of WLCG Tier-0 Maite Barroso, CERN-IT With input from T0 service managers Grid Deployment Board 9 April Apr-2014 Maite Barroso Lopez (at)
HEPiX Summary Martin Bly HEPSysMan - RAL, June 2013.
October, Scientific Linux INFN/Trieste B.Gobbo – Compass R.Gomezel - T.Macorini - L.Strizzolo INFN - Trieste.
Integration Program Update Rob Gardner US ATLAS Tier 3 Workshop OSG All LIGO.
LCG and HEPiX Ian Bird LCG Project - CERN HEPiX - FNAL 25-Oct-2002.
News from the HEPiX IPv6 Working Group David Kelsey (STFC-RAL) GridPP35, Liverpool 11 Sep 2015.
Oxford Update HEPix Pete Gronbech GridPP Project Manager October 2014.
The HEPiX IPv6 Working Group David Kelsey EGI TF, Prague 18 Sep 2012.
HEPiX Fall 2013 U Mich Ann Arbor, USA Workshop Wrap-Up Helge Meinhard, Sandy Philpott.
CERN IT Department CH-1211 Genève 23 Switzerland t Tier0 Status - 1 Tier0 Status Tony Cass LCG-LHCC Referees Meeting 18 th November 2008.
HEPiX Spring 2012 Highlights Helge Meinhard CERN-IT GDB 09-May-2012.
JLab Scientific Computing: Theory HPC & Experimental Physics Thomas Jefferson National Accelerator Facility Newport News, VA Sandy Philpott.
1 Resource Provisioning Overview Laurence Field 12 April 2015.
HEPiX Trip Report Stanford Linear Accelerator Center October Martin Bly – RAL Tier1 HEPSysMan.
March 11, 2008 USCMS Tier-2 Workshop Oh Dear God Alain made a PowerPoint presentation 1.
KISTI-GSDC SITE REPORT Sang-Un Ahn, Jin Kim On the behalf of KISTI GSDC 24 March 2015 HEPiX Spring 2015 Workshop Oxford University, Oxford, UK.
RAL Site Report HEPiX FAll 2014 Lincoln, Nebraska October 2014 Martin Bly, STFC-RAL.
Grid User Interface for ATLAS & LHCb A more recent UK mini production used input data stored on RAL’s tape server, the requirements in JDL and the IC Resource.
High Energy Physics and Grids at UF (Dec. 13, 2002)Paul Avery1 University of Florida High Energy Physics.
HEPIX Fall 2015 Summary Tony Wong Helge Meinhard.
HEPiX IPv6 Working Group David Kelsey GDB, CERN 11 Jan 2012.
Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Tools and techniques for managing virtual machine images Andreas.
2012 Objectives for CernVM. PH/SFT Technical Group Meeting CernVM/Subprojects The R&D phase of the project has finished and we continue to work as part.
PanDA Status Report Kaushik De Univ. of Texas at Arlington ANSE Meeting, Nashville May 13, 2014.
CMS Usage of the Open Science Grid and the US Tier-2 Centers Ajit Mohapatra, University of Wisconsin, Madison (On Behalf of CMS Offline and Computing Projects)
HEPiX Spring 2014 LAPP Annecy-Le-Vieux, France Workshop Wrap-Up Helge Meinhard.
HEPiX report Autumn/Fall 2015 HEPiX meeting Brookhaven National Lab, Upton NY, U.S.A. Helge Meinhard, CERN-IT Grid Deployment Board 04-Nov-2015 (with.
Andrea Manzi CERN On behalf of the DPM team HEPiX Fall 2014 Workshop DPM performance tuning hints for HTTP/WebDAV and Xrootd 1 16/10/2014.
The HEPiX IPv6 working group David Kelsey (STFC-RAL) HEPiX meeting, Bologna 17 Apr 2013.
1 The Cloud and Desktop as a Service as a teaching tool for different research communities David Wallom Oxford e-Research Centre.
CERN IT Department CH-1211 Genève 23 Switzerland t Migration from ELFMs to Agile Infrastructure CERN, IT Department.
1 Update at RAL and in the Quattor community Ian Collier - RAL Tier1 HEPiX FAll 2010, Cornell.
A. Mohapatra, T. Sarangi, HEPiX-Lincoln, NE1 University of Wisconsin-Madison CMS Tier-2 Site Report D. Bradley, S. Dasu, A. Mohapatra, T. Sarangi, C. Vuosalo.
Enabling Grids for E-sciencE INFSO-RI Enabling Grids for E-sciencE Gavin McCance GDB – 6 June 2007 FTS 2.0 deployment and testing.
CERN IT Department CH-1211 Genève 23 Switzerland t SL(C) 5 Migration at CERN CHEP 2009, Prague Ulrich SCHWICKERATH Ricardo SILVA CERN, IT-FIO-FS.
Feedback from CMS Andrew Lahiff STFC Rutherford Appleton Laboratory Contributions from Christoph Wissing, Bockjoo Kim, Alessandro Degano CernVM Users Workshop.
WLCG and IPv6 David Kelsey (STFC-RAL) LHCOPN/LHCONE, Rome 28 Apr 2014.
HEPiX Spring 2015 Oxford University, UK Workshop Wrap-Up Helge Meinhard.
Testing Infrastructure Wahid Bhimji Sam Skipsey Intro: what to test Existing testing frameworks A proposal.
HEPiX report Spring 2015 HEPiX meeting Oxford University, UK Helge Meinhard, CERN-IT Grid Deployment Board 10-Jun Helge Meinhard (at) CERN.ch.
Michele Michelotto – CCR Marzo 2015 Past present future Fall 2012 Beijing IHEP Spring 2013 – INFN Cnaf Fall 2013 – Ann Arbour, Michigan Univ. Spring.
HEPiX report Spring 2016 HEPiX meeting DESY Zeuthen (Berlin), Germany Helge Meinhard, CERN-IT Grid Deployment Board 11-May Helge Meinhard (at)
HEPiX IPv6 Working Group David Kelsey david DOT kelsey AT stfc DOT ac DOT uk (STFC-RAL) HEPiX, Vancouver 26 Oct 2011.
The Great Migration: From Pacman to RPMs Alain Roy OSG Software Coordinator.
News from the HEPiX IPv6 Working Group David Kelsey (STFC-RAL) HEPIX, BNL 13 Oct 2015.
The HEPiX IPv6 Working Group David Kelsey (STFC-RAL) EGI OMB 19 Dec 2013.
Hepix spring 2012 Summary SITE:
WLCG Operations Coordination report Maria Dimou Andrea Sciabà IT/SDC On behalf of the WLCG Operations Coordination team GDB 12 th November 2014.
HEPiX Fall 2014 U Nebraska Lincoln, USA Workshop Wrap-Up Sandy Philpott, Helge Meinhard.
HEPiX Fall 2011 Summary Report QMUL 10 November 2011 Martin Bly, STFC-RAL.
HEPiX IPv6 Working Group David Kelsey (STFC-RAL) GridPP33 Ambleside 22 Aug 2014.
HEPiX spring 2013 report HEPiX Spring 2013 CNAF Bologna / Italy Helge Meinhard, CERN-IT Contributions by Arne Wiebalck / CERN-IT Grid Deployment Board.
WLCG IPv6 deployment strategy
Helge Meinhard, CERN-IT Grid Deployment Board 04-Nov-2015
HEPiX Fall 2016 Summary Report
Dag Toppe Larsen UiB/CERN CERN,
Dag Toppe Larsen UiB/CERN CERN,
HEPiX Spring 2014 Annecy-le Vieux May Martin Bly, STFC-RAL
FCT Follow-up Meeting 31 March, 2017 Fernando Meireles
Helge Meinhard, CERN-IT Grid Deployment Board 10-May-2017
Introduction to HEPiX Helge Meinhard, CERN-IT
HEPiX Spring 2009 Highlights
Presentation transcript:

HEPiX Summary Fall 2014 – Lincoln, Nebraska Martin Bly

17/11/2014 HEPiX Report 2014 Fall - HEPSysMan, QMUL 2 Stats 193 registered participants, several first-timers 43 different affiliations –6 of 8 US-CMS, 2 of 5 US-ATLAS –4 via Vidyo 60 presentations, including two remote Usual tracks…

Tracks Site Reports End-User IT Services and Operating Systems Basic IT services Computing and Batch Services Security and Networking IT Facilities and Business Continuity Storage and File Systems Grids, Clouds & Virtualisation 17/11/2014 HEPiX Report 2014 Fall - HEPSysMan, QMUL 3

End-User IT Services and Operating Systems SL Status, Futures –SL 5.11 in beta –RHEL 6.6 in beta from August Nothing unexpected in notes –Developer Toolset 3., private beta, expect to build on releases –Software Collection Library 1.2, private beta SL6.6 will follow –SL7 released Recommitting to mission, not in competition with other communities Tooling: new home of RHEL sources in git repository git.centos.org Needed to build a workflow to acquire sources SL maintainers have contributed tools SL7 has comprehensive release notes Automatic updates – uses yum-cron rather than yum-autoupdate. All SL package update repos enabled 17/11/2014 HEPiX Report 2014 Fall - HEPSysMan, QMUL 4

More OS stuff Next CERN –SLC5.11 last minor version Support for some newer LSI RAID cards –SLC6.5 released Dec 2013, SLC6.6 likely this year when ready –CentOS 7 releases 7/7/14 CERN CentOS 7 test version 4/8/14 CentOS 7 upstream rpms, no customisation Additional software via CERN and CERNONLY repos Updates staged. Includes yum-auto-update X86_64 only, systemd, gnome 3, Ixc / docker, gcc 4.8.x MySQL -> MariaDB Experiences with EL 7 at T2_US_Nebraska –Good talk on their experiences with RHEL7 17/11/2014 HEPiX Report 2014 Fall - HEPSysMan, QMUL 5

End User IT (3) FTS3, large scale file transfer service with simplicity and performance at its best –Run through FTS3 Issue Tracking and Version Control Services status update –Update on the systems at CERN Migration of Savannah Version control with SVN and Git –Consolidating SVN with lessons learned from Git Monviso: a portal for metering and reporting CNAF resources usage –Another reporting portal 17/11/2014 HEPiX Report 2014 Fall - HEPSysMan, QMUL 6

Computing and Batch Systems Benchmarking system on a chip and Fast Benchmarking –Curve for E5-26xx-v3 (Haswell) has bumps in it, 64bit better than 32bit –Reviewed events/W for Haswell and Arm, noted that Arms ship in billions –Fast benchmarking requirements Future of Batch Processing at CERN –Update on their testing of HTCondor – promising, user pilot after security review CMS benchmarking for workflows –Highlights that benchmarks aren’t simple HTCondor and HEP Partnership and Activities: (Todd Tannenbaum) –Review and developments of HTCondor Looking to collaborate more with HEP HTCondor on the Grid and in the Cloud –Review of HTCondor capability and use with non-Condor-managed resources 17/11/2014 HEPiX Report 2014 Fall - HEPSysMan, QMUL 7

Security and Networking IPv6 WWBG update - Kelsey EEX: ESnet Extension to Europe and ESnet support for the LHC Community –What it says… review of what they do and what they are doing Coming to Europe soon if not already here… Do You Need to Know Your Users? (Bob Cowles) –The future of AuthN/AuthZ Security Update –More problems to worry about 17/11/2014 HEPiX Report 2014 Fall - HEPSysMan, QMUL 8

Basic IT Services Suspending Nagios checks during planned outages –Code development Updates on configuration service sat CERN Puppet at USCSM-T1 AGLT2 Change management at RACF 17/11/2014 HEPiX Report 2014 Fall - HEPSysMan, QMUL 9

IT Facilities and Business Continuity UPS BNL Update on Wigner Datacentre –Good talk on the issues encountered in the Wigner project Joint procurement of IT equipment/services –New project called PICSE (Procurement model for Cloud Services in Europe) – H2020 project –5 year timeframe, Submission up to 14 April /11/2014 HEPiX Report 2014 Fall - HEPSysMan, QMUL 10

Storage and File Systems Petabyte Lustre File Florida HPC Centre –2 x 2PB EOS across 100km –Issues encountered with EOS data from Wigner Using XrootD to minimise Hadoop Replication –Utilising network of collaborating sites to heal broken files CERNbox + EOS –Dropbox-like services at CERN OpenZFS on Linux SSD benchmarking at CERN –Lost of comparisons for various different workload types CEFH-based storage at RACF DPM performance tuning hints for HTTP/WebDAV and Xrootd High availability storage at PDSF 17/11/2014 HEPiX Report 2014 Fall - HEPSysMan, QMUL 11

Grids, Clouds, Virtualisation & volunteer CERN –Pros and cons of volunteer computing VM IO bottleneck –Aka the lxplus problem RAL Tier1 could computing developments Cloud Technologies within LHC experiments CERN cloud infrastructure update 17/11/2014 HEPiX Report 2014 Fall - HEPSysMan, QMUL 12

Other Board Meeting –Yet to enable new website –Aiming to get inactive former HEPiX sites re-engaged –New NA co-chair – Tony BNL Next Meetings –Spring 2015: University of Oxford, UK March same tracks, add CEPH focus: BOF or dedicated session –Fall 2015: Brookhaven, propose October (any known conflicts) –Spring 2016: Fall 2015: Brookhaven, propose October Any known conflicts? –Spring 2016: to be confirmed - possibly DESY Zeuthen 17/11/2014 HEPiX Report 2014 Fall - HEPSysMan, QMUL 13

Summary CEPH IPv6 17/11/2014 HEPiX Report 2014 Fall - HEPSysMan, QMUL 14