CERN IT Department CH-1211 Genève 23 Switzerland www.cern.ch/it PES SVN User Forum David Asbury Alvaro Gonzalez Alvarez Pawel Kacper Zembrzuski 16 April.

Slides:



Advertisements
Similar presentations
1. What is Subversion? Why do we need CM? Basic concepts Repositories Options Setup Clients Options Setup Operation Troubleshooting Slide 2.
Advertisements

Data & Storage Services CERN IT Department CH-1211 Genève 23 Switzerland t DSS TSM CERN Daniele Francesco Kruse CERN IT/DSS.
JPLIS-FILServer Performance Comparisons1 AFS Server Performance Comparisons Bo Tretta Kim Kimball Jet Propulsion Laboratory Information Services - FIL.
Software Configuration Management Donna Albino LIS489, December 3, 2014.
Customer Debrief Shared Services Major Incidents January thru September October 23, 2013.
How to Cluster both Servers and Storage W. Curtis Preston President The Storage Group.
Virtual Network Servers. What is a Server? 1. A software application that provides a specific one or more services to other computers  Example: Apache.
CERN IT Department CH-1211 Genève 23 Switzerland IT Forum, June 2011 Software and Hardware Inventory Initiatives Computer Security Team,
Backup Rationalisation Reorganisation of the CERN Computer Centre Backups David Asbury IT/DS Friday 6 December 2002.
H-1 Network Management Network management is the process of controlling a complex data network to maximize its efficiency and productivity The overall.
SubVersioN – the new Central Service at DESY by Marian Gawron.
European Organization for Nuclear Research Source Control Management Service (Subversion) Brice Copy, Michel Bornand EN-ICE 13 May 2009.
CERN - IT Department CH-1211 Genève 23 Switzerland t SVN Pilot: CVS Replacement Manuel Guijarro Jonatan Hugo Hugosson Artur Wiecek David.
Chapter - 2 What is “GIT” VERSION CONTROL AND GIT BASICS.
Database Services for Physics at CERN with Oracle 10g RAC HEPiX - April 4th 2006, Rome Luca Canali, CERN.
CERN IT Department CH-1211 Genève 23 Switzerland t Virtualization with Windows at CERN Juraj Sucik, Emmanuel Ormancey Internet Services Group.
DONE-10: Adminserver Survival Tips Brian Bowman Product Manager, Data Management Group.
CAA/CFA Review | Andrea Laruelo | ESTEC | May CFA Development Status CAA/CFA Review ESTEC, May 19 th 2011 European Space AgencyAndrea Laruelo.
Chapter 8 Implementing Disaster Recovery and High Availability Hands-On Virtual Computing.
CERN - IT Department CH-1211 Genève 23 Switzerland t CERN - IT Department CH-1211 Genève 23 Switzerland t Internet Services.
CERN - IT Department CH-1211 Genève 23 Switzerland t Tier0 database extensions and multi-core/64 bit studies Maria Girone, CERN IT-PSS LCG.
Data & Storage Services CERN IT Department CH-1211 Genève 23 Switzerland t DSS From data management to storage services to the next challenges.
Operating Systems & Information Services CERN IT Department CH-1211 Geneva 23 Switzerland t OIS Working with Windows 7 at CERN Michał Budzowski.
Creating a Personal Webvoyáge Development Environment Using VMware Chris Delis, CARLI.
Object-Oriented Analysis & Design Subversion. Contents  Configuration management  The repository  Versioning  Tags  Branches  Subversion 2.
Wenjing Wu Andrej Filipčič David Cameron Eric Lancon Claire Adam Bourdarios & others.
CERN IT Department CH-1211 Genève 23 Switzerland t Tier0 Status - 1 Tier0 Status Tony Cass LCG-LHCC Referees Meeting 18 th November 2008.
Continuous Integration and Code Review: how IT can help Alex Lossent – IT/PES – Version Control Systems 29-Sep st Forum1.
CERN - IT Department CH-1211 Genève 23 Switzerland Castor External Operation Face-to-Face Meeting, CNAF, October 29-31, 2007 CASTOR2 Disk.
PROOF Cluster Management in ALICE Jan Fiete Grosse-Oetringhaus, CERN PH/ALICE CAF / PROOF Workshop,
1 The new Fabric Management Tools in Production at CERN Thorsten Kleinwort for CERN IT/FIO HEPiX Autumn 2003 Triumf Vancouver Monday, October 20, 2003.
CERN - IT Department CH-1211 Genève 23 Switzerland WLCG 2009 Data-Taking Readiness Planning Workshop Tier-0 Experiences Miguel Coelho dos.
CERN - IT Department CH-1211 Genève 23 Switzerland t CASTOR Status March 19 th 2007 CASTOR dev+ops teams Presented by Germán Cancio.
Operating Systems & Information Services CERN IT Department CH-1211 Geneva 23 Switzerland t OIS Update on Windows 7 at CERN & Remote Desktop.
EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Stephen Childs Trinity College Dublin &
CERN - IT Department CH-1211 Genève 23 Switzerland t OIS Deployment of Exchange 2010 mail platform Pawel Grzywaczewski, CERN IT/OIS HEPIX.
 Registry itself is easy and straightforward in implementation  The objects of registry are actually complicated to store and manage  Objects of Registry.
CERN IT Department CH-1211 Genève 23 Switzerland t Load Testing Dennis Waldron, CERN IT/DM/DA CASTOR Face-to-Face Meeting, Feb 19 th 2009.
Department of Computing, School of Electrical Engineering and Computer Sciences, NUST - Islamabad KTH Applied Information Security Lab Secure Sharding.
CERN IT Department CH-1211 Genève 23 Switzerland PES 1 Ermis service for DNS Load Balancer configuration HEPiX Fall 2014 Aris Angelogiannopoulos,
CERN - IT Department CH-1211 Genève 23 Switzerland t High Availability Databases based on Oracle 10g RAC on Linux WLCG Tier2 Tutorials, CERN,
High Availability Technologies for Tier2 Services June 16 th 2006 Tim Bell CERN IT/FIO/TSI.
CCA Forum Winter Meeting January CCA Common Component Architecture CCA Forum Collaboration Services Migration Update David E. Bernholdt ORNL.
Operating Systems & Information Services CERN IT Department CH-1211 Geneva 23 Switzerland t OIS Drupal at CERN Juraj Sucik Jarosław Polok.
MND review. Main directions of work  Development and support of the Experiment Dashboard Applications - Data management monitoring - Job processing monitoring.
File Transfer And Access (FTP, TFTP, NFS). Remote File Access, Transfer and Storage Networks For different goals variety of approaches to remote file.
CERN IT Department CH-1211 Genève 23 Switzerland t Migration from ELFMs to Agile Infrastructure CERN, IT Department.
CERN - IT Department CH-1211 Genève 23 Switzerland t Operating systems and Information Services OIS Proposed Drupal Service Definition IT-OIS.
Tackling I/O Issues 1 David Race 16 March 2010.
CERN - IT Department CH-1211 Genève 23 Switzerland CASTOR F2F Monitoring at CERN Miguel Coelho dos Santos.
ATLAS FroNTier cache consistency stress testing David Front Weizmann Institute 1September 2009 ATLASFroNTier chache consistency stress testing.
0/8 HyperNews for ATLAS Status and expectations Applications Area meeting, February 1, 2006 Traudl Kozanecki.
Platform & Engineering Services CERN IT Department CH-1211 Geneva 23 Switzerland t PES AI Images, flavours and partitions Vítor Gouveia,
Platform & Engineering Services CERN IT Department CH-1211 Geneva 23 Switzerland t PES Improving resilience of T0 grid services Manuel Guijarro.
2-December Offline Report Matthias Schröder Topics: Monte Carlo Production New Linux Version Tape Handling Desktop Computers.
CERN IT Department CH-1211 Genève 23 Switzerland t Bamboo users meeting IT-CS-CT.
Platform & Engineering Services CERN IT Department CH-1211 Geneva 23 Switzerland t PES Agile Infrastructure Project Overview : Status and.
CommVault Architecture
CERN IT Department CH-1211 Genève 23 Switzerland t DPM status and plans David Smith CERN, IT-DM-SGT Pre-GDB, Grid Storage Services 11 November.
CERN IT Department CH-1211 Genève 23 Switzerland M.Schröder, Hepix Vancouver 2011 OCS Inventory at CERN Matthias Schröder (IT-OIS)
E-ISuite Incident Business Workshop May 10, Implementation Review 2016 News and Updates.
Platform & Engineering Services CERN IT Department CH-1211 Geneva 23 Switzerland t PES GIT Service in the Agile Infrastructure Project Vítor.
CERN IT Department CH-1211 Genève 23 Switzerland PES Version control services at CERN Status of Version Control and Twiki services at CERN.
How to Contribute to System Testing and Extract Results
CONFIGURING A MICROSOFT EXCHANGE SERVER 2003 INFRASTRUCTURE
Building Scalable Ignition Enterprise Architectures
Windows 7 deployment at CERN
Software Version System Part1: Subversion at CERN
Distributed System Structures 16: Distributed Structures
AFS Server Performance Comparisons
Presentation transcript:

CERN IT Department CH-1211 Genève 23 Switzerland PES SVN User Forum David Asbury Alvaro Gonzalez Alvarez Pawel Kacper Zembrzuski 16 April 2010

CERN IT Department CH-1211 Genève 23 Switzerland PES Agenda for Today  Welcome  CERN IT Reorganisation  SVN Client Versions  Status of Service, Migration to SVN  Current Efforts  Performance  Questions SVN User Forum 216 April 2010

CERN IT Department CH-1211 Genève 23 Switzerland PES CERN IT Reorganisation  Jan 2010, most IT groups changed  CVS & SVN now in IT/PES group Product and Engineering Support Previous experts now in DB group  CVS & SVN now 3 people David 80%, Alvaro 80%, Pawel 100% 2 people after September 2010 SVN User Forum 316 April 2010

CERN IT Department CH-1211 Genève 23 Switzerland PES SVN Client Versions  SVN Server version is 1.5  SVN client on lxplus is 1.4 (ok with server) SLC4 has client 1.4.4, SLC5 has ok Problem when use later major client version then return to lxplus  Want lxplus version = SVN server version  Must still be careful with versions elsewhere SVN User Forum 416 April 2010

CERN IT Department CH-1211 Genève 23 Switzerland PES Incidents and Support  March 2010: adding new SVN server Unexpected reordering of CDB templates  Selected by load balancing, but login failed   Full support during CERN working hours  Best-efforts basis outside this SVN User Forum 516 April 2010

CERN IT Department CH-1211 Genève 23 Switzerland PES Status of the Service  Projects: CVS ~300, SVN ~450  Want to end LCGCVS by end 2010 Difficult to support, several disadvantages  Much work to move CVS to SLC5  SVN has many small projects More efficient for performance, management  TRAC uses NAS disk system (DB group) SVN User Forum 616 April 2010

CERN IT Department CH-1211 Genève 23 Switzerland PES CVS Projects SVN User Forum 716 April 2010

CERN IT Department CH-1211 Genève 23 Switzerland PES SVN Projects SVN User Forum 816 April 2010

CERN IT Department CH-1211 Genève 23 Switzerland PES Current Efforts  Handling daily problems and questions  Performance studies - important  More servers on SVN for performance Added 3 more servers, already better  Move CVS to SLC5 if not stopped (major)  TRAC plugins being tested /SVNFeatureRequesthttps://twiki.cern.ch/twiki/bin/viewauth/DESgroup /SVNFeatureRequest  Try to get Helpdesk to handle more queries  Very limited manpower for clients! SVN User Forum 916 April 2010

CERN IT Department CH-1211 Genève 23 Switzerland PES Performance: CVS v SVN  SVN is the future, so effort will be there  Want redundancy so AFS is an advantage LCGCVS uses local disks  CVS slow as it writes lock files into the directory at check-out  SVN writes into a lower directory  So SVN benefits much more than CVS from load-sharing across multiple servers  SVN also offers repository protection SVN User Forum 1016 April 2010

CERN IT Department CH-1211 Genève 23 Switzerland PES Redundant Server Model SVN User Forum 1116 April 2010

CERN IT Department CH-1211 Genève 23 Switzerland PES Performance Studies (1)  Most daily activity happens 2200 to ~0100  Looking at whole chain from file system to client  AFS volume placement, splitting  Network  CVS/SVN server memory, disk setup, AFS cache configuration SVN User Forum 1216 April 2010

CERN IT Department CH-1211 Genève 23 Switzerland PES Performance Studies (2)  Tests checking-out AFS volume on SSD Local disks in LCGCVS: ~22 mins AFS volume on SSD: ~31 mins AFS volume on normal disk: ~40 mins  Impact on which machines to retire soon Must retire some CVS servers soon (warranty)  Impact on new machine configurations SVN User Forum 1316 April 2010

CERN IT Department CH-1211 Genève 23 Switzerland PES Suggestions and Questions  to  Don’t expect instant replies! SVN User Forum 1416 April 2010