Update On Scientific Linux Connie Sieh Pat Riehecky Hepix Spring 2013.

Slides:



Advertisements
Similar presentations
Configuration management
Advertisements

Software change management
Configuration management
GHOST glibc gethostbyname() Vulnerability CVE Johannes B. Ullrich, Ph.D. SANS Technology Institute
Fedora Linux Fedora: the (somewhat) new Linux distribution on the block. To switch or not to switch? Moreover, why use it at all? And, what is its target?
1 Web Server Administration Chapter 3 Installing the Server.
Manuka project IEEE IA Workshop June 10, Agenda Introduction Inspiration to Solution Manuka Use SE Approach Conclusion.
Background Info The UK Mirror Service provides mirror copies of data and programs from many sources all over the world. This enables users in the UK to.
Apache : Installation, Configuration, Basic Security Presented by, Sandeep K Thopucherela, ECE Department.
Cambodia-India Entrepreneurship Development Centre - : :.... :-:-
Mgt 240 Lecture Website Construction: Software and Language Alternatives March 29, 2005.
Installing software on personal computer
Va-scanCopyright 2002, Marchany Unit 3 – Installing Solaris Randy Marchany VA Tech Computing Center.
This chapter is extracted from Sommerville’s slides. Text book chapter
Installing and maintaining clusters of FreeBSD servers using PXE and Rsync Cor Bosman XS4ALL
Downloading & Installing Software Chapter 13. Maintaining the System Yum Pirut BitTiorrent Rpm Keeping Software Up To Date Up2date Red Hat Network Wget.
Linux Operations and Administration
1 Web Server Administration Chapter 3 Installing the Server.
SUSE Linux Enterprise Server Administration (Course 3037) Chapter 4 Manage Software for SUSE Linux Enterprise Server.
By: Paul Hill Technology Coordinator Gwinn Area Community Schools.
1 Guide to Novell NetWare 6.0 Network Administration Chapter 13.
5 Chapter Five Web Servers. 5 Chapter Objectives Learn about the Microsoft Personal Web Server Software Learn how to improve Web site performance Learn.
Implementation - Deployment Methods of deployment –User PC –Network shared (workstation install) –Terminal server –Web Deployment (ActiveX) (Note: this.
1 Web Server Administration Chapter 3 Installing the Server.
October, Scientific Linux INFN/Trieste B.Gobbo – Compass R.Gomezel - T.Macorini - L.Strizzolo INFN - Trieste.
 To explain the importance of software configuration management (CM)  To describe key CM activities namely CM planning, change management, version management.
Crawlers - Presentation 2 - April (Web) Crawlers Domain Presented by: Or Shoham Amit Yaniv Guy Kroupp Saar Kohanovitch.
FNAL System Patching Design Jack Schmidt, Al Lilianstrom, Andy Romero, Troy Dawson, Connie Sieh (Fermi National Accelerator Laboratory) Introduction FNAL.
Guide to Linux Installation and Administration, 2e1 Chapter 2 Planning Your System.
Guide to Linux Installation and Administration, 2e1 Chapter 10 Managing System Resources.
Scientific Linux Infrastructure Changes Connie Sieh Pat Riehecky Hepix Fall 2012 Oct 15, 2012.
1 / 22 AliRoot and AliEn Build Integration and Testing System.
Security monitoring boxes Andrew McNab University of Manchester.
Deploying a Network of GNU/Linux Clusters with Rocks / Arto Teräs Slide 1(18) Deploying a Network of GNU/Linux Clusters with Rocks Arto Teräs.
Kickstart Installation
What is a port The Ports Collection is essentially a set of Makefiles, patches, and description files placed in /usr/ports. The port includes instructions.
PerfSONAR-PS Functionality February 11 th 2010, APAN 29 – perfSONAR Workshop Jeff Boote, Assistant Director R&D.
1 Chapter 12 Configuration management This chapter is extracted from Sommerville’s slides. Text book chapter 29 1.
Chapter 8: Installing Linux The Complete Guide To Linux System Administration.
Cscape EnvisionFX Horner APG, LLC March 7, EnvisionFX - What Does it Do? Graphical interface allows easy transfers of data to and from the PC and.
Performance Testing Test Complete. Performance testing and its sub categories Performance testing is performed, to determine how fast some aspect of a.
SPI NIGHTLIES Alex Hodgkins. SPI nightlies  Build and test various software projects each night  Provide a nightlies summary page that displays all.
GP 2015 Client Event. Management Reporter As of 5/1/2015 the most recent version of MR is 2012 Cumulative Update 12. Mainstream Support for FRx 6.7 ended.
SCD Monthly Projects Meeting 2014 Scientific Linux Update Rennie Scott January 14, 2014.
Aaron Corso COSC Spring What is LAMP?  A ‘solution stack’, or package of an OS and software consisting of:  Linux  Apache  MySQL  PHP.
The EPIKH Project (Exchange Programme to advance e-Infrastructure Know-How) 马兰馨 IHEP, CAS Setting Up a Repository.
Chapter 7: Using Network Clients The Complete Guide To Linux System Administration.
Scientific Linux Inventory Project (SLIP) Troy Dawson Connie Sieh.
Scientific Linux Connie Sieh CSAM Meeting May 2, 2006.
FermiLinux STS Scientific Linux 6 Connie Sieh HEPIX Spring 2009 May 25, 2009.
Update On Scientific Linux Troy Dawson HEPIX Spring 2010 April 21, 2010.
Update On Scientific Linux Connie Sieh Hepix Spring 2012 April 25, 2012.
MirrorManager: The Fedora Mirror System Matt Domsch Fedora Mirror Wrangler Linux Technology Strategist Office of the CTO Dell, Inc.
Update On Scientific Linux Connie Sieh Hepix Fall 2011 October 24, 2011.
Customizing Fedora Jeroen van Meeuwen Fedora Project.
New Tools Used by the Scientific Linux Team
Architecture Review 10/11/2004
Red hat Installation 2 Live CD.
Ideas and Challenges on testing a routing protocol
Update On Scientific Linux
Update On Scientific Linux
Introduction to CVMFS A way to distribute HEP software on cloud
Spacewalk and Koji at Fermilab
More Scripting & Chapter 11
Networking for Home and Small Businesses – Chapter 2
System And Application Software
Chapter 2: The Linux System Part 1
IS3440 Linux Security Unit 7 Securing the Linux Kernel
Networking for Home and Small Businesses – Chapter 2
Operating Systems Networking for Home and Small Businesses – Chapter 2 – Introduction To Networking.
Presentation transcript:

Update On Scientific Linux Connie Sieh Pat Riehecky Hepix Spring 2013

Scientific Linux Presentation Overview – The last six months – What we are currently working on – What we see in the future – Topics for conversation

Scientific Linux Past Six Months The following statistics were gathered from ftp.scientificlinux.org log files ftp.scientificlinux.org These numbers are a minimum. We know that the real numbers are higher. The values we have are based on yum downloads of security errata We currently have 80 public mirrors. These statistics do not represent any of the mirror sites. Vertical axis represents “number of unique ip addresses” Horizontal axis is time

Scientific Linux Past 14 Months

Scientific Linux Past Six Months SL 5.9 released February 2013 – We decided to treat it more like SL 6 Doesn't automatically integrate fastbugs or security errata into the main tree Packages will be available as always, but in the security/fastbugs repo where they belong – Defaults to 5x yum conf, formerly yum-conf-59 – Ndiswrapper removed as does not compile, available via elrepo – Closed source Java 6 now at “End of Life” so not included in SL 5.9

Scientific Linux Past Six Months SL 6.4 released – March 2013 – y um-conf-6x is now the default – openafs kernel module changed – created addons repo – created external_products repo – updateinfo.xml suppport

Scientific Linux Past Six Months SL Live 6.4 expected release – April 2013 – Web site is at – For i386 and x86_64 – CD, DVD, mini-CD – Uses anaconda to install to a hard drive – Liveusb-creator makes it trivial to create a LiveUSB from the CD/DVD images. – LiveCD-tools makes it easier for people to create their own LiveCD – tools moved from main tree to addons

Scientific Linux Past Six Months OpenAFS and SL 6.3/SL 6.4 – There is an issue with the AFS cache Read/Write may fail, hang, or be very slow. – If your cache is on EXT4 and was in use on a previous kernel (before el6) and your system is 32-bit. If you update to a kernel >= el6 you may be affected. – See for a good detailed descriptionhttps://lwn.net/Articles/544520/

Scientific Linux Past Six Months OpenAFS and SL 6.3/SL 6.4 – Problem resolved in this manner: kmod-openafs is now a noarch – It depends on current kmod-openafs- and one version back, this provides yum downgrade support – for 6.4 it depends on kmod-openafs-279(SL 6.3) and kmod-openafs-358(SL 6.4 ) – A tweaked /sbin/weak-modules » only lets the 6.3 kmod load in 6.3 series kernels same with 6.4 Added /etc/init.d/afs purgecache to clean bad caches. --ONLY RUN THIS WHEN YOU KNOW YOU NEED IT Thanks to Stephan Wiesand of DESY for this work

Scientific Linux Past Six Months SL 6.4 addons repo – live-creator was moved from SL main tree Urs live cd tools – pssh parallel OpenSSH client with good reporting – python-rpmpatch script to automate patching rpms – python-Updateinfo tools to create updateinfo.xml – revisor was moved from SL main tree compose tool for SL – zfs via GE

Scientific Linux Past six months SL 6.4 external_products repo – Red Hat Developer Toolset 1.0 and 1.1 Newer compilers Installed in parallel with existing compilers Power users can have the latest gcc/g++ Invoked via 'scl' (software collection) see nUS/Red_Hat_Developer_Toolset/1/html/User_ Guide/index.html

Scientific Linux SL updateinfo.xml is available now for SL 6.4 – This provides metadata for yum-plugin-security Provides for easy CVE search Provides a description of the update, typically with reasons for applying the update Allows filtering based on severity Currently only security errata – See example on next slide Metadata nicely formatted via http interface

Scientific Linux

]# yum info-sec ============================================== Security ERRATA Important: openjpeg on SL6.x i386/x86_64 ============================================== Update ID : SLSA-2012: Release : Scientific Linux Type : security Status : final Issued : Bugs : openjpeg: heap-based buffer overflow CVEs : CVE Description : OpenJPEG is an open source library for reading and writing image : files in JPEG 2000 format. It was found that OpenJPEG failed to : sanity-check an image header field before using it. A remote attacker : could provide a specially-crafted image file that could cause an : application linked against OpenJPEG to crash or, possibly, execute : arbitrary code. (CVE ). All running applications : using OpenJPEG must be restarted for the update to take effect. Severity : important

Scientific Linux The Past Six Months Security updates continually released for all supported versions – SL 6.4 security repo now supports updateinfo.xml Fastbugs updates consistently released weekly for latest versions of SL 5 and SL 6

Scientific Linux The Past Six Months Security updates continually released for all supported versions – SL 6.4 security repo now supports updateinfo.xml Fastbugs updates consistently released weekly for latest versions of SL 5 and SL 6

Scientific Linux Distribution Servers Old model

Scientific Linux Distribution Servers Old shortcomings – Some systems are overloaded while others are underutilized – Single system outages significantly impact the user community – Adding new systems requires changes to yum repos or removing existing systems – Existing systems are getting old – 1 x 1GB ethernet interface used

Scientific Linux Distribution Servers New model

Scientific Linux Distribution Servers New model added benefits – Systems should be equally utilized, no one system will carry all the weight – Single system outages should be transparent – Additional systems can be added or removed without interfering with the community – More physically distributed Currently the distribution servers are in one room With the new plan the systems are in multiple data centers – Newer hardware More memory 2 x 1GB ethernet interfaces used – 1 BlueArc Backing store, 1 to internet

Scientific Linux Distribution Servers Still under investigation – Caching The actual distribution files are kept on an NFS share and provided to each distribution server. – This may be a large performance bottleneck as files must always be fetched from the share. – Researching mirrorbrain redirects to mirrors based on config settings allows for us to still get statistics offloads to local mirrors

Scientific Linux Distribution Servers Caching – Squid Pros – Proven track record – Lots of local expertise Cons – HTTP only, can't accelerate ftp or rsync – Requires http source to cache from – fscached, does it work? Pros – Accelerates all protocols – Trivial configuration Cons – Technology Preview – Not a lot of history, unknown future

Scientific Linux What we see in the future Continue to have security updates for all releases of SL 5 and 6. Continue to have fastbug updates for only the latest releases of SL 5 and 6.

Scientific Linux Discussion topics SL 7 – expected 2013 – Default to 7x rather than 7.0, 7.1, et al. – Plan on supporting UEFI Secure Boot via “Fedora Method” as expected to be RHEL 7 method – Point releases? Yes – contains lots of long term maintenance concerns, and possible errata issues No – is different than we've done things before Discuss on scientific-linux-devel

Scientific Linux Discussion / Questions Discussion Other Questions?

Scientific Linux References Red_Hat_Developer_Toolset/1/pdf/User_Guide/ Red_Hat_Developer_Toolset-1-User_Guide-en-US.pdf