High Performance Storage System

Slides:



Advertisements
Similar presentations
Andrew Hanushevsky7-Feb Andrew Hanushevsky Stanford Linear Accelerator Center Produced under contract DE-AC03-76SF00515 between Stanford University.
Advertisements

NGAS – The Next Generation Archive System Jens Knudstrup NGAS The Next Generation Archive System.
Networking Essentials Lab 3 & 4 Review. If you have configured an event log retention setting to Do Not Overwrite Events (Clear Log Manually), what happens.
Chapter 20 Oracle Secure Backup.
Serverless Network File Systems. Network File Systems Allow sharing among independent file systems in a transparent manner Mounting a remote directory.
Introduction to the new mainframe © Copyright IBM Corp., All rights reserved. Chapter 2: z/OS Overview.
Deploying Servers Installing Windows Server 2008
NHSmail: Technology Refresh 26 th February 2008 Mike Dolan NHSmail Migration Manager.
Lesson 18 – INSTALLING AND SETTING UP WINDOWS 2000 SERVER.
Jaap Wesselius May 27, 2009 Exchange Server 2010 what’s new?
What is it? Hierarchical storage software developed in collaboration with five US department of Energy Labs since 1992 Allows storage management of 100s.
Nationwide Database Operations Team Database Software Currency Using EM 12c Provisioning and Patching Gary Henderson.
1 Andrew Hanushevsky - HEPiX, October 6-8, 1999 Mass Storage For BaBar at SLAC Andrew Hanushevsky Stanford.
Introduction to the new mainframe: Large-Scale Commercial Computing © Copyright IBM Corp., All rights reserved. Chapter 6: Accessing large amount.
Agenda  Overview  Configuring the database for basic Backup and Recovery  Backing up your database  Restore and Recovery Operations  Managing your.
What are your questions and feedback? What happens when there is change or a service incident? What is the Service Health Dashboard? What is our communications.
Empower Hyper-V Improved Manageability Improved Manageability Continue Simplification Mission Expand Cluster Validation Flexible Migrations.
Migration XenDesktop 7. © 2013 Citrix | Confidential – Do Not Distribute Migration prerequisites Set up a XenDesktop 7 Site, including the site database.
Experiences Deploying Xrootd at RAL Chris Brew (RAL)
DMF Configuration for JCU HPC Dr. Wayne Mallett Systems Manager James Cook University.
1 © 2003, Cisco Systems, Inc. All rights reserved. CCNA 3 v3.0 Module 6 Switch Configuration.
1 © 2003, Cisco Systems, Inc. All rights reserved. CCNA 3 v3.0 Module 6 Switch Configuration.
SafeNet Protects Data at Rest
Chapter 8 Implementing Disaster Recovery and High Availability Hands-On Virtual Computing.
Issues in Milan Two main problems (details in the next slides): – Site excluded from analysis due to corrupted installation of some releases (mainly )
Real Time Monitor of Grid Job Executions Janusz Martyniak Imperial College London.
Summary of 1 TB Milestone RD Schaffer Outline : u Goals and assumptions of the exercise u The hardware constraints u The basic model u What have we understood.
20-22 September 1999 HPSS User Forum, Santa Fe CERN IT/PDP 1 History  Test system HPSS 3.2 installation in Oct 1997 IBM AIX machines with IBM 3590 drives.
Write-through Cache System Policies discussion and A introduction to the system.
Copyright © 2002 Legato Systems, Inc. Version: 1.0 Author: Shu-na Chu Doc d1795 Version: 1.0 Author: Shu-na Chu Doc d1795 8/11/2005 Legato Confidential.
1 GCA Application in STAR GCA Collaboration Grand Challenge Architecture and its Interface to STAR Sasha Vaniachine presenting for the Grand Challenge.
Owen SyngeTitle of TalkSlide 1 Storage Management Owen Synge – Developer, Packager, and first line support to System Administrators. Talks Scope –GridPP.
Test Results of the EuroStore Mass Storage System Ingo Augustin CERNIT-PDP/DM Padova.
CREAM: ALICE Experience WLCG GDB Meeting, CERN 11th November 2009 Stefano Bagnasco (INFN-Torino), Jean-Michel Barbet (Subatech), Latchezar Betev (ALICE),
1 Status of HPSS New Features, Requirements, and Installations Otis Graf IBM Global Services - Federal Houston, Texas October 1999.
Online Monitoring for the CDF Run II Experiment T.Arisawa, D.Hirschbuehl, K.Ikado, K.Maeshima, H.Stadie, G.Veramendi, W.Wagner, H.Wenzel, M.Worcester MAR.
5 Copyright © 2009, Oracle. All rights reserved. Configuring Essbase Server.
Accounting in DataGrid HLR software demo Andrea Guarise Milano, September 11, 2001.
CERN IT Department CH-1211 Genève 23 Switzerland t The Tape Service at CERN Vladimír Bahyl IT-FIO-TSI June 2009.
An Introduction to GPFS
Recovering deleted files from HPSS Pierre-Emmanuel Brinette.
High Performance Storage System (HPSS) Jason Hick Mass Storage Group HEPiX October 26-30, 2009.
MindMajix IBM AIX TrainingIBM AIX Training. Introduction to IBM AIX IBM AIX IBM Advanced Interactive executive is an open-standards-based UNIX OS designed.
Jean-Philippe Baud, IT-GD, CERN November 2007
Integrating Disk into Backup for Faster Restores
Dinesh Rawat , Software Test Manager
Enrico Fattibene CDG – CNAF 18/09/2017
Chapter 2: System Structures
Luca dell’Agnello INFN-CNAF
Generator Services planning meeting
Testing Metrics Building Confidence Before Go-Live
HEPiX Fall 2017 CERN project Follow-up
Ákos Frohner EGEE'08 September 2008
The INFN Tier-1 Storage Implementation
C VCE
Storage Virtualization
Acutelearn Technologies Tivoli Storage Manager(TSM) Training Tivoli Storage Manager Basics: Tivoli Storage Manager Overview Tivoli Storage Manager concepts.
Kirill Lozinskiy NERSC Storage Systems Group
Newness and Coolness in Configuration MANAGER
11/23/2018 3:03 PM © Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN.
Moodle Scalability What is Scalability?
Internal QA in Open Source Development
IT and Development support services
Microsoft Core Storage Update
Prepared by Jaroslav makovski
Backup Monitoring – EMC NetWorker
Backup Monitoring – EMC NetWorker
Any Data, Anytime, Anywhere
Chapter 2: Operating-System Structures
Presentation transcript:

High Performance Storage System HPSS Development Status 8 March, 2017 Copyright © IBM 2016 Slide Number 1

7.5.1 Installed Status Open LLNL is on 7.5.1 now (post-QREP) Very smooth upgrade after QREP Some Core Server Issues with workarounds or local mods in place (and pending release in 7.5.1p1) Closed LLNL is in replication waiting for the Open LLNL to prove stable over a longer period LANL is preparing for 7.5.1 conversion via QREP Several other HPSS installations at 7.5.1 for test, but not production yet Copyright © IBM 2016 Slide Number 2

7.5.1p1 Release 7.5.1p1 Planned release end of March, 2017 Key Contents DB2 10.5 and DB2 11 Apply fixes for production issues found at LLNL and elsewhere Improve server stability Improved POSIX compliance SCSI PVR change to recognize 'ENODEV' condition SCSI PVR improvements for more efficient inventory ppc64le support Copyright © IBM 2016 Slide Number 3

7.5.1p2 Release 7.5.1p2 Planned release end of September, 2017 Still being planned Copyright © IBM 2016 Slide Number 4

7.5.2 Development Development Began 8/1/16 Planned Release 1Q 2018 Content Metrics 15 CRs planned (See list to follow) 55 unique 'enhancements', includes things like Internal software quality improvement Improvements to Recover Quaid enhancements based on feedback lbp_verify enhancements based on feedback Support for O_EXCL-specific behaviors 110 bug fixes Copyright © IBM 2016 Slide Number 5

7.5.2 Dev/Test Milestone Process Working this release in several iterations (milestones) Get features to the test team sooner Test team runs one milestone back from development Get feedback and bug reports sooner Currently there are 4 planned milestones Roughly every 3 months Iterative process is helping us avoid a Big Test Cycle at the end of development like we had for 7.5.1 Copyright © IBM 2016 Slide Number 6

7.5.2 Planned Contents Release 7.5.2 New since HUF 2016 Subsystem Limits via API (CR 369) Current / Maximum values for open files, connections, etc. Core Server UDA / XML limits Allow Recover to take advantage of TOR (Bug 4859) Improvement to performance of Recover on sparse tape Remove open file table limit for Client API (Bug 6333) Prior limit was 4096 open files, now configurable lbp_verify maps block comparison failures onto file names (Bug 6473) Copyright © IBM 2016 Slide Number 7

7.5.2 Planned Contents (Cont) Release 7.5.2 Performance and Scalability Run DB2 on non-Core System (CR 386) PFTP support for Tape Order Recall (CR 357) Use file system as HPSS device (CR 379) Balanced Disk Purge (Bug 2617) Monitoring Syslog-based HPSS logging (CR 375) New log type: INFO (CR 349) Log stage performance metrics (CR 320) Provide more PVR and VV information in PVL Job Request Copyright © IBM 2016 Slide Number 8

7.5.2 Planned Contents (Cont) Release 7.5.2 Recover Improve Recover data analysis performance (Bug 5306) Improve Recover workflow (Bugs 5308 & 5523) Administration and Control Job Control and I/O Abort (CRs 183 & 280) Real-time Disk Ownership (CR 310) Aggregation Group Migration Candidates by Parent Directory (CR 376) Improve Aggregate Stage Performance (CR 270) Improve Sparse Repack Performance (CR 397) Copyright © IBM 2016 Slide Number 9