IDC HPC User Forum Panasas Update April 5, 2011 Houston, TX.

Slides:



Advertisements
Similar presentations
Disruption (and Recovery) of the ISP Business Model with IPv4 Depletion PTC12 15 January 2012 John Curran President and CEO, ARIN.
Advertisements

PRESENTATION TITLE GOES HERE Introduction to NFS v4 and pNFS David Black, SNIA Technical Council, EMC slides by Alan Yoder, NetApp with thanks to Michael.
Content Aggregation & Distribution: Abbotts Custom Solution Dawn Lynn Research Information Scientist, Abbott Labs.
Tom Hamilton – America’s Channel Database CSE
The Linux Storage People Simple Fast Massively Scalable Network Storage Coraid EtherDrive ® Storage.
Windows IT Pro magazine Datacenter solution with lower infrastructure costs and OPEX savings from increased operational efficiencies. Datacenter.
© 2006 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice HP Simply StorageWorks Roadshow.
NAS vs. SAN 10/2010 Palestinian Land Authority IT Department By Nahreen Ameen 1.
Cloud Computing: Theirs, Mine and Ours Belinda G. Watkins, VP EIS - Network Computing FedEx Services March 11, 2011.
PNFS, 61 th IETF, DC1 pNFS: Requirements 61 th IETF – DC November 10, 2004.
PNFS Update Sorin Faibish, EMC. pNFS Update Outline What is pNFS? pNFS Timeline Standards Status Industry Support pNFS EMC Status.
Network-Attached Storage
Using Samba with a Commercial Clustered File System.
2 June 2015 © Enterprise Storage Group, Inc. 1 The Case for File Server Consolidation using NAS Nancy Marrone Senior Analyst The Enterprise Storage Group,
NWfs A ubiquitous, scalable content management system with grid enabled cross site data replication and active storage. R. Scott Studham.
How to Cluster both Servers and Storage W. Curtis Preston President The Storage Group.
Module – 7 network-attached storage (NAS)
Data Storage Willis Kim 14 May Types of storages Direct Attached Storage – storage hardware that connects to a single server Direct Attached Storage.
Network File System (NFS) in AIX System COSC513 Operation Systems Instructor: Prof. Anvari Yuan Ma SID:
Windows ® Powered NAS. Agenda Windows Powered NAS Windows Powered NAS Key Technologies in Windows Powered NAS Key Technologies in Windows Powered NAS.
Storage Area Networks The Basics. Storage Area Networks SANS are designed to give you: More disk space Multiple server access to a single disk pool Better.
Object-based Storage Long Liu Outline Why do we need object based storage? What is object based storage? How to take advantage of it? What's.
FLIP Architecture & Requirements Roger Cummings Symantec
CSC 456 Operating Systems Seminar Presentation (11/13/2012) Leon Weingard, Liang Xin The Google File System.
Almaden Rice University Nache: Design and Implementation of a Caching Proxy for NFSv4 Ajay Gulati, Rice University Manoj Naik, IBM Almaden Renu Tewari,
SGI Proprietary SGI Update IDC HPC User Forum September, 2008.
pNFS extension for NFSv4 IETF 61 November, 2004
Buffalo Data Storage Expansion June As organizations grow the amount of data storage capacity required to support it grows as well Increased data.
IDC HPC User Forum Update APRIL 16, 2012 PANASAS PRODUCT MARKETING.
Microsoft Active Directory(AD) A presentation by Robert, Jasmine, Val and Scott IMT546 December 11, 2004.
October 2, 2015 pNFS extension for NFSv4 IETF-62 March 2005 Brent Welch
Chapter 5 Section 2 : Storage Networking Technologies and Virtualization.
Latest Relevant Techniques and Applications for Distributed File Systems Ela Sharda
Tag line, tag line NetApp HPC Update 28 th HPC User Forum April 2008 Norfolk, Virginia.
Large Scale Test of a storage solution based on an Industry Standard Michael Ernst Brookhaven National Laboratory ADC Retreat Naples, Italy February 2,
Storage Tank in Data Grid Shin, SangYong(syshin, #6468) IBM Grid Computing August 23, 2003.
Large Scale Parallel File System and Cluster Management ICT, CAS.
PNFS BOF FAST Sorin Faibish, EMC Mike Eisler, NetApp Brent Welch, Panasas Piyush Shivam, Sun Microsystems.
1 Public DAFS Storage for High Performance Computing using MPI-I/O: Design and Experience Arkady Kanevsky & Peter Corbett Network Appliance Vijay Velusamy.
Introducing ULTAMUS TM RAID. The Need for Storage Immediate Accessibility Limited IT Staff Budget Constraints Data Growth Security Levels Retention Characteristics.
NA-MIC National Alliance for Medical Image Computing UCSD: Engineering Core 2 Portal and Grid Infrastructure.
Continuous Availability
High Performance Storage Solutions April 2010 Larry Jones VP, Product Marketing.
ISCSI. iSCSI Terms An iSCSI initiator is something that requests disk blocks, aka a client An iSCSI target is something that provides disk blocks, aka.
PNFS Birds-of-Feather FAST 2010: February 24 Sorin Faibish, EMC and pNFS friends.
First Look at the New NFSv4.1 Based dCache Art Kreymer, Stephan Lammel, Margaret Votava, and Michael Wang for the CD-REX Department CD Scientific Computing.
25 April Unified Cryptologic Architecture: A Framework for a Service Based Architecture Unified Cryptologic Architecture: A Framework for a Service.
To provide the world with a next generation storage platform for unstructured data, enabling deployment of mobile applications, virtualization solutions,
STORAGE ARCHITECTURE/ MASTER): Where IP and FC Storage Fit in Your Enterprise Randy Kerns Senior Partner The Evaluator Group.
AFS/OSD Project R.Belloni, L.Giammarino, A.Maslennikov, G.Palumbo, H.Reuter, R.Toebbicke.
PNFS State of the Union Update HECFSIO – August 10, 2011 Sorin Faibish- EMC, Peter Honeyman - CITI.
Tackling I/O Issues 1 David Race 16 March 2010.
Red Hat Enterprise Linux Presenter name Title, Red Hat Date.
An Introduction to GPFS
GPFS Parallel File System
Extreme Scale Infrastructure
Storage Area Networks The Basics.
Video Security Design Workshop:
iSCSI Storage Area Network
Direct Attached Storage and Introduction to SCSI
Legacy NFS provides sharing, but does not scale
Large Scale Test of a storage solution based on an Industry Standard
Direct Attached Storage and Introduction to SCSI
XenData SX-550 LTO Archive Servers
Scalable SoftNAS Cloud Protects Customers’ Mission-Critical Data in the Cloud with a Highly Available, Flexible Solution for Microsoft Azure MICROSOFT.
Storage & Backup Solution Update
Bev Crair Engineering Manager Sun Microsystems, Inc.
PNFS Block Status - EMC.
Factors Driving Enterprise NVMeTM Growth
Presentation transcript:

IDC HPC User Forum Panasas Update April 5, 2011 Houston, TX

Panasas Focused on Growth within HPC Markets Strong Financial Position Five consecutive years of revenue growth 42% revenue growth in FY10, year-over-year Loyal, Brand Name Customers >75% repeat buyers Global Presence >300 active customers in over 50 countries Expecting 50% Headcount Increase in 2011 Worldwide support with over 25 global resellers

Panasas® PAS 12 Hardware 4U chassis (eleven blades) houses up to 40TB of storage at 1.5GB/s performance throughput 10 chassis per standard 40U rack – 400TB/15GB/s per rack Blades are form, fit, function backward compatible – investment protection Performance Aggregate performance scales from 1.5GB/s to a staggering 150GB/s, the industry’s highest per gigabyte performance Capacity Expansion from 40TB to 4PB in 40TB increments Scalability Add blades, chassis, or entire racks, without system disruption, to extend performance and capacity. Additional capacity is self configured. Blades are managed in a global namespace and can be easily networked to create extremely large storage pools 3

Unprecedented Performance and Scale with Parallel Architecture

Why a Standard for Parallel I/O? NFS is the only network file system standard Proprietary file systems have unique advantages, but aren’t right for everyone NFS widens the playing field Panasas, IBM, EMC want to bring their experience in large scale, high-performance file systems into the NFS community Sun/Oracle and NetApp want a standard HPC solution Broader market benefits vendors More competition benefits customers What about open source NFSv4 Linux client is very important for NFSv4 adoption, and therefore pNFS Still need vendors that are willing to do the heavy lifting required in quality assurance for mission critical storage

NFSv4 and pNFS NFS originally created in ’80s to share data among engineering workstations NFSv3 widely deployed NFSv4 several years in the making Integrated Kerberos (or PKI) user authentication Integrated File Locking and Open Delegations (stateful server!) ACLs (hybrid of Windows and POSIX models) Official path to add (optional) extensions NFSv4.1 adds even more pNFS for parallel I/O Directory Delegations for efficiency RPC Sessions for robustness, better RDMA support

pNFS: Standard Storage Clusters pNFS is an extension to the Network File System v4 protocol standard Allows for parallel and direct access From Parallel Network File System clients To Storage Devices over multiple storage protocols Moves the NFS (metadata) server out of the data path pNFS Clients Block (FC) / Object (OSD) / File (NFS) Storage NFSv4.1 Server data metadata control

The pNFS Standard The pNFS standard defines the NFSv4.1 protocol extensions between the server and client The I/O protocol between the client and storage is specified elsewhere, for example: SCSI Block Commands (SBC) over Fibre Channel (FC) SCSI Object-based Storage Device (OSD) over iSCSI Network File System (NFS) The control protocol between the server and storage devices is also specified elsewhere, for example: SCSI Object-based Storage Device (OSD) over iSCSI Client Storage MetaData Server

pNFS Layouts Client gets a layout from the NFS Server The layout maps the file onto storage devices and addresses The client uses the layout to perform direct I/O to storage At any time the server can recall the layout Client commits changes and returns the layout when it’s done pNFS is optional, the client can always use regular NFSv4 I/O Clients Storage NFSv4.1 Server layout

pNFS Client Common client for different storage back ends Wider availability across operating systems Fewer support issues for storage vendors Client Apps Layout Driver pNFS Client pNFS Server Cluster Filesystem 1. SBC (blocks) 2. OSD (objects) 3. NFS (files) 4. PVFS2 (files) 5. Future backend… Layout metadata grant & revoke NFSv4.1

Key pNFS Participants Panasas (Objects) ORNL and ESSC/DoD funding Linux pNFS development Network Appliance (Files over NFSv4) IBM (Files, based on GPFS) BlueArc (Files over NFSv4) EMC (Blocks, HighRoad MPFSi) Sun/Oracle (Files over NFSv4) U of Michigan/CITI (Linux maint., EMC and Microsoft contracts) DESY – Java-based implementation

pNFS Standard Status IETF approved Internet Drafts in December 2008 RFCs for NFSv4.1, pNFS-objects, and pNFS-blocks published January 2010 RFC Network File System (NFS) Version 4 Minor Version 1 Protocol RFC Network File System (NFS) Version 4 Minor Version 1 External Data Representation Standard (XDR) Description RFC Parallel NFS (pNFS) Block/Volume Layout RFC Object-Based Parallel NFS (pNFS) Operations 12

pNFS Implementation Status NFSv4.1 mandatory features have priority RPC session layer giving reliable at-most-once semantics, channel bonding, RDMA Server callback channel Server crash recovery Other details EXOFS object-based file system (file system over OSD) In kernel module since (2008) Export of this file system via pNFS server protocols Simple striping (RAID-0), mirroring (RAID-1), and RAID-5 “Most stable and scalable implementation” Files (NFSv4 data server) implementation Open source server based on GFS Layout recall not required due to nature of underlying cluster file system Blocks implementation Server in user-level process, Ganesha/NFS support desirable Sponsored by EMC

Linux Release Cycle KernelMerge Window Date What’s New Mar 2009RPC sessions, NVSv4.1 server, OSDv2 rev5, EXOFS June 2009NFSv4.1 client, sans pNFS Sep server-side patches add back-channel Dec pNFS patches Feb NFS 4.1 patches May client and 1 server patch (4.1 support) Aug patches Nov 2010First chunk of pNFS beyond generic 4.1 infrastructure. Disabled for now. 2.6.xx pNFS patches including remaining files-based pNFS patches, object-based pNFS, block-based pNFS Then comes Linux distribution support…

A Few Predictions pNFS will be in production use in 2012, fully supported by major Linux distributions and by leading storage vendors (including Panasas) Proprietary protocols like DirectFlow will continue to provide higher performance and reliability advantages for some time as pNFS matures pNFS will see most of its early adoption within HPC, especially in NFS environments Storage systems leveraging pNFS objects will be the ones capable of delivering the highest parallel file system performance pNFS will eventually make parallel file systems commonplace