Presentation is loading. Please wait.

Presentation is loading. Please wait.

New approach to the design and deployment of storage Piotr Biskupski – IBM STG Poland IBM Forum 2012 – Estonia Tallinn, October 9, 2012.

Similar presentations

Presentation on theme: "New approach to the design and deployment of storage Piotr Biskupski – IBM STG Poland IBM Forum 2012 – Estonia Tallinn, October 9, 2012."— Presentation transcript:

1 New approach to the design and deployment of storage Piotr Biskupski – IBM STG Poland IBM Forum 2012 – Estonia Tallinn, October 9, 2012

2 22 …while dealing with constraints like a flat budget. And respond to demands for new services… Internet connected devices 22B in 2020 (24.9% CAGR) 31.9 million servers worldwide Since 2000 security vulnerabilities grew eightfold The volume of digital content, up 48% from 2011, is expected to reach 2.7 ZB (1ZB = 1 billion terabytes) in 2012 and 8ZB by Data centers have doubled energy use in past 5 years Real-time analytics workloads growing 13% CAGR with related server spend growing 3x average Collaborative software workloads growing 10% CAGR Last 10 years servers up 2X and virtual machines up 42% CAGR To realize the promise of a Smarter Planet, enterprises must address the IT challenges that have emerged.

3 IBM Storage is key to Smarter Computing Designed for data Storage Efficiency is essential to outpace data growth Storage Virtualization enables a robust cloud deployment Storage must adapt to changing information patterns Smarter Computing

4 Introducing IBM Smarter Storage for Smarter Computing Cloud Agile Efficient by Design Self-optimizing Increase information access and improve ROI Manage cost and capacity growth Improve performance and productivity

5 Efficient by Design Manage Cost and Capacity Growth Decreases Space Requirements Store more information in less space Supports non-IBM storage, savings throughout the data center Simplifies Administration Reduce complexity Automate tasks Efficiency for Active Workloads Efficiency for transaction processing, big data, clouds Not just for inactive data Benefits Reduce space requirements for active data up to 80% Save up to 47% in administrator time Reduce complexity by up to 30% Reduce Capital Expenses Reduce Operating Expenses

6 Self-optimizing Improve Performance and Productivity Analyzes and adapts Analyzes access patterns and adapts automatically Flash optimization makes high performance affordable Automates performance tuning Saves time, reduces errors and eliminates user disruption Easy to match critical workloads with performance features Analyze Big Data Fast Tuning and tiering are faster and more accurate Optimization is a continuous automated process Benefits Increase performance 3X with only 3% SSDs Reduce storage costs by 50% Optimize performance and cost Increase administrator productivity

7 Cloud Agile Adaptive Storage adapts easily to unpredictable workloads Data is automatically synchronized between facilities Automated Self-service provisioning Simpler and faster administration Deploy Clouds Faster Administrators manage far more capacity Leverage existing storage systems Benefits Reduce disk space needs by up to 50% Speed storage deployment up to 26% Improve application availability by 29% Increase Information Access and Improve ROI Increase Agility Increase productivity

8 Information Governance Cloud Agile SONAS and Storwize V7000 file storage virtualization (SoD) SONAS and Storwize V7000 ACE enables global file collaboration with multi-writer support (SoD) SONAS and Storwize V7000 Unified, cloud storage self-service service portal (SoD) Storwize V7000 support for Active Cloud Engine (SoD) XIV clustering (SoD) XIV Gen3 GTS Implementation Services Self-optimizing DS8000 Easy Tier extended to server based storage (SoD) DS8000 new high-density flash storage option (SoD) DS8000 Easy Tier support for application API (SoD) IBM SmartCloud Virtual Storage Center will introduce analytics-based storage tier recommendations and automation to migrate data to the right tier (SoD) Efficient by Design Real-time Compression integrated into Storwize V7000, SVC TPC improved GUI, enhanced reporting, tiering optimization, cloud support SONAS TPC support TPC now supports XIV/Storwize V7000 GUI ProtecTIER file protocol support Storwize V7000U real-time compression for file workloads (SoD) Tying IBM Smarter Storage to New Capabilities and Vision: June Cross-IBM Announcements and SoDs

9 IBM Smarter Storage Virtualization Thin Provisioning Compression RACE Easy Tier option: TPC for Disk Midrange Edition FlashCopy option: FlashCopy Manager Advanced copy services - Metro and/or Global Mirror option: TPC for Replication Active Cloud Engine

10 Storage virtualization SAN 95% capacity 50% capacity 25% capacity SVC / V % capacity

11 Virtualized strorage VM- machine Virtual DC… …no walls Storage virtualization with HA

12 Thin-provisioning Traditional (fully allocated) virtual disks use physical disk capacity for the entire capacity of a virtual disk even if it is not used With thin-provisioning, Storwize V70000 allocates and uses physical disk capacity when data is written Available at no additional charge with base virtualization license Support all hosts supported with traditional volumes and all advanced features (EasyTier, FlashCopy, etc.) Reclaiming Unused Disk Space –When using Volume Mirroring to copy from a fully-allocated volume to a thin-provisioned volume, Storwize V7000 will not copy blocks that are all zeroes –When processing a write request, Storwize V7000 detects if all zeroes are being written and does not allocate disk space for such requests in the thin-provisioned volumes Helps avoid space utilization concerns when formatting Volumes Done at Grain Level (32/64/128/256KiB) If grain contains all zeros dont write Without thin provisioning, pre-allocated space is reserved whether the application uses it or not With thin provisioning, applications can grow dynamically, but only consume space they are actually using Dynamic growth

13 A compressed Volume is a third type of volume – Regular (fully allocated) – Thin Provisioned (Space Efficient) – Compressed A compressed volume is a kind of Thin Provisioning – Compression supports all Thin Provisioning features (e.g. autoexpand) – Only uses physical storage to store the compressed version of the volume – Can be on back-end virtualized storage – Supported with CLI and GUI GUI also has a preset for compressed volumes Performance monitoring tab support for Compression CPU resource usage Compression operates at a volume copy level – Maximum of 200 compressed Volume copies per IO group Specified at creation of the volume copy – No conversion in place, but a volume can be converted via Volume Mirroring 1 Compressed volumes can be source and target of Remote Copy relationship or FlashCopy mapping – Data between copies is uncompressed 13 Copy 0 Copy 1 Storwize V7000 RWW Real-Time Compression

14 14 0% 20% 40% 60% 80% 100% Bazy danych Dane użytkowników CAD/CAM Engineering Serwery wirtualneOil & Gas 2.5x data 6.6x backup 3.3x replication 3.5x RTOs 2.0x Backup lic. 20% do 60% 85.0% 70.0% 72.0% 50.0% Compression Ratio Real-Time Compression

15 Orion (Oracle I/O Calibration Tool) is a standalone tool for calibrating the I/O performance for storage systems that are intended to be used for Oracle databases. The calibration results are useful for understanding the performance capabilities of a storage system, either to uncover issues that would impact the performance of an Oracle database or to size a new database installation


17 What is Easy Tier? –A function that dynamically re- distributes active data across multiple tiers of storage class based on workload characteristics –The goal being to reduce response time –Users have automatic and semi-automatic extent based placement and migration management Why it matters? –Solid State Storage has orders of magnitude better throughput and response time with random reads –Full volume allocation to SSD only benefits a small number of volumes or portions of volumes, and use cases –Allowing dynamic movement of the hottest extents to be transferred to the highest performance storage enables a small number of SSD to benefit the entire infrastructure –Works with Thin-provisioned Volumes IBM EasyTier Hot-spots Optimized performance and throughput Automatic Relocation SSDs HDDs SSDs HDDs Transparent reorganization Hot-spots Optimized performance and throughput

18 12 hours (Elapsed Time) Application Transaction Throughput Easy Tier Learning Easy Tier In Action 240% from Original Brokerage transaction PRELIMINARY 18 IBM EasyTier

19 Snapshots, backup etc. Backup, Recovery, Tests, FlashCopy Full Snapshot Backup Cascaded copy – copy from copy Reverse FlashCopy 256 copies 2. Reverse FlashCopy OR Source Target Vol3 FlashCopy target of Vol1 Vol0 Source Map 1Map 2 Map 3 Map 4 Vol1 FlashCopy target of Vol0 Vol2 FlashCopy target of Vol1 Vol4 FlashCopy target of Vol3

20 Internal Storage Storwize V Volume Mirroring outside the box 2 close sites (<10Km) Warning, there is no consistency group Global Mirror Consistent Asynchronous Mirror –Limited impact on write IO response time –Data loss –All write IOs are sent to the remote site in the same order they were received on source volumes –1 source and 1 target volumes + change volumes on each site 2 remote sites (>300 Km) Metro Mirror Synchronous Mirror –Write IO response time doubled + distance latency –No data loss 2 close sites (<300 Km) Warning, production performance impact if inter-site links are unavailable, during microcode upgrades, etc. FlashCopy Point-in-Time Copy outside the box 2 close sites (<10Km) Warning, this is not real time replication Source and target can have different characteristics and be from different vendors Source and target can be in the same cluster Remote Copy between SVC & Storwize V7000 is supported Vol0 Internal Storage External Storage RWW Advanced Copy Services

21 Non-disruptive Data Migration Traditional SAN 1. Stop applications 2. Move data 3. Re-establish host connections 4. Restart applications Storwize V Move data Host systems and applications are not affected In both cases, if it is with a new back-end external storage, you need to… – Cabling, – Change the SAN zoning, – Create arrays & create LUNs in the arrays, – Assign those LUNs to the server or Storwize V7000 Once Managed Disk Groups are created using the assigned LUNs, Volumes will be migrated between MDG with just one command/click SAN Storwize V7000 SAN Migration scenarios: – Image mode to image mode – Image mode to managed mode – Managed mode to managed mode – Managed mode to image mode Image mode = Native mode Managed mode = Virtual mode Migrate on-line to decommission, up-Tier, down-Tier, re-Tier…


23 Cluster system * Easy Tier RAID innovative GUI SAN virtualization Snapshot IBM Storwize V7000 IBM Storwize v7000 IBM Active Cloud Engine NAS Unified unified

24 Modular Hardware Building Blocks Software inherited from prior Offerings plus Enhancements Software inherited from SVC and DS8000 RAID FCP, iSCSI & FCoE RAID 0, 1, 5, 6, 10 Storage Virtualization (Internal & external disks) Non-disruptive Data Migration Global & Metro Mirror (Multi-site) FlashCopy (Point-In-Time Copy) Thin Provisioning Real Time Compression New and enhanced Software functions New GUI (Easy-to-use, web based, XIV like) Easy TierTM SSD exploitation RAID & enclosure RAS services and diagnostics Additional scalability improvements Enhanced Host, Controller and ISV interoperability Integration with IBM Systems Director Enhancements to TPC, FCM and TSM support Storwize V7000 Overview New!

25 /212/312 –12 x 3.5 LFF Drive Bays –Four columns of three horizontally mounted drive carriers –Drive slots are numbered 1 to 12 starting top left and going left to right and top to bottom /224/324 –24 x 2.5 SFF Drive Bays –One row of 24 vertically mounted drive carriers –The drive slots are numbered 1 to 24 from left to right Enclosure Front View 25

26 Drive TypeVendorDrive NameDrive Sizes Model 124/ Small Form Factor (SFF) SSD (eMLC) STEC Hitachi Hikari Ralston Peak 200, 300 & 400GB SAS 15K RPM SeagateHornet146 & 300GB SAS 10K RPM Seagate Firefly300GB Firestorm450, 600 & 900GB NL-SAS 7.2K RPM Seagate1TB Model 112/ Large Form Factor (LFF) NL-SAS 7.2K RPM SeagateMuskie2 & 3TB Drive Options

27 Control Enclosure Rear View 27 Four 2/4/8Gbps Fibre Channel ports Two USB2 portsTwo 1Gbps Ethernet ports Two 6Gbps SAS ports (connections to expansions) Top node canister Bottom node canister Note: identical but installed upside down Power Supply Unit (PSU) Power Cooling Module (PCM) & Battery Note: identical but installed upside down Power Supply Unit (PSU) Power Cooling Module (PCM) & Battery Two 10Gbps Ethernet ports 10Gbps dual port Converged Network Adapter (CNA) can now carry not only iSCSI but also FCoE frames

28 Expansion Enclosures Control Enclosures Modular Scalability Start with a single control enclosure (a pair of controllers) – And add up to 9 expansion enclosures to scale-in Mix 2.5 & 3.5 drive enclosures Mix drive type and drive size in an enclosure Add control enclosures independently of expansion enclosures – Build a cluster (a Grid) of controller pairs to scale-out – Add expansion enclosures as required for capacity and performance

29 Overview of the I/O Stack SCSI Target – looks like a disk system and presents Volumes to Hosts (HBA driver layer) Remote Copy – replicates data to second site for disaster recovery Cache – mirrors writes between nodes in I/O Group FlashCopy creates point-in-time copies Volume Mirroring – provides pointers to two copies of data for high availability Thin-provisioned Volume – consumes disk space only when data written – Random Access Compression Engine TM sits parallel to Thin-Provisioning acts in coordination RACE is running in a controlled binary executable Virtualization – Volume MDisk mappings, non-disruptive data migration RAID – Internal storage Array 1 array = 1 Mdisk migration SCSI Initiator – talks to disk backend just like a host accessing LUNs (MDisks) – HBA driver layer Remote Copy Cache FlashCopy SCSI target Thin-provisioning Virtualization RAID Volume Mirroring SCSI Initiator Comperssion

30 LAN Volumes Up to 2,048/8,192 Volumes per IO group/cluster Max. Volume size of 256TiB Image Mode = Native Mode Managed Mode = Virtualized Mode Single Multipath driver (SDD, MPIO) SAN Storwize V7000 Internal StorageExternal Storage Internal Storage 1 to 8/16 drives (HDD) to form an Array 1 Array Managed Disk (MD) External Storage Multiple Storage Subsystems 1 LUN Managed Disk (MDisk) SSDSASNL-SAS Storage Pools Up to 128 MDisks per Storage Pool Up to 128 storage pools per cluster Pool 3Pool 4Pool 5 Vol4 iSCSI, FCP or FCoE Host Mapping Virtualisation Concepts & Limits Up to 4,096 MDisksMax. External MDisk Size of 2TiB Or greater (1) Hosts Up to 256/1024 Hosts per IO group/cluster Up to 512/2048 FC ports per IO group/cluster Up to 256/1024 iSCSI ports per IO group/cluster Pool 1Pool 2 Vol1 Round-robin port selection for back-end storage subsystems Enhanced! Vol3Vol6 Vol7 Vol2 Vol5

31 Storwize V7000u Features FCP, iSCSI & FCoE Block Access Protocols, and file (NAS) Cache partitioning Easy to use GUI – Real Time Performance Statistics Embedded SMI-S agent , SNMP trap & Syslog error event logging Authentication service for Single Sign-On & LDAP Virtualise data without data-loss – External storage virtualization (optional) Thin-provisioned & Compressed Volumes – Reclaim Zero-write space – Thick to thin, thin to thick & thin to thin migration Expand or shrink Volumes on-line On-line Volume Migration between Storage Pools & IO groups Volume Mirroring EasyTier: Automatic relocation of hot and cold extents Snapshot-FlashCopy (Point-In-Time copy) – Up to 256 target per source – Full (with background copy = clone) – Partial (no background copy) – Space Efficient – Incremental – Cascaded – Consistency Groups – Reverse Microsoft Virtual Disk Service & Volume Shadow Copy Services hardware provider Remote Copy (optional) – Synchronous & asynchronous remote replication with Consistency groups Optional Cycling Mode using snapshots VMware – Storage Replication Adaptor for Site Recovery Manager – VAAI support & vCenter Server management plug-in Hot-spotsOptimized performance and throughput Automatic Relocation SSDsHDDsSSDsHDDs Volume Volume copy 1 Storwize V7000 Volume copy 0 Volume MDisk Target Storwize V7000 MDisk Source Up to 256 Vol3 FlashCopy target of Vol1 Vol0 Source Map 1Map 2 Map 3 Map 4 Vol1 FlashCopy target of Vol0 Vol2 FlashCopy target of Vol1 Vol4 FlashCopy target of Vol3 MM or GM Relationship Consolidated DR Site MM or GM Relationship MM or GM Relationship Storwize V7000 New!

32 Management role Active* Storage role Interface role Management role Standby* Storage role Interface role Storage Module File Module ACE Storwize V7000 Unified Data Movement - V7000 unified Information Lifecycle Management /data/web /home /appl 5. Perform results of scan /home/appl/data/web/ important_big_spreadsheet.xls big_architecture_drawing.ppt unstructured_big_video.mpg All File Modules participate in parallel data movement No change to the logical directory

33 Management role Active* Storage role Interface role Management role Standby* Storage role Interface role Storage Module File Module ACE Storwize V7000 Unified Data Movement Hierarchical Storage Management /data/web /home /appl /home/appl/data/web/ important_big_spreadsheet.xls big_architecture_drawing.ppt unstructured_big_video.mpg... Tier 3 Stub files left on disk Auto-recall if accessed External TSM server 5. Perform results of scan

34 34 Visual task flow guidance Integrated video instruction System status always available System recommendations Link to more information if needed User Interface Based on the well-received XIV interface

35 What it is: – Site Recovery Manager is a VMware product for disaster recovery What it does: – Simplifies and automates disaster recovery processes Discovery of replicated storage Non-disruptive failover test using a writable copy of replicated data Emergency and planned failover Reverse replication after failover as part of failback Restore replication after failover as part of a production test Site Recovery Manager works with VMware Infrastructure to enable faster, more reliable, affordable disaster recovery Site Recovery Manager leverages VMware Infrastructure to transform disaster recovery VMware Site Recovery Manager

36 VMware vStorage API for Array Integration VAAI support Integration with vStorage APIs to improve performance – Full copy (and Block zeroing which was delivered in 6.1.0) offload work from production virtual servers to storage which improves application performance – Hardware-assisted locking enables a finer grained level of locking on VMFS metadata which is more efficient and also scales better in larger VMware clusters Example tasks that can benefit from improved performance : – VM creation/cloning/snapshots/deletion – vMotion and storage vMotion – Extending a VMFS Volume – Extending the size of a VMDK file VMware Storage Stack VMFS NFS VMware LVM Data Mover NFS Client Network Stack vStorage API for Multi- Pathing NFS HBA Drivers NIC vStorage APIs Provisioning / Cloning

37 VMware Storage Management Plugin Gives a detailed look at current storage use Supports Storwize V7000, Storwize V7000 Unified, Scale Out NAS, SAN Volume Controller & XiV Easy to use GUI Allows the VMware operator to provision storage to: – Create datastores – Create RDMs – Extend existing datastores and RDMs – Move datastores and RDMs between storage pools

38 Combine the capacity from multiple arrays into a single pool of storage Apply common copy services across the storage pool Manage the storage pool from a central point Make changes to the storage without disrupting host applications Volume SAN Storwize V7000 / SVC Advanced Copy Services Storage Pool HP EMC DS4000 DS8000 HDS Flexible Storage Infrastructure with Storwize V7000

39 IBM Smarter Storage for Smarter Computing Efficient by design With Smarter Storage, essential storage technologies are built in and tightly integrated. Efficiency is effortless – requiring no manual intervention. Management is intuitive and easy – improving the efficiency of your most important asset, your people. Self-optimizing Smarter Storage analyzes data access patterns, adapts and improves performance. Sophisticated internal analytics automatically place data on the appropriate storage tier. Cloud agile Smarter Storage fully participates in highly virtualized cloud environments. Both IBM and non-IBM storage are managed as one virtual storage pool. Existing storage systems inherit IBM's latest, most advanced capabilities. Data is automatically synchronized between facilities. Files flow to users wherever they are.

40 innovation that matters

Download ppt "New approach to the design and deployment of storage Piotr Biskupski – IBM STG Poland IBM Forum 2012 – Estonia Tallinn, October 9, 2012."

Similar presentations

Ads by Google