Presentation is loading. Please wait.

Presentation is loading. Please wait.

New approach to the design and deployment of storage

Similar presentations

Presentation on theme: "New approach to the design and deployment of storage"— Presentation transcript:

1 New approach to the design and deployment of storage
Piotr Biskupski – IBM STG Poland IBM Forum 2012 – Estonia Tallinn, October 9, 2012

2 To realize the promise of a Smarter Planet, enterprises must address the IT challenges that have emerged. 31.9 million servers worldwide Internet connected devices—22B in 2020 (24.9% CAGR) Since 2000 security vulnerabilities grew eightfold Last 10 years servers up 2X and virtual machines up 42% CAGR The volume of digital content, up 48% from 2011, is expected to reach 2.7 ZB (1ZB = 1 billion terabytes) in 2012 and 8ZB by 2015. Data centers have doubled energy use in past 5 years And respond to demands for new services… Real-time analytics workloads growing 13% CAGR with related server spend growing 3x average Collaborative software workloads growing 10% CAGR …while dealing with constraints like a flat budget. 2 2 2 2

3 IBM Storage is key to Smarter Computing
Storage Virtualization enables a robust cloud deployment Smarter Computing Designed for data Storage Efficiency is essential to outpace data growth Storage must adapt to changing information patterns

4 Introducing IBM Smarter Storage for Smarter Computing
Efficient by Design Manage cost and capacity growth Self-optimizing Cloud Agile Improve performance and productivity Increase information access and improve ROI 4

5 Efficient by Design Decreases Space Requirements
3/25/2017 Efficient by Design Manage Cost and Capacity Growth Decreases Space Requirements Store more information in less space Supports non-IBM storage, savings throughout the data center Simplifies Administration Reduce complexity Automate tasks Efficiency for Active Workloads Efficiency for transaction processing, big data, clouds Not just for inactive data Benefits Reduce space requirements for active data up to 80% Save up to 47% in administrator time Reduce complexity by up to 30% Reduce Capital Expenses Reduce Operating Expenses 5

6 Optimize performance and cost Increase administrator productivity
3/25/2017 Self-optimizing Improve Performance and Productivity Analyzes and adapts Analyzes access patterns and adapts automatically Flash optimization makes high performance affordable Automates performance tuning Saves time, reduces errors and eliminates user disruption Easy to match critical workloads with performance features Analyze Big Data Fast Tuning and tiering are faster and more accurate Optimization is a continuous automated process Benefits Increase performance 3X with only 3% SSDs Reduce storage costs by 50% Optimize performance and cost Increase administrator productivity 6

7 Cloud Agile Adaptive Automated Deploy Clouds Faster Benefits
3/25/2017 Cloud Agile Increase Information Access and Improve ROI Adaptive Storage adapts easily to unpredictable workloads Data is automatically synchronized between facilities Automated Self-service provisioning Simpler and faster administration Deploy Clouds Faster Administrators manage far more capacity Leverage existing storage systems Benefits Reduce disk space needs by up to 50% Speed storage deployment up to 26% Improve application availability by 29% Increase Agility Increase productivity 7

8 Tying IBM Smarter Storage to New Capabilities and Vision: June Cross-IBM Announcements and SoDs
Efficient by Design Real-time Compression integrated into Storwize V7000, SVC TPC improved GUI, enhanced reporting, tiering optimization, cloud support SONAS TPC support TPC now supports XIV/Storwize V7000 GUI ProtecTIER file protocol support Storwize V7000U real-time compression for file workloads (SoD) Cloud Agile SONAS and Storwize V7000 file storage virtualization (SoD) SONAS and Storwize V7000 ACE enables global file collaboration with multi-writer support (SoD) SONAS and Storwize V7000 Unified, cloud storage self-service service portal (SoD) Storwize V7000 support for Active Cloud Engine (SoD) XIV clustering (SoD) XIV Gen3 GTS Implementation Services Self-optimizing DS8000 Easy Tier extended to server based storage (SoD) DS8000 new high-density flash storage option (SoD) DS8000 Easy Tier support for application API (SoD) IBM SmartCloud Virtual Storage Center will introduce analytics-based storage tier recommendations and automation to migrate data to the right tier (SoD) Information Governance

9 IBM Smarter Storage Virtualization Thin Provisioning Compression RACE
Easy Tier option: TPC for Disk Midrange Edition FlashCopy option: FlashCopy Manager Advanced copy services - Metro and/or Global Mirror option: TPC for Replication Active Cloud Engine

10 Storage virtualization
25% capacity 50% capacity 55% capacity SAN SVC / V7000 10 95% capacity

11 Storage virtualization with HA
…no walls Virtual DC… Virtualized strorage Mobilnosc maszyn Ochrona DR w standardzie VM-machine 11

12 Thin-provisioning Traditional (“fully allocated”) virtual disks use physical disk capacity for the entire capacity of a virtual disk even if it is not used With thin-provisioning, Storwize V70000 allocates and uses physical disk capacity when data is written Available at no additional charge with base virtualization license Support all hosts supported with traditional volumes and all advanced features (EasyTier, FlashCopy, etc.) Reclaiming Unused Disk Space When using Volume Mirroring to copy from a fully-allocated volume to a thin-provisioned volume, Storwize V7000 will not copy blocks that are all zeroes When processing a write request, Storwize V7000 detects if all zeroes are being written and does not allocate disk space for such requests in the thin-provisioned volumes Helps avoid space utilization concerns when formatting Volumes Done at Grain Level (32/64/128/256KiB)  If grain contains all zeros don’t write Dynamic growth Without thin provisioning, pre-allocated space is reserved whether the application uses it or not With thin provisioning, applications can grow dynamically, but only consume space they are actually using

13 Real-Time Compression
A compressed Volume is a third type of volume Regular (fully allocated) Thin Provisioned (Space Efficient) Compressed A compressed volume is “a kind of” Thin Provisioning Compression supports all Thin Provisioning features (e.g. autoexpand) Only uses physical storage to store the compressed version of the volume Can be on back-end virtualized storage Supported with CLI and GUI GUI also has a preset for compressed volumes Performance monitoring tab support for Compression CPU resource usage Compression operates at a volume copy level Maximum of 200 compressed Volume copies per IO group Specified at creation of the volume copy No conversion in place, but a volume can be converted via Volume Mirroring1 Compressed volumes can be source and target of Remote Copy relationship or FlashCopy mapping Data between copies is uncompressed Storwize V7000 R W W Copy 1 Copy 0 13

14 Real-Time Compression
Compression Ratio 100% 80% 2.0x Backup lic. 60% 2.5x data 3.3x replication 3.5x RTOs 40% 6.6x backup 50.0% 20% do 60% 20% 70.0% 72.0% 85.0% 0% Dane użytkowników CAD/CAM Engineering Bazy danych Serwery wirtualne Oil & Gas 14 14

15 15 Orion (Oracle I/O Calibration Tool) is a standalone tool for calibrating the I/O performance for storage systems that are intended to be used for Oracle databases. The calibration results are useful for understanding the performance capabilities of a storage system, either to uncover issues that would impact the performance of an Oracle database or to size a new database installation


17 Optimized performance and throughput
IBM EasyTier Hot-spots Optimized performance and throughput Transparent reorganization What is Easy Tier? A function that dynamically re- distributes active data across multiple tiers of storage class based on workload characteristics The goal being to reduce response time Users have automatic and semi-automatic extent based placement and migration management Why it matters? Solid State Storage has orders of magnitude better throughput and response time with random reads Full volume allocation to SSD only benefits a small number of volumes or portions of volumes, and use cases Allowing dynamic movement of the hottest extents to be transferred to the highest performance storage enables a small number of SSD to benefit the entire infrastructure Works with Thin-provisioned Volumes Hot-spots Optimized performance and throughput Automatic Relocation SSDs HDDs

18 Brokerage transaction
IBM EasyTier PRELIMINARY 240% from Original Brokerage transaction Application Transaction Throughput Easy Tier In Action Easy Tier Learning 12 hours (Elapsed Time) 18

19 Snapshots, backup etc. Backup, Recovery, Tests, FlashCopy Full
Cascaded copy – copy from copy Reverse FlashCopy 256 copies 2. Reverse FlashCopy OR Source Target Vol3 FlashCopy target of Vol1 Vol0 Source Map 1 Map 2 Map 3 Map 4 Vol1 FlashCopy target of Vol0 Vol2 FlashCopy target of Vol1 Vol4 FlashCopy target of Vol3

20 Advanced Copy Services
Volume Mirroring “outside the box” 2 close sites (<10Km) Warning, there is no consistency group FlashCopy Point-in-Time Copy “outside the box” 2 close sites (<10Km) Warning, this is not real time replication Metro Mirror Synchronous Mirror Write IO response time doubled + distance latency No data loss 2 close sites (<300 Km) Warning, production performance impact if inter-site links are unavailable, during microcode upgrades, etc. Global Mirror Consistent Asynchronous Mirror Limited impact on write IO response time Data loss All write IOs are sent to the remote site in the same order they were received on source volumes 1 source and 1 target volumes + change volumes on each site 2 remote sites (>300 Km) Vol0 Vol0’ Vol0’ R W W Storwize V7000 Storwize V7000 External Storage Internal Storage Internal Storage Source and target can have different characteristics and be from different vendors Source and target can be in the same cluster Remote Copy between SVC & Storwize V7000 is supported 20

21 Non-disruptive Data Migration
Traditional SAN Stop applications Move data Re-establish host connections Restart applications Storwize V7000 Move data Host systems and applications are not affected In both cases, if it is with a new back-end external storage, you need to… Cabling, Change the SAN zoning, Create arrays & create LUNs in the arrays, Assign those LUNs to the server or Storwize V7000 Once Managed Disk Groups are created using the assigned LUNs, Volumes will be migrated between MDG with just one command/click Migration scenarios: Image mode to image mode Image mode to managed mode Managed mode to managed mode Managed mode to image mode SAN SAN Storwize V7000 Migrate on-line to decommission, up-Tier, down-Tier, re-Tier… 21 Image mode = Native mode Managed mode = Virtual mode


23 IBM Active Cloud Engine™
IBM Storwize v7000 unified IBM Active Cloud Engine™ NAS Unified innovative GUI SAN virtualization Snapshot Easy Tier Storwize V7000 and now Storwize V7000 Unified are platforms where IBM is integrating together the best of our technologies to deliver great value and efficiency to midsized customers. A year ago, we integrated things like a great user interface from our XIV system, Easy Tier from our DS8000 system, and virtualization from our SAN Volume Controller offering. About six months later, we added clustering capability. And now we're adding NAS capability from a common IBM NAS platform. All of these technologies coming together in a midrange storage system. We're bringing all the resources of IBM and focusing them to help midsized customers. Now, let’s go to chart 10… RAID IBM Storwize V7000 Cluster system*

24 Storwize V7000 Overview Modular Hardware Building Blocks
3/25/2017 Storwize V7000 Overview Modular Hardware Building Blocks What if we took what we had been doing in SVC for years, but shrunk the 1U server form factor into a much more storage friendly form factor. Say Storage Bridge Bay (SBB) for example. We could still have, the Fibre-Channel "PCIe card", a SAS "PCIe card", maybe even a PCIe internode connection and still have spare room for another TBD "PCIe card".... people have been doing micro and even smaller PC formfactors for years... The same goes for the battery, since we need a way to hold up power/memory to enable a graceful shutdown should the site power be lost. With SVC we've been using a separate 1U UPS, but why not embed the battery in the PSU itself, rather than take up space in the control canister. The SVC code stack has a hefty investment in the PMC Sierra Tachyon based Fibre Channel cards, and like the latest CF8 node hardware the Storwize V7000 uses their QE8 - 4 port 8Gbit protocol chip. In addition we are using their SPC SAS protocol chip, which the observant will know is the same chip we provided as an optional feature on the CF8 node hardware with the SSD attachment. The base controller unit also includes a PMC SAS Expander chip, this is connected to one of the wide ports on the SPC chip and to the 12 or 24 internal drive phys on the control enclosure. Software inherited from prior Offerings plus Enhancements Software inherited from SVC and DS8000 RAID FCP, iSCSI & FCoE RAID 0, 1, 5, 6, 10 Storage Virtualization (Internal & external disks) Non-disruptive Data Migration Global & Metro Mirror (Multi-site) FlashCopy (Point-In-Time Copy) Thin Provisioning Real Time Compression New and enhanced Software functions New GUI (Easy-to-use, web based, XIV like) Easy TierTM SSD exploitation RAID & enclosure RAS services and diagnostics Additional scalability improvements Enhanced Host, Controller and ISV interoperability Integration with IBM Systems Director Enhancements to TPC, FCM and TSM support New! IBM Confidential 24

25 Enclosure Front View 2076-112/212/312 2076-124/224/324
12 x 3.5” LFF Drive Bays Four columns of three horizontally mounted drive carriers Drive slots are numbered 1 to 12 starting top left and going left to right and top to bottom /224/324 24 x 2.5” SFF Drive Bays One row of 24 vertically mounted drive carriers The drive slots are numbered 1 to 24 from left to right 25

26 Drive Options Drive Type Vendor Drive Name Drive Sizes Model 124/224
2.5” Small Form Factor (SFF) SSD (eMLC) STEC Hitachi Hikari Ralston Peak 200, 300 & 400GB SAS 15K RPM Seagate Hornet 146 & 300GB 10K RPM Firefly 300GB Firestorm 450, 600 & 900GB NL-SAS 7.2K RPM 1TB Model 112/212 3.5” Large Form Factor (LFF) Muskie 2 & 3TB

27 Control Enclosure Rear View
3/25/2017 Control Enclosure Rear View 10Gbps dual port Converged Network Adapter (CNA) can now carry not only iSCSI but also FCoE frames Top node canister Two 6Gbps SAS ports (connections to expansions) Four 2/4/8Gbps Fibre Channel ports Two USB2 ports Two 1Gbps Ethernet ports Two 10Gbps Ethernet ports Power Supply Unit (PSU) Power Cooling Module (PCM) & Battery Note: identical but installed upside down Power Supply Unit (PSU) Power Cooling Module (PCM) & Battery Bottom node canister Note: identical but installed upside down IBM Confidential 27 27

28 Modular Scalability Control Enclosures Expansion Enclosures
Start with a single control enclosure (a pair of controllers) And add up to 9 expansion enclosures to scale-in Mix 2.5” & 3.5” drive enclosures Mix drive type and drive size in an enclosure Add control enclosures independently of expansion enclosures Build a cluster (a Grid) of controller pairs to scale-out Add expansion enclosures as required for capacity and performance Control Enclosures Expansion Enclosures

29 Overview of the I/O Stack
SCSI target SCSI Target – looks like a disk system and presents Volumes to Hosts (HBA driver layer) Remote Copy – replicates data to second site for disaster recovery Cache – mirrors writes between nodes in I/O Group FlashCopy creates point-in-time copies Volume Mirroring – provides pointers to two copies of data for high availability Thin-provisioned Volume – consumes disk space only when data written Random Access Compression EngineTM sits parallel to Thin-Provisioning  acts in coordination RACE is running in a controlled binary executable Virtualization – Volume  MDisk mappings, non-disruptive data migration RAID – Internal storage Array  1 array = 1 Mdisk migration SCSI Initiator – talks to disk backend just like a host accessing LUNs (MDisks) – HBA driver layer Remote Copy Cache FlashCopy Volume Mirroring Comperssion Thin-provisioning Virtualization RAID SCSI Initiator

30 Virtualisation Concepts & Limits
Enhanced! Hosts Up to 256/1024 Hosts per IO group/cluster Up to 512/2048 FC ports per IO group/cluster Up to 256/1024 iSCSI ports per IO group/cluster Volumes Up to 2,048/8,192 Volumes per IO group/cluster Max. Volume size of 256TiB Image Mode = Native Mode Managed Mode = Virtualized Mode Single Multipath driver (SDD, MPIO) LAN iSCSI, FCP or FCoE Host Mapping SAN , I/O is submitted using one path per target port per MDisk per node Paths are chosen according to port groups presented by storage system I/O is sent in parallel to all target ports This enables I/O to an MDisk to progress in a “round robin” way Spread across multiple storage system ports Number of preferred paths per node port is balanced, both within each port group, and across the system as a whole. Round robin port selection improves resilience to certain storage system failures If traffic to one port is slow, traffic will still progress via other ports Round robin port selection is enabled on these controllers in 6.3.0: IBM Storwize V7000 IBM DS8xxx IBM DS5xxx IBM DS4800 IBM XIV EMC Symmetrix (including DMX and VMAX) Storwize V7000 SSD SAS NL-SAS Pool 1 Pool 2 Pool 3 Pool 4 Pool 5 Storage Pools Up to 128 MDisks per Storage Pool Up to 128 storage pools per cluster Vol2 Vol1 Vol3 Vol7 Vol4 Vol5 Vol6 Internal Storage External Storage 30 Internal Storage 1 to 8/16 drives (HDD) to form an Array 1 Array  Managed Disk (MD) Up to 4,096 MDisks Max. External MDisk Size of 2TiB Or greater(1) External Storage Multiple Storage Subsystems 1 LUN  Managed Disk (MDisk) Round-robin port selection for back-end storage subsystems

31 Optimized performance and throughput
3/25/2017 Storwize V7000u Features New! FCP, iSCSI & FCoE Block Access Protocols, and file (NAS) Cache partitioning Easy to use GUI Real Time Performance Statistics Embedded SMI-S agent , SNMP trap & Syslog error event logging Authentication service for Single Sign-On & LDAP Virtualise data without data-loss External storage virtualization (optional) Thin-provisioned & Compressed Volumes Reclaim Zero-write space Thick to thin, thin to thick & thin to thin migration Expand or shrink Volumes on-line On-line Volume Migration between Storage Pools & IO groups Volume Mirroring EasyTier: Automatic relocation of hot and cold extents Snapshot-FlashCopy (Point-In-Time copy) Up to 256 target per source Full (with background copy = clone) Partial (no background copy) Space Efficient Incremental Cascaded Consistency Groups Reverse Microsoft Virtual Disk Service & Volume Shadow Copy Services hardware provider Remote Copy (optional) Synchronous & asynchronous remote replication with Consistency groups Optional Cycling Mode using snapshots VMware Storage Replication Adaptor for Site Recovery Manager VAAI support & vCenter Server management plug-in Up to 256 Vol3 FlashCopy target of Vol1 Vol0 Source Map 1 Map 2 Map 3 Map 4 Vol1 FlashCopy target of Vol0 Vol2 FlashCopy target of Vol1 Vol4 FlashCopy target of Vol3 Volume MDisk Target Storwize V7000 MDisk Source MM or GM Relationship Consolidated DR Site MM or GM Relationship Storwize V7000 Volume Volume copy 1 Storwize V7000 Volume copy 0 IBM Confidential 31 Hot-spots Optimized performance and throughput Automatic Relocation SSDs HDDs

32 Data Movement - V7000 unified Information Lifecycle Management
/home /appl /home/appl/data/web/ important_big_spreadsheet.xls /data No change to the logical directory big_architecture_drawing.ppt /web unstructured_big_video.mpg SONAS applies the same parallel scale-out architecture to internal data movement. After the results of the scan are done, Storwize V7000U then uses the multiple File Modules to physically relocate the data in parallel. No changes to the user appearance of the file structure. Note that Tivoli Storage Manager is only required to do movement from internal Storwize V7000U storage to external storage. That will be explained more a couple of slides from now. Again, for internal Storwize V7000U physical data movement, Tivoli Storage Manager is not involved, and need not be present in any way. All File Modules participate in parallel data movement 5. Perform results of scan Management role Active* Storage role Interface role Management role Standby* Storage role Interface role File Module File Module Storwize V7000 Unified ACE Storage Module 32

33 Data Movement Hierarchical Storage Management
/home /appl /home/appl/data/web/ important_big_spreadsheet.xls /data big_architecture_drawing.ppt /web unstructured_big_video.mpg External TSM server Storwize V7000U applies the same parallel scale-out architecture to internal data movement. After the results of the scan are done, Storwize V7000U then uses the multiple file modules to physically relocate the data in parallel. No changes to the user appearance of the file structure. Note that Tivoli Storage Manager is only required to do movement from internal Storwize V7000U storage to external storage. That will be explained more a couple of slides from now. Again, for internal Storwize V7000U physical data movement, Tivoli Storage Manager is not involved, and need not be present in any way. 5. Perform results of scan Tier 3 Management role Active* Storage role Interface role Management role Standby* Storage role Interface role File Module File Module Storwize V7000 Unified ACE Storage Module 33 Stub files left on disk  Auto-recall if accessed . . .

34 User Interface Based on the well-received XIV interface
3/25/2017 User Interface Based on the well-received XIV interface System recommendations Visual task flow guidance Integrated video instruction System status always available IBM Confidential 34 34 34 Link to more information if needed 34

35 VMware Site Recovery Manager
Site Recovery Manager leverages VMware Infrastructure to transform disaster recovery What it is: Site Recovery Manager is a VMware product for disaster recovery What it does: Simplifies and automates disaster recovery processes Discovery of replicated storage Non-disruptive failover test using a writable copy of replicated data Emergency and planned failover Reverse replication after failover as part of failback Restore replication after failover as part of a production test Site Recovery Manager works with VMware Infrastructure to enable faster, more reliable, affordable disaster recovery 35 35

36 VMware vStorage API for Array Integration
3/25/2017 VMware vStorage API for Array Integration VAAI support Integration with vStorage API’s to improve performance Full copy (and Block zeroing which was delivered in 6.1.0) offload work from production virtual servers to storage which improves application performance Hardware-assisted locking enables a finer grained level of locking on VMFS metadata which is more efficient and also scales better in larger VMware clusters Example tasks that can benefit from improved performance : VM creation/cloning/snapshots/deletion vMotion and storage vMotion Extending a VMFS Volume Extending the size of a VMDK file Two new SCSI commands (Primitives) in 6.2.0: Full Copy: With a single command the host can tell the storage to copy several chunks of data from one volume to another This saves the host having to read the data from the storage and then write it back again to another volume Compare and Write (Hardware-assisted locking) Locking is required whenever VMFS metadata needs to be updated There are a large number of tasks that require VMFS metadata updates Rather than using a SCSI-2 Reserve (which locks an entire SVC/V7000 Volume and blocks access for ALL other hosts in the ESX cluster), sub-sections of Volumes can be locked Reminder - already in 610 WriteSame (Block zeroing) With a single command the host can tell the storage to zero out a large chunk of a volume VMware Storage Stack Provisioning / Cloning VMFS NFS VMware LVM NFS Client Data Mover vStorage APIs NFS vStorage API for Multi- Pathing Network Stack IBM Confidential 36 HBA Drivers NIC

37 VMware Storage Management Plugin
Gives a detailed look at current storage use Supports Storwize V7000, Storwize V7000 Unified, Scale Out NAS, SAN Volume Controller & XiV Easy to use GUI Allows the VMware operator to provision storage to: Create datastores Create RDMs Extend existing datastores and RDMs Move datastores and RDMs between storage pools

38 Flexible Storage Infrastructure with Storwize V7000
Make changes to the storage without disrupting host applications Volume Volume Volume Volume SAN Manage the storage pool from a central point Storwize V7000 / SVC Apply common copy services across the storage pool Advanced Copy Services Storage Pool Combine the capacity from multiple arrays into a single pool of storage HP DS8000 38 HDS EMC DS4000

39 IBM Smarter Storage for Smarter Computing
Efficient by design With Smarter Storage, essential storage technologies are built in and tightly integrated. Efficiency is effortless – requiring no manual intervention. Management is intuitive and easy – improving the efficiency of your most important asset, your people. Self-optimizing Smarter Storage analyzes data access patterns, adapts and improves performance. Sophisticated internal analytics automatically place data on the appropriate storage tier. Cloud agile Smarter Storage fully participates in highly virtualized cloud environments. Both IBM and non-IBM storage are managed as one virtual storage pool. Existing storage systems inherit IBM's latest, most advanced capabilities. Data is automatically synchronized between facilities. Files flow to users wherever they are.

40 innovation that matters
40 innovation that matters

Download ppt "New approach to the design and deployment of storage"

Similar presentations

Ads by Google