Scality RING Organic Storage 4 Jan. 2013

Slides:



Advertisements
Similar presentations
9 x9 81 4/12/2015 Know Your Facts!. 9 x2 18 4/12/2015 Know Your Facts!
Advertisements

1 x0 0 4/15/2015 Know Your Facts!. 9 x1 9 4/15/2015 Know Your Facts!
1 x0 0 4/16/2015 Know Your Facts!. 1 x8 8 4/16/2015 Know Your Facts!
3 x0 0 7/18/2015 Know Your Facts!. 4 x3 12 7/18/2015 Know Your Facts!
MD025 Clonezilla Server Andrew Fang. School of Information Technology Computer Systems Major.
Enterprise search: 2010 & beyond Nick Patience Research Director, Information Management The 451 Group.
Mergers and acquisitions and their impact on the training departments The case of Scitex-CreoScitex-Creo-Kodak.
Our Purpose The GreenCom Way Our Vision Our Strategies What we excel at Where are we going ?Why we exist ? How do we do it ? Partnering using our shared.
Ni.com National Instruments Liane Grametbauer Human Resources – Global Mobility and Immigration February 2014.
Microsoft Enterprise Search Strategy and Solutions Denise Holehouse Business Productivity Solution Specialist Microsoft Public Sector, Australia.
Mission Statement Explain why your are starting your business and what you hope to accomplish.
4 x1 4 10/18/2015 Know Your Facts!. 5 x /18/2015 Know Your Facts!
3 x0 0 10/18/2015 Know Your Facts!. 11 x /18/2015 Know Your Facts!
Care Farming UK Conference Jane King Editor Farmers Weekly.
Your team name.
12 September Continua Health Alliance: Architectural Overview & Comparison with 2009 Phoenix Architecture Christopher J Adams Phoenix Project
T8. Open Source Tools That are Changing the Content Technology Landscape Gilbane San Francisco 2010.
© 2008 Cisco Systems, Inc. All rights reserved.Cisco Public4/24/2008 EMS 1 How to Partner with the Primes Emily Martinez Stein Program Manager Global Supplier.
1. 2 Sub-Message 2 Sub-Message Headline: What do you want people to get from this slide? It is NOT a description, it is a headline that 1) force you to.
Presentation Name Student Names School Name Teacher’s Name Date.
Insert Nonprofit Logo Project Name Final Presentation.
Birmingham: The Digital Agenda Léan Doody | 11 February 2015.
Caprolactam Industry 2016 : Global Market Outlook
International Body Armor Industry: Market research, Company Assessment and Industry Analysis 2016
Slides for building a International Management group project.
Global Microfluidic Devices Market Forecasts to 2021
Global Scanners Industry 2016 Market Research Report
Global Activity Monitors Industry- Size, Share and Market Forecasts 2021
From Vision to Reality Implementing a University Web Strategy Ian Upton Corporate Web Team University of Birmingham.
Vision 2050 Generic Presentation Short Version March 2010
These proof-point slides are customer approved This Proof-point slide is customer approved. Therefore, quotes or information from these slides could.
Global Enterprise Challenge Seminar
continued on next slide
 Real Madrid.  Contents:  About the team.  Facts.
Team 1: 32 responses Team 2: 55 responses Team 3: 29 responses
CORPORATE LEARNING COURSE Seminar -- Best Practices
CORPORATE LEARNING COURSE Seminar -- Best Practices
Data Privacy: Essentials for Payroll
Support for Asus Routers. About Callpcexperts Independent technical support service provider World Class Service Experienced technicians Quick solutions.
MSN Support. About Callpcexperts Independent technical support service provider World Class Service Experienced technicians Quick solutions.
Customer Support for Hotmail Problems. About Callpcexperts Independent technical support service provider World Class Service Experienced technicians.
 Independent technical support service provider  World Class Service  Experienced technicians  Quick solutions.
Report Snapshot 1 Report Buyers : Hospitals Clinics Diagnostic Centers In-Home Care Facilities Published Date : April 2018.
BACK SOLUTION:
Growth Opportunities in the South Africa Carbon Composites Market :Trends, Forecast, and Opportunity Analysis.
 Independent technical support service provider  World Class Service  Experienced technicians  Quick solutions.
                                                                                                                                                                                                                                                
Which type of claim does this represent?
Which type of claim does this represent?
continued on next slide
continued on next slide
דיני חברות ד"ר ויקטור ח. בוגנים
حماية التصميمات الصناعية فى مصــــــــــر بين المعاصرة والمستقبلية
William Band, Vice President, Principal Analyst
Learn Your 2x Facts.
Student Names School Name Teacher’s Name Date
COMP-13 Running your Business Intelligently
Student Names School Name Teacher’s Name Date
Global TPO Roofing Membrane Market Report : Trends, Forecast and Competitive Analysis 1.
Company Profile Recruitment, Outsourcing, Training.
POWER CHALLENGES Several Ways To Solve 7 CHALLENGES.
Riverbed Delivers faster time-to-market for happier customers
Action Planning.
continued on next slide
Connect To The Customer
HR Systems HR Information Office
continued on next slide
Presentation transcript:

Scality RING Organic Storage 4 Jan. 2013

Agenda Corporate Profile Industry Trends and Business Challenges Scality RING 4 Scality Solutions Ecosystem Roadmap and Vision Conclusion

Scality – Quick Facts Founded 2009 Experienced management team HQ in the San Francisco, Global reach <50 Employees, 20 engineers in Paris 24 x 7 support team US patents $13M invested in Scality to-date 120% annual growth Industry Associations “Aggressive use of a scale-out architecture like that enabled by Scality's RING architecture will become more prevalent, as IT organizations develop best practices that boost storage asset use, reduce operational overhead, and meet high data availability expectations.”

A Rolling and Unstoppable Ball…

Industry Trends Rapid unstructured data growth “Enterprises will see a staggering 52% growth in data over the next years — much of it an increase in unstructured data”, IDC x8-10 in 5 years, x100 in 10 years !! 100TB today will be 1PB then 10PB Rapid decline in storage costs “Cost of disk storage systems is declining >30% annually”, IDC Skyrocketing storage budget & complexity More storage devices need to be managed Increasing cost of commercial real estate Increasing energy costs (power, cooling) Cost of managing storage between 5 and 10 times the acq. cost (Gartner, IDC) Storage Budget TB Growth $/TB Cost

Data and Storage Challenges 100s Millions of Users, 10s-100s PB of Data and Billions of files to store and serve What all these companies have in common ? Internet/Cloud business impossible to sustain and develop with traditional IT approaches

Control and Efficiency at Scale Scality’s Mission Their DC Their App. YOUR Data Their DC YOUR App. YOUR Data YOUR DC YOUR App. YOUR Data Control and Efficiency at Scale Unified Scale-Out Storage Software from primary to long term storage with Cloud’s advantages, investment protection and ready for future

Scality RING Organic Storage 4 Email File Storage StaaS Digital Media Big Data* Enterprise & Cloud Email System Scale Out File System S3 & CDMI API Data Processing with Hadoop Origin Server Scality RING Organic Storage 4 Ring Topology P2P End-to-End Parallelism DATA MD Object Storage Replication ARC Erasure Coding Geo Redundancy Tiering S3 CDMI Standard Management MESA NewSQL DB x86 * Available Q2/2013

Scale-Out Storage Software based on Shared Nothing Model Hardware Agnostic Racks (10…40U) x86 server (1U, 2U…4U) with CPU, RAM, Ethernet and DAS running Linux Clusters Scale-Out Storage Software based on Shared Nothing Model

Distributed Architecture P2P Scality RING 1 node manages 1/36th of the key space servers (6) storage nodes (ex: 6/server, total=36) 36 storage nodes projected on a ring From Servers to Storage Nodes RING Topology, P2P Architecture Limitless Scale-Out Storage based on Shared Nothing model Fully Distributed Storage (Data and Meta-data)

Distributed Architecture P2P DHT & Consistent Hashing 360° key space, each node manages a key range Key generation and projection (no overhead at running time) MIT CHORD Inter-routing Algo. + 3 Scality methods (Proxy, Balance & Rebuild) 1/6 key space to rebalance when a storage node is lost No Single Point of Failure, No central Catalog or DB Stateless architecture Easy to grow, high resistance and seamless to failures Self Healing and Organic Upgrade Elastic Clustering Inherent Load balancing & Symmetry Every node can serve a request Maximum # of hops 100 nodes 3 1 000 nodes 5 10 000 nodes 7 Topology is cashed at connector level.

End-to-End Parallelism APPLICATIONS / CONNECTORS APPLICATIONS / CONNECTORS APPLICATIONS / CONNECTORS APPLICATIONS / CONNECTORS APPLICATIONS / CONNECTORS Parallel Connectors access to Storage Nodes Performance aggregation Redundant Data Path Multiple Storage Nodes per server Minimum 6 to increase parallelism and data independence Fast and easy rebuild Multiple IO Daemons per Server Control Physical and Boost IO STORAGE NODES STORAGE NODES STORAGE NODES STORAGE NODES I/O DAEMONS I/O DAEMONS I/O DAEMONS I/O DAEMONS I/O DAEMONS I/O DAEMONS SSD SATA TIERED STORAGE Scality Parallelism Factor #Storage Nodes x #IO Daemons vs Simple server node with only 1 IO Engine Independent Performance and Capacity Scalability

Object and Key/Values Stores DATA MD Object as a opaque entity with Metadata and Data No limit for object size and number Random block R/W access on large objects Object Chunking, Splitting, Striping and Streaming 160 bit Key Space with 128 bit Object key Store node acting as Simple and High Performance Key/Value stores Fully Autonomous Replica Class 128 bits 160 bits 24 bits Dispersion Payload Class of Service 8 bits

Internal Distributed DB Scality MESA NewSQL Philosophy Distributed Tables across Storage Nodes Multiple Indexes per table Schemas updates/Flexible schemas 100% ACID 100% Elastic Linear Transactional Performance Automatic Fault Tolerance SQL front-end (not exposed) Main DEFS Properties/Name Mapping Table Key Page -> Page Page # Value

Data Replication No data transformation Class of Storage Rack-aware 00 20 40 60 80 100 11 120 140 160 180 200 220 91 171 No data transformation Clear/Native data format Very fast access Simple projection Class of Storage Up to 5 replicas (6 copies) Rack-aware Guarantee of full independent object location Self-healing Balance misplaced objects Transparently proxy misplaced objects Rebuild missing replicas Permanent CRC of all contents (no silent data corruption)

ARC: Scality’s Erasure Coding RAID 5 or 6 can’t scale without risk With Bit Error Rate vendors information (1 bit error among 1014 bits) 55% of probability to receive an error for a volume of 10TB 99.9% for 100TB !! (worst beyond) Replication is a great method but too costly for large storage environment Solution: Scality Advanced Resilience Configuration (ARC) Available as a standard RING Core feature (no extra cost) Configuration option, running within the RING Leveraging Reed Solomon technology

Better Durability & Reduced Storage overhead than Replication Scality ARC ARC Fully configurable, by default ARC(14,4) meaning… 14 data fragments + 4 checksums fragments so max. loss of 4 elements in a transaction (18 total fragments committed on disk) Read() is satisfied with minimum of 14 fragments: (14,0), (13,1), …, (10,4) Data fragments = Native Data (no transformation) Direct and fast read access Scality ARC(14,4) Data Check sums Data inputs Data source Output to be stored Scality RING 4 14 … HW overhead ratio = 1.3 (14+4/14) (n,k) configurable to accept different tolerance profile for drive, node and site failure Arguments against: key difference vs Cleversafe and Amplidata (only equations stored, need to decode at every read – very CPU intensive and latency added) Better Durability & Reduced Storage overhead than Replication

Scality ARC Comparison Replication A B Storage space x3 Multiple copies Direct access Reduced storage space Redundant information Direct access Scenario #1: loss of A read(A+B) - read(B) = A Scenario #2: loss of B read(A+B) - read(A) = B Scality ARC A B A+B Dispersed A-B Reduced storage space Scrambled data Latency with additional computation for each read (decoding phase) A+B A*B

Geo Redundancy Business Continuity with “true 99.999%” availability including maintenance Multi-site topology with Scality RING (up to 6 sites) Replication or Geo Erasure Coding implementation – Synchronous Or Multi-RINGs on Multi-site (independent topology) – Asynchronous Asynchronous multiple independent RINGs Synchronous stretched RING across 2 sites

20% 80% Auto Tiering Tiering like HSM 20/80 approach Criteria Primary Site Site A Tiering like HSM Fully automated and transparent for application 20/80 approach Perfect for Hot data on SSD/Flash and Cold data on SATA Criteria Age, Access Time & Object size Potentially different data protection mechanisms Replication with 3 copies on Tier 1 Erasure Code – Scality ARC – on Tier 2 Data Migration across RINGs within same site or across sites 80% Tier 2 Secondary Site Site B

Access Methods and Standards S3 CDMI Open Cloud Access Strategy Scality RING as the storage backend File and Object Access Methods Local and Remote Global Namespace Scality RS2 API (HTTP/REST) Compatible with Amazon S3 Full CDMI server implementation By object ID and hierarchical path- based namespace Cloud Files as the OpenStack Swift protocol S3 CDMI Internet NFS NFS NFS SOFS SOFS Scality RING

Management Supervisor RingSH Central management platform Monitor application connectors & storage nodes down to individual disk drives Passive component Detailed Activity Log RingSH Command line interface Easy to integrate or script with Manage platform, store/retrieve/delete objects List all keys

« Exceptional Performance » “ESG Lab verified exceptional performance for an object-based storage solution, which rivals block-based solutions. Aggregate throughput scaled linearly as nodes were added to a RING. Response times improved as the RING grew in size, allowing for predictability when deploying a RING.” Content Delivery Object Type Simultaneously Sustained Objects Delivered 5 servers with Intel SSD Internet Audio (MP3) 211,424 Internet Image (JPG) 135,311 Internet Video (MPEG) 90,208 CD Audio (ISO) 18,877 Broadcast TV (HD) 2,298

Scality RING – The BIG picture

Scality Solutions Email File Storage StaaS Digital Media Big Data2 Scality RING Core P2P, Replication, Erasure Code, Tiering, API/Interface (HTTP/REST with Scality SRWS and RS2 Light, CDMI by Obj. ID), Management Email Full Email platform integration Certified with Openwave Messaging, Critical Path, Cyrus, Dovecot, VMware Zimbra, Open-Xchange File Storage Scale-Out File System for Linux NFS/CIFS CDMI by Path Global Namespace GeoSync StaaS Amazon S3 API Authentication, Metering Option Multi-Geo Sync-n-Share1 Digital Media Optimized SOFS for CDN Origin server Big Data2 Hadoop integration with in-place data processing Scality SOFS instead of HDFS Open Cloud Access S3 & CDMI API 1: Product available separately / 2: Available Q2/2013

Scality Ecosystem and Partnership File Sync & Share Backup & Archive Email Gateway Hardware vendor strategic partnerships

Scality Product availability Software only Hardware agnostic RING Core + Solutions Pack Multi-Geo option Price per usable storage capacity “Appliance” based on MIS (Duo or Solo server) RING Core + StaaS Pack Multi-Geo option Price per enclosure (4U) Highest storage density on the market (72 x 4TB/4U) Scality RING Organic Storage 4.0

Release Calendar & Roadmap H1/2014 TBC RING 5.0 “Universal Data Platform” - Block interface - Policy Engine & Data Placement June 2012 RING 4.0 - ARC (Erasure Code) SOFS 1.0 (FUSE) Supervisor (Keys, Agent, SNMP) 2012 | 2013 | 2014 Q4 2013 RING 4.3 OCA Phase 3 (Metering/Multi-Tenant + Swift + S3) Act./Act. Geo RS2 Q2 2013 RING 4.2 SOFS 2.0 (NFS, CIFS) + GeoSync Hadoop (HDFS replacement, computing on nodes) Multipart Upload Q1 2013 RING 4.1 Digital Media Open Cloud Access (CDMI & SOFS) SOFS GeoSync Supervisor (usage) OpenStack integration (EBS with Cinder) Feb. 2013

Scality Technology Milestones wth Replication and Tiering for primary storage (HTTP, S3) Blob Store Authentication, Metering, Security for S3 Policy data placement, data protection Erasure Code data protection CIFS based on Samba 4 Hadoop for Big Data Cloud Files Swift Protocol 2010 | 2011 | 2012 | Q2/2013 | Q4/2013 CDMI NFS Distributed Database File Sync-and-Share OEM Nomadesk Scale Out File System for Linux SQL front-end for Distributed DB Block Storage (to add storage to VMs) with OpenStack integration via Cinder Multi-Tenancy, QoS Mgmt (IOPS, Throughput, Capacity) & Snapshot Mature Ready Beta Alpha Prototype Design

Scality Technical Vision Compute Media HPC StaaS Note: Underlined items are roadmap Tenant A Tenant B Tenant C Tenant D Unified Storage Interface (File, Block, Object and HDFS Local and Remote) Scale Out Access Layer Metering Auth. Real-time Policy & QoS Big Data Analytics Content Indexing Security Storage Back-end Local, Distant or Multi-Geo RINGs High Perf Transactional Standard Storage 1 year Long-Term Storage 100 years Statistics SSD SATA Erasure Code SATA Discovery Customer IT Infrastructure

Unified Scale-Out Storage Software Conclusion Technology Leader Fully Autonomous Software only solution with oem agreements High Performance and strong Security Proven deployed solution Cost efficiency and rapid ROI 100% Data Availability and Durability Unified Scale-Out Storage Software