1. Module 2: DriveScale architecture and components
DriveScale Proprietary Information © 2017

2. DriveScale Confidential Information © 2017
List of acronyms
Acronyms
Meaning
DSC
DriveScale Management Server
DMS
DSA
DriveScale Adapter
LDAP
Lightweight Directory Access Protocol
iSCSI
Internet Small Computer Systems Interface
MLAG
Multichassis Link Aggregation
JBOD
Just a Bunch Of Disks HA
High Availibilty DS
DriveScale
SAS
Serial Attached SCSI
SATA
Serial Advanced Technology Attachment
Gbps
Gigabits per second
SFP
Small Form Factor
DriveScale Confidential Information © 2017

3. DriveScale Confidential Information © 2017
The DriveScale System
DriveScale Adapter
DriveScale Management System
Cloud Central
Highly Automated Infrastructure Provisioning and Management
DriveScale Confidential Information © 2017

4. DriveScale Adapter: Interfaces
1U appliance with adapters that connect to servers via Ethernet, and to JBOD’s via SAS
4 DriveScale Ethernet to SAS Adapters in 1u Chassis
Dual Redundant Power Supplies
With 80 Gb throughput, a single chassis can comfortably support simultaneous access to 80 drives w/ equivalent performance to Direct Attached Storage
2x 10GbE Interfaces per Adapter
2x 12Gb 4 Lane SAS Interfaces per Adapter
DriveScale Confidential Information © 2017

5. DriveScale Adapter: Front Panel NVMe Drives
DriveScale Confidential Information © 2017

6. DriveScale Confidential Information © 2017
Chassis Block Diagram
NVMe Slot_1
Controller_1
12Gb 4 Lane SAS: MiniSAS_HD
12Gb 4 Lane SAS: MiniSAS_HD
10GbE: SFP+
10GbE: SFP+
1GbE RJ45
Controller_2
12Gb 4 Lane SAS: MiniSAS_HD
12Gb 4 Lane SAS: MiniSAS_HD
10GbE: SFP+
NVMe Slot_5
10GbE: SFP+
1GbE RJ45
Power Supply_1
Showing Two of the Four Controllers in the Chassis
Power Supply_2
DriveScale Confidential Information © 2017

7. DriveScale Adapter Controller Block Diagram
SAS Controller
12G, 4 Lane SAS
PCIe Interfaces to
NVMe slots in front
12G, 4 Lane SAS
PCIe Switch
Network Processor
10GbE SFP+
10GbE SFP+
Chassis NW
1GbE RJ45
DriveScale Confidential Information © 2017

8. Deployment Model Adapter 4 Adapter 3 Adapter 2 Adapter 1 DSA
Management Plane Switch
Switch 1
Switch 2
MLAG
DMS & Cloudera
VM Server
Data Node 4

Controller 2
Controller 1
Data Node 3
Data Node 2
1GE (mgmt)
Data Node 1
10GE
SAS
Name Node 8
JBOD

9. Disaggregation is accomplished here
Compute pool: Processor + Memory Servers
1u DriveScale Adapter (DA) -Ethernet to SAS
This is where we cut the lady in half. So, a fully loaded rack might look something like this. In the top half of the rack we have diskless or disk-lite servers. In the bottom of the rack as JBOD’s with several drives in each. In the middle are two or more DriveScale Adapters (DA’s). One thing to point out here is that the DriveScale system is designed to be a DataCenter wide system, so our management system scales to hundreds of racks.
Storage pool: Disks in JBODs, connected via SAS to the DA’s
DriveScale Proprietary Information © 2017
DriveScale Confidential Information © 2017

10. DriveScale Software Components
There are four principal components of the DriveScale software:
DriveScale Management Server (DMS)
DriveScale Server Agent
DriveScale Central (DSC)
DriveScale Adapter firmware
DriveScale Proprietary Information © 2017

11. DriveScale Software Components Cont..
DriveScale Management Server (DMS)
Whichever machine runs the DMS software bundle is called the DMS node
Typical deployment consists of 3 DMS Systems in a clustered fashion for HA
Manages and configure resources and contains inventory/configuration repository of:
Inventory (DMS’s, DS Adapters, Switches, JBOD Chassis, Disks, Server Nodes)
Configuration (Node Templates, Cluster Templates, Configured Clusters)
DMS Database is used as a message bus to communicate with the end points
DriveScale Server Agent
DriveScale Server Agent Discovery provides inventory for hardware and servers
Creates mappings for Server Nodes to consume disks
DriveScale Confidential Information © 2017

12. DriveScale Software Components Cont..
DriveScale Central (DSC)
Cloud-based software management portal where DriveScale repos are stored for software distribution to subscribers.
Keys repository
Centralized log file repository.
Documentation repository
License management
DriveScale Adapter Firmware
Heart of the cluster where the code is running on the processor and enables the JBODs to be presented to the servers to be used as local drives
DriveScale Confidential Information © 2017

13. DriveScale Confidential Information © 2017
Central
Kerberos/LDAP Integration
HTTPS
HTTPS (80)
SSH (22)
HTTPS
HTTPS (443)
Zookeeper
(2281 TCP)
HTTPS (8444,443)
Zookeeper
(2281 TCP)
HTTPS (8443)
Zookeeper (2888, 3888 TCP)
MongoDB (27017)
HTTPS
HTTPS/SSH
iSCSI (wide port range) 13
DriveScale Confidential Information © 2017
HTTP (38202)

14. DriveScale Cluster Minimum Hardware Requirements
Two 10G SFP+ switches
One1G switch
One JBOD
One DSA chassis
DriveScale Confidential Information © 2017

15. DriveScale OS Support Matrix
DriveScale now supports server nodes of type CentOS 6, CentOS 7, and Ubuntu
The DriveScale Management Servers (DMS) can be installed on CentOS 6, CentOS7, and Ubuntu 14.04
DMS
Server Nodes
CentOS/RHEL 6.x X
CentOS/RHEL 7.x
Ubuntu 14.04
DriveScale Confidential Information © 2017

16. DriveScale Proprietary Information © 2017
Communication Flow
User -> DMS - Management interface access (HTTPS , HTTP redirect to HTTPS on 80)
if using haproxy for HA, then HTTPS of individual server (not haproxy) is on 8443
User -> Adapter - Network configuration - HTTPS
Adapter -> DMS - software updates (HTTPS on 8444)
DMS -> DriveScale Central - software updates (HTTPS)
DMS -> DriveScale Central - statistics / logs upload (HTTPS)
DMS -> DMS - haproxy health check (HTTPS on 8443)
DMS -> DMS - VRRP for HA setup
DMS -> DMS - Zookeeper replication (2888, 3888 TCP)
DMS -> DMS - MongoDB replication + access (27017 TCP)
Server/Adapter/DMS -> DMS - Zookeeper access (2181 TCP)
Server -> Adapter - iSCSI (wide port range, one iSCSI portal per drive used)
Server -> Adapter, HTTP on alternate port for balancing (Live Data load Monitoring Reported from Adapter).
Server -> DriveScale Central - software install (HTTPS)
Server/Adapter -> DMS Log Report (HTTPS)
DriveScale Proprietary Information © 2017

17. HDFS Cluster Minimum Hardware Requirements
1x DSA chassis (includes 4x DS Adapters)
1x JBOD to be loaded with the 60 drives
3 (min) x Servers for Data Nodes with 1 direct attached drive each for OS install (4-12 drives will be remotely attached via DSA)
1x Server for Name Node with 1 direct attached drive for OS install and Name node service
1x Server or a VM for DMS and Cloudera/Hortonworks
2x 10GbE switches for Data Flow
1x Management Switch (1GbE)
Cables
DriveScale Confidential Information © 2017