1. Microsoft Ignite 2016
5/22/2018 7:21 PM
BRK2007
SQL Server 2016 HTAP Performance with Windows 2016 and HPE Persistent Memory (Hybrid Transaction Processing and Analytics Processing)
Lindsey Allen
Microsoft SQL Server
Tobias Klima
Microsoft Windows Server
© 2016 Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

2. Agenda SQL 2016 HTAP Technology
5/22/2018 7:21 PM
Agenda
SQL 2016 HTAP Technology
What is HTAP
SQL 2016 is the best HTAP engine
In-memory HTAP reference
Accelerate HTAP on SQL Server with Persistent Memory
Overview
Windows 2016 Persistent Memory
HPE Persistent Memory
© 2014 Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

3. What is HTAP? Hybrid Transaction and Analytics Processing
Microsoft Ignite 2016
5/22/2018 7:21 PM
What is HTAP? Hybrid Transaction and Analytics Processing
Runs OLTP and OLAP on the same database
Real time analytics without data latency
Minimum performance impact to OLTP workload
OLAP has access to up-to-date data as we eliminate need to ETL data
SQL Server 2016 is the best HTAP engine
Integrated column-store and row-store, both In-Memory and on-disk
© 2016 Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

4. Traditional Analytics Architecture
Microsoft Ignite 2015
5/22/2018 7:21 PM
Traditional Analytics Architecture
Select ProduceName, ExpiryDate, SUM (inventory – item_sold)
From <transactions>
where [Date] >= DATEADD(day, -1, GETDATE())
Group by ProductName, ExpiryDate, DATEPART(HOUR, [Date])
Insert into <transactions>
values (‘<upc-code>, ‘flowers’, $20.00)
SQL Server
Database
Application Tier
Presentation Layer
IIS Server
BI and analytics
Dashboards
Reporting
SQL Server
Analysis Server
Key Issues
Complex Implementation
Requires two Servers (CapEx and OpEx)
Data Latency in Analytics
More businesses demand/require real-time Analytics
SQL Server
Relational DW
Database
ETL
Hourly, Daily, Weekly
© 2015 Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

5. Microsoft Ignite 2015
5/22/2018 7:21 PM
SQL Server 2016 HTAP Technology Real-Time Analytics without compromise OLTP Performance
Select ProduceName, ExpiryDate, SUM (inventory – item_sold)
From <transactions>
where [Date] >= DATEADD(day, -1, GETDATE())
Group by ProductName, ExpiryDate, DATEPART(HOUR, [Date])
Insert into <transactions>
values (‘<upc-code>, ‘flowers’, $20.00)
SQL Server
Database
Application Tier
Presentation Layer
IIS Server
Benefits
No Data Latency
No ETL
No Separate DW
Challenges
Minimizing Impact on OLTP workload
Delivering Performant Analytics
BI and analytics
Dashboards
Reporting
This is Real-Time ANALYTICS
SQL Server
Analysis Server
Add columnstore index
© 2015 Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

6. SQL Server 2016 HTAP Demo Lindsey Allen Microsoft Ignite 2016
5/22/2018 7:21 PM
SQL Server 2016 HTAP Demo
Lindsey Allen
© 2016 Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

7. SQL In-Memory Technologies
5/22/2018
SQL In-Memory Technologies
SQL Real-Time Analytics
In 2016 and Azure DB
Faster Transactions
Faster Analytics +
IN-MEMORY OLTP +
IN-MEMORY DW
Up to 30x faster transaction processing with In-Memory OLTP
Over 100x analytics query speed and significant data compression with In-Memory ColumnStore
Using the same tables
© 2012 Microsoft Corporation. All rights reserved. Microsoft, Windows, and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries.
The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

8. SQL Server 2016 HTAP Case Study
Microsoft Ignite 2016
5/22/2018 7:21 PM
SQL Server 2016 HTAP Case Study
Dell IT monitoring system collecting data from more than 2000 database servers
Used to take more than 10 hours to processing data
In-Memory HTAP reduced the data processing to less than an hour, enable Dell to collect and process more data points
Data visualization from minutes to seconds
“10X performance improvement in data processing pipeline, and can visualize richer insights in seconds”
– Reinaldo Kibel, Dell
© 2016 Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

9. Accelerate SQL Server with Persistent Memory
5/22/2018 7:21 PM
Accelerate SQL Server with Persistent Memory
© 2014 Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

10. More Transactions, Lower Latency
How do I increase my transaction throughput?
How do I reduce my transaction latency?
Options:
More CPU! 2S system  4S system
More Memory! 128GB  256GB  1TB+
Faster Storage! HDD  SATA SSD  NVMe SSD
SQL Server 2016 “Tail Of Log” (preview) on Persistent Memory

11. SQL Server 2016 “Tail- of-Log” (preview) on Persistent Memory
Tobias Klima

12. Faster Transaction Processing via Persistent Memory Use
Microsoft Ignite 2016
5/22/2018 7:21 PM
Faster Transaction Processing via Persistent Memory Use
NVDIMM-N (Byte) 1
In the Past:
Copy log records into buffer, building up block
Close log block once commit arrives
Schedule I/O to persist block on SSD
Complete transaction when I/O completes
Log Buffers 2 3
With ToL:
Copy log records into buffer, building up block
Complete transaction when commit arrives
Close log block when full
Schedule I/O to persist full block on SSD
Red indicates the critical path for a transaction
SSD (Block) 4
Log File
© 2016 Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

13. Native NVDIMM-N Support in WS 2016
Windows exposes a latency-optimized “disk” device (block interface)
DirectAccess (DAX): enlightened apps (SQL 2016) can directly access their data on the Persistent Memory (PM) device via Load/Store instructions
Use of DAX on NVDIMM-N provides DRAM-like performance
4K Random Write
Thread Count
IOPS
Latency (us)
NVDIMM-N (Block) 1
187,302
5.01
NVDIMM-N (DAX)
1,667,688
0.52
Data gathered on pre-release hardware and software, final results may differ.
Workload: 4KB random writes against a 1GB file on NTFS, MSFT-internal testing tool

14. Demo Configuration & References
Hardware
Server: HPE Proliant® DL380® Gen9
CPU: 2x Intel® Xeon® CPU E GHz
Memory: 96GB
PM: 2x HPE 8GB NVDIMM
Storage: 2x NVMe SSDs (1.6TB) (Log, Tables)
Software:
Windows Server 2016 (RTM)
SQL Server 2016
Internal Load Generation Tool for In-Memory OLTP
Reference Material:
WS 2016 NVDIMM Support (Block) (
WS 2016 NVDIMM Support (Byte) (
WS SQL 2016 ToL (preview) (

15. HTAP on Nextgen HPE Server
Microsoft Ignite 2016
5/22/2018 7:21 PM
HTAP on Nextgen HPE Server
© 2016 Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

16. HPE Persistent Memory on ProLiant DL3x0 Gen9
Delivering the performance of memory with the persistence of traditional storage
HPE Persistent Memory for SQL Server
Up to 64 GB persistent memory per socket
Removes the bottleneck of SQL Server log write times
Increases throughput and resource utilization
Hewlett Packard Enterprise is here to help
Don’t take any chances
Future-proof your SQL Server environment
Design an optimal SQL Server environment with purpose-built, HPE scale-up servers with persistent memory
Take advantage of HPE tested and validated configurations

17. HTAP on NextGen HPE Server Demo
Microsoft Ignite 2016
5/22/2018 7:21 PM
HTAP on NextGen HPE Server Demo
Lindsey Allen
© 2016 Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

18. Takeaways
HTAP empowers application leaders to innovate and improved business agility.
SQL Server 2016 is the best HTAP Engine
Accelerate your SQL Server 2016 deployments using Windows Server 2016 and HPE Persistent Memory Servers.

19. Free IT Pro resources To advance your career in cloud technology
Microsoft Ignite 2016
5/22/2018 7:21 PM
Free IT Pro resources To advance your career in cloud technology
Plan your career path
Microsoft IT Pro Career Center
Cloud role mapping
Expert advice on skills needed
Self-paced curriculum by cloud role
$300 Azure credits and extended trials
Pluralsight 3 month subscription (10 courses)
Phone support incident
Weekly short videos and insights from Microsoft’s leaders and engineers
Connect with community of peers and Microsoft experts
Get started with Azure
Microsoft IT Pro Cloud Essentials
Demos and how-to videos
Microsoft Mechanics
Connect with peers and experts
Microsoft Tech Community
© 2016 Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

20. Please evaluate this session
5/22/2018 7:21 PM
Please evaluate this session
Your feedback is important to us!
From your PC or Tablet visit MyIgnite at
From your phone download and use the Ignite Mobile App by scanning the QR code above or visiting
© 2014 Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.