Microsoft Ignite 2016 5/22/2018 7:21 PM BRK2007

Slides:



Advertisements
Similar presentations
Review DirectQuery in SSAS 2016, best practices and use cases
Advertisements

Learn how the cloud is accelerating network transformation
5 reasons to store your backups on ReFS 3.0 and Storage Spaces
Enable Operational Analytics (HTAP) in SQL Server 2016 and Azure SQL Database Sunil Agarwal Principal Program Manager, SQL Server Product Tiger Team
C# and VB code-focused development with Visual Studio
2/20/2018 7:04 PM BRK1038 Meet Azure Information Protection customers and learn about their success stories Jeffrey Kalfut Strategy & Architecture Manager,
Microsoft Ignite /30/2018 9:28 PM BRK3174
Data Platform Modernization
Transform yourself and build your IT cloud career path
Convergence /6/2018 © 2013 Microsoft Corporation. All rights reserved. Microsoft, Windows, and other product names are or may be registered trademarks.
Deliver business insights with Microsoft Dynamics AX and Power BI
Examine information management in Cortana Intelligence
System Center Marketing
5/22/2018 1:39 AM BRK2156 Power BI Report Server: Self-service BI and enterprise reporting on-premises Christopher Finlan Senior Program Manager © Microsoft.
Develop, debug and deploy containerized applications with Docker
5/25/2018 5:29 AM BRK3081 Delivering High Performance Analytics with Columnstore Index on Traditional DW and HTAP Workloads Sunil Agarwal (Microsoft) Aaron.
Operational Analytics in SQL Server 2016 and Azure SQL Database
System Center Marketing
Build interactive data analysis environments using Apache Spark
Microsoft /2/2018 3:42 PM BRK3129 Query Big Data using the Expanded T-SQL footprint with PolyBase in SQL Server 2016 Casey Karst Program Manager.
BRK3288-Discover data-driven apps that learn and adapt
Windows Server* 2016 & Intel® Technologies
SQL 2016 new Hosting Offers Secure Database Hybrid HyperScale
Conduct a successful pilot deployment of Microsoft Intune
Review the Nutanix Cloud Platform System Standard solution
Microsoft Ignite /11/2018 1:18 AM BRK4017
Using non-volatile memory (NVDIMM-N) as block storage in Windows Server 2016 Tobias Klima Program Manager.
Microsoft /23/2018 1:11 AM BRK3180 Migrate CRM OnPremise organizations to CRM Online cloud using Dynamics Lifecycle Services (LCS) Aditya Varma Ganapathy.
Web development productivity with Visual Studio
Deep Dive into the Azure Container Service
Matching Storage Spaces Direct Configurations to Your Workload
Innovate with Microsoft BI in the enterprise
Microsoft Ignite /22/2018 3:27 PM BRK2121
Secure Remote Access to on-premises Web Apps using Azure AD
7/22/2018 9:21 PM BRK3270 Building a Better Data Solution: Microsoft SQL Server and Azure Data Services Joey D’Antoni Principal Consultant Denny Cherry.
BRK2264 Move 13,000+ global Dynamics CRM users from on-premises to Online at Caterpillar Inc. Todd Byrne & John Finney 1 Business Unit Name Here.
Master Modern PaaS for the Enterprise with Azure App Service
Understanding Windows Analytics Update Compliance
HPE Persistent Memory Microsoft Ignite 2017
Get Started with Common Data Model (CDM) and PowerApps
Microsoft Ignite /8/2018 3:50 PM BRK2112
Design Seamless Upgrades to SQL Server 2016 with Query Store
Installation and database instance essentials
Microsoft /8/2018 4:45 PM BRK3062 BRK3062- Build smarter and scalable applications using Microsoft Azure Database Services Moshe Gutman CEO, GeoSafe.
Bring new levels of visibility to your datacenter with Cisco Tetration
Integrate Power BI with Microsoft Dynamics
Automate all things! Microsoft Azure continuous deployment
Microsoft Ignite /16/2018 2:39 PM BRK3307
Add intelligence to Dynamics AX with Cortana Intelligence suite
Use server-based personal desktops in Windows Server 2016
Azure SQL Data Warehouse Scaling: Configuration and Guidance
Accelerate Your Transition from Traditional IT to the Cloud
BRK Maximize the power of SQL Azure with Dynamics AX
Explore web development with Microsoft ASP.NET Core 1.0
Microsoft Ignite /14/ :21 AM BRK2101
Migrate to CRM Online - Tips and Tricks
Determine your role in a managed service
Dive into Predictive Maintenance using Cortana Intelligence Suite
Data Platform Modernization
Microsoft Ignite /22/2018 3:58 PM BRK2254
11/22/2018 1:43 PM THR3005 How to provide business insight from your data using Azure Analysis Services Peter Myers Bitwise Solutions © Microsoft Corporation.
Automating Windows 10 and software deployments from the Cloud
Mobile Center and VSTS:​ Better together for your Mobile DevOps
Task recorder in Dynamics AX
Microsoft Virtual Academy
Learn how to use and customize the Dynamics AX interactive help system
Microsoft Virtual Academy
Ask the Experts: Windows 10 deployment and servicing
Diagnostics and troubleshooting in Azure App Service Support Center
Microsoft Virtual Academy
Presentation transcript:

Microsoft Ignite 2016 5/22/2018 7:21 PM BRK2007 SQL Server 2016 HTAP Performance with Windows 2016 and HPE Persistent Memory (Hybrid Transaction Processing and Analytics Processing) Lindsey Allen Microsoft SQL Server Tobias Klima Microsoft Windows Server © 2016 Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

Agenda SQL 2016 HTAP Technology 5/22/2018 7:21 PM Agenda SQL 2016 HTAP Technology What is HTAP SQL 2016 is the best HTAP engine In-memory HTAP reference Accelerate HTAP on SQL Server with Persistent Memory Overview Windows 2016 Persistent Memory HPE Persistent Memory © 2014 Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

What is HTAP? Hybrid Transaction and Analytics Processing Microsoft Ignite 2016 5/22/2018 7:21 PM What is HTAP? Hybrid Transaction and Analytics Processing Runs OLTP and OLAP on the same database Real time analytics without data latency Minimum performance impact to OLTP workload OLAP has access to up-to-date data as we eliminate need to ETL data SQL Server 2016 is the best HTAP engine Integrated column-store and row-store, both In-Memory and on-disk © 2016 Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

Traditional Analytics Architecture Microsoft Ignite 2015 5/22/2018 7:21 PM Traditional Analytics Architecture Select ProduceName, ExpiryDate, SUM (inventory – item_sold) From <transactions> where [Date] >= DATEADD(day, -1, GETDATE()) Group by ProductName, ExpiryDate, DATEPART(HOUR, [Date]) Insert into <transactions> values (‘<upc-code>, ‘flowers’, $20.00) SQL Server Database Application Tier Presentation Layer IIS Server BI and analytics Dashboards Reporting SQL Server Analysis Server Key Issues Complex Implementation Requires two Servers (CapEx and OpEx) Data Latency in Analytics More businesses demand/require real-time Analytics SQL Server Relational DW Database ETL Hourly, Daily, Weekly © 2015 Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

Microsoft Ignite 2015 5/22/2018 7:21 PM SQL Server 2016 HTAP Technology Real-Time Analytics without compromise OLTP Performance Select ProduceName, ExpiryDate, SUM (inventory – item_sold) From <transactions> where [Date] >= DATEADD(day, -1, GETDATE()) Group by ProductName, ExpiryDate, DATEPART(HOUR, [Date]) Insert into <transactions> values (‘<upc-code>, ‘flowers’, $20.00) SQL Server Database Application Tier Presentation Layer IIS Server Benefits No Data Latency No ETL No Separate DW Challenges Minimizing Impact on OLTP workload Delivering Performant Analytics BI and analytics Dashboards Reporting This is Real-Time ANALYTICS SQL Server Analysis Server Add columnstore index © 2015 Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

SQL Server 2016 HTAP Demo Lindsey Allen Microsoft Ignite 2016 5/22/2018 7:21 PM SQL Server 2016 HTAP Demo Lindsey Allen © 2016 Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

SQL In-Memory Technologies 5/22/2018 SQL In-Memory Technologies SQL Real-Time Analytics In 2016 and Azure DB Faster Transactions Faster Analytics + IN-MEMORY OLTP + IN-MEMORY DW Up to 30x faster transaction processing with In-Memory OLTP Over 100x analytics query speed and significant data compression with In-Memory ColumnStore Using the same tables © 2012 Microsoft Corporation. All rights reserved. Microsoft, Windows, and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries. The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

SQL Server 2016 HTAP Case Study Microsoft Ignite 2016 5/22/2018 7:21 PM SQL Server 2016 HTAP Case Study Dell IT monitoring system collecting data from more than 2000 database servers Used to take more than 10 hours to processing data In-Memory HTAP reduced the data processing to less than an hour, enable Dell to collect and process more data points Data visualization from minutes to seconds “10X performance improvement in data processing pipeline, and can visualize richer insights in seconds” – Reinaldo Kibel, Dell © 2016 Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

Accelerate SQL Server with Persistent Memory 5/22/2018 7:21 PM Accelerate SQL Server with Persistent Memory © 2014 Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

More Transactions, Lower Latency How do I increase my transaction throughput? How do I reduce my transaction latency? Options: More CPU! 2S system  4S system More Memory! 128GB  256GB  1TB+ Faster Storage! HDD  SATA SSD  NVMe SSD SQL Server 2016 “Tail Of Log” (preview) on Persistent Memory

SQL Server 2016 “Tail- of-Log” (preview) on Persistent Memory Tobias Klima

Faster Transaction Processing via Persistent Memory Use Microsoft Ignite 2016 5/22/2018 7:21 PM Faster Transaction Processing via Persistent Memory Use NVDIMM-N (Byte) 1 In the Past: Copy log records into buffer, building up block Close log block once commit arrives Schedule I/O to persist block on SSD Complete transaction when I/O completes Log Buffers 2 3 With ToL: Copy log records into buffer, building up block Complete transaction when commit arrives Close log block when full Schedule I/O to persist full block on SSD Red indicates the critical path for a transaction SSD (Block) 4 Log File © 2016 Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

Native NVDIMM-N Support in WS 2016 Windows exposes a latency-optimized “disk” device (block interface) DirectAccess (DAX): enlightened apps (SQL 2016) can directly access their data on the Persistent Memory (PM) device via Load/Store instructions Use of DAX on NVDIMM-N provides DRAM-like performance 4K Random Write Thread Count IOPS Latency (us) NVDIMM-N (Block) 1 187,302 5.01 NVDIMM-N (DAX) 1,667,688 0.52 Data gathered on pre-release hardware and software, final results may differ. Workload: 4KB random writes against a 1GB file on NTFS, MSFT-internal testing tool

Demo Configuration & References Hardware Server: HPE Proliant® DL380® Gen9 CPU: 2x Intel® Xeon® CPU E5-2699 v4 @ 1.80GHz Memory: 96GB PM: 2x HPE 8GB NVDIMM Storage: 2x NVMe SSDs (1.6TB) (Log, Tables) Software: Windows Server 2016 (RTM) SQL Server 2016 Internal Load Generation Tool for In-Memory OLTP Reference Material: WS 2016 NVDIMM Support (Block) (https://channel9.msdn.com/events/Build/2016/P466) WS 2016 NVDIMM Support (Byte) (https://channel9.msdn.com/events/Build/2016/P470) WS 2016 + SQL 2016 ToL (preview) (https://channel9.msdn.com/Shows/Data-Exposed/SQL-Server-2016-and-Windows-Server-2016-SCM--FAST)

HTAP on Nextgen HPE Server Microsoft Ignite 2016 5/22/2018 7:21 PM HTAP on Nextgen HPE Server © 2016 Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

HPE Persistent Memory on ProLiant DL3x0 Gen9 Delivering the performance of memory with the persistence of traditional storage HPE Persistent Memory for SQL Server Up to 64 GB persistent memory per socket Removes the bottleneck of SQL Server log write times Increases throughput and resource utilization Hewlett Packard Enterprise is here to help Don’t take any chances Future-proof your SQL Server environment Design an optimal SQL Server environment with purpose-built, HPE scale-up servers with persistent memory Take advantage of HPE tested and validated configurations

HTAP on NextGen HPE Server Demo Microsoft Ignite 2016 5/22/2018 7:21 PM HTAP on NextGen HPE Server Demo Lindsey Allen © 2016 Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

Takeaways HTAP empowers application leaders to innovate and improved business agility. SQL Server 2016 is the best HTAP Engine Accelerate your SQL Server 2016 deployments using Windows Server 2016 and HPE Persistent Memory Servers.

Free IT Pro resources To advance your career in cloud technology Microsoft Ignite 2016 5/22/2018 7:21 PM Free IT Pro resources To advance your career in cloud technology Plan your career path Microsoft IT Pro Career Center www.microsoft.com/itprocareercenter Cloud role mapping Expert advice on skills needed Self-paced curriculum by cloud role $300 Azure credits and extended trials Pluralsight 3 month subscription (10 courses) Phone support incident Weekly short videos and insights from Microsoft’s leaders and engineers Connect with community of peers and Microsoft experts Get started with Azure Microsoft IT Pro Cloud Essentials www.microsoft.com/itprocloudessentials Demos and how-to videos Microsoft Mechanics www.microsoft.com/mechanics Connect with peers and experts Microsoft Tech Community https://techcommunity.microsoft.com © 2016 Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

Please evaluate this session 5/22/2018 7:21 PM Please evaluate this session Your feedback is important to us! From your PC or Tablet visit MyIgnite at http://myignite.microsoft.com From your phone download and use the Ignite Mobile App by scanning the QR code above or visiting https://aka.ms/ignite.mobileapp © 2014 Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.