1. Mission-critical performance with Microsoft SQL Server 2016
Speaker Name

2. Introduction Class hours Restrooms Meals Internet connectivity
8:00 A.M. to 5:00 P.M.
Restrooms
Meals
10:00 A.M. – Break
Noon – Lunch
3:00 P.M. – Break
Internet connectivity

3. Agenda – SQL Server 2016 Day 2 Time Title 08:00 – 08:15
PPE training overview and welcome back
08:15 – 09:45
Query Store, Live Query Statistics Overview and HOLs
09:45 – 10:00
Break
10:00 – 11:00
Temporal Tables Overview and HOL
11:00 – 12:00
Polybase Overview
12:00 – 13:00
Lunch
13:00 – 13:45
Polybase HOL
13:45 – 15:15
Stretch Database Overview and HOL
15:15 – 15:30
15:30 – 16:45
Enhanced Backup to Azure Overview and HOL
16:45 – 17:00
Day 2 wrap-up

4. ESP Sales Presentation for Mobility
4/10/2013
© 2016 Microsoft Corporation. All rights reserved. Microsoft, Windows, Microsoft Azure, and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries. The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION
Microsoft Corporation

5. SQL Server 2016 Query Store & Live Query Statistics
5/15/ :04 AM
SQL Server 2016 Query Store & Live Query Statistics
Mission-critical performance with Microsoft SQL Server 2016
© 2013 Microsoft Corporation. All rights reserved. Microsoft, Windows, and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries. The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

6. 5/15/ :04 AM
Learning objectives
Key Usage Scenarios Query Store Architecture Troubleshooting Query Performance with Query Store Live Query Statistics HOLs: Query Store & Live Query Statistics
© 2013 Microsoft Corporation. All rights reserved. Microsoft, Windows, and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries. The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

7. Query Store overview

8. Key usage scenarios Find and fix query plan regressions
5/15/ :04 AM
Key usage scenarios
Find and fix query plan regressions
Identify top resource consumers
Conduct deep analysis of workload patterns/ performance
Reduce risks with server upgrade
Long-term/strategic
Short-term/tactical
© 2014 Microsoft Corporation. All rights reserved. Microsoft, Windows, and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries.
The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

9. How Query Store works SQL Query Store
Durability latency controlled by DB option
DATA_FLUSH_INTERNAL_SECONDS
Query Store
Async write-back
Compile
Execute
SQL
Plan store
Runtime stats
Query Store schema
Compile MSG
Execute MSG
Collects query texts—plus all relevant properties
Stores all plan choices and performance metrics
Works across restarts/upgrades/recompiles
Dramatically lowers the bar for performance troubleshooting
Allows new views
Offers intuitive and easy plan forcing

10. Runtime stats interval
Query Store schema explained
Internal tables
sys.
Compile stats
query_store_query_text
query_context_settings
query_store_query
query_store_plan
Runtime stats
query_store_runtime_stats_interval
query_store_runtime_stats
Exposed views
Query text
Query
Plan
Runtime stats
1 -n
1 -n
One row per query text, per plan affecting option
(example: ANSI NULLS on/off)
One row per plan (for each query)
One row per plan, per time interval (example: 5 min)
Context settings
Runtime stats interval

11. Stability during upgrade to SQL Server 2016
Query optimization enhancements tied to database compatibility level
Install bits
Keep existing compat level
Run Query Store
(create a baseline)
Move to vNext CompatLevel
Fix regressions with plan forcing

12. Troubleshooting query performance
Enable Query Store
(ALTER DB)
Let Query Store collect the data
Search for “problematic” queries
Set FORCE PLAN policies

13. ALTER DATABASE AdventureWorks2012 SET QUERY_STORE = ON;
5/15/ :04 AM
Enabling Query Store
Query Store is not active for new databases by default
Use the Query Store page in Management Studio
In Object Explorer, right-click a database, and then click Properties
In the Database Properties dialog box, select Query Store page
In the Enable box, select True
Use Transact-SQL statements
Use the ALTER DATABASE statement to enable Query Store
For example:
ALTER DATABASE AdventureWorks2012 SET QUERY_STORE = ON;
© 2013 Microsoft Corporation. All rights reserved. Microsoft, Windows, and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries. The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

14. Working with Query Store
/* (6) Performance analysis using Query Store views*/
SELECT q.query_id, qt.query_text_id, qt.query_sql_text, SUM(rs.count_executions) AS total_execution_count
FROM
sys.query_store_query_text qt JOIN
sys.query_store_query q ON qt.query_text_id = q.query_text_id JOIN
sys.query_store_plan p ON q.query_id = p.query_id JOIN
sys.query_store_runtime_stats rs ON p.plan_id = rs.plan_id
GROUP BY q.query_id, qt.query_text_id, qt.query_sql_text
ORDER BY total_execution_count DESC
/* (7) Force plan for a given query */
exec sp_query_store_force_plan
12 14
/* (1) Turn ON Query Store */
ALTER DATABASE MyDB SET QUERY_STORE = ON;
/* (2) Review current Query Store parameters */
SELECT * FROM sys.database_query_store_options
/* (3) Set new parameter values */
ALTER DATABASE MyDB
SET QUERY_STORE (
OPERATION_MODE = READ_WRITE,
CLEANUP_POLICY = (
STALE_QUERY_THRESHOLD_DAYS = 30 ),
DATA_FLUSH_INTERVAL_SECONDS = 3000,
MAX_SIZE_MB = 500,
INTERVAL_LENGTH_MINUTES = 15 );
/* (4) Clear all Query Store data */
ALTER DATABASE MyDB SET QUERY_STORE CLEAR;
/* (5) Turn OFF Query Store */
ALTER DATABASE MyDB SET QUERY_STORE = OFF;
DB-level feature exposed through T-SQL extensions
ALTER DATABASE
Catalog views (settings, compile, and runtime stats)
Stored Procs (plan forcing, query/plan/stats cleanup)

15. Monitoring query performance
Query Store feature provides DBAs with insight on query plan choice and performance
Regressed Queries pane shows queries and plans in Query Store
Drop-down boxes at top allow you to select queries based on various criteria

16. Live Query Statistics overview

17. Live query statistics Collect actual metrics about query while running
5/15/ :04 AM
Live query statistics Collect actual metrics about query while running
To view live query execution plan, on the Tools menu, click Live Query Statistics
Using LQS, you can view CPU/memory usage, execution time, query progress, and so on
Enables rapid identification of potential bottlenecks for troubleshooting query performance issues
Allows drill-down to live operator level statistics
Number of generated rows
Elapsed time
Operator progress
Live warnings
© 2013 Microsoft Corporation. All rights reserved. Microsoft, Windows, and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries. The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

18. How does it work? Real-time showplan dynamic management views
5/15/2018
How does it work?
Real-time showplan dynamic management views
sys.dm_exec_requests
sys.dm_exec_sql_text
sys.dm_exec_query_memory_grants
sys.dm_exec_query_plan
sys.dm_exec_query_profiles
Enable live query plan
In Management Studio, click the Live Query Statistics or Query Store menu
SET STATISTICS XML ON or SET STATISTICS PROFILE ON in the session before the query is started
Enabling Extended Event query_post_execution_showplan
The event itself does not have to fire—it just needs to be enabled
© 2014 Microsoft Corporation. All rights reserved. Microsoft, Windows, and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries. The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

19. Other ways to view live query statistics
5/15/ :04 AM
Other ways to view live query statistics
In Management Studio, right-click the selected query, and then click Include Live Query Statistics
In Activity Monitor, right-click queries in the Active Expensive Queries table
© 2013 Microsoft Corporation. All rights reserved. Microsoft, Windows, and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries. The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

20. Live query statistics limitations
5/15/ :04 AM
Live query statistics limitations
Natively compiled stored procedures are not supported
© 2013 Microsoft Corporation. All rights reserved. Microsoft, Windows, and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries. The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

21. Live query statistics permissions
5/15/ :04 AM
Live query statistics permissions
Requires
Database-level SHOWPLAN permission to populate live query statistics results page
Server-level VIEW SERVER STATE permission to see live statistics
Any permissions necessary to execute query
© 2013 Microsoft Corporation. All rights reserved. Microsoft, Windows, and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries. The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

22. HOL: Query Store HOL: Live Query Statistics

23. ESP Sales Presentation for Mobility
4/10/2013
© 2016 Microsoft Corporation. All rights reserved. Microsoft, Windows, Microsoft Azure, and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries. The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION
Microsoft Corporation

24. SQL Server 2016 Temporal Tables
5/15/ :04 AM
SQL Server 2016 Temporal Tables
Mission-critical performance with Microsoft SQL Server 2016
© 2013 Microsoft Corporation. All rights reserved. Microsoft, Windows, and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries. The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

25. 5/15/ :04 AM
Learning objectives
Why Temporal Tables Key Scenarios Temporal Tables Architecture Stretching Temporal History to the Cloud HOL: Temporal Tables
© 2013 Microsoft Corporation. All rights reserved. Microsoft, Windows, and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries. The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

26. Why temporal Data changes over time Temporal in DB
5/15/ :04 AM
Why temporal
Data changes over time
Tracking and analyzing changes is often important
Temporal in DB
Automatically tracks history of data changes
Calculating trends over time
Enables easy querying of historical data states
Maintaining a slowly changing dimension
Recovering from accidental data changes and application errors
Advantages over workarounds
Simplifies app development and maintenance
Efficiently handles complex logic in DB engine
Time travel
Data audit
Slowly changing dimensions
Repair record-level corruptions
Performance
© 2014 Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

27. No change in programming model
Microsoft Ignite 2015
5/15/ :04 AM
How to start with system-versioned temporal tables
ANSI compliant
No change in programming model
New insights
FOR SYSTEM_TIME
AS OF
FROM..TO
BETWEEN..AND
CONTAINED IN
Temporal Querying
CREATE temporal TABLE PERIOD FOR SYSTEM_TIME…
ALTER regular_table TABLE ADD PERIOD…
DDL
INSERT / BULK INSERT
UPDATE
DELETE
MERGE
DML
SELECT * FROM temporal
Querying
Performance
© 2015 Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

28. How does system-time work?
Microsoft Ignite 2015
5/15/ :04 AM
How does system-time work?
Temporal table (actual data)
History table
* Old versions
Update */ Delete *
Insert / Bulk Insert
Performance
© 2015 Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

29. Temporal Tables and Streching to the Cloud
Azure SQL Server Stretch Database with Always Encrypted Data
Temporal queries
Performance

30. Internal data retention
In-Memory OLTP and temporal
Current data
(in-memory)
Extreme OLTP with cost-effective data history
Disk-based history table
Super-fast DML and current data querying
Temporal querying in interop mode
Fast DML
In-memory buffer
(internal)
Internal data retention
Historical data
(disk-based)
Performance

31. HOL: Temporal Tables

32. ESP Sales Presentation for Mobility
4/10/2013
© 2016 Microsoft Corporation. All rights reserved. Microsoft, Windows, Microsoft Azure, and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries. The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION
Microsoft Corporation

33. 5/15/ :04 AM
PolyBase overview
Mission-critical performance with Microsoft SQL Server 2016
© 2015 Microsoft Corporation. All rights reserved. Microsoft, Windows, and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries. The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

34. 5/15/ :04 AM
Learning objectives
Overview of Polybase Use Cases Getting Started with Polybase Creating Polybase Objects Querying Polybase HOL: Polybase
© 2013 Microsoft Corporation. All rights reserved. Microsoft, Windows, and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries. The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

35. Overview of PolyBase 5/15/2018 12:04 AM
© 2015 Microsoft Corporation. All rights reserved. Microsoft, Windows, and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries. The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

36. PolyBase unites …for a better-together world of analytics
Structured data
Unstructured data
Business data
…for a better-together world of analytics

37. 5/15/ :04 AM
Interest in big data
Increase in number and variety of data sources that generate large quantities of data
Realization that data is “too valuable” to delete
Dramatic decline in hardware cost, especially storage $
Adoption of big-data technologies like Apache Hadoop
© 2015 Microsoft Corporation. All rights reserved. Microsoft, Windows, and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries. The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

38. Unique, innovative technology
5/15/ :04 AM
Why PolyBase?
Component of SQL Server 2016 and Azure SQL Data Warehouse
Highly parallelized, distributed query engine accessing heterogeneous data via SQL
Import and Export data back and forth between relational tables in SQL Server and non-relational data stored in Hadoop or Azure Blob Storage
Unique, innovative technology
Seamless integration
© 2015 Microsoft Corporation. All rights reserved. Microsoft, Windows, and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries. The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

39. PolyBase use cases Load data Interactively query Age-out data
5/15/ :04 AM
PolyBase use cases
Load data
Use Hadoop as an ETL tool to cleanse data before loading to data warehouse with PolyBase
Interactively query
Analyze relational data with semi-structured data using split-based query processing
Age-out data
Age-out data to HDFS and use it as “cold” but queryable storage
© 2015 Microsoft Corporation. All rights reserved. Microsoft, Windows, and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries.
The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

40. Getting started withPolyBase
5/15/ :04 AM
Getting started withPolyBase
© 2015 Microsoft Corporation. All rights reserved. Microsoft, Windows, and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries. The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

41. How to use PolyBase in SQL Server 2016
PolyBase Group
Head Node
Compute Nodes
SQL 2016
PolyBase Engine
PolyBase DMS
Hadoop Cluster
Namenode
Datanode
File System AB 01
PolyBase T-SQL queries submitted here
PolyBase Group with multiple Compute Nodes access the Hadoop Cluster Datanodes or Azure Blob Storage.
Access any data

42. Configure PolyBase group
Head Node
Compute Nodes
SQL 2016
PolyBase Engine
PolyBase DMS
Compute nodes
Use stored procedures and GUI to configure nodes as compute nodes of a PolyBase group
Access any data

43. Step 1: Set up a Hadoop cluster…
Namenode
Datanode
File System AB 01
Hortonworks or Cloudera distributions
Hadoop 2.0 or above
Linux or Windows
On-premises or in Azure
Access any data

44. Step 1: …or set up an Azure Storage Blob
Azure Storage Volume
Azure Storage Blob (ASB) exposes an HDFS layer
PolyBase reads and writes from ASB using Hadoop RecordReader/RecordWrite
No compute pushdown support for ASB
Access any data

45. Step 2: Install SQL Server
Server Instances
SQL 2016
PolyBase DLLs
Install one or more SQL Server instances with PolyBase
PolyBase DLLs (Engine and DMS) are installed and registered as Windows Services
Prerequisite: User must download and install JRE (Oracle)
Access any data

46. Step 3: Configure PolyBase group
Head Node
Compute Nodes
SQL 2016
PolyBase Engine
PolyBase DMS
Compute nodes
Use stored procedures and GUI to configure nodes as compute nodes of a PolyBase group
Access any data

47. Step 3: Configure PolyBase group
Head Node
Compute Nodes
SQL 2016
PolyBase Engine
PolyBase DMS
Compute nodes
PolyBase scale-out group
Head node is the SQL Server instance to which queries are submitted
Compute nodes are used for scale-out query processing for data in HDFS or Azure

48. Step 4: Choose External Big Data Source
-- different numbers map to various Hadoop flavors
-- example: value 4 stands for HDP 2.x on Linux, value 5 for HDP 2.x on Windows,
value 6 for CHD 5.x on Linux
Supported Big Data Sources
Hortonworks HDP 1.3 on Linux/Windows Server
Hortonworks HDP 2.0 – 2.3 on Linux/Windows Server
Cloudera CDH 4.3 on Linux
Cloudera CDH 5.1 – 5.5 on Linux
Azure blob storage
What happens behind the scenes?
Loading the right client jars to connect to Hadoop distribution

49. Step 5: Attach Hadoop cluster or Azure Storage
Head Node
Compute Nodes
SQL 2016
SQL 2016
SQL 2016
SQL 2016
PolyBase Engine
PolyBase DMS
PolyBase DMS
PolyBase DMS
PolyBase DMS
Azure
Azure Storage Volume
Hadoop Cluster
Namenode
Datanode
File System AB 01
Access any data

50. After setup
PolyBase Group
Head Node
Compute Nodes
SQL 2016
PolyBase Engine
PolyBase DMS
Hadoop Cluster
Namenode
Datanode
File System AB 01
Compute nodes are used for scale-out query processing on external tables in HDFS
Tables on compute nodes cannot be referenced by queries submitted to head node
Number of compute nodes can be dynamically adjusted by DBA
Hadoop clusters can be shared among multiple SQL16 PolyBase groups
Access any data

51. Creating Polybase objects
5/15/ :04 AM
Creating Polybase objects
CREATE EXTERNAL DATA SOURCE HadoopCluster WITH(
TYPE = HADOOP,
LOCATION = 'hdfs:// :8020' );
CREATE EXTERNAL FILE FORMAT CommaSeparatedFormat WITH(
FORMAT_TYPE = DELIMITEDTEXT,
FORMAT_OPTIONS (FIELD_TERMINATOR = ',', USE_TYPE_DEFAULT = TRUE)
CREATE EXTERNAL TABLE [dbo].[SensorData](
vin varchar(255),
speed int,
fuel int,
odometer int,
city varchar(255),
datatimestamp varchar(255) )
WITH(
LOCATION = '/apps/hive/warehouse/sensordata',
DATA_SOURCE = HadoopCluster,
FILE_FORMAT = CommaSeparatedFormat
Create an external data source
Create an external file format
Create an external table for unstructured data
© 2015 Microsoft Corporation. All rights reserved. Microsoft, Windows, and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries. The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

52. Polybase queries Query external data table as SQL data
5/15/ :04 AM
Polybase queries
SELECT
[vin],
[speed],
[datetimestamp]
FROM dbo.SensorData
[make],
[model],
[modelYear],
FROM dbo.AutomobileData
LEFT JOIN dbo.SensorData
ON dbo.AutomobileData.[vin] = dbo.SensorData.[vin]
Query external data table as SQL data
Data returned as defined in an external data table
Join SQL data with external data
Join data between internal and external table
All T-SQL commands supported
PolyBase will optimize between SQL-side query and pushdown to MapReduce
© 2015 Microsoft Corporation. All rights reserved. Microsoft, Windows, and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries. The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

53. 5/15/ :04 AM
HOL: Polybase
© 2015 Microsoft Corporation. All rights reserved. Microsoft, Windows, and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries. The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

54. ESP Sales Presentation for Mobility
4/10/2013
© 2016 Microsoft Corporation. All rights reserved. Microsoft, Windows, Microsoft Azure, and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries. The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION
Microsoft Corporation

55. SQL Server 2016 Stretch Database
5/15/ :04 AM
SQL Server 2016 Stretch Database
Hybrid IT with Microsoft SQL Server 2016
© 2013 Microsoft Corporation. All rights reserved. Microsoft, Windows, and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries. The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

56. 5/15/ :04 AM
Learning objectives
Why Stretch Database for Hybrid Row Storage How Stretch Database Works? Security, Backup & Restore HOL: Stretch Database
© 2013 Microsoft Corporation. All rights reserved. Microsoft, Windows, and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries. The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

57. Ever growing data, ever shrinking IT
5/15/ :04 AM
Ever growing data, ever shrinking IT
What do we have?
Massive tables
Cold data―infrequently accessed, always online
Maintenance challenges
Business service level agreements (SLAs) at risk
What do we need?
Expanded server and storage
Consolidated datacenter
Indefinite data storage
Flexible and safe options for moving and deleting data
© 2015 Microsoft Corporation. All rights reserved. Microsoft, Windows, and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries. The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

58. What is Microsoft Stretch Database?
5/15/ :04 AM
What is Microsoft Stretch Database?
Capability
Stretch large operational tables from on-premises to Azure with the ability to query
Benefits
Cost-effective online cold data
Entire table is online and remains queryable from on-premises apps
No application changes
Support for Always Encrypted and Row-Level Security
Stretching history tables of temporal tables a great scenario
Solution for securely stretching cold tables to Microsoft Azure with remote query processing
Order History
Order History
SQL
Azure
Customers
Products
Order History
Stretch to cloud
Order History
Server 2016
SQL
App
© 2015 Microsoft Corporation. All rights reserved. Microsoft, Windows, and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries. The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

59. How Stretch Database works
5/15/ :04 AM
How Stretch Database works
© 2015 Microsoft Corporation. All rights reserved. Microsoft, Windows, and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries. The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

60. How Stretch Database works
Creates a secure linked server definition in the on-premises SQL Server Targets linked server definition as the remote endpoint Provisions remote resources and begins to migrate eligible data, if migration is enabled Queries against tables run for both local database and remote endpoint
On-premises instance
Azure
Internet boundary
Linked servers
Remote Endpoint
Remote Data
Local
Database
Eligible Data
Local Data

61. Typical workflow High-level steps
5/15/ :04 AM
Typical workflow
High-level steps
Configure local server for remote data archive
Create credential with administrator permission
Create a filter predicate (optional) to select rows to migrate.
Alter specific database for remote data archive
Alter table for remote data archive
-- Enable local server
EXEC sp_configure 'remote data archive' , '1';
RECONFIGURE;
-- Provide administrator credential to connect to
-- Azure SQL Database
CREATE CREDENTIAL <server_address> WITH
IDENTITY = <administrator_user_name>,
SECRET = <administrator_password>
-- Alter database for remote data archive
ALTER DATABASE <database name>
SET REMOTE_DATA_ARCHIVE = ON (SERVER = server name); GO
-- Alter table for remote data archive
ALTER TABLE <table name>
ENABLE REMOTE_DATA_ARCHIVE
WITH ( MIGRATION_STATE = ON );
GO;
© 2015 Microsoft Corporation. All rights reserved. Microsoft, Windows, and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries. The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

62. Work without disruption
5/15/ :04 AM
Work without disruption
Business applications continue working without disruption
Database administrator (DBA) scripts and tools work as before; all controls still held in local SQL Server
Developers continue building or enhancing applications with existing tools and methods
Trickle migration
Orders
Orders History
© 2015 Microsoft Corporation. All rights reserved. Microsoft, Windows, and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries. The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

63. Queries continue working
Business applications continue working without disruption DBA scripts and tools work as before (all controls still held in local SQL Server) Developers continue building or enhancing applications with existing tools and methods
Orders_History
Orders_History
Orders
Hybrid solutions

64. Security, backup, and restore features
5/15/ :04 AM
Security, backup, and restore features
© 2015 Microsoft Corporation. All rights reserved. Microsoft, Windows, and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries. The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

65. Security Data in motion always via secure channels (TLS1.1 / 1.2)
5/15/ :04 AM
Security
Data in motion always via secure channels (TLS1.1 / 1.2)
Always Encrypted supported if enabled by user
Encryption key remains on-premises
Row-level security already works with this feature
SQL Server and SQL Azure audit already works with this feature
Orders
Orders History
Orders History
Trickle migration
© 2015 Microsoft Corporation. All rights reserved. Microsoft, Windows, and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries. The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

66. 5/15/ :04 AM
Backup and restore
DBAs backup and restore local SQL Server hot data only
Stretch Database ensures remote data transactionally consistent with local SQL Server
Upon completion of local restoration, SQL Server reconciles with remote using metadata―not data copy―operation
SQL Server offers remote restoration with time not dependent on size of data
Backup/Restore
Auto reconcile
Orders
Orders History
Orders History
Trickle migration
© 2015 Microsoft Corporation. All rights reserved. Microsoft, Windows, and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries. The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

67. Capabilities and functions
5/15/ :04 AM
Capabilities and functions
Enabling and disabling Stretch Database for SQL Server Instance
Configure databases for Stretch Database, migrate data, and query data on the remote endpoint
Enabling and Disabling Stretch Database for a database or table
CONTROL DATABASE permission
To configure a table for Stretch Database, you must have ALTER privilege
Data Access
Does not change the permissions model of an existing database
© 2015 Microsoft Corporation. All rights reserved. Microsoft, Windows, and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries. The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

68. Security and Permissions
5/15/ :04 AM
Security and Permissions
User Application
Local
Database
Eligible Data
Local Data
Remote Endpoint
Remote Data
Internet boundary
Linked servers
On-premises instance
Azure
© 2015 Microsoft Corporation. All rights reserved. Microsoft, Windows, and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries. The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

69. HOL: Stretch Database 5/15/2018 12:04 AM
© 2015 Microsoft Corporation. All rights reserved. Microsoft, Windows, and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries. The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

70. ESP Sales Presentation for Mobility
4/10/2013
© 2016 Microsoft Corporation. All rights reserved. Microsoft, Windows, Microsoft Azure, and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries. The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION
Microsoft Corporation

71. SQL Server 2016 Enhanced Backup to Azure
5/15/ :04 AM
SQL Server 2016 Enhanced Backup to Azure
Hybrid IT with Microsoft SQL Server 2016
© 2013 Microsoft Corporation. All rights reserved. Microsoft, Windows, and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries. The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

72. 5/15/ :04 AM
Learning objectives
Understanding Backup to Azure Options Understanding Managed Backups Understanding Backups with File Snapshots HOL: Enhanced Backup to Azure
© 2013 Microsoft Corporation. All rights reserved. Microsoft, Windows, and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries. The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

73. Enhanced Backup to Azure Overview

74. Enhanced backup to Azure
Managed backup
Granular control of the backup schedule
Local staging support for faster recovery and resiliency to transient network issues
Support for system databases
Support for simple recovery mode
Backup to Azure block blobs
Cost savings on storage
Significantly improved restore performance
More granular control over Azure Storage
Azure Storage snapshot backup
Fastest method for creating backups and running restores
SQL Server database files on Azure Blob Storage
Hybrid solutions

75. Backup to Azure block blobs
5/15/ :04 AM
Backup to Azure block blobs
© 2013 Microsoft Corporation. All rights reserved. Microsoft, Windows, and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries. The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

76. Backup to Azure SQL Server 2012 SP1 CU2 Azure Storage Benefits
BACKUP database TO URL = ‘
WITH CREDENTIAL = ‘credential_name’
Azure Virtual Machines
Azure Storage
On-premises
Benefits
Near “bottomless” storage
Off-site, geo-redundant
No provisioning, decay free
No device management
Remote accessibility
Limitations
Backup size up to 1 TB
Restore speed
On-premises
On-site and off-site storage costs
Device management costs
Azure
Limit of 1 TB on Azure drive
Max of 16 drives
Management of drives and policy

77. Backup to Azure block blobs
SQL Server 2016
Less expensive storage
Backup stripping and faster restore
Approximate maximum backup size of 12 TB
Granular access and unified credential story (SAS URIs)
Supports all existing backup and restore features (except append)
CREATE CREDENTIAL [
WITH IDENTITY = 'Shared Access Signature',
SECRET = 'sig=mw3K6dpwV%2BWUPj8L4Dq3cyNxCI'
BACKUP DATABASE database TO
URL = N'
URL = N'

78. Usage scenarios Recovery Dev/Test Data Inexpensive disaster recovery
5/15/ :04 AM
Usage scenarios
Recovery
Dev/Test
Data
Media failure or undesired action (for example, DROP TABLE)
Restore to any on-premises SQL Server database
Inexpensive disaster recovery
Restore to an Azure virtual machine and redirect applications
Restore to an Azure virtual machine and give access to developers
© 2013 Microsoft Corporation. All rights reserved. Microsoft, Windows, and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries. The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

79. Backup to Azure with file snapshots

80. SQL Server data files in Azure
DB3
DB3
Near “bottomless” storage
Off-site, geo-redundant
No provisioning
No device management
Media safety (decay free)
Remote accessibility
Native support for SQL Server data files stored as Azure blobs
DB1
DB2
Azure Virtual Machines
DB6
DB6
Azure Storage
DB4
DB5
On-premises
CREATE CREDENTIAL [
WITH IDENTITY = ‘Shared Access Signature',
SECRET = ‘<your SAS key>   
CREATE DATABASE mydb ON
( NAME = mydb_dat,
FILENAME = ' )
LOG ON
( NAME = foo_log,
FILENAME = '
Separation of compute and storage
Database migration to other machines
Basic disaster recovery
Increased storage on Azure virtual machines

81. SQL Server 2016 Back up to Azure with file snapshots
SQL Server data files
MDF
MDF
BAK
LDF
LDF
Database
Azure Storage
BACKUP DATABASE database TO URL = N' WITH FILE_SNAPSHOT

82. Point-in-time restore with file snapshots
SQL Server 2016
Traditional backup
Multiple backup types
Complex point-in-time restore process
Full
Log
Diff
Back up to Azure with file snapshots
Full backup only once
Point-in-time restore only needs two adjacent backups
Log
Full

83. Back up to Azure with file snapshots
Benefits
Fastest way to back up and restore
Faster than backing up to block blobs (no data move)
Faster than Volume Copy Shadow Service backups (no need for log backups)
Least expensive option (no full copies)
Convenient and intuitive
Notes
Only works with SQL database files in Azure Storage
Some restrictions with snapshots of SQL database files
The number of snapshots needs to be controlled to avoid performance regression
Backup encryption checks for transparent data encryption, not encrypts

84. SQL Server Managed Backup to Azure

85. SQL Server 2014 Managed Backup to Azure
What is it?
An agent that manages and automates SQL Server backup policy
Benefits
Simple and flexible
Minimal input (controls retention period)
Manages entire instance or individual databases
Leverages backup to Azure (page blob)
Supports backup encryption
Inherently off-site and geo-redundant
Minimal storage cost and hardware management
Built-in intelligence
Retention
Context-aware (for example, workload/throttling)
Backups consider log accumulation
Example:
EXEC smart_admin.sp_set_db_backup GO

86. Managed Backup to Azure in SQL Server 2014
5/15/ :04 AM
Managed Backup to Azure in SQL Server 2014
Prerequisites
SQL credential based on Azure Storage account
Enable SQL Server Agent
Backup logic
Full: 1 week, or 1 GB log growth; initial and log chain broken
Log: 2 hours, or 5 MB log growth
Retention
Up to 30 days (capable of point-in-time recovery)
Limitations
Full and log backups only
Recovery models: full or bulk-logged
User databases only
Max backup size of 1 TB (Azure page blob limit)
© 2013 Microsoft Corporation. All rights reserved. Microsoft, Windows, and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries. The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

87. Customized scheduling
5/15/ :04 AM
Customized scheduling
Step 1: Run the Scheduling stored procedure to configure custom scheduling
EXEC Managed_Backup.sp_backup_config_schedule
@database_name = 'testDB'
'Custom'
= 'weekly’
= 'Saturday'
= '11:00'
= '02:00'
= '00:05'
Step 2: Run the Basic stored procedure to configure Managed Backup
EXEC msdb.managed_backup.sp_backup_config_basic
@database_name= 'testDB',
@enable_backup=1,
@container_url=' account name.blob.core.windows.net/container name',
@retention_days=30
© 2013 Microsoft Corporation. All rights reserved. Microsoft, Windows, and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries. The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

88. SQL Server 2016 Managed Backup
Tech Ready 15
5/15/2018
SQL Server 2016 Managed Backup
Scheduling
Ability to choose when to take full backups and how often to take log backups
Staging
Keeps a local copy of the last part of the backup chain
Full backup
Log backup
SQL Server
Asynchronous copy
Full backup
Log backup
Full backup
Log backup
On-premises
Azure Storage
© 2012 Microsoft Corporation. All rights reserved. Microsoft, Windows, Windows Vista and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries.
The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

89. HOL: Enhanced Backup to Azure

90. ESP Sales Presentation for Mobility
4/10/2013
© 2016 Microsoft Corporation. All rights reserved. Microsoft, Windows, Microsoft Azure, and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries. The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION
Microsoft Corporation