1. SQL Server 2017 Linux and Beyond Andrew Loree

2. Got a question? Andrew Loree
andyloree.com @LowOnDiskSpace

3. Are you passionate about helping customers unleash the value of their data? Building mission critical solutions? Using hybrid database platforms that have everything built in – from in-memory performance and advanced security to in-database analytics? Joining a team of passionate people who share your curiosity and dedication to discovering the value of data? Come join our team of consultants and Premier Field Engineers at Microsoft Services. Send us your resume, we want to know more about you:
To register for more Microsoft information:
If you’re interested in other positions with Microsoft, check out our current open jobs at Microsoft.com/ServicesCareers

4. Goals To understand: What is SQL Server 2017
Install and configure on Linux
Running on Docker
What else is new?
What is next?

5. https://aka.ms/eapsignup
What is SQL Server 2017
Next major release of SQL Server
Currently in Customer Technology Preview (CTP 2.1)
Monthly releases of new features and fixes
Release notes
CTP 1.0 (Nov 2016),…,CTP 2.0 (Apr 2017), CTP 2.1 (May 2017)
Lots of new features (beyond just SQL Server on Linux)
Production support with Early Adoption Program (EAP)
Describe the purpose, link to source info, release notes, …

6. Where can I run SQL Server 2017?
Windows 64-bit (ISO and CAB)
Linux (supported Linux distributions)
Red Hat Enterprise (RHEL) 7.3
Ubuntu Linux 16.04
SUSE v12 SP2
Azure VM template (RHEL 7.3)
Docker
on Windows Image
on Linux Image
What about macOS or XYZ Distro?
Not planned for support but likely to work or use Docker
Windows 64-bit (ISO and CAB) -
Linux (supported OS packages)
Red Hat Enterprise (RHEL)
Ubuntu Linux
SUSE v12 SP2 -
Azure VM template (RHEL 7.3) -
Docker
on Windows Container -
on Linux Container -
macOS – use Docker

7. How does SQL Server run on Linux?
SQL Server Operating System (SOS/SQL OS)
Internal abstraction layer for tasks, schedules, memory,…
Drawbridge project
MSFT Research late 2011
Application sandboxing – isolating, picoprocesses, library OS,…
SQL Platform Abstraction Layer (SQL PAL)
Started with SQL 2005 design
Reference

8. How does SQL Server run on Linux?
Started with SQL 2005 design
Reference
Outcome:
Effectively the same code for Windows runs on Linux

9. SQL Server on Linux Minimum system requirements:
4 GB memory (tested up to 1TB to date)
2 GB disk space minimum
Supported file systems:
ext4 or xfs

10. SQL Server on Linux - Demo
Install & config
mssql-server
command-line tools
mssql-server-agent
Restore a database

11. SQL Server on Linux - Administration
Configuration – Port, SA password, default paths, traceflags
/opt/mssql/bin/mssql-conf list /opt/mssql/bin/mssql-conf set network.tcpport 1433
Service control – systemd service manager
systemctl enable mssql-server
systemctl disable mssql-server
systemctl start mssql-server
systemctl stop mssql-server
systemctl status mssql-server
Logging
Default path for errorlog, XE - /var/opt/mssql/log
syslog by default for SQLPAL, so make sure to monitor

12. SQL Server on Linux - Administration
Connecting – via ssh protocol – putty, ssh,...
Command pipeline – similar to PowerShell’s |
Admin commands
su/sudo – “run as” admin
File
nano/vi/emacs,… - console text editing and more
grep/sed/ack – text file patterns, regex, stream & transform
ls/find/mkdir/rmdir/touch – navigate and modify files & folders
Process and performance related
top/htop - displays process and resource usage
ps/kill – active processes, signal or terminate a process

13. SQL Server on Linux - Administration
Network
ifconfig – view, config & control interfaces
traceroute & ping
Storage
parted – partition/formatting
mkfs – format file system on a partition
mount/unmount – attach/detach into the root file system
df – mounted file system free space & usage
du – used space for given directory
chown/chmod/setfacl – file permissions/ACL’s
lvcreate/lgcreate – create lvm disk, groups
* General Linux admin support links in the slide notes

14. SQL Server on Linux – High Availability
Shared-disk clustering using Pacemaker
Pacemaker != WSFC
Availability Groups
All features supported
Read-only routing
Auto-seeding
Distributed/subnets
Failover options

15. SQL Server on Linux - Performance
Hardware/virtualization and OS vendor recommendations
Storage configuration & separation rules still apply
Tempdb, data, log, …
Kernel tunables (sysctl):
vm.swappiness = 10?
vm.dirty_reads
fs.file-max …
Check out TPC-H support documents for SQL on Linux submission
SQL configuration practices: max server memory, MAXDOP, trace flags,…
ALWAYS BASELINE, CHANGE & TEST AGAIN!

16. SQL Server on Linux - Monitoring
Most 3rd party tools will continue to work as they do with Windows hosts – DMV’s work as always
DBFS open-source FUSE mount of SQL DMV’s
DMV access, the linux sysadmin way

17. Machine vs OS Virtualization (containers)
What is Docker?
Machine vs OS Virtualization (containers)

18. Why Docker? Resource efficiency – shared OS
Manage apps side-by-side in isolation – higher density
Not a new concept (FreeBSD Jails, Solaris Zones,…)
Easy container management
Portable
Ready-to-run containered applications
Ability to create your own
Integration into DevOps world
Puppet, Chef, Vagrant, Ansible,…

19. Docker - Terminology Images – collection layered file system changes
Does not have state and never changes
Registry – hosting service of images
100,000 apps on Docker Hub
Containers – runtime instance of an image
Layered filesystem
Data Volumes - persisted
Network port bindings

20. SQL Server Docker - Images
Two different base-images: Linux and Windows
Github -
Requirements
Docker Engine 1.8+
Min 4 GB disk
Min 4 GB memory

21. SQL Server Docker - Demo
Docker commands
Pull mssql-server-windows image
Create a container, mapping port and data volume
Restore a database
Create more containers, using “attach_dbs”

22. SQL Server Docker – Administration
Management tooling options:
Kitematic – Desktop UI interface to Hub
Rancher - Orchestration
Shipyard – Cluster management
Deployment:
Windows Server 2016
Azure – PaaS and IaaS options
Resource allocation:
CPU shares
Specific cores
Memory limit

23. SQL Server Docker – Environment Variables

24. SQL Server 2017 - What else is new?
Lots of Community driven enhancements!
Smarter backup information – sys.dm_db_file_space_usage has modified_page counts
SELECT INTO … ON FILEGROUP! – keep your staging separate
Tempdb per-user database usage information
VLF DMF - sys.dm_db_log_info()
Sockets, cores per, numa_node_count - sys.dm_os_sys_info
Improved small database backup performance

25. What else is new? – Part 2
Resumeable online index rebuilds – pause, continue
Graph Processing – represent complex relationships with NODES and EDGE tables, and the new MATCH operator
LOB support in Clustered Columnstore indexes
Adaptive JOINS – dynamic switching of joins during query execution
Query store wait stats – query level wait information
Automatic Tuning – query store analysis and automation to recommend and fix identified problems

26. What else is new? – Part 3 Reporting Services
Stand-alone install – no longer within the DB engine bits
Power BI hosted reports
Analysis Services
Ragged Hierarchy members
Detail row – custom row sets definable in the drill-down
Tabular table-level security
Machine Learning (formerly R Services)
Python language support

27. What else is new? – Part 4 New Microsoft open source projects
mssql-scripter – cross-platform SQL scripting tool ~= SSMS wizards
DBFS - open-source FUSE mount of SQL DMV’s
??? – cross-platform management UI – coming soon
Coming Soon
AD authentication on Linux – host must be AD joined (realmd)
sql-xplat-cli

28. What else is new? - Demo T-SQL fun! BULK INSERT … FORMAT = ‘CSV’
TRIM(), TRANSLATE(), CONCAT_WS()
MovieLens dataset -
Full: 24,000,000 ratings and 670,000 tag applications applied to 40,000 movies by 260,000 users. Includes tag genome data with 12 million relevance scores across 1,100 tags. Last updated 10/2016.

29. Need Help? Check the Release Notes Post questions
Stack Overflow (tag sql-server)
MSDN Forums
Search/File Bugs
Microsoft Connect – report bugs/request features

30. Got a question? Andrew Loree
andyloree.com @LowOnDiskSpace