2. THR1171
Azure Data Integration: Choosing between SSIS, Azure Data Factory, and Azure Databricks
Cathrine Wilhelmsen, Inmeta
@cathrinew | cathrinew.net

3. You are a
data engineer

4. You are starting a new project

5. Which tool do you pick?

6. SQL Server Integrations Services (SSIS)?
Azure Data Factory (ADF)?
Azure Databricks?
All of the above?

7. It Depends ™

8. What does it depend on?

9. Let's take a look!

10. SQL Server Integration Services

11. SQL Server Integration Services
Data Integration
Extract, Transform, Load (ETL)
On-Premises

13. Azure Data Factory

14. Azure Data Factory Data Movement & Orchestration
Extract, Load, Transform (ELT)
Hybrid

16. Azure Databricks

17. Azure Databricks Apache Spark-based Analytics Service
Collaborative Notebooks
Cloud

20. Data
Volume
Velocity
Variety

21. Volume
Medium
High
High

22. Velocity
Batch
Batch
Streaming
Batch
Streaming
Real-Time

23. Variety
Structured
Structured
Unstructured
Structured
Unstructured

24. Development
Tools
Interface
Languages

25. Development Tools
SSDT
Browser
Browser

26. Development Interface
Drag and Drop
Drag and Drop
Code
Code

27. Development Languages
VB / C#
Biml
.NET
Python
PowerShell
SQL
Python R
Scala

28. Usage
Platform
Pricing
Purpose

29. Platform On-Premises Own Hardware Scale Out Hybrid Managed Scale Up
Cloud
Managed
Autoscale

30. Pricing
License
Pay as you go
Pay as you go

31. Purpose Integration Transformation ETL Movement Orchestration
ETL / ELT
Preparation
Collaboration
AI / ML

32. Modern Data Warehouse

33. Modern Data Warehouse Ingest Store Prep & Train Model & Serve
Visualize

34. SSIS ♥ ADF
Lift and Shift SSIS
Execute SSIS in ADF

35. ADF ♥ Databricks
Databricks Activities
Data Flows run on Databricks

36. …everywhere a data flow…
Here a flow…
…there a flow
…everywhere a data flow…

38. Cathrine Wilhelmsen, Inmeta @cathrinew | cathrinew.net
Thank you! :)
Cathrine Wilhelmsen, Inmeta
@cathrinew | cathrinew.net

39. Please evaluate this session Your feedback is important to us!
1/1/2019 9:51 PM
Please evaluate this session Your feedback is important to us!
Please evaluate this session through MyEvaluations on the mobile app or website.
Download the app:
Go to the website:
© 2014 Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

40. 1/1/2019 9:51 PM
© Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.