1. Azure Databricks: Beginner’s Journey
Katie Novotny

2. We’re Here to Talk About
Azure Databricks
Overview
Core Concepts
Notebook Authoring
Simple ETL
Visualizations
Operationalize Notebook with Azure Data Factory
Resources to facilitate learning

3. Katie Novotny A little about me
DevOps | Automation | Cloudie| Application Development |
Not-so-Big Data | Power BI
DDI: ddiworld.com/
LinkedIn: /in/katie-novotny
Meetup: Flow-User-Group/

4. Feel free to put your hand up and ask questions along the way!
Flow of Conversation
PowerPoint Presentation
Azure Databricks Demo
Azure Portal
Azure Storage Explorer
Resources
Q&A
Feel free to put your hand up and ask questions along the way!

5. Tell me a little about Azure Databricks

6. Azure Databricks Overview
How do you know about Azure Databricks?
I’m hearing the word Spark a lot. Can you tell me about that?
Ok, but what is Azure Databricks?
Sounds cool, but what problem does Azure Databricks solve?

7. Azure Databricks Workspace
Notebooks/Libraries
Clusters
Azure Databricks Workspace
Data
Jobs

8. Azure Databricks Notebooks/Libraries
Runs code on a cluster
Cells that operate on files
Language support:
Python
Scala R
SQL
Libraries
Built-in dbutils
Upload and reference your own
Jar
Python Egg,
Python Wheel

9. Azure Databricks Data DBFS: Databricks File System
Distributed file system
Mount blob data
Multiple mount points
Interact as is on local file system
Persist so data remains after cluster spins down
/mnt/
Root data
/FileStore: Imported data files, generated plots, and uploaded libraries.
/databricks-datasets: Sample public datasets.
Mount point metadata

10. Azure Databricks Cluster
Group of machines
Interactive
Manually start/terminate/share
Automated
When a job is run
Tons of configuration features
Mode
Auto-scale
Auto-terminate
Runtime

11. Azure Databricks Jobs Scheduled/Immediate way to run code
Area to see job details
60 day job history
Options
Alerts
Timeouts
Retries

12. SHOW ME THE MONEY!

13. Resources
Databricks

14. Katie Novotny A little about me
DevOps | Automation | Cloudie| Application Development |
Not-so-Big Data | Power BI
DDI: ddiworld.com/
LinkedIn: /in/katie-novotny
Meetup: Flow-User-Group/