1. WPC042 - Data ON THE ROAD: the IoT architecture
Erica Barone
Microsoft Technical Evangelist – IoT & Windows

2. Agenda IoT solutions: the importance of data
A concrete scenario: MyDriving
IoT Architecture
Devices
Field Gateway
IoT Hub
Stream Analytics
PowerBI
Agenda –

3. IoT: gain value from Your Things
Connectivity
Data
Analytics
Action
IoT is not just about collecting data,
it’s about how you can use these data to gain VALUE
Money
Happy Customers
New Business Models –

4. Data...? Where can I find useful data?
How can simple data transform my business?
How can I manage these data to transform into concrete value?

5. Concrete scenario: car insurance
COVERAGE PARAMETERS
(insurance ceilings,
weathering, vandalism,
fire and theft, etc)
DRIVER AGE
(less than 21 years old,
more than 65 years old, etc)
KM per year
CITY OF RESIDENCE
(and of main drives)
VEHICLE CHARACTERISTICS
(cubic capacity,
kind of vehicle, etc)
TRAFFIC COLLISIONS
In the recent period

6. REAL drivers

7. Data could help improve the insights
Speed along the road
Usage of the car: trip frequency and trip duration
Time slots of the trips: early morning, late afternoon, night, etc
Top paths: traffic, kind of roads, etc
Drive style: avg speed, hard stops, hard accelerations, etc
Integration with public traffic systems: autovelox, red light cameras, speed limits on the top paths, etc
Data could help improve the insights

8. Azure IoT Reference Architecture
Device Connectivity and Management
Data Processing, Analytics and Management
Business Connectivity
IP capable devices
IoT Client
Cloud Gateway
Provisioning API
App Backend
Solution UX
Personal mobile devices
Device Registry
Device State Store
Existing IoT devices
IoT Client
Business Integration Connectors and Gateway(s)
Stream Processors
Gateway
Business systems
Storage
Analytics & Machine Learning
Low power devices
IoT Client
Data Path
Optional solution component
Azure IoT solution component –

9. DEMO MyDriving –

10. MyDriving Architecture

11. On Boarding Diagnostic Device
For Android & Windows
(Bluetooth)
For iOS (Wi-Fi)

12. Device connectivity and management
End user IoT gateway scenarios
Security and Isolation of Devices
Bridge networks and isolate public Internet
Ensure cloud security and encryption
Integration with any device
Low resource devices
Device agents can be simplified
Connect new and legacy devices
Cloud Offload
Run logic on premises to reduce network and cloud consumption
Low-latency / critical messages
Segregate message types
Edge processing
Enable time-sensitive decisions
Run edge analytics
Auditing - Central choke point to apply data policies
Batching
Optimize bandwidth and messages
Device Connectivity and Management
IP capable devices
IoT Client
IoT Hub
Existing IoT devices
IoT Client
Gateway
Low power devices
IoT Client –

13. Field Gateway WHY A FIELD GATEWAY?
Most ODB dongles are not internet-capable
The wireless connection used by ODB devices might not be secure
The device MUST be able to use one of the secure protocols supported by IoT Hub (HTTPS, AMQPS, MQTT)
WHY A PHONE AS FIELD GATEWAY?
Most drivers already have a phone to be used as field gateway
It’s easy and cheap: you just have to download and install the app
The phone works as an opaque field gateway
Additional data (like GPS data) can be collected using the phone, and can be merged with the ones from ODB device
The phone caches local data for later visualization purposes
(if you don’t have a ODB device, the myDriving app simulates ODB data)
Xamarin App

14. myDriving App – data flow
User Authentication 1
IoT Field Gateway 2
Device provisioning
DeviceClient creation using connection string
Polling on ODB device every second to retrieve data
Local GPS data every 3 secs / 5 m
Integration: message setup and sendEvent to IoTHub
Data Visualization
PastTrips
Profile view (aggregate data) 3

15. Azure IoT Hub Hyper scale IoT solution Cloud-scale messaging
Two-way communication
Per-device authentication
Multi-protocol support
Cloud-scale gateway –

16. Operational monitoring
IoT Hub
Security
Operational monitoring
Device SDKs
Provisioning
Create an entry for the device in the Device Identity Registry of our IoTHub. This creates a unique identity identity with an associated key.
Install the device key on the device, to enable it to connect to IoT Hub

17. Azure IoT Hub DM Service Architecture
Telemetry HTTPS, AMQPS,
MQTT
Device Telemetry
(All Devices)
IoT Cloud Solution
Command and Control
(Per Device)
Device / Gateway
Device Management Objects
Application
Your Code
Device (Object)
Device App
Your Code
Service Properties
Tags
Device Properties
Device Management APIs
DM Client Library
Registry Manager API
Create, Update, Delete Devices
Management LWM2M over CoAP/TCP
Device Query API
Tags, Device and Service Properties
Device Jobs API
Create, Monitor, Cancel –

18. Device-to-cloud messages
IoT Hub
Device id
C2D queue
endpoint
D2C send endpoint
Device …
D2C receive endpoint
C2D send endpoint
IoT Hub management
Interface
AMQP, HTTPS, MQTT device-side endpoint
AMQP service-side endpoint
Device and service SDKs
Compatible with Event Hubs
Partitioned receiver, client check-pointing
Integrations with Azure Stream Analytics, Storm, …
100% compatible with Event Hubs receivers
IoT Hub services for D2C
Millions of simultaneously connected devices
Per-device authentication
Connection-multiplexing:
C2D and D2C traffic
Across multiple devices for gateway scenarios
D2C receive endpoint
Consumer Group j
Partition 1
Partition 2
Partition n
Consumer Group 1
Worker 1
Callback partition 1
Callback partition n
Worker k
Callback partition z
Callback partition 2
D2C send endpoint –

19. IoT Hub - Device Management concepts
Query
Twin
Jobs –

20. Data Processing Azure Stream Analytics Real Time analytics
Data Processing, Analytics and Management
Azure Stream Analytics
Real Time analytics
Fully managed
No challenges with scale
Rapid development
Built in temporal semantics
Cloud Gateway
Provisioning API
App Backend
Solution UX
Device State Store
Device Registry
Business Integration Connectors and Gateway(s)
Stream Processors
Storage
Analytics & Machine Learning –

21. Azure Stream Analytics
Components of an Azure Stream Analytics Application
OUTPUT
[Result of Query]
Azure SQL DB
Azure Event Hubs
Azure Blob Storage
INPUT
Source of Events
Azure IoT Hub
Reference Data
Query runs continuously against incoming stream of events
Stream Analytics Query
Events
Have a defined schema and are temporal (sequenced in time) –

22. Stream Analytics in myDriving
SA Job
Path
Output Name
Usage
mydriving-sqlbi
Real time hot-path
PowerBISink
Real-time aggregate data for consumption by Power BI.
SQLSink
Real-time aggregate data for consumption by App Service APIs (and thus the mobile app).
mydriving-hourlypbi
A second hourly aggregation of real-time data for Power BI.
mydriving-vinlookup
Extensions
EHSink
Runs a simple query to extract the VIN number from a trip, and sends to Event Hubs for extensibility
mydriving-archive
Aggregate cold-path
BlobSink
Sends real-time data to blob storage where it accumulates for longer periods of time, for later processing by HDInsight and visualization in Power BI and for retraining Machine Learning

23. Stream Analytics: mydriving-sqlbi
INPUT
OUTPUT
PowerBI – data visualization
IoTHub data
SQL DB – data consumed by App Service
QUERY
TripPointRaw
Purpose: shaping the incoming IoT data
TripPointAgg
Purpose: aggregation (max, min, avg)
RoughDrivingStats
Purpose: creating driving statistics
Query to route the specific data to PowerBISink
Query to route the specific data to PowerBISink

24. Stream Analytics - Queries

25. A 20-second Tumbling Window
Tumbling windows:
Repeat
Are non-overlapping 1 5 4 6 2 8 6 5 3 6 1 10 20 30 40 50 60
Time
(secs)
An event can belong to only one tumbling window 1 5 4 6 2
Query: Count the total number of vehicles entering each toll booth every interval of 20 seconds. 8 6
SELECT TollId, COUNT(*)
FROM EntryStream TIMESTAMP BY EntryTime
GROUP BY TollId, TumblingWindow(second, 20) 5 3 6 1 –

26. Business Connectivity
PowerBI
Live dashboards provide a 360º view of your business
Track your data in real-time with support for streaming data
Drill through to underlying reports to explore in more detail
Pin new visualizations and KPIs to monitor performance
Solution UX
Personal mobile devices
Business Integration Connectors and Gateway(s)
Business systems –

27. PowerBI
Dataset
Report
Dashboard
Workspaces

28. PowerBI
Pre-built content packs, consisting of dashboards and reports, for popular SaaS solutions
Real-time dashboard updates
Secure, live connection to your data sources, on-premises and in the cloud
Intuitive data exploration by using natural language query
Integration with familiar Microsoft products, and commitment for scale and availability in Azure
Fast deployment, hybrid configuration, secure, and integrated with existing IT systems –

29. Power BI Data sources Power BI service Content packs
SaaS solutions
E.g. Marketo, Salesforce, GitHub, Google analytics
Content packs
Natural language query
Sharing & collaboration
On-premises data
E.g. Analysis Services
Live dashboards
Organizational content packs Corporate data sources, or external data services
Visualizations
Azure services
E.g. Azure SQL, Stream Analytics
Reports
Excel files
Workbook data or data models
Datasets
01001
10101
Power BI Desktop files
Related data from files, databases, Azure, and other sources
Data refresh –

30. DEMO MyDriving –

31. What’s more? What’s more? mydriving-vinlookup Event Hub Service Fabric
Storage - Blob
Machine Learning
mydriving-archive
mydrivingAnalyticsDB
Xamarin App
(device)
mydriving-sqlpbi
mydrivingDB
IoT Hub
Data Factory
HDInsight
mydriving-hourlypbi
Car (Sensor)
Power BI

32. WPC047 - Data ON THE ROAD: the Azure part
Follow the next session to learn more:
WPC047 - Data ON THE ROAD: the Azure part
Jessica Tibaldi

33. Q&A –

34. Contatti OverNet Education
Tel
@overnete
Contatti OverNet Education –