1. Extreme Scaling with SQL Azure SQL Bits 7, York, October 2010 Martin Schmidt – Miracle A/S Denmark

2. Subtitle: The Safetrack story

3. Agenda O Speaker Info O Safetrack facts & system info O Safetrack architecture O Database design O Issues with current setup O The Azure platform O Sharding O Solution Walkthrough O Moving Exsisting Data to SQL Azure

4. Speaker info O Name: Martin Schmidt O Email: msc@miracleas.dk O Blog: www.performanceduo.comwww.performanceduo.com O Twitter: @ms1333

5. Agenda O Speaker Info O Safetrack facts & system info O Safetrack architecture O Database design O Issues with current setup O The Azure platform O Sharding O Solution Walkthrough O Moving Exsisting Data to SQL Azure

6. Safetrack facts O Danish Company – started 2005 O GPS tracking of trucks and excavators O Started out as an insurance service against theft O Today: A complete platform for fleet management O Tracks more than 25.000 units O Website: http://www.safetrack.dk

7. Unit Types

11. How does this Work?

12. How does this Work O All units are equipped with a GPS transmitter O Sends binary packages over GPRS O Built-in SIM card O Sends a package every 2 min when running O Sends a package every 15 min when parked O Data is sent using UDP Protocol

13. ME - 301 Length = 75 mm Width = 45 mm Height = 18 mm

14. Package data O Reporttime O Longitude O Latitude O Speed O KM Status O Inputs status information O Is the lift up / down O Is the engine running O Timecounter info on inputs O For how long has the engine been running O How long has the lift been in use

15. Agenda O Speaker Info O Safetrack facts & system info O Safetrack architecture O Database design O Issues with current setup O The Azure platform O Sharding O Solution Walkthrough O Moving Exsisting Data to SQL Azure

16. System Archietecture

17. Agenda O Speaker Info O Safetrack facts & system info O Safetrack architecture O Database design O Issues with current setup O The Azure platform O Sharding O Solution Walkthrough O Moving Exsisting Data to SQL Azure

18. Database Design

19. Agenda O Speaker Info O Safetrack facts & system info O Safetrack architecture O Database design O Issues with current setup O The Azure platform O Sharding O Solution Walkthrough O Moving Exsisting Data to SQL Azure

20. Issues ? O Database and application on same box O Everything runs on the same single server O Single Point of Failure O Hardware O Database O Services / Website O No HA solution O Limited scaling options (Buy bigger HW)

21. Issues ? O All elements are independend O Easy to split things O No ”secret” data O No personal or banking information O Not breaking the Danish data law

22. Issues ? O SQL Azure in the future? O Windows Azure in the future? O Why Not

23. Agenda O Speaker Info O Safetrack facts & system info O Safetrack architecture O Database design O Issues with current setup O The Azure platform O Sharding O Solution Walkthrough O Moving Exsisting Data to SQL Azure

24. SQL Azure O High Availibity = Free O 1 DB = 3 DB’s (automatic failover) O Size limitations O 1 – 50 GB O Safetrack database > 250 GB  O Get the database off the current box O Release more power to the Windows service

25. SQL Azure O Let Microsoft be your primary DBA! O SQL Azure = Black boks O Running your database with other unknown applications

26. Windows Azure O Moving the website to Windows Azure O Easy peasy O The Windows Service is not compatible with Azure at present O No support for UDP – TCP Only 

27. SQL Azure O Lets move the database to the Cloud O Latency from the local Windows service to SQL Azure is not a big issue. O Size is a issue, we will have to Shard the data across multiple databases O Sharding gives us scalability

28. Agenda O Speaker Info O Safetrack facts & system info O Safetrack architecture O Database design O Issues with current setup O The Azure platform O Sharding O Solution Walkthrough O Moving Exsisting Data to SQL Azure

29. Sharding facts O Partition data across multiple databases O Each database holds a subset of the data O A query needs only to look in one database O Sharding is no silver bullet, you still need to think O Important to choose the correct sharding key O Try to avoid fan-out queries, if possible

30. Agenda O Speaker Info O Safetrack facts & system info O Safetrack architecture O Database design O Issues with current setup O The Azure platform O Sharding O Solution Walkthrough O Moving Exsisting Data to SQL Azure

31. Solution walkthrough O Shard key candidates O UnitID O CustomerID O The winner is: O CustomerID O All reports on the web front end is based on customerID. This gives the customer the option to se the status of all his units.

32. Data Syncronisation O MS Data sync Framework O Requires SQL Agent to do scheduling O SQL Azure Data Sync (Dev Preview) O The winner so far O We will have a look in a minute O Pretty Slow  O SQL Server Integration Services O Still no scheduler O Windows Azure worker role O We need to test this

33. Database Design

34. DEMO O Enough Power Pointing

35. Agenda O Speaker Info O Safetrack facts & system info O Safetrack architecture O Database design O Issues with current setup O The Azure platform O Sharding O Solution Walkthrough O Moving Exsisting Data to SQL Azure

36. Loading data into Azure O Task: Load existing data into SQL Azure O 265.000.000 Rows (ReportMessage) O 150 GB O Possible solutions O BCP Utility O SSIS

37. Loading data into Azure

38. O Slow, poor performance O Still working on improving performance O Tested throughput (Laptop) O 1000 Rows / sec

39. SQL Azure Ressources O SQL Azure webfrontend O http://sql.azure.com http://sql.azure.com O SQL Azure Labs O http://www.sqlazurelabs.com http://www.sqlazurelabs.com O SQL Azure team Blog O http://blogs.msdn.com/b/sqlazure/

40. More Ressources O PerformanceDUO O http://www.performanceduo.com http://www.performanceduo.com O Miracle A/S O http://www.miracleas.dk http://www.miracleas.dk O MiracleDB O http://Miracledb.codeplex.com http://Miracledb.codeplex.com O Safetrack O http://www.safetrack.dk

41. Q & A O Questions?

42. Thank You

43. Coming up… P/X001 Understanding and Preventing SQL Injection Attacks Kevin Kline P/L001 SSIS Fieldnotes Darren Green P/L002 The (Geospatial) Shapes of Things to Come Simon Munro P/L005 End to End Master Data Management with SQL Server Master Data Services Jeremy Kashel P/T007 Understanding Microsoft Certification in SQL Server Chris Testa-O'Neill # SQLBITS