1. explore engage elevate Data Migration Without Tears Mike Feingold Empoint Ltd Tuesday 10th November 2015

2. exploreengageelevate About Me Mike Feingold Dynamics CRM Consultant Focussed on data migration and integration with CRM Scribe MVP Been working with Dynamics CRM since v1.2 E: mike@empoint.co.ukmike@empoint.co.uk W: www.empoint.co.ukwww.empoint.co.uk L: http://uk.linkedin.com/in/mikefeingoldhttp://uk.linkedin.com/in/mikefeingold

3. exploreengageelevate Scenario “We're decommissioning our old SQL based CRM application and implementing Microsoft Dynamics CRM 2015. My boss/client/manager asked me to migrate all the data from the old to the new system. What shall I do?”

4. exploreengageelevate Get involved early in the project Data migration needs to be thought about during the project development stage. Don’t leave it until the end. Questions to ask: Will there be parallel running of the old and new systems or a “big-bang” cutover? If a cutover, can this be done quickly (eg, overnight or over a weekend)? If parallel running, can the old system be made read only? Do we need ongoing integration from the old to the new system?

5. exploreengageelevate Tool choice Can’t write to CRM database – must use the API Custom coded application Tools Scribe SSIS Kingsway The are others

6. exploreengageelevate Scribe Scribe Insight – Windows application Scribe Online – Cloud based Has an adapter for Dynamics CRM, and templates for getting data from other CRM systems (eg, Act, Goldmine) No coding experience required Prices: Up to 15 CRM users: $3000 15 - 100 CRM users: $5500 101 - 250 CRM users $8000 60d migration $2000

7. exploreengageelevate Scribe Demo

8. exploreengageelevate Scribe

9. exploreengageelevate Scribe

10. exploreengageelevate Kingswaysoft - SSIS Integration Toolkit for Microsoft Dynamics CRM SQL Server Integration Services (SSIS) Part of SQL Server No extra charge Kingswaysoft Adapter for CRM (online, on premise, hosted) No coding experience required Can be used for migration and/or ongoing integration Price $695 for single server, one year; $1495 for perpetual licence

11. exploreengageelevate Kingswaysoft Demo

12. exploreengageelevate Kingswaysoft

13. exploreengageelevate Kingswaysoft

14. exploreengageelevate SSIS – Custom script component No 3 rd party add on required Requires coding experience (ideally C#), knowledge of.Net and the CRM API Maximum flexibility – everything exposed by the API is available Highest development effort

15. exploreengageelevate SSIS – Custom script component Demo

16. exploreengageelevate SSIS Script Component

17. exploreengageelevate SSIS Script Component

18. exploreengageelevate Tool comparison AspectWinnerWhy SpeedNone Any speed bottlenecks are usually to do with the CRM web service, not the migration tool being used. ScalabilitySSISHas business data distributor component to allow multi threaded processes DeploymentSSIS Can specify all deployment parameters (eg, database connections) on the command line. With Scribe it’s necessary to edit the DTS. ‘Other’ CRM messages SSIS C# has complete access to the CRM API so can call messages that Scribe can’t (Eg: change the business unit of a user, change user manager). ODBCSSIS Scribe needs ODBC connections (eg, to connect to files). These needs to be included in any deployment. SSIS allows a direct file connection. Multi row operations SSIS Eg: Source of phone numbers needs to create multiple records in target for each row in source. SSIS supports joins to source. DebuggingScribeRow based (rather than SSIS which is set based) so easier to see what’s going on. LoggingScribeScribe has built in logging. SSIS need to implement manually and not as elegant.

19. exploreengageelevate Net change patterns What has changed in the source data? Delta Various methods Publish changes to a queue or table using a trigger Set a RecordModified flag Use LastModifiedDate field

20. exploreengageelevate Design strategy Jobs must be able to be rerun without duplicating data If source if CRM on premise then read from filtered views in database (not API) Do any data manipulation outside of migration tool. Use a staging database (especially if source data is file format eg, CSV) If records in the source have a primary key then store this in CRM. Index this field. If source is CRM then migrate the record primary key GUID to the target. Error handling – log, don’t fail

21. exploreengageelevate Watch out for Activity migration can be complex For some entity types (eg, Email), the state of the record determines if it can be updated When migrating date time fields, watch out for BST and GMT. Users say that some dates are 1 day out and the underlying data is 1 hour out. CRM restrictions Can’t delete users Can’t assign roles to inactive users Can assign records to users who don't have permissions to see them

22. exploreengageelevate Other considerations Migration sequence is important Is all data being migrated, or just active records? Users who have left the company Reconcile source and target data (esp, row counts).

23. exploreengageelevate Plugins, workflows and Javascript Understand what these do and any impact on migration CRM API doesn’t respect mandatory fields Use JavaScript for entry validation only Synchronous plugins impact speed Can they be disabled during data load? ‘Maintenance mode’ Disable plugins and workflows Disable email router Change the banner Consider user roles or read-only status Run jobs (eg, aggregation) when load completed

24. exploreengageelevate Directly updating the CRM database

25. exploreengageelevate Directly updating the CRM database Fields ModifiedOn, ModifiedBy CreatedBy (can use overriddencreatedon) Merged/IsMaster ExchangeRate Base currency values On premise only

26. exploreengageelevate Speed Dynamics CRM is a beautiful product But it isn’t fast How to increase migration speed Scribe – partition the source data and run multiple instances SSIS – use the Balanced Data Distributor Increase CRM performance Disable plugins Turn off audit Use indexes

27. exploreengageelevate Scenario “We're decommissioning our old SQL based CRM application and implementing Microsoft Dynamics CRM 2015. My boss/client/manager asked me to migrate all the data from the old to the new system. What do I do?”

28. exploreengageelevate About Me Mike Feingold Dynamics CRM Consultant E: mike@empoint.co.ukmike@empoint.co.uk W: www.empoint.co.ukwww.empoint.co.uk L: http://uk.linkedin.com/in/mikefeingoldhttp://uk.linkedin.com/in/mikefeingold