1. SQL Server Integration Services (SSIS) Presented by Tarek Ghazali IT Technical Specialist Microsoft SQL Server (MVP) Microsoft Certified Technology Specialist (MCTS) Web Development (MCP) LebDev Vice President © 2007 Tarek Ghazali. All rights reserved.

2. What Is SSIS? Integration Services is a platform for building high performance data integration and workflow solutions, including extraction, transformation, and loading (ETL) operations for data warehousing. Integration Services is a platform for building high performance data integration and workflow solutions, including extraction, transformation, and loading (ETL) operations for data warehousing. Transfer and transform data Transfer and transform data –SSIS contains a data-flow engine to transfer and transform data to and from varied data sources Tools and wizards Tools and wizards –SSIS contains graphical tools and wizards for creating an extraction, transform, and loading system New version of DTS (Data Transformation Services in SQL Server 2000) New version of DTS (Data Transformation Services in SQL Server 2000)

3. Typical use of Integration Services Merging Data from Heterogeneous Data Stores Merging Data from Heterogeneous Data Stores Populating Data Warehouses and Data Marts Populating Data Warehouses and Data Marts Cleaning and Standardizing Data Cleaning and Standardizing Data Building Business Intelligence into a Data Transformation Process Building Business Intelligence into a Data Transformation Process Automating Administrative Functions and Data Loading Automating Administrative Functions and Data Loading

4. Data integration without SSIS

5. Data Integration with SSIS

6. SSIS Architecture –Integration Services has a completely new architecture that separates data movement and transformation from Package control flow and management –Packages are the units of work that you execute –Tasks do the work in packages –Containers are objects that provide structure to packages

7. -The run-time engine implements the control flow and package management infrastructure -The data flow engine is a specialized, high performance engine that is exclusively dedicated to extracting, transforming, and loading data. SSIS Architecture

8. SSIS Tools Wizards Wizards –SQL Server Import and Export Wizard –Package Migration Wizard –… SSIS Designer SSIS Designer –built into the BI Development Studio and is the main surface for package development. Command-prompt utilities Command-prompt utilities –Dtexec (run an existing package at the command prompt ) –Dtutil (manage existing packages at the command prompt)

9. SSIS Development Environment SSIS Projects: SSIS Projects: –Data Sources –Data Source Views –SSIS Packages: Control flow Control flow –Tasks –Loops, sequences and events –Variables and scoping –Precedence constraints Connections Manager Connections Manager Data flow Data flow –Source and destination adapters –Transformations –Multiple sources with joins and unions –Multiple destinations with splits and multicast

10. Using SQL Server Integration Services What Are Data Sources and Data Source Views? What Are Data Sources and Data Source Views? What Is a Connection Manager? What Is a Connection Manager? What Is Package Control Flow? What Is Package Control Flow? What Is a Data Flow Task? What Is a Data Flow Task? How to Deploy Packages How to Deploy Packages

11. Data Sources and Data Source Views Data sources Data sources –A data source is a connection reference that you create outside a package. –A real-time reference to a data store connection, which includes all tables and views in the data store. Data source views Data source views –Provide a subset of data from a data source –You can extend a data source view by adding calculated columns that are populated by custom expressions, adding new relationships between tables, replacing tables in the data source view with queries, and adding related tables.

12. Connection Manager A connection manager is a logical representation of a connection A connection manager is a logical representation of a connection Different types of connection managers enable packages Different types of connection managers enable packages to connect to a variety to connect to a variety of data sources and of data sources and servers servers

13. Package Control Flow Tasks Tasks –Tasks do the work in packages. The most important task is the data flow task Precedence constraints Precedence constraints –Precedence constraints join tasks together Containers Containers –Containers allow you to group together, or loop through, the tasks

14. Deploy Package Define package configurations Define package configurations –Allow you to update the values of properties at run time Build the project Build the project –Configure the deployment utility –Build the project Deploy the build Deploy the build –Copy the build folder to the new system –Run the manifest

15. SSIS Execution Methods Visual Studio / BIDS Visual Studio / BIDS –Debugging environment Command Line – (dtexec) Command Line – (dtexec) Execute Package Utility (dtexecui) Execute Package Utility (dtexecui) SQL Agent Sub System SQL Agent Sub System Object Model Object Model

16. SSIS Designer Available in Business Intelligence Development Studio as part of an Integration Services project. Available in Business Intelligence Development Studio as part of an Integration Services project. Perform the following tasks: Perform the following tasks: –Constructing the control flow in a package. –Constructing the data flows in a package. –Adding event handlers to the package and package objects. –Viewing the package content. –At run time, viewing the execution progress of the package.

17. Packages Debugging Control flow Control flow –Breakpoints –Progress reporting –Debug window Data flow Data flow –Data viewer –Row counts –Progress reporting

18. Security Packages signed with certificates Packages signed with certificates Data encryption before saving the package Data encryption before saving the package Packages protected using passwords Packages protected using passwords Packages controlled with database-level roles, by default: Packages controlled with database-level roles, by default: –Administrator –User –Operator

19. Compatibility Possibility to run DTS and SSIS packages Possibility to run DTS and SSIS packages –Use ‘Execute DTS 2000 Package Task’ for running DTS packages from Integration Services Packages Use ‘Package Migration Wizard’ for migrating packages with SQLServer 2000 DTS format Use ‘Package Migration Wizard’ for migrating packages with SQLServer 2000 DTS format

20. Migration limitations Doesn’t migrate ActiveX Script code with that accesses the DTS object model via parent property of the Global Variables Doesn’t migrate Analysis Services tasks Doesn’t migrate Complex Data transformation tasks Doesn’t migrate customs tasks Doesn’t migrate dynamic properties Doesn’t migrate parallel data pumps Doesn’t migrate ActiveX Script attached to package steps Doesn’t migrate transaction settings Doesn’t migrate ActiveX Script code with that accesses the DTS object model via parent property of the Global Variables Doesn’t migrate Analysis Services tasks Doesn’t migrate Complex Data transformation tasks Doesn’t migrate customs tasks Doesn’t migrate dynamic properties Doesn’t migrate parallel data pumps Doesn’t migrate ActiveX Script attached to package steps Doesn’t migrate transaction settings

21. Break

22. Demo

23. Resources & Questions Contact me : Contact me : –tghazali@sqlmvp.com –www.sqlmvp.com www.sqlmvp.com Microsoft Resources: Microsoft Resources: –msdn.microsoft.com/sqlserver/ msdn.microsoft.com/sqlserver/ –www.microsoft.com/sql/community www.microsoft.com/sql/community Download Presentations: Download Presentations: –www.lebdev.net www.lebdev.net –www.devconnect.net www.devconnect.net Site dedicated to Integration Services: Site dedicated to Integration Services: –www.SQLIS.com