Pulling Data into the Model

Agenda Overview BI Development Studio Integration Services Solutions Integration Services Packages DTS to SSIS

Overview Not Your Father’s DTS Virtually a Complete Rewrite of DTS.NET Object Model All Objects Stored as XML

BI Development Studio Business Intelligence Studio One Interface for all projects Analysis Services Reporting Services Data Transformation Visual Studio Interface Integrated package debugging Package host for runtime use Edit, debug, fix loop in one UI

BI Development Studio Integration Services Project Data Sources Data Source Views Packages Control Flow Data Flow Event Handlers Package Explorer

BI Development Studio Integration Services Project

Integration Services Package Control Flow Data Flow Event Handlers Package Explorer

Control Flow Elements ContainersTasks Precedence Constraints

Control Flow Containers Arbitrary grouping of task lists List of one is allowed Tasks connected to others by Precedence Constraints Lists execute concurrently Tasks in each list execute sequentially The package is a container Add your own tasks Insert your own containers Loops are containers, too

Control Flow Containers For Each Loop Container Uses an Enumerator For Loop Container Uses an expression Sequence Container Groups tasks and containers TaskHost Container Provides services to a single task

Control Flow Tasks Smallest Unit of Work Individually successful or unsuccessful Disabled or enabled

Control Flow Tasks Data Flow Task Data Preparation Tasks Workflow Tasks SQL Server tasks Scripting Tasks Analysis Services tasks Database Maintenance Tasks Event Watcher Tasks

Precedence Constraints Connect one task to another Give sequential relationship to tasks and their completion Success/Failure workflow Expressions can provide more control

SQL Server 2005 Integration Services Package Control Flow

Control Flow vs. Data Flow Control Flow Process-oriented Do “something” to “an object” Success, fail, or completion result Environmental Inputs Distinct beginning and end

Control Flow vs. Data Flow Data Flow Data-oriented Produce and/or consume rows of data Rows as inputs and outputs Can observe environment Starts with first row, ends with last row “for each” row

Data Flow Components Source and Destination Adapters TransformationsPaths

Data Flow Adapters OLEDB Source and Destination Flat File Source and Destination XML Source SQL Server Destination SQL CE Destination Recordset Destination Raw Source and Destination

Data Flow Transforms Some transforms work on each row as it goes by Derived column Character Map Data Conversion Lookup

Data Flow Transforms Some transforms see whole data set before emitting even one row SortAggregate Some will decide to emit rows as they need to, not always for each input row Pivot, UnPivot MergeJoin

Data Flow Transforms Some transforms have multiple inputs and outputs Union All Multicast Conditional Split Lookup Fuzzy Lookup

Data Flow Paths Paths Just a route between one component and another Includes metadata about columns moving around

SQL Server 2005 Integration Services Package Data Flow

Putting It Together Control Flow provides execution environment Data Flow is just one of many tasks Copy data, just like you used to Manipulate data like you never thought possible!

SQL Server Integration Services Package Moving Data From AdventureWorks To AdventureWorksDW

DTS to SSIS: The Data Pump Pump is now the data flow task Different features, slightly different paradigm

DTS to SSIS: Dynamic Properties Configurations Variable-based properties

© 2004 Microsoft Corporation. All rights reserved. This presentation is for informational purposes only. Microsoft makes no warranties, express or implied, in this summary.