Presentation is loading. Please wait.

Presentation is loading. Please wait.

Cedric Labuschagne Solutions Architect BI-Lateral BIN301.

Similar presentations


Presentation on theme: "Cedric Labuschagne Solutions Architect BI-Lateral BIN301."— Presentation transcript:

1

2 Cedric Labuschagne Solutions Architect BI-Lateral BIN301

3 Agenda What is new in SSIS 2008? Connectivity components Connectivity Categories New SSIS connectors

4 ERP Thinking Bigger About Business Intelligence Majority of the content for decision making are in multiple heterogeneous sources (e.g. ERP systems, databases, flat files) Need to integrate & consolidate data from all these sources, and make quality data available to users Connectivity is the key to address these challenges Flat File ERP Systems Excel XML Databases

5 What is new in SSIS 2008? Improved and new task components New Lookup Capabilities (caching enhanced) Data Profiling Task (data quality checking) C# Scripting. VSA replaced by VSTA Scalable Data Flow (thread pooling) Enhanced and new connectivity support ADO.NET Source and Destination New connectors for Oracle, Teradata and SAP BI

6 SSIS Connectivity Components SSIS Package Data Flow Task FTPFTPFLATFILEFLATFILEADO.NETADO.NETOLEDBOLEDB FTPFTP Execute SQL Task FlatFileFlatFile LookupLookup ADO.NETADO.NET Connection Manager TaskTask Data Source/ Destination Data Transformation Note: Execute SQL Task can also make use of ADO.Net, ODBC Connection Managers

7 Component Interaction SSIS Data Storage AcquireConnection() Connection Object Write()Read() Task or Component Connection Manager

8 Data Flow Connectivity Options Data Flow Task OLEDB Connector ADO.NET Connector Custom Connector OLEDB Provider Native ADO.NET Adapter ADO.NET ODBC Data Source Specific Interface/ Protocol ODBCODBC Data Storage

9 Data Access APIs and SSIS "When developing in BIDS, 32-bit data providers are always used at design time, if 64-bit providers will be used in production packages, the equivalent 32-bit provider must be available at design time." APIProsCons OLEDB Comprehensive support with SSIS 64-bit OLE DB providers less prevalent. ADO.NET Good support with SSIS Direct support with ADO.Net Source & ADO.Net Destination Somewhat limited availability of out of the box ADO.NET providers ODBC ODBC drivers for possible data sources widely available Requires the use of a bridge - introduces performance and reliability issues Custom-API Designed for performance of native utilities Limited availability for most databases Inconsistent support with SSIS - varies according to architecture

10 SSIS Enterprise Data Connectivity VersionsSuggested Connector SSIS Source & Destination SSIS Connection Manager SQL ServerAllSQL Data Access Components ADO.NET OLEDB ADO.NET OLEDB Oracle9iR2, 10, 11Microsoft Connector for Oracle Oracle MSORA TeradataV2R6.0/1/2, 12Microsoft Connector for Teradata Teradata MSTERA SAP BI7Microsoft Connector for SAP BI SAP BI DB28.1, 9.x Microsoft OLEDB Provider for DB2 OLEDB SAP R/34.6c, 4.7, 5, 6BizTalk Adapter 3.0 for mySAP ADO.NET Siebel7.5, 7.7, 7.8, 8BizTalk Adapter 3.0 for Siebel ADO.NET

11 Connectivity Categories Database Systems (RDBMS) Microsoft SQL Server Oracle Sybase IBM DB2 Teradata MS Access Queue Systems & Protocols MSMQ (Message Queue Task) (s)FTP (FTP Task) ** HTTP/HTTPs (Web Service Task) IBM MQ Series* Tibco Rendezveus* Unstructured,Semi-structured Data Microsoft Excel, CSV Text XML EDI (Electronic Data Interchange) Application Systems Siebel Microsoft Excel Hyperion (Essbase, Planning, Financial Management) SAP R/3 & SAPBI * not supported out-of-the-box, however, custom components can do this. ** sFTP is not supported out-of-the-box

12

13 Microsoft Connector for SAP BI Provider Microsoft Version SAP NetWeaver BI Version 7 Pre-requisites SQL Server Enterprise License SAP librfc32 library SAP OpenHub license Platform x86, x64, ia64

14 Microsoft Connector for SAP BI Data Flow Task SAP BI Connection Mgr Remote Function Calls (RFC’s) * SAP BI SAP BI Data Source SAP BI Data Destination OpenHubOpenHubBAPIBAPI *standard programming interface used by SAP

15 SQL Server Application Scenario 1 Extracting data from SAP BI into SQL Server SAP BI OHS Destination SSIS SSIS Package OLE dB Destination SAP BI Source Open Hub Info Cube Process Chain Triggered SAP BI Connection Manager

16 SAPBI Connector

17 Microsoft Connector for SAP BI Extracting data from SAP BI to SQL Server 1.SAP BI Configuration 1. Set up the RFC Destination 2. Configure and create the Open Hub Destination 3. Create the Data Transfer Process (DTP) and transformation 4. Configure the process chain 2.SSIS Package 1. Setup the SAP BI Source 2. Setup the connection manager for SAP BI 3. Setup the Destination (OLE DB, SQL Destination) 4. Construct Workflow 3.Run the SSIS package

18 SAP BI Staging BAPI Application Scenario 2 Loading non-SAP data into SAP BI SSIS SSIS Package SAP BI Connection Manager OLE DB Source SAP BI Destination SQL Server XML Flat File InfoSource/ InfoPackage

19

20 Microsoft Connector for Oracle Provider Attunity Supported by Microsoft Version Oracle 9iR2, 10, and 11 Pre-requisites SQL Server Enterprise License *Oracle client components Platform SSIS: x86, x64, ia64 * 32 bit @design time, 64 bit @ runtime)

21 Microsoft Connector for Oracle Data Flow Task Oracle Connection Mgr OCIOCI Oracle dB Oracle Data Source OCI Array Binding Oracle Data Destination OCI Direct Path OCI

22 Performance of Oracle Connectors

23 Performance of Microsoft Connector for Oracle

24 Microsoft Connector for Oracle Custom Properties ComponentAccess ModeProperty (Default) Oracle SourceTable NameBatch Size (100) Prefetch Count (0) SQL Oracle DestinationTable NameBatch Size (100) Transaction Size No Logging (False) Table Name – Fast LoadParallel (False) No Logging (False) Buffer Size (64KB)

25 Oracle Connector

26

27 Microsoft Connector for Teradata Provider Attunity Supported by Microsoft Version Teradata V2R6.0/1/2, 12 Pre-requisites SQL Server Enterprise License Teradata ODBC driver TPT 12 for high-performance Platform x86, x64

28 Microsoft Connector for Teradata Data Flow Task Teradata Connection Mgr TPT12TPT12 Teradata DW Teradata Data Source Teradata Data Destination TPT Fast Load TPT TPUMP TPT Fast Export

29 Microsoft Connector for Teradata Custom Properties ComponentAccess ModeProperty (Default) Teradata SourceTable Name – TPT ExportBlockSize (64330) DataEncryption (False) Max Sessions (1) Min Sessions (1) TenacityHours(4) TenacitySleep(6) SQL Command – TPT Export Teradata DestinationTable Name – TPT StreamBlockSize (64330) DataEncryption(False) MaxErrors (0) MaxSessions (1) MinSessions(1) TenacityHours(4) TenacitySleep(6) Table Name – TPT Load

30 TeraData Connector

31 Recap SSIS connectivity Provides a robust connectivity architecture Provides an extensible connectivity architecture Provides rich connectivity options to enterprise data via : Built-in connectors Additional connectors (available from Microsoft downloads) *Third party connectors Rich ecosystem for SSIS connectors *[codeplex or custom dev]

32

33 www.microsoft.com/teched International Content & Community http://microsoft.com/technet Resources for IT Professionals http://microsoft.com/msdn Resources for Developers www.microsoft.com/learning Microsoft Certification & Training Resources Resources Required Slide Speakers, TechEd 2009 is not producing a DVD. Please announce that attendees can access session recordings from Tech-Ed website. These will only be available after the event. Required Slide Speakers, TechEd 2009 is not producing a DVD. Please announce that attendees can access session recordings from Tech-Ed website. These will only be available after the event. Tech ·Ed Africa 2009 sessions will be made available for download the week after the event from: www.tech-ed.co.zawww.tech-ed.co.za

34 Related Content Breakout Sessions BIN207 Upgrading DTS Packages to Microsoft SQL Server Integration Services Required Slide Speakers, please list the Breakout Sessions, TLC Interactive Theaters and Labs that are related to your session. Required Slide Speakers, please list the Breakout Sessions, TLC Interactive Theaters and Labs that are related to your session.

35 SSIS Community Resources SSIS Community wiki http://wiki.sqlis.com/default.aspx SSIS Codeplex http://sqlsrvintegrationsrv.codeplex.com/ SSIS Junkies : http://blogs.conchango.com/jamiethomson/ Attunity Support Forums : http://www.attunity.com/forums/microsoft-ssis-oracle-connector http://www.attunity.com/forums/micorosft-ssis-teradata-connector Additional Community Resources TechNet Community for IT Professionals http://technet.microsoft.com/en-us/sqlserver/bb671048.aspx Developer Center http://msdn.microsoft.com/en-us/sqlserver/bb671064.aspx SQL Server 2008 Learning Portal http://www.microsoft.com/learning/sql/2008/default.mspx http://www.microsoft.com/learning/sql/2008/default.mspx

36 Additional Resources External Resources SSIS ETL Record – Loaded 1TB in 30 Minutes! http://msdn.microsoft.com/en-us/library/dd537533.aspx http://msdn.microsoft.com/en-us/library/dd537533.aspx Connectivity Options for Microsoft SQL Server 2008 Integration Services http://msdn.microsoft.com/en-us/library/dd299429.aspx http://msdn.microsoft.com/en-us/library/dd299429.aspx Microsoft Connectors for Oracle and Teradata by Attunity http://www.microsoft.com/downloads/details.aspx?FamilyId=D9CB21FE- 32E9-4D34-A381-6F9231D84F1E http://www.microsoft.com/downloads/details.aspx?FamilyId=D9CB21FE- 32E9-4D34-A381-6F9231D84F1E http://www.microsoft.com/downloads/details.aspx?FamilyId=D9CB21FE- 32E9-4D34-A381-6F9231D84F1E Using SQL Server 2008 Integration Services with SAP BI 7.0 http://msdn.microsoft.com/en-us/library/dd299430.aspx SQL Server 2008 Business Value Calculator: www.moresqlserver.com Team Forum: http://social.msdn.microsoft.com/forums/en- US/sqlintegrationservices/threads/

37 Required Slide Complete a session evaluation and enter to win! 10 pairs of MP3 sunglasses to be won

38 © 2009 Microsoft Corporation. All rights reserved. Microsoft, Windows, Windows Vista and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries. The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION. Required Slide


Download ppt "Cedric Labuschagne Solutions Architect BI-Lateral BIN301."

Similar presentations


Ads by Google