Choosing the Right Integration Technology for Exposing and Consuming Services (“When to Use What”) Ofer Ashkenazi Sr. Technical Product Manager Connected Systems Division Microsoft Corporation

What to use when…?

Demystifying Microsoft Integration Technologies How do I categorize these capabilities? What are the core scenarios per technology? What if my business scenario requires more than one technology?!

The Integration Challenge Two or more pieces of software working together to solve a larger problem Complex and unique requirements by asset type Support for existing legacy systems Purchased solutions vs. home-grown solutions Heterogeneous and distributed data stores External trading partners Unique requirements by scenario Support of SOA initiatives

Many Technology Choices Windows Communication Foundation SQL Service Broker MSMQ BizTalk Server ASMX WSE Enterprise Services SQL Integration Services Host Integration Server Windows Workflow Foundation SQL Replication

Messaging Integration Data Integration Two Categories of Integration Host Integration Server IBM Mainframe & Midrange connectivity WCF Unified framework for exposing and consuming services MSMQ Message queuing in Windows in Windows BizTalk Server Business process and integration server SQL Integration Services Data integration service deeply integrated within SQL SQLReplication Data synchronization service within SQL SQLServiceBroker Reliable data tier messaging within SQL

Two Categories of Integration Transmission and transformation of messages to stimulate work Copying and transformation of data Supports sending and processing messages Supports movement of data Conceptually “Work-Bite-Sized” Conceptually “Chunky” data Often embedded into applications Often application independent Often active Fundamentally passive Heterogeneous systems Heterogeneous schema Messaging Integration Data Integration

Microsoft Messaging Technologies Messaging Integration WCF Unified framework for exposing and consuming services MSMQ Message queuing in Windows in Windows BizTalk Server Business process and integration server SQLServiceBroker Reliable data tier messaging within SQL Host Integration Server IBM Mainframe & Midrange connectivity

Message Styles Queued Broker Direct Application TechnologiesAdvantagesChallenges RPC SOAP v1 WCF HIS Simple Coding within the app Temporal and address coupled N(N-1) interfaces Interface coupling Protocol and format issues MSMQ WCF SSB HIS More loosely coupled Temporally uncoupled Address coupled More concepts Protocol issues BizTalk Server Loosely coupled Temporally uncoupled Address uncoupled Protocol agnostics process Even more concepts

Queued Messaging on Windows Microsoft Message Queue Core Scenarios Asynchronous communication between Windows applications Message-level logging is required Key features Built into Windows.NET APIs and MMC Management Supports in memory or durable storage Windows.NET Client

Exposing & Consuming Services Windows Communication Foundation Core Scenarios Distributed.NET communication MSMQ,.NET Remoting, Enterprise Services Next generation web services stack Exposing.NET applications as services Consuming services in.NET applications Key features Unified programming model Broad standards support WS-Security, WS-Trust, WS-SecureConversation, WS- Policy WS-Coordination, WS-AtomicTransation WS-ReliableMessaging

Exposing & Consuming Services Windows Communication Foundation Windows.NET App WCF WCF Windows.NET App WCF MSMQ SOAP/TCP Web Services.NET Web Services Other Web Service Platforms

Data Tier Messaging SQL Service Broker Core Scenarios Asynchronous triggers Reliable query processing Reliable data collection Large-scale batch processing Key features T-SQL constructs for queues, services, and messages Conversational and reliable styles SQL Server

BizTalk Server Business Process and Integration Server Core Scenarios Brokered messaging between applications, services, and organizations Standards based B2B integration EDI, RosettaNet, HL7, HIPAA, and SWIFT Composite services Key features Content/context based, multi-endpoint, message routing and transformation Business process state management and distributed activity monitoring Business Rules Engine Rich management console and integration with MOM

BizTalk Server Business Process and Integration Server BPA B2BEAI Contoso Logistics Customer ERP HR System eComm CRM Bank Supplier SWIFT XML EDI EDI RosettaNet

Receive Port Receive Adapter Receive Pipeline Send Port Send Adapter Send Pipeline MessageBox Persistent Store HostHost Host Business Rules Inference Engine Orchestration Event Driven Pub/Sub Model With BizTalk Server 2006 Message Message

Highly Scalable Event Driven Architecture Mainframe Line of Business Service Heterogeneous Connectivity Effective Process Implementation Modifiable Business Rules HumanWorkflow Business Process Management With BizTalk Server 2006 Business Activity Monitoring

BizTalk Server / Workflow Foundation BizTalk Server Business Process & Integration Server  Adapters for application integration  Standards support for B2B integration  Unified console for management and operations  Business Activity Monitoring  Trading Partner Management  Future support for Workflow Foundation Windows Workflow Foundation Developer Framework  Common API and development environment for building workflow logic into applications  Common technology for workflow across Microsoft and the Windows platform (ISV)

Host Asset Integration BizTalk Adapters for Host Systems Core Scenarios Network integration with IBM mainframe and AS/400 infrastructure Application and data integration with mainframe and midrange assets To.NET As Services Bridging between MSMQ and MQSeries Key features Transaction integration with CICS, IMS & DB2 BizTalk Adapters

Legacy Asset Integration Host Integration Server Host Integration Server.NET Clients z/OS, OS/400… DB2 CICS & IMS MQ Web Service Clients

Legacy Integration Scenarios HIS & BTS 2006 Legend: Data Connection Data Connection Application connection (Transaction Integrator) Application connection (Transaction Integrator) Session connection (Session Integrator) Session connection (Session Integrator) Message Queuing (WebSephere MQ) Message Queuing (WebSephere MQ)

Microsoft Data Technologies Data Integration SQL Integration Services Data integration service deeply integrated within SQL SQLReplication Data synchronization service within SQL

Warehousing & Federated Queries SQL Server Integration Services Core Scenarios Combining information into data warehouses Transferring data between heterogeneous DBMSs Data harvesting from diverse data sources Federated queries across disparate data sources Key Features Extract, Transform, Load (ETL) designers and engine Error Handling & Fuzzy Logic components for data cleansing

Data Warehousing SQL Server Integration Services SQL Server Integration Services Data Warehouse

Federated Queries SQL Server Integration Services SQL Server Integration Services Client Application

SQL Replication Core Scenarios Replicating data SQL Server tables (offline, client/server). Replication from and to Oracle and IBM databases Key features Incremental changes User driven UI Support Across SQL Server, CE SQL Server Integration Services Client Application Oracle/DB2

Messaging Integration Data Integration Two Categories of Integration WCF Unified framework for exposing and consuming services MSMQ Message queuing in Windows in Windows BizTalk Server Business process and integration server SQL Integration Services Data integration service deeply integrated within SQL SQLReplication Data synchronization service within SQL SQLServiceBroker Reliable data tier messaging within SQL Host Integration Server IBM Mainframe & Midrange connectivity

When to Use What Quiz MSMQ: Asynchronous, parties not concurrent,message level logging WCF: Direct or queued WS communication with WS platforms or Windows apps BizTalk: Brokered app-to-app message-based integration with data mapping, process integration, business rules,B2B Integration, BAM HIS: Connect securely to legacy (IBM MF/MR) app, host files, DB and MQ SQL Service Broker: Connect logic built as stored procedures or as.Net Framework application spanning one or more SQL Server 2005 instances SSIS: ETL to data warehouse,transfer data to and from several DBMSs, load diverse data files into SQL Server SQL Replication: Replicate data SQL Server tables, from and to Oracle and IBM databases

Mix and Match Quiz Often your scenario will require multiple patterns: Aggregate bulk data from multiple stores to SQL. Enough stock? Reorder a part SSIS and BTS Receive a message through a Web Service and send to a mainframe WCF and HIS Shared technologies provide strong integration capabilities

“Intellectuals solve problems; geniuses prevent them.” Albert Einstein

Resources Technical Chats and Webcasts Microsoft Learning and Certification MSDN & TechNet Virtual Labs Newsgroups communities/newsgroups/en-us/default.aspx Technical Community Sites User Groups

© 2006 Microsoft Corporation. All rights reserved. This presentation is for informational purposes only. Microsoft makes no warranties, express or implied, in this summary.

BizTalk Server and.Net Framework 3.0 Future version of BizTalk will leverage WinFX BizTalk can be used as a host for WF for scale and access to features like BAM SharePoint Portal Server BizTalk Server Windows Communication Foundation Windows Workflow Foundation SQL Server