Master Data & BizTalk Enfo Zystems Johan Hedberg johan.hedberg@enfo.se Enfo Zystems Microsoft Integration MVP, MCT, V-TSP http://blogical.se/blogs/johan Twitter: @JoHed

Master Data = Data Distribution? Subscribing System Subscribing System Subscribing System Best of Breed System Subscribing System Subscribing System Subscribing System Data Integration & Distribution Subscribing System Best of Breed System Subscribing System Subscribing System Best of Breed System Data Data

SQL Master Data Services “Master Data Services (MDS) is the SQL Server solution for master data management (MDM); the efforts made by an organization to discover and define non- transactional lists of data, with the goal of compiling maintainable master lists”

What Master Data Services is It is a central data store It contains data staging tables and data export views It does not contain any integration capabilities in itself

Basic MDS Architecture MDS Database Staging Tables Subscription Views MDS Tables

What Master Data Services is not It is not data distribution It is not data sync from a (another) master system

Datamodell Tabeller Vyer

Förändringar i 2012

MDS Future and evolution Building the foundation V1 product Empowering IW through Excel Add-in and improved Web UI (Silverlight) Enhanced performance and scalability Improved quality (usability, robustness, security) Improved Integration through readability enhancements A Service Enhance curation Enhanced collaboration and sharing Improved data quality (DQS) Further empowering business users through simplified, advanced modeling capabilities Better productivity Improved productivity through external IP (data types and models) Sharing and reuse Post SQL2012 SQL2012 SQL 2008R2

Förändringar i 2012 Yttre stage tabeller för att rensa data innan man tar in det i MDS staging

Data Architecture – Custom Data Flow External Systems External Systems Data Import Data Export DQS (Cleansing & Matching) Data MERGE and Translation Staging Tables Staging Tables MDS Database Staging Tables Subscription Views MDS Tables

Data Architecture – Basic Data Flow Data Import MDS Database Data Export Staging Tables Subscription Views MDS Tables

Data Architecture – Basic Data Flow BizTalk Adaptability Eventing Processes MDS Database BizTalk Adaptability Pub/Sub Processes Staging Tables Subscription Views MDS Tables

Förändringar i 2012 Yttre stage tabeller för att rensa data innan man tar in det i MDS staging SSIS är en integrationsplattform

SQL Server Integration Services (SSIS) “SSIS is an Extract, Transform, Load (ETL) framework that allows you to integrate different data sources using a workflow like designer and a set of tasks.”

SSIS är en integrationsplattform Förändringar i 2012 Yttre stage tabeller för att rensa data innan man tar in det i MDS staging SSIS är en integrationsplattform Data från “SAP” kommer genom export till en fil från “SAP” Data in sker i nattliga batchar Men events då?

Workflow/ Notifications MDS WCF Architecture WEB-UI Excel Add-In Workflow/ Notifications IIS Service MDS Service External Systems WCF MDS Database

MDS WCF Architecture WCF MDS Service IIS Service MDS Database BizTalk External Systems IIS Service MDS Service WCF MDS Database

Demo Stage/Import data with BizTalk Server Export/Sync data with BizTalk Server Lookup data with BizTalk Server

Problem generating metadata for automatic stage procedure - Typed

Problem using default generated port and transactions

Using code samples to test

Using the BasicHttpEnpoint and not WSHttp

Using tcpTrace to view requests and responses

MDS Architecture WCF BizTalk/ IIS Service .NET MDS Service BizTalk/ WEB-UI Excel Add-In Workflow/ Notifications IIS Service MDS Service External Systems WCF BizTalk/ .NET BizTalk/ .NET BizTalk/ .NET MDS Database Subscribing Systems Subscription Views Staging Tables DQS (Cleansing & Matching) SSIS SSIS