1. C5: Introduction to DataXtend® Semantic Integrator (DX SI)
Dean Elliott
Client Solutions Manager

2. Agenda
Data challenges in integration solutions
DX SI enables the data layer in integration
DX SI Lifecycle
DX SI Demonstration

3. Traditional approaches to data integration
CMR1
CRM2
Billing
Provisioning
Billing
CRM1
CRM2
Provisioning
Inventory TT
Data W/house
Call Center
Inventory TT
Call Center
Data W/house
‘Integration Spaghetti’
Message Oriented Middleware

4. Increasing complexity Increasing maintenance costs
Business Challenges resulting from traditional approaches to data integration TT
Provisioning
Billing
Inventory
CRM1
CRM2
Call Center
‘Integration Spaghetti’
Data W/house
Business Challenges
Agility
Managing Change
Increasing complexity
Increasing maintenance costs
Message Oriented Middleware
Inventory TT
Provisioning
Billing
CMR1
CRM2
Call Center
Data W/house

5. A new approach to data integration
Provision -ing
Billing
CRM1
CRM2
Billing
Provisioning
CRM1
CRM2
Billing
CRM1
CRM2
Provisioning
Common Data Model
Inventory TT
Data W/house
Call Center
Inventory TT
Call Center
Data W/house
Inventory TT
Call Center
A common data model enables transformation of all interfaces to a single semantic meaning.
‘Integration Spaghetti’
Messaged Oriented Middleware
ESB and
Semantic Data Integration

6. Can’t We All Just Get Along?
The Problem
Application 2
Translation
Application 1
Translation
Application 3
Translation
Translation
Translation
Translation
Translation
Translation
Translation
Translation
Translation
Translation
Translation
Database 3
No central management
Costly to modify
Not easily adapted to change
Database 1
Translation
Database 2
Translation
Translation

7. Model Driven Integration
The Solution
Application 2
Application 1
Application 3
Common Model
Distributed Transformation Engine
Database 3
Database 1
Centralized management
Rapid development and deployment
Lower TCO
Database 2

8. Why DataXtend Semantic Integrator?
Data has different meanings in different systems (semantics)
“age” means something different to an insurance company issuing a premium than to a government agency issuing a driver’s permit
Many data transformations between systems are complex
XSLT is not enough
In SOA, everybody needs to know how to talk to everybody else!

9. DataXtend Semantic Integrator
Address the accidental architecture of data
Customer Care
Common model architecture for semantic mediation
Visual mapping of large, complex integrations
Robust project life cycle support
Round-trip testing and impact analysis
Flexible, distributed deployment options
Web services, ESB, app server, or Java container
Invoicing
TM Forum SID
Provisioning
Services
Customers
Products

10. Challenges of Common Model Integration
A good Common Model should be
Comprehensive
Abstract
Extensible
But… a comprehensive, abstract model is
Large
Complex for simple things
Hard to maintain
DataXtend SI addresses these issues

11. Industry Standard Common Data Models
P&C Insurance (ACORD P&C)
Health Care Payers and Providers (HL7)
Financial Derivatives (FpML)
Telecommunication (TMF SID)
Horizontal (OAGIS)
Retail (ARTS)
Mortgage Banking (MISMO)
Utilities (IEC 61968)
Life Insurance (ACORD Life)
Financial Services Messages (ISO20022)
B2B Supply Chain (RosettaNet, GS1/EAN)

12. Agenda
Data challenges in integration solutions
DXSI enables the data layer in integration
DXSI in the Systems Development Lifecycle
Summary

13. Progress® DataXtend SI
- Enables the data layer in Integration
BPM Layer
BPM
BAM
Business Process Layer
- Process Abstraction
Progress DataXtend SI
Utilizes a Common Model
Semantic Brokering
Model based Mappings
Visual Round-Trip Testing
360º End-to-End Impact Analysis
Governance Change and Lifecycle Management
Common Data Model
Customer
Product
Resource
Partner
Common
Market
Service
Data Interoperability Layer
- Semantic Abstraction
ENTERPRISE SERVICE BUS
NMS
Inventory
OMS
Billing
CRM
System Integration Layer
- Infrastructure Abstraction
ESB/EAI Layer

14. DataXtend SI Product Capabilities
CENTRALIZED DESIGN
DISTRIBUTED RUNTIME
TESTING
Deploy
Generate
Visual tool for designing integration
Stateless for scalability
Runs in any Java container
Connects to any bus
Runs in Eclipse

15. Agenda
Data challenges in integration solutions
DXSI enables the data layer in integration
DXSI in the Systems Development Lifecycle
Summary

16. The DataXtend SI Lifecycle
Design Time
Import, enrich, define
rules, aggregations and maps needed to exchange valid data between enterprise systems
Runtime
Automate
rules execution
Audit and Validate
every exchange
Lifecycle Management
Manage rules, aggregations and maps over time
Change integrations of adaptive infrastructure with build-in change management facilities

17. DataXtend Exchange Model
Import directly from a UML
Import directly from a database
(default validation rules to enforce constraints)
Import directly from XML
Semantic Mappings:
Validate Data
Match incompatible data
Flag Data Errors
Conditionally Map
1000 Classes
Your Own
Model!
1020 Classes
1080 Classes
5000 Classes
Import directly from a WSDL

18. DataXtend Common Model Navigator
Component View Detail about the component in tabular form: attributes, types, classes, collections and relationships
Graph View Shows relationships as lines. Dotted lines represent inheritance while solid lines are containment relationships
Tree View Allows you to navigate through the containment hierarchy of the component.

19. Computed Attributes Simplify Common Models for Ease of Use
Centralized design
Virtual attributes simplify models without deviating from the standard
Contact
Mobile
Type = Home
Type = Work
Type = Mobile
Telephone
Customer

20. DataXtend Mapping and Rule Designer
All assets are visually mapped to and from the common model
Even complex expressions are designed without coding

21. DataXtend Tester

22. Deployment Options: Distributed Execution
The DXSI Runtime is stateless and each executes independently
There is no central hub to limit performance or single point of failure
Multiple deployment options can be used simultaneously
Source Application
DXSI
Adaptor
DXSI Assembly
DXSI Data Services
Target System
Target System
App Server
DXSI Runtime Influences Message Content, Not Transport Architecture

23. DXSI Exchange Model Packaging
DXSI services can be wrapped with a variety of code generators to provide easily deployed, high performance packages for many platforms including:
Sonic ESB Itineraries
Websphere SCA / SDO
WebLogic 8 and 9 XMLBeans
WAR, EAR, EJB etc.
Packagers are designed to leverage the infrastructure and tools of the chosen platform

24. DataXtend Deployment 1: Creating the DX SI service interfaces
Interface wrappers
Simplify access to DX SI service interface
Build-in to DX SI
IBM SDOs
Sonic™ ESB
BEA Beehive
JMS
Java™ Beans
EJB Sessions
Create one or more wrappers for every data service
No wrappers. DX SI Java interface is used
build
DX SI
Java Runtime
build
Can run standalone or
packaged

25. DataXtend Deployment 2: Packaging
Application and Service packagers
Define wrappers
Build
Package
DX SI
Java Runtime
Examples:
Sonic Workbench
IBM WID
BEA Workshop
Fully deployable solution generated
Build-in packagers to DX SI
Web service, EJB, EAR
Supported platforms:
JBOSS, IBM, BEA, Oracle®
3rd Party IDE
Package & Deploy
Application Server
BPM Server
ESB

26. The DataXtend SI Lifecycle
Design Time
Import, enrich, define
rules, aggregations and maps needed to exchange valid data between enterprise systems
Runtime
Automate
rules execution
Audit and Validate
every exchange
Lifecycle Management
Manage rules, aggregations and maps over time
Change integrations of adaptive infrastructure with build-in change management facilities

27. DataXtend SI Runtime DataXtend SI Engine runtime process:
Input data is mapped to the Common Model
Common Model is enriched with extra data if required
Data is mapped from Common Model to Data Source (writing)
Results are mapped back to the Common Model and Data Services
Rules engine automates validation of the data at all stages
Runtime report is available detailing all issues

28. ESB Solution without DataXtend SI
Goal:
To provide an aggregated view of a customer’s accounts
Issues
Solution assumes all data is equivalent i.e. canonical and on the same version, for message and data
No controls to map data types
E,g. TVAccounts – maps Mr as ‘0’
Wireless maps Mr as ‘A’
To solve requires multiple transformation svcs
Possibly 10 XForm and Enrichment steps

29. DataXtend SI and ESB ESB and DX SI
Intermediate services replaced by DX SI
DX SI handles Data and Message layout impedance
Using XML based invocation framework similar to WS
11 Intermediate services to 1

30. The DataXtend SI Lifecycle
Design Time
Import, enrich, define
rules, aggregations and maps needed to exchange valid data between enterprise systems
Runtime
Automate
rules execution
Audit and Validate
every exchange
Lifecycle Management
Manage rules, aggregations and maps over time
Change integrations of adaptive infrastructure with build-in change management facilities

31. DataXtend SI Lifecycle Management Features
Impact Analysis view and report:
Identify interdependencies in a project.
An Impact Analysis report provides a snapshot of an element's current state for future reference.
Comparison of exchange model elements:
Provides an interface for comparing elements in the same project or in different projects.
Synchronize model changes:
Allows you to selectively accept changes from one exchange model into another.

32. DataXtend SI Impact Analysis
The Impact Analysis view displays all entities affected by or related to the entity selected in the Exchange Model editor
Select the DataXtend Impact Analysis tab with an entity selected
You can generate an HTML Impact Analysis Report that displays all entities related to the selected entity

33. DataXtend SI Compare Editor
Changes are highlighted in the Compare Editor
Use the Compare Editor to compare:
Entities in the same or in different projects
Two files in the same project
This example shows how to compare two files in the same project.

34. Synchronizing Model Changes
You use project synchronization to merge the contents of two exchange models: The current project (the target) and an external project (the source).
You can also use project synchronization to create a new project based on another, exported one.

35. Agenda
Data challenges in integration solutions
DXSI enables the data layer in integration
DXSI Lifecycle
Summary

36. Summary DX SI Differentiator vs. Traditional Mappers
Comparison with traditional point-to-point message mapping tools

37. What if…?
What if… you could accurately turn around change impact assessments in hours rather than days?
What if… you could radically increase systems agility and responsiveness to business requests through a loosely coupled architecture?
What if… you could significantly reduce maintenance costs (through re-use, consistency, reduction in custom code, end-to-end visibility of data, and leverage of open inter-operable standards)

38. In Summary
DataXtend SI reduces costs to create and maintain data transformation
DataXtend SI utilizes and enables a common model approach
DataXtend SI deploy as a service

39. For More Information, go to…
PSDN
DataXtend SI Product Center
Documentation
Progress.com
DataXtend SI Home Page
DataXtend SID Model Browser

40. Relevant PTW Sessions C4: Common Applications of Sonic ESB
C8: Enterprise Integration Patterns in Sonic ESB
C9: SOA Management with Actional for Sonic live at work

41. ?
Questions

42. Thank You