Presentation on theme: "C5: Introduction to DataXtend® Semantic Integrator (DX SI)"— Presentation transcript:
1 C5: Introduction to DataXtend® Semantic Integrator (DX SI) Dean ElliottClient Solutions Manager
2 AgendaData challenges in integration solutionsDX SI enables the data layer in integrationDX SI LifecycleDX SI Demonstration
3 Traditional approaches to data integration CMR1CRM2BillingProvisioningBillingCRM1CRM2ProvisioningInventoryTTData W/houseCall CenterInventoryTTCall CenterData W/house‘Integration Spaghetti’Message Oriented Middleware
4 Increasing complexity Increasing maintenance costs Business Challenges resulting from traditional approaches to data integrationTTProvisioningBillingInventoryCRM1CRM2Call Center‘Integration Spaghetti’Data W/houseBusiness ChallengesAgilityManaging ChangeIncreasing complexityIncreasing maintenance costsMessage Oriented MiddlewareInventoryTTProvisioningBillingCMR1CRM2Call CenterData W/house
5 A new approach to data integration Provision -ingBillingCRM1CRM2BillingProvisioningCRM1CRM2BillingCRM1CRM2ProvisioningCommon Data ModelInventoryTTData W/houseCall CenterInventoryTTCall CenterData W/houseInventoryTTCall CenterA common data model enables transformation of all interfaces to a single semantic meaning.‘Integration Spaghetti’Messaged Oriented MiddlewareESB andSemantic Data Integration
6 Can’t We All Just Get Along? The ProblemApplication 2TranslationApplication 1TranslationApplication 3TranslationTranslationTranslationTranslationTranslationTranslationTranslationTranslationTranslationTranslationTranslationDatabase 3No central managementCostly to modifyNot easily adapted to changeDatabase 1TranslationDatabase 2TranslationTranslation
7 Model Driven Integration The SolutionApplication 2Application 1Application 3Common ModelDistributed Transformation EngineDatabase 3Database 1Centralized managementRapid development and deploymentLower TCODatabase 2
8 Why DataXtend Semantic Integrator? Data has different meanings in different systems (semantics)“age” means something different to an insurance company issuing a premium than to a government agency issuing a driver’s permitMany data transformations between systems are complexXSLT is not enoughIn SOA, everybody needs to know how to talk to everybody else!
9 DataXtend Semantic Integrator Address the accidental architecture of dataCustomer CareCommon model architecture for semantic mediationVisual mapping of large, complex integrationsRobust project life cycle supportRound-trip testing and impact analysisFlexible, distributed deployment optionsWeb services, ESB, app server, or Java containerInvoicingTM Forum SIDProvisioningServicesCustomersProducts
10 Challenges of Common Model Integration A good Common Model should beComprehensiveAbstractExtensibleBut… a comprehensive, abstract model isLargeComplex for simple thingsHard to maintainDataXtend SI addresses these issues
11 Industry Standard Common Data Models P&C Insurance (ACORD P&C)Health Care Payers and Providers (HL7)Financial Derivatives (FpML)Telecommunication (TMF SID)Horizontal (OAGIS)Retail (ARTS)Mortgage Banking (MISMO)Utilities (IEC 61968)Life Insurance (ACORD Life)Financial Services Messages (ISO20022)B2B Supply Chain (RosettaNet, GS1/EAN)
12 AgendaData challenges in integration solutionsDXSI enables the data layer in integrationDXSI in the Systems Development LifecycleSummary
13 Progress® DataXtend SI - Enables the data layer in IntegrationBPM LayerBPMBAMBusiness Process Layer- Process AbstractionProgress DataXtend SIUtilizes a Common ModelSemantic BrokeringModel based MappingsVisual Round-Trip Testing360º End-to-End Impact AnalysisGovernance Change and Lifecycle ManagementCommon Data ModelCustomerProductResourcePartnerCommonMarketServiceData Interoperability Layer- Semantic AbstractionENTERPRISE SERVICE BUSNMSInventoryOMSBillingCRMSystem Integration Layer- Infrastructure AbstractionESB/EAI Layer
14 DataXtend SI Product Capabilities CENTRALIZED DESIGNDISTRIBUTED RUNTIMETESTINGDeployGenerateVisual tool for designing integrationStateless for scalabilityRuns in any Java containerConnects to any busRuns in Eclipse
15 AgendaData challenges in integration solutionsDXSI enables the data layer in integrationDXSI in the Systems Development LifecycleSummary
16 The DataXtend SI Lifecycle Design TimeImport, enrich, definerules, aggregations and maps needed to exchange valid data between enterprise systemsRuntimeAutomaterules executionAudit and Validateevery exchangeLifecycle ManagementManage rules, aggregations and maps over timeChange integrations of adaptive infrastructure with build-in change management facilities
17 DataXtend Exchange Model Import directly from a UMLImport directly from a database(default validation rules to enforce constraints)Import directly from XMLSemantic Mappings:Validate DataMatch incompatible dataFlag Data ErrorsConditionally Map1000 ClassesYour OwnModel!1020 Classes1080 Classes5000 ClassesImport directly from a WSDL
18 DataXtend Common Model Navigator Component View Detail about the component in tabular form: attributes, types, classes, collections and relationshipsGraph View Shows relationships as lines. Dotted lines represent inheritance while solid lines are containment relationshipsTree View Allows you to navigate through the containment hierarchy of the component.
19 Computed Attributes Simplify Common Models for Ease of Use Centralized designVirtual attributes simplify models without deviating from the standardContactMobileType = HomeType = WorkType = MobileTelephoneCustomer
20 DataXtend Mapping and Rule Designer All assets are visually mapped to and from the common modelEven complex expressions are designed without coding
22 Deployment Options: Distributed Execution The DXSI Runtime is stateless and each executes independentlyThere is no central hub to limit performance or single point of failureMultiple deployment options can be used simultaneouslySource ApplicationDXSIAdaptorDXSI AssemblyDXSI Data ServicesTarget SystemTarget SystemApp ServerDXSI Runtime Influences Message Content, Not Transport Architecture
23 DXSI Exchange Model Packaging DXSI services can be wrapped with a variety of code generators to provide easily deployed, high performance packages for many platforms including:Sonic ESB ItinerariesWebsphere SCA / SDOWebLogic 8 and 9 XMLBeansWAR, EAR, EJB etc.Packagers are designed to leverage the infrastructure and tools of the chosen platform
24 DataXtend Deployment 1: Creating the DX SI service interfaces Interface wrappersSimplify access to DX SI service interfaceBuild-in to DX SIIBM SDOsSonic™ ESBBEA BeehiveJMSJava™ BeansEJB SessionsCreate one or more wrappers for every data serviceNo wrappers. DX SI Java interface is usedbuildDX SIJava RuntimebuildCan run standalone orpackaged
25 DataXtend Deployment 2: Packaging Application and Service packagersDefine wrappersBuildPackageDX SIJava RuntimeExamples:Sonic WorkbenchIBM WIDBEA WorkshopFully deployable solution generatedBuild-in packagers to DX SIWeb service, EJB, EARSupported platforms:JBOSS, IBM, BEA, Oracle®3rd Party IDEPackage & DeployApplication ServerBPM ServerESB
26 The DataXtend SI Lifecycle Design TimeImport, enrich, definerules, aggregations and maps needed to exchange valid data between enterprise systemsRuntimeAutomaterules executionAudit and Validateevery exchangeLifecycle ManagementManage rules, aggregations and maps over timeChange integrations of adaptive infrastructure with build-in change management facilities
27 DataXtend SI Runtime DataXtend SI Engine runtime process: Input data is mapped to the Common ModelCommon Model is enriched with extra data if requiredData is mapped from Common Model to Data Source (writing)Results are mapped back to the Common Model and Data ServicesRules engine automates validation of the data at all stagesRuntime report is available detailing all issues
28 ESB Solution without DataXtend SI Goal:To provide an aggregated view of a customer’s accountsIssuesSolution assumes all data is equivalent i.e. canonical and on the same version, for message and dataNo controls to map data typesE,g. TVAccounts – maps Mr as ‘0’Wireless maps Mr as ‘A’To solve requires multiple transformation svcsPossibly 10 XForm and Enrichment steps
29 DataXtend SI and ESB ESB and DX SI Intermediate services replaced by DX SIDX SI handles Data and Message layout impedanceUsing XML based invocation framework similar to WS11 Intermediate services to 1
30 The DataXtend SI Lifecycle Design TimeImport, enrich, definerules, aggregations and maps needed to exchange valid data between enterprise systemsRuntimeAutomaterules executionAudit and Validateevery exchangeLifecycle ManagementManage rules, aggregations and maps over timeChange integrations of adaptive infrastructure with build-in change management facilities
31 DataXtend SI Lifecycle Management Features Impact Analysis view and report:Identify interdependencies in a project.An Impact Analysis report provides a snapshot of an element's current state for future reference.Comparison of exchange model elements:Provides an interface for comparing elements in the same project or in different projects.Synchronize model changes:Allows you to selectively accept changes from one exchange model into another.
32 DataXtend SI Impact Analysis The Impact Analysis view displays all entities affected by or related to the entity selected in the Exchange Model editorSelect the DataXtend Impact Analysis tab with an entity selectedYou can generate an HTML Impact Analysis Report that displays all entities related to the selected entity
33 DataXtend SI Compare Editor Changes are highlighted in the Compare EditorUse the Compare Editor to compare:Entities in the same or in different projectsTwo files in the same projectThis example shows how to compare two files in the same project.
34 Synchronizing Model Changes You use project synchronization to merge the contents of two exchange models: The current project (the target) and an external project (the source).You can also use project synchronization to create a new project based on another, exported one.
35 AgendaData challenges in integration solutionsDXSI enables the data layer in integrationDXSI LifecycleSummary
36 Summary DX SI Differentiator vs. Traditional Mappers Comparison with traditional point-to-point message mapping tools
37 What if…?What if… you could accurately turn around change impact assessments in hours rather than days?What if… you could radically increase systems agility and responsiveness to business requests through a loosely coupled architecture?What if… you could significantly reduce maintenance costs (through re-use, consistency, reduction in custom code, end-to-end visibility of data, and leverage of open inter-operable standards)
38 In SummaryDataXtend SI reduces costs to create and maintain data transformationDataXtend SI utilizes and enables a common model approachDataXtend SI deploy as a service
39 For More Information, go to… PSDNDataXtend SI Product CenterDocumentationProgress.comDataXtend SI Home PageDataXtend SID Model Browser
40 Relevant PTW Sessions C4: Common Applications of Sonic ESB C8: Enterprise Integration Patterns in Sonic ESBC9: SOA Management with Actional for Sonic live at work