Presentation on theme: "C5: Introduction to DataXtend® Semantic Integrator (DX SI)"— Presentation transcript:
1C5: Introduction to DataXtend® Semantic Integrator (DX SI) Dean ElliottClient Solutions Manager
2AgendaData challenges in integration solutionsDX SI enables the data layer in integrationDX SI LifecycleDX SI Demonstration
3Traditional approaches to data integration CMR1CRM2BillingProvisioningBillingCRM1CRM2ProvisioningInventoryTTData W/houseCall CenterInventoryTTCall CenterData W/house‘Integration Spaghetti’Message Oriented Middleware
4Increasing complexity Increasing maintenance costs Business Challenges resulting from traditional approaches to data integrationTTProvisioningBillingInventoryCRM1CRM2Call Center‘Integration Spaghetti’Data W/houseBusiness ChallengesAgilityManaging ChangeIncreasing complexityIncreasing maintenance costsMessage Oriented MiddlewareInventoryTTProvisioningBillingCMR1CRM2Call CenterData W/house
5A new approach to data integration Provision -ingBillingCRM1CRM2BillingProvisioningCRM1CRM2BillingCRM1CRM2ProvisioningCommon Data ModelInventoryTTData W/houseCall CenterInventoryTTCall CenterData W/houseInventoryTTCall CenterA common data model enables transformation of all interfaces to a single semantic meaning.‘Integration Spaghetti’Messaged Oriented MiddlewareESB andSemantic Data Integration
6Can’t We All Just Get Along? The ProblemApplication 2TranslationApplication 1TranslationApplication 3TranslationTranslationTranslationTranslationTranslationTranslationTranslationTranslationTranslationTranslationTranslationDatabase 3No central managementCostly to modifyNot easily adapted to changeDatabase 1TranslationDatabase 2TranslationTranslation
7Model Driven Integration The SolutionApplication 2Application 1Application 3Common ModelDistributed Transformation EngineDatabase 3Database 1Centralized managementRapid development and deploymentLower TCODatabase 2
8Why DataXtend Semantic Integrator? Data has different meanings in different systems (semantics)“age” means something different to an insurance company issuing a premium than to a government agency issuing a driver’s permitMany data transformations between systems are complexXSLT is not enoughIn SOA, everybody needs to know how to talk to everybody else!
9DataXtend Semantic Integrator Address the accidental architecture of dataCustomer CareCommon model architecture for semantic mediationVisual mapping of large, complex integrationsRobust project life cycle supportRound-trip testing and impact analysisFlexible, distributed deployment optionsWeb services, ESB, app server, or Java containerInvoicingTM Forum SIDProvisioningServicesCustomersProducts
10Challenges of Common Model Integration A good Common Model should beComprehensiveAbstractExtensibleBut… a comprehensive, abstract model isLargeComplex for simple thingsHard to maintainDataXtend SI addresses these issues
11Industry Standard Common Data Models P&C Insurance (ACORD P&C)Health Care Payers and Providers (HL7)Financial Derivatives (FpML)Telecommunication (TMF SID)Horizontal (OAGIS)Retail (ARTS)Mortgage Banking (MISMO)Utilities (IEC 61968)Life Insurance (ACORD Life)Financial Services Messages (ISO20022)B2B Supply Chain (RosettaNet, GS1/EAN)
12AgendaData challenges in integration solutionsDXSI enables the data layer in integrationDXSI in the Systems Development LifecycleSummary
13Progress® DataXtend SI - Enables the data layer in IntegrationBPM LayerBPMBAMBusiness Process Layer- Process AbstractionProgress DataXtend SIUtilizes a Common ModelSemantic BrokeringModel based MappingsVisual Round-Trip Testing360º End-to-End Impact AnalysisGovernance Change and Lifecycle ManagementCommon Data ModelCustomerProductResourcePartnerCommonMarketServiceData Interoperability Layer- Semantic AbstractionENTERPRISE SERVICE BUSNMSInventoryOMSBillingCRMSystem Integration Layer- Infrastructure AbstractionESB/EAI Layer
14DataXtend SI Product Capabilities CENTRALIZED DESIGNDISTRIBUTED RUNTIMETESTINGDeployGenerateVisual tool for designing integrationStateless for scalabilityRuns in any Java containerConnects to any busRuns in Eclipse
15AgendaData challenges in integration solutionsDXSI enables the data layer in integrationDXSI in the Systems Development LifecycleSummary
16The DataXtend SI Lifecycle Design TimeImport, enrich, definerules, aggregations and maps needed to exchange valid data between enterprise systemsRuntimeAutomaterules executionAudit and Validateevery exchangeLifecycle ManagementManage rules, aggregations and maps over timeChange integrations of adaptive infrastructure with build-in change management facilities
17DataXtend Exchange Model Import directly from a UMLImport directly from a database(default validation rules to enforce constraints)Import directly from XMLSemantic Mappings:Validate DataMatch incompatible dataFlag Data ErrorsConditionally Map1000 ClassesYour OwnModel!1020 Classes1080 Classes5000 ClassesImport directly from a WSDL
18DataXtend Common Model Navigator Component View Detail about the component in tabular form: attributes, types, classes, collections and relationshipsGraph View Shows relationships as lines. Dotted lines represent inheritance while solid lines are containment relationshipsTree View Allows you to navigate through the containment hierarchy of the component.
19Computed Attributes Simplify Common Models for Ease of Use Centralized designVirtual attributes simplify models without deviating from the standardContactMobileType = HomeType = WorkType = MobileTelephoneCustomer
20DataXtend Mapping and Rule Designer All assets are visually mapped to and from the common modelEven complex expressions are designed without coding
22Deployment Options: Distributed Execution The DXSI Runtime is stateless and each executes independentlyThere is no central hub to limit performance or single point of failureMultiple deployment options can be used simultaneouslySource ApplicationDXSIAdaptorDXSI AssemblyDXSI Data ServicesTarget SystemTarget SystemApp ServerDXSI Runtime Influences Message Content, Not Transport Architecture
23DXSI Exchange Model Packaging DXSI services can be wrapped with a variety of code generators to provide easily deployed, high performance packages for many platforms including:Sonic ESB ItinerariesWebsphere SCA / SDOWebLogic 8 and 9 XMLBeansWAR, EAR, EJB etc.Packagers are designed to leverage the infrastructure and tools of the chosen platform
24DataXtend Deployment 1: Creating the DX SI service interfaces Interface wrappersSimplify access to DX SI service interfaceBuild-in to DX SIIBM SDOsSonic™ ESBBEA BeehiveJMSJava™ BeansEJB SessionsCreate one or more wrappers for every data serviceNo wrappers. DX SI Java interface is usedbuildDX SIJava RuntimebuildCan run standalone orpackaged
25DataXtend Deployment 2: Packaging Application and Service packagersDefine wrappersBuildPackageDX SIJava RuntimeExamples:Sonic WorkbenchIBM WIDBEA WorkshopFully deployable solution generatedBuild-in packagers to DX SIWeb service, EJB, EARSupported platforms:JBOSS, IBM, BEA, Oracle®3rd Party IDEPackage & DeployApplication ServerBPM ServerESB
26The DataXtend SI Lifecycle Design TimeImport, enrich, definerules, aggregations and maps needed to exchange valid data between enterprise systemsRuntimeAutomaterules executionAudit and Validateevery exchangeLifecycle ManagementManage rules, aggregations and maps over timeChange integrations of adaptive infrastructure with build-in change management facilities
27DataXtend SI Runtime DataXtend SI Engine runtime process: Input data is mapped to the Common ModelCommon Model is enriched with extra data if requiredData is mapped from Common Model to Data Source (writing)Results are mapped back to the Common Model and Data ServicesRules engine automates validation of the data at all stagesRuntime report is available detailing all issues
28ESB Solution without DataXtend SI Goal:To provide an aggregated view of a customer’s accountsIssuesSolution assumes all data is equivalent i.e. canonical and on the same version, for message and dataNo controls to map data typesE,g. TVAccounts – maps Mr as ‘0’Wireless maps Mr as ‘A’To solve requires multiple transformation svcsPossibly 10 XForm and Enrichment steps
29DataXtend SI and ESB ESB and DX SI Intermediate services replaced by DX SIDX SI handles Data and Message layout impedanceUsing XML based invocation framework similar to WS11 Intermediate services to 1
30The DataXtend SI Lifecycle Design TimeImport, enrich, definerules, aggregations and maps needed to exchange valid data between enterprise systemsRuntimeAutomaterules executionAudit and Validateevery exchangeLifecycle ManagementManage rules, aggregations and maps over timeChange integrations of adaptive infrastructure with build-in change management facilities
31DataXtend SI Lifecycle Management Features Impact Analysis view and report:Identify interdependencies in a project.An Impact Analysis report provides a snapshot of an element's current state for future reference.Comparison of exchange model elements:Provides an interface for comparing elements in the same project or in different projects.Synchronize model changes:Allows you to selectively accept changes from one exchange model into another.
32DataXtend SI Impact Analysis The Impact Analysis view displays all entities affected by or related to the entity selected in the Exchange Model editorSelect the DataXtend Impact Analysis tab with an entity selectedYou can generate an HTML Impact Analysis Report that displays all entities related to the selected entity
33DataXtend SI Compare Editor Changes are highlighted in the Compare EditorUse the Compare Editor to compare:Entities in the same or in different projectsTwo files in the same projectThis example shows how to compare two files in the same project.
34Synchronizing Model Changes You use project synchronization to merge the contents of two exchange models: The current project (the target) and an external project (the source).You can also use project synchronization to create a new project based on another, exported one.
35AgendaData challenges in integration solutionsDXSI enables the data layer in integrationDXSI LifecycleSummary
36Summary DX SI Differentiator vs. Traditional Mappers Comparison with traditional point-to-point message mapping tools
37What if…?What if… you could accurately turn around change impact assessments in hours rather than days?What if… you could radically increase systems agility and responsiveness to business requests through a loosely coupled architecture?What if… you could significantly reduce maintenance costs (through re-use, consistency, reduction in custom code, end-to-end visibility of data, and leverage of open inter-operable standards)
38In SummaryDataXtend SI reduces costs to create and maintain data transformationDataXtend SI utilizes and enables a common model approachDataXtend SI deploy as a service
39For More Information, go to… PSDNDataXtend SI Product CenterDocumentationProgress.comDataXtend SI Home PageDataXtend SID Model Browser
40Relevant PTW Sessions C4: Common Applications of Sonic ESB C8: Enterprise Integration Patterns in Sonic ESBC9: SOA Management with Actional for Sonic live at work