Presentation is loading. Please wait.

Presentation is loading. Please wait.

1 ETL Framework Definition - For a leading Financial Service Company - Name: Designation: Date: February, 2004 Copyright Wipro Technologies 2004 Consultancy.

Similar presentations


Presentation on theme: "1 ETL Framework Definition - For a leading Financial Service Company - Name: Designation: Date: February, 2004 Copyright Wipro Technologies 2004 Consultancy."— Presentation transcript:

1 1 ETL Framework Definition - For a leading Financial Service Company - Name: Designation: Date: February, 2004 Copyright Wipro Technologies 2004 Consultancy Assignment Feb-March 2004

2 2 Business Objectives GAE has standardized on a data integration platform and invited Wipro to establish a reference ETL framework to enable Business Technology Groups to adopt Informatica for their data integration needs and to leverage the shared infrastructure for their decision support requirements  Provide a consistent set of processes to approach data integration requirements within the Firm  Capturing best practices around the process of designing and developing an analytic solution architecture using Informatica  Define an Informatica based ETL framework that will support –  Genericity – the derivation of a simple model, powerful to capture ideal cases of ETL activities  Extensibility – the possibility of extending the functionality of the system with new, user-specific requirements  Standardize on a single ETL platform – Informatica  Leverage best practices across projects  Build a repository of reusable components  Sharing the product licensing cost

3 3 Wipro’s Contribution A team of 2 Wipro Consultants defined the ETL Framework, set up the ETL Infrastructure Shared Service model and demonstrated the strength of recommendations made via the PoC.  Defining ETL Architecture considering following factors  Standardization of ETL infrastructure across the Firm, reducing maintenance cost  Optimized usage of ETL tool licenses, reducing operational cost  Supports adoption of ETL best practices across projects  Provides for a readily available production deployment environment  Defining strategy for Data Load/Extraction/Cleansing (Considering different sources the customer use for data integration requirements, proper recommendations were made for Load, Extraction and Cleansing strategies)  Metadata Management (How Informatica maintains the metadata and the strategy for utilizing this metadata)  Error Handling and Customized Notification (Strategy for error handling includes, reload of rejected data, exception handling, different ways to handle errors e.g. out of the box solution and logical solutions. Strategy for Error notification, integration with the existing error notification infrastructure)  Scheduling Strategy (Different option for scheduling the ETL jobs, Use of third party scheduler like Autosys, Cron jobs, etc, Event based scheduling)  Reusability and Best Practices (Different re-usable components of Informatica that can be shared across the firm)  Configuration Management ETL Framework Definition  Setup of Informatica PowerCenter Server farm  Configuration of Informatica as Highly Available System (IP Failover mechanism)  Informatica shared service setup for Prod/QA/Dev environment on high end servers ETL Infrastructure – Shared Service Model setup PoC on ETL Shared Service Infrastructure  Migration of Oracle/Sybase SP based jobs to Informatica  Execution of complete life cycle of ETL migration projects  Identification of reusable components  Metadata Reporting

4 4 Project Highlights  CSAT rating of 5/5 achieved  Clients existing infrastructure was analyzed and integration points were identified from ETL infrastructure and existing infrastructure (e.g. Error notification mechanism, disaster recovery, architecture compliance with later versions of Informatica, etc). This helped customer to adopt the newly introduced ETL framework very easily.  Wipro solicited the information from different business technology groups about their data integration environments and requirements. This helped in addressing the issues with existing data integration environment and how these issues will be resolved with adoption of new ETL framework factored in Informatica.  The PoC performed showed about 35% performance gain in existing ETL jobs  Informatica jobs scheduling through third party scheduler (Autosys)  Interface with existing error notification system e.g. BING notification  Leveraged performance enhanced techniques of Informatica  As the outcome of this ETL Framework definition project about 15 different business technology groups have already availed the shared service provided by GAE group and 10 more groups are in the process of coming on board. This environment is centrally maintained by GAE group and different business technology groups were charged by the change back model established by Wipro for GAE.

5 5 Technical Details & Application Architecture  ETL Tool - Informatica PowerCenter 6.2.1  Operating System - Linux 2.4.9- e.25enterprise  DBMS - Sybase 12.5.0.3/EBF 10973 ESD#1


Download ppt "1 ETL Framework Definition - For a leading Financial Service Company - Name: Designation: Date: February, 2004 Copyright Wipro Technologies 2004 Consultancy."

Similar presentations


Ads by Google