1 ETL Framework Definition - For a leading Financial Service Company - Name: Designation: Date: February, 2004 Copyright Wipro Technologies 2004 Consultancy.

Slides:



Advertisements
Similar presentations
IBM SMB Software Group ® ibm.com/software/smb Maintain Hardware Platform Health An IT Services Management Infrastructure Solution.
Advertisements

Upgrading the Oracle Applications: Going Beyond the Technical Upgrade Atlanta OAUG March 19, 1999 Robert Cooney.
Database Area Neighborhood (DAN)
Enterprise Resource Planning
The Business Value of CA Solutions Ovidiu VALEANU Senior Consultant DNA Software – CA Regional Representative.
Experience, Technology and Focus in Mid Market CRM Soffront Asset management: An Overview.
Oncor’s EIM Program.
SOA Architecture Delivery Process by Dr. Robert Marcus SRI International 1100 Wilson Boulevard Arlington, VA
SAS® Data Integration Solution
Lecture 12 Reengineering Computer-aided Software Engineering Cleanroom Software Engineering.
Copyright 2009 FUJITSU TECHNOLOGY SOLUTIONS PRIMERGY Servers and Windows Server® 2008 R2 Benefit from an efficient, high performance and flexible platform.
ISS IT Assessment Framework
Components and Architecture CS 543 – Data Warehousing.
Presentation Title: Utilizing Business Process Management (BPM) and Enterprise Architecture (EA) to Achieve and Maintain a Competitive Advantage Presented.
RVP overview 19 kwietnia 2012 mgr inż. Marcin Kłosiński
Business Intelligence Dr. Mahdi Esmaeili 1. Technical Infrastructure Evaluation Hardware Network Middleware Database Management Systems Tools and Standards.
Navision Business Analytics Joyce Leung, Partner Technology Specialist.
December 3, 2010 SAIF Governance Framework A Brief Update on work to date.
Building solutions with Improving solution governance on SharePoint 2010 Rico Ho Chief Dreaming Officer
Data Management Capabilities and Past Performance Dr. Srinivas Kankanahalli.
LEVERAGING THE ENTERPRISE INFORMATION ENVIRONMENT Louise Edmonds Senior Manager Information Management ACT Health.
ACL Solutions for Continuous Auditing and Monitoring John Verver CA, CISA, CMC Vice President, Professional Services & Product Strategy ACL Services Ltd.
® IBM Software Group © IBM Corporation IBM Information Server Service Oriented Architecture WebSphere Information Services Director (WISD)
Pseudos Technologies Private Limited
1 Data Strategy Overview Keith Wilson Session 15.
BUSINESS INTELLIGENCE/DATA INTEGRATION/ETL/INTEGRATION AN INTRODUCTION Presented by: Gautam Sinha.
Effective Methods for Software and Systems Integration
SOA – Development Organization Yogish Pai. 2 IT organization are structured to meet the business needs LOB-IT Aligned to a particular business unit for.
An Introduction to the new features in TOGAF® 9
Intro Informatica Productivity Pack Save Time and Money while Increasing the Quality of Your PowerCenter Deployment Louis Hausle.
©Ian Sommerville 2004Software Engineering, 7th edition. Chapter 18 Slide 1 Software Reuse.
The Microsoft Office 2007 Enterprise Project Management Solution:
© 2008 OSIsoft, Inc. | Company Confidential Analytics and Notifications Michael Hesselbach Beth McNeill Michael Hesselbach Beth McNeill.
Mantychore Oct 2010 WP 7 Andrew Mackarel. Agenda 1. Scope of the WP 2. Mm distribution 3. The WP plan 4. Objectives 5. Deliverables 6. Deadlines 7. Partners.
The Challenge of IT-Business Alignment
Roles and Responsibilities
Service Transition & Planning Service Validation & Testing
MediaGrid Processing Framework 2009 February 19 Jason Danielson.
© Mahindra Satyam 2009 Decision Analysis and Resolution QMS Training.
Middleware for FIs Apeego House 4B, Tardeo Rd. Mumbai Tel: Fax:
Sigur Ecommerce Pvt. Ltd.
HCL PeopleSoft Capabilities Date:21 st May, 2014.
3 Copyright © 2009, Oracle. All rights reserved. Accessing Non-Oracle Sources.
GREG CAPPS [ ASUG INSTALLATION MEMBER MEMBER SINCE:1998 ISRAEL OLIVKOVICH [ SAP EMPLOYEE MEMBER SINCE: 2004 GRETCHEN LINDQUIST [ ASUG INSTALLATION MEMBER.
NA-MIC National Alliance for Medical Image Computing UCSD: Engineering Core 2 Portal and Grid Infrastructure.
Chapter © 2012 Pearson Education, Inc. Publishing as Prentice Hall.
I Copyright © 2007, Oracle. All rights reserved. Module i: Siebel 8.0 Essentials Training Siebel 8.0 Essentials.
Process Asad Ur Rehman Chief Technology Officer Feditec Enterprise.
Avanade Confidential – Do Not Copy, Forward or Circulate © Copyright 2014 Avanade Inc. All Rights Reserved. For Internal Use Only SharePoint Insights (BETA)
Data Warehouse A place the information system department puts the data that is turned into information. Data must be properly prepared,organized,and presented.
ITIL® Service Asset & Configuration Management Foundations Service Transition Thatcher Deane 02/17/2010.
Overview of SAP Application Services By Accely. Introduction Developed organizations in any business industry will invest in SAP programs to offer progressive.
LECTURE 5 Nangwonvuma M/ Byansi D. Components, interfaces and integration Infrastructure, Middleware and Platforms Techniques – Data warehouses, extending.
1 Copyright © 2007, Oracle. All rights reserved. Installing and Setting Up the Warehouse Builder Environment.
Blazent / ServiceNow Messaging Guide. Transforming data into actionable intelligence Improve business outcomes by contextualizing data to make informed.
1 ECM APPLICATIONS AND SOLUTIONS - PART 1 MODULE 8 ECM SPECIALIST COURSE 1 Copyright AIIM.
INFSOM-RI Elisabetta Ronchieri INFN CNAF ETICS 2 nd EU Review (CERN) 15 February 2008 WP3 - Software Configuration Tools and Methodologies.
Je-Kyun Kim Swapnil Patil William Lindsey Ken Brenner Sumit Gangwani Varun Jain.
Data Management Capabilities and Past Performance
BA Continuum India Pvt Ltd
Cisco Data Virtualization
Overview of MDM Site Hub
QlikView Connector for Informatica Powercenter An Introduction
Navision Business Analytics
PowerMart of Informatica
Enterprise Program Management Office
Presentation to Project Certification Committee, DoIT August 24, 2008
Kovaion Consulting IT Services Portfolio Date : Apr-2015
Demo for Partners and Customers
Presentation transcript:

1 ETL Framework Definition - For a leading Financial Service Company - Name: Designation: Date: February, 2004 Copyright Wipro Technologies 2004 Consultancy Assignment Feb-March 2004

2 Business Objectives GAE has standardized on a data integration platform and invited Wipro to establish a reference ETL framework to enable Business Technology Groups to adopt Informatica for their data integration needs and to leverage the shared infrastructure for their decision support requirements  Provide a consistent set of processes to approach data integration requirements within the Firm  Capturing best practices around the process of designing and developing an analytic solution architecture using Informatica  Define an Informatica based ETL framework that will support –  Genericity – the derivation of a simple model, powerful to capture ideal cases of ETL activities  Extensibility – the possibility of extending the functionality of the system with new, user-specific requirements  Standardize on a single ETL platform – Informatica  Leverage best practices across projects  Build a repository of reusable components  Sharing the product licensing cost

3 Wipro’s Contribution A team of 2 Wipro Consultants defined the ETL Framework, set up the ETL Infrastructure Shared Service model and demonstrated the strength of recommendations made via the PoC.  Defining ETL Architecture considering following factors  Standardization of ETL infrastructure across the Firm, reducing maintenance cost  Optimized usage of ETL tool licenses, reducing operational cost  Supports adoption of ETL best practices across projects  Provides for a readily available production deployment environment  Defining strategy for Data Load/Extraction/Cleansing (Considering different sources the customer use for data integration requirements, proper recommendations were made for Load, Extraction and Cleansing strategies)  Metadata Management (How Informatica maintains the metadata and the strategy for utilizing this metadata)  Error Handling and Customized Notification (Strategy for error handling includes, reload of rejected data, exception handling, different ways to handle errors e.g. out of the box solution and logical solutions. Strategy for Error notification, integration with the existing error notification infrastructure)  Scheduling Strategy (Different option for scheduling the ETL jobs, Use of third party scheduler like Autosys, Cron jobs, etc, Event based scheduling)  Reusability and Best Practices (Different re-usable components of Informatica that can be shared across the firm)  Configuration Management ETL Framework Definition  Setup of Informatica PowerCenter Server farm  Configuration of Informatica as Highly Available System (IP Failover mechanism)  Informatica shared service setup for Prod/QA/Dev environment on high end servers ETL Infrastructure – Shared Service Model setup PoC on ETL Shared Service Infrastructure  Migration of Oracle/Sybase SP based jobs to Informatica  Execution of complete life cycle of ETL migration projects  Identification of reusable components  Metadata Reporting

4 Project Highlights  CSAT rating of 5/5 achieved  Clients existing infrastructure was analyzed and integration points were identified from ETL infrastructure and existing infrastructure (e.g. Error notification mechanism, disaster recovery, architecture compliance with later versions of Informatica, etc). This helped customer to adopt the newly introduced ETL framework very easily.  Wipro solicited the information from different business technology groups about their data integration environments and requirements. This helped in addressing the issues with existing data integration environment and how these issues will be resolved with adoption of new ETL framework factored in Informatica.  The PoC performed showed about 35% performance gain in existing ETL jobs  Informatica jobs scheduling through third party scheduler (Autosys)  Interface with existing error notification system e.g. BING notification  Leveraged performance enhanced techniques of Informatica  As the outcome of this ETL Framework definition project about 15 different business technology groups have already availed the shared service provided by GAE group and 10 more groups are in the process of coming on board. This environment is centrally maintained by GAE group and different business technology groups were charged by the change back model established by Wipro for GAE.

5 Technical Details & Application Architecture  ETL Tool - Informatica PowerCenter  Operating System - Linux e.25enterprise  DBMS - Sybase /EBF ESD#1