Presentation is loading. Please wait.

Presentation is loading. Please wait.

Data Exchange Needs Using ETL Tools. Overview Client Project Issue Methodology Schedule & Budget Results & Recommendations Challenges Acknowledgments.

Similar presentations


Presentation on theme: "Data Exchange Needs Using ETL Tools. Overview Client Project Issue Methodology Schedule & Budget Results & Recommendations Challenges Acknowledgments."— Presentation transcript:

1 Data Exchange Needs Using ETL Tools

2 Overview Client Project Issue Methodology Schedule & Budget Results & Recommendations Challenges Acknowledgments Questions

3 Ministry Of Transportation

4 Project Issue & Primary Goal Current data conversion process o Each time data is updated it needs to be redone manually o Need to streamline the process o Extract Transform Load (ETL) Tools Safe Software Feature Manipulation Engine (FME) Esri ArcGIS Geoprocessing Tools (Data Interoperability Extension)

5 Methodology Standard Methodological Approach: Identify objectives, issues & goals Research topic and best practices Identify scheduling, budget, risks Communicate & Conduct Meetings Gather information for evaluation, reporting and decision making Report findings

6 Streamlined data conversion process User know-how ETL tools capabilities and limitations ETL tool decision making Final Report and recommendations Goals & Deliverables

7 Extract Transform Load ETL - Traditional ETL is used to migrate data from one database to another, to form data marts and data warehouses and also to convert databases from one format or type to another. Spatial ETL – Safe Software Feature Manipulation Engine - FME Provides the data processing functionality of traditional ETL, but with a primary focus on the ability to manage spatial data (the geometry, attributes, and coordinate systems of spatial datasets)

8

9 Oracle SQL Bridge Date xls ArcSDE ArcGIS Server ArcGIS Desktop Current Process

10

11 MTO Proof of Concept

12

13

14

15

16 FME Output

17 FME Server FME Desktop is the authoring tool for FME Server Any spatial ETL workflow created in FME Desktop can be published to FME Server FME Server is a scalable processing environment that allows multiple users via the web Workflows can be shared and automated in this environment

18 “Safe Software sets the standard for spatial data interoperability, so it was an obvious choice to use their FME technology for Esri’s ArcGIS Data Interoperability Extension.” – Jack Dangermond, Esri President ArcGIS Desktop Data Interoperability Spatial ETL

19

20

21 ArcGIS Output

22 Arc Server

23 Evaluation Architecture ETL Functionality Ease-of-Use Reusability Debugging Real-time Connectivity General ETL tool characteristics

24 Challenges GIS Expertise, knowledge and training Assumed licenses acquired and ready to use Data availability and ability to work on data Client Representation

25 Recommendations Streamlined data conversion process User know-how ETL tools capabilities and limitations ETL tool decision making

26 Acknowledgements Client o Laura Kingston Project Thesis Adviser o Mike Wallace Technical Advising o Colin Bissell o Jonathan Lepage o Allison Hughes FME Software Acquisition o Gerry McCoubrey o Craig Vernon

27 Questions


Download ppt "Data Exchange Needs Using ETL Tools. Overview Client Project Issue Methodology Schedule & Budget Results & Recommendations Challenges Acknowledgments."

Similar presentations


Ads by Google