with SAS® Data Integration Studio Just Go with the Flow! with SAS® Data Integration Studio Thank you. Honour. 2. Questions.
Goals of the Presentation Background Information Define SAS Data Integration Define SAS Data Integration (DI) Studio Major Features and Advantages of Data Integration Studio. Disadvantages of SAS Data Integration Studio. Above all, to encourage you to “just go with the flow” and give SAS Data Integration Studio a try. 2017-04-25 Statistique Canada • Statistics Canada
Background Information Statistics Canada 350 Surveys SAS Data Integration Studio is a natural fit Research Project Largest user of SAS 2. Survey everything 2. Constantly renaming, calculating, converting, concatenating subdividing ….. 2017-04-25 Statistique Canada • Statistics Canada
What is Data Integration? Imagine two puzzles Present images Different names, lengths, codesets and formats Data Example Data Harmonization concept. 2017-04-25 Statistique Canada • Statistics Canada
What is SAS Data Integration Studio According to my SAS course notes, “it is a visual design tool for building processes, Implementing processes AND managing processes Regardless Of: Data sources, Applications, OR Platforms 2017-04-25 Statistique Canada • Statistics Canada
Advantages of DI Studio Meta Data rich ($) – Meta data on just about any object you use in Data Integration Studio. Visual – It is almost like working on a flow chart. Explain Meta Data concept. 1. Incredible power 1. Run anytime, anywhere and with any type of data. 2. Explain the concept of a transformation. 2. 73 transformations in Data Integration Studio 4.4. 2. Explain custom naming of objects. 2. CASE tool 2017-04-25 Statistique Canada • Statistics Canada
Advantages of DI Studio Can be Integrated with SAS® Dataflux (More Integration with the release of SAS 9.3 suite of products). Ability to create stored processes and SOA modules. Ability to schedule jobs via the SAS® Platform Scheduler (an industrial strength scheduler). Explain Dataflux Explain stored processes and SOA. Stored Process can be run from many clients. SAS Platform Scheduler – 2 step process. 2017-04-25 Statistique Canada • Statistics Canada
Advantages of DI Studio Import Existing Code. Ability to push the processing to the database Explain ETL versus ELT. 3. Diagram on following page 2017-04-25 Statistique Canada • Statistics Canada
Advantages of DI Studio Import Existing Code. Ability to push the processing to the database 2017-04-25 Statistique Canada • Statistics Canada
Advantages of DI Studio Integration of Third Party Source Control starting with SAS Data Integration Studio 9.3. SAS Data Integration Studio can leverage the security that is set up from within the SAS platform. Can build tables quickly by importing column definitions from other tables. open source: SubVersion and CVS 1. API Explain about source control Group based versus role based. Group –features of application Imagine if you will – a huge table. DIAGRAM TO FOLLOW. 2017-04-25 Statistique Canada • Statistics Canada
Advantages of DI Studio 2017-04-25 Statistique Canada • Statistics Canada
Advantages of DI Studio Impact Analysis Explain Impact Analysis 2017-04-25 Statistique Canada • Statistics Canada
Advantages of DI Studio Performance Statistics Start Time, End Time, Duration CPU Time CPU Time, Current Memory System Memory Number of threads. Can run jobs on a grid Explain the link to optimization. BOTTLENECKS. Possible solutions to BOTTLENECKS. Explain Grid. 2017-04-25 Statistique Canada • Statistics Canada
Some Disadvantages of DI Studio Not Many….. Installation is more complex. There is a learning curve. Training is required. MetaData administrator required. The same reason these disadvantages exist 1-4 Expand on all the points. 5. As stated earlier, These disadvantages or a double edged sword 2017-04-25 Statistique Canada • Statistics Canada
DI Studio Summary In summary, DI Studio is the ideal tool for integrating data across the organization. DI Studio accomplishes task in a very transparent, organized and secure fashion. It has many advantages and very few disadvantages. Questions? 2. Break for questions 2017-04-25 Statistique Canada • Statistics Canada
Contact Information David Dean Technical Consultant, Statistics Canada R.H. Coats 14O Tunney’s Pasture, Ottawa, Ontario Canada 1-613-951-5052 David.Dean@statcan.gc.ca Thank you for listening Have a great time 2017-04-25 Statistique Canada • Statistics Canada