1. CMPE 226 Database Systems October 28 Class Meeting
Department of Computer Engineering San Jose State University Fall 2015 Instructor: Ron Mak

2. Extract, Transform, and Load (ETL)

3. Extract, Transform, and Load (ETL), cont’d

4. Extract, Transform, and Load (ETL), cont’d

5. Extract, Transform, and Load (ETL), cont’d

6. Data Virtualization
An approach to data management that allows an application to retrieve and manipulate data without requiring technical details about the data, such as how it is formatted or where it is physically located.
An agile data integration approach organizations use to gain more insight from their data, respond faster to ever changing analytics and BI needs and save 50-75% over data replication and consolidation.

7. Data Virtualization, cont’d
Differs from traditional ETL.
The original data remains in place.
A real-time process accesses the data sources.
Reduces the risk of data errors.
Reduces the workload of extracting, transforming, and loading data that may never be used by an application.
Provides applications a “virtual view” of the data.
Applications can treat the disparate and heterogeneous data as a single relational database.

8. Data Virtualization Functionality
Abstraction
Abstract the technical aspects of stored data, such as location, storage structure, API, access language, and storage technology.
Virtualized data access
Connect to different data sources and make them accessible from a common logical data access point.
Transformation
Transform, improve quality, reformat, etc. source data for consumer use.

9. Data Virtualization Functionality, cont’d
Data federation
Combine result sets from across multiple source systems.
Data delivery
Publish result sets as views and/or data services executed by client applications or users when requested.

10. Cisco Information Server (CIS)
The Cisco Information Server (CIS) forms the core of the Cisco Data Virtualization Platform.

11. Install the CIS Studio
Studio is the client-side application that connects to the CIS server.
It’s configured to run only on Windows.
Even though it’s a Java application.
Download and install Studio.
See
Unzip the 2.54 GB zip file, which includes both the CIS server and the client Studio app.
Install only Studio.
See the Installation Guide.

12. CIS Team Accounts Each team has a CIS account. Team User name Password
Alpha Squad
alpha
Apollo
apollo
Blade Runner
blade
Data Crunchers
cruncher
Database Predators
predator
Data Nerds
nerd
Elite
elite
GangOfFour
gang
Oceans3
ocean
Sappers
sapper
Snowlions
snow
Swagg
swagg
Team Include
include

13. Logging into CIS To log in, start the client-side Studio application.
Windows only!
Domain: composite
Server:
Port: 9400

14. Demo: Cisco Information Server
This demo is described in the Getting Started Guide.
Query: Why did customer Landmark Systems not receive product Widget 5 on the promised date of February 10, 2003?

15. Demo: Cisco Information Server, cont’d
ViewOrder
View the activities of an order.
Obtain product status, order date, and customer contact information.
ViewSales
Obtain information about the purchase department’s interactions with the customer and the supplier.
ViewSupplier
Use the sales department’s record and noted the lead time for product delivery.

16. Assignment #8
Each team do the CIS demo described in the Getting Started Guide.
Create your sources folder under My Home, not under Shared.
You can named the sources folder anything you like.
Each team member can have a separate folder.
Generate the following screen shots.

17. Assignment #8, cont’d

18. Assignment #8, cont’d

19. Assignment #8, cont’d

20. Assignment #8, cont’d

21. Assignment #8, cont’d Tips
On page 19 of the Getting Started Guide, after you’ve clicked the Create & Introspect button, you may need to click the Refresh Resource List button.
On page 23, the XML file is located on the server in /opt/Composite_Software/CIS_6.2.6/examples

22. Assignment #8, cont’d Tips, cont’d
On page 26, the Create Link and Target is the button circled in red:

23. Assignment #8, cont’d
a zip file containing your screen shots to
Due: Wednesday, Nov. 4 at 11:59 PM.
NOTE: We are also creating MySQL accounts for you on the same server. If we accomplish that in the next couple of days, you should upload your database dump file to the server via FTP, recreate your database on the server, and import it into CIS as another data source.

24. Extra Credit! Convert Studio to run under Bash on Linux or the Mac.
Studio is a Java application.
Convert the Windows batch file studio.bat (in the CIS bin directory) to a Bash script.
Zip all the required directories, jar files, xml files, property files, etc.
Unzip and run Studio on Linux or Mac OS X.

25. Extra Credit! cont’d
Create the same screen shots as for Assignment #8.
Individual work only!
Up to 25 points added to the midterm score of up to 10 students, chosen in the order of midterm scores (lowest scores first).
Due Friday, Nov. 13.
NOTE: No guarantees that this conversion is even possible!

26. Project Presentations
We lose two days:
Nov. 11 Veterans’ Day
Nov. 25 Day before Thanksgiving.
Originally scheduled for project presentations:
Nov. 18
Dec. 2 (last day for this class)
We need a new plan for doing project presentations!
Two weeks apart!