1 1 EPCC 2 Curtin Business School & Edinburgh University Management School Michael J. Jackson 1 Ashley D. Lloyd 2 Terence M. Sloan 1 Enabling Access to Federated Grid Databases An OGSA-DAI ODBC Driver

2 Overview Why develop an OGSA-DAI ODBC driver? ODBC OGSA-DAI Design and Development What does an OGSA-DAI ODBC driver give us? Issues and Concerns

3 Why?  Facilitate use of standard data analysis tools in a Grid environment: –Remove need for Grid awareness –Allow use of existing data analysis skills in a Grid environment –Improve rate of adoption of Grid technologies  Data analysis tools: –SPSS, SAS  How can standard data analysis tools access Grid-enabled databases? –An ODBC driver for OGSA-DAI

4 Open DataBase Connectivity – ODBC Application Driver Manager Driver ODBC data source Data source name Database API ODBC API Reside on same host

5 ODBC Advantages  Application developers: –Applications can be database-independent –No need to compile against database-specific libraries –Call-level interface – execute SQL generated at run-time –Change a database => only change driver and configuration  Database manufacturers: –An ODBC-compliant driver allows the database to be a back end for any ODBC-compliant application

6 OGSA-DAI  Open Grid Services Architecture – Data Access and Integration: –Extensible framework for data access and integration –Expose heterogeneous data resources to a Grid through web services  Data operations: –Access, update, management and integration – relational, XML, files –Compression and transformation –Delivery to URLs, FTP, GridFTP, mail, other services  Base for developing higher-level services: –Data federation and distributed query processing –Data mining –Data visualisation

7 Accessing Data Resources via OGSA-DAI Application OGSA-DAI Data Service OGSA-DAI Response document Database JDBC API OGSA-DAI Perform document

8 An ODBC Driver for OGSA-DAI Application Driver Manager Driver Data source name ODBC API OGSA-DAI Data Service OGSA-DAI Response document Database JDBC API OGSA-DAI Perform document

9 A Simple Scenario  Data analysis  ODBC view: –Connect to OGSA-DAI ODBC data source –Submit a SELECT * FROM table query –Get back the results –Disconnect from the data source  OGSA-DAI view: –Connect to an OGSA-DAI data service –Construct a Perform document holding the query –Send it to the service –Receive a Response document from the service –Parse it to get the results

10 Development Options  Implement an OGSA-DAI ODBC driver: –From scratch  Use an open source ODBC driver: –Extract a data resource-independent skeleton –Customise it to OGSA-DAI  Use an ODBC SDK: –OpenAccess –Simba –Syware

11 Using an SDK  Proof of concept: –Prototype within a tight time-scale  OpenAccess SDK: –30 day evaluation licence –Provides an ODBC driver –Developer codes an Interface Provider (IP) –Supports Java development => exploit OGSA-DAI’s client toolkit

12 An ODBC Driver for OGSA-DAI using OpenAccess OpenAccess ODBC Driver Interface Provider Data resource configuration (e.g. service URL) OGSA-DAI CTk API OpenAccess API OGSA-DAI Data Service OGSA-DAI Client Toolkit OGSA-DAI Response document OGSA-DAI Perform document

13 Testing  OpenAccess ODBC SQL query tool: –Submit SQL statements to an ODBC data source –Present the results  EPCC: –OGSA-DAI ODBC data source on a PC –ODBC driver + OGSA-DAI service URL  Curtin Business School: –OGSA-DAI server and services –Database

14 What does this give us?  Transparency: –Database location Changes are restricted to the OGSA-DAI server Client applications are unaffected –Database product  Global access of data: –Publish service URL  Security: –Database user names and passwords reside on OGSA-DAI server –Clients can be required to provide credentials to connect to OGSA-DAI services

15 Data Federation Application Driver Manager Driver Data source name ODBC API OGSA-DAI Data Service OGSA-DAI documents Database Virtual database

16 Issues and Concerns  OGSA-DAI WSI / WSRF compliance: –Prototype developed using OGSA-DAI OGSI –Data source includes OGSA-DAI factory service URL –OGSA-DAI WSI or WSRF – data service URL + resource ID  Driver development: –Complete the OpenAccess IP –Write a pure OGSA-DAI ODBC driver from scratch  ODBC conformance –Cursors, sessions, transactions, timeouts, meta-data –Analysis of SAS or SPSS ODBC usage  Efficiency

17 Questions