OGSA-DAI in OMII-Europe Neil Chue Hong EPCC, University of Edinburgh

EU project: RIO31844-OMII-EUROPE 2 Overview Data Services Introduction to OGSA-DAI OMII-Europe and OGSA-DAI

EU project: RIO31844-OMII-EUROPE 3 It’s all about DATA location administration description diversity scale security longevity integration discovery processing transfer storage access

EU project: RIO31844-OMII-EUROPE 4 Data Service Goals Make access transparent Make integration easy Make management simple

EU project: RIO31844-OMII-EUROPE 5 Data Service Challenges Diversity Scale Ownership Security of data resource types, vendors, middleware, schema, metadata of collections, formats, geographical, political and social distance on individual, group, and organisation levels; intersecting yet independent for client, service and data owner; at many levels, with many tradeoffs

EU project: RIO31844-OMII-EUROPE 6 OGSA-DAI In One Slide An extensible framework for data access and integration. Expose heterogeneous data resources to a grid through web services. Interact with data resources: – Queries and updates. – Data transformation / compression – Data delivery. Customise for your project using – Additional Activities – Client Toolkit APIs – Data Resource handlers A base for higher-level services – federation, mining, visualisation

EU project: RIO31844-OMII-EUROPE 7 MySQL OGSA-DAI service Engine SQLQuery JDBC Data Resources Activities DB2 The OGSA-DAI Framework GZipGridFTPXPath XMLDB XIndice readFile File SWISS PROT XSLT SQL Server Data- bases Application Client Toolkit

EU project: RIO31844-OMII-EUROPE 8 MySQL OGSA-DAI service Engine SQLQuery JDBC SQL JDBC SQL JDBC SQL JDBC SQL JDBC Multiple SQL GDS SQLQuery

EU project: RIO31844-OMII-EUROPE 9 Challenges for OMII-Europe Diversity Scale Ownership Security of data resource types, vendors, middleware, schema, metadata of collections, formats, geographical, political and social distance on individual, group, and organisation levels; intersecting yet independent for client, service and data owner; at many levels, with many tradeoffs OMII-Europe OGSA-DAI

EU project: RIO31844-OMII-EUROPE 10 Challenge 1: Grid Middleware OGSA-DAI currently runs on GT4, OMII_2 and Axis 1.2 –want to extend this to UNICORE(GS), EGEE, CrownGrid Different, but similar architectural models –addressing and naming –versioning Unicore/GS prototype developed (no security) MUST keep client APIs the same –ideally service code and configuration will stay similar

EU project: RIO31844-OMII-EUROPE 11 Challenge 2: Security OGSA-DAI uses GSI for GT4, and WSS4J for Axis/OMII –x509 cert based, TLS and MLS –many security levels: macro, service, resource, activity Want to utilise standards where possible –move to SAML –interaction with other OMII-Europe work Delegation, authorisation, etc., should support a single developer model, multiple provider implementations

EU project: RIO31844-OMII-EUROPE 12 Challenge 3: Interoperation and Intersection The technology must work together in mixed and dynamic domains –security is of primary importance –also data transfer –both together would be nice Many other “supplemental” components will need to interoperate for full functionality –e.g. discovery services, auditing services If we solve this, we make the Grid useful

EU project: RIO31844-OMII-EUROPE 13 Admin domain 3 Admin domain 2 Admin domain 1 Three Challenges Together How do we handle? –security delegation between middleware –addressing DBs across domains DB1 MyNotes OGSA-DAI DS1 GT4 OGSA-DAI DS2 EGEE OGSA-DAI DS3 UNICORE DB2 Results1 DB3 Results2 DB4 GroupDB Distributed query Resilient query Update Results transfer Data operation workflow

EU project: RIO31844-OMII-EUROPE 14 Summary Data services provide a means of addressing the challenges of managing and using increasing amounts of data OGSA-DAI provides components which present a model of transparency and abstraction for data resources OMII-Europe aims to extend OGSA-DAI services to address challenges of differing middleware, diverse security domains and interoperation between intersecting dynamic virtual organisations

EU project: RIO31844-OMII-EUROPE 15 Thank you for listening Any questions?