Presentation is loading. Please wait.

Presentation is loading. Please wait.

OGSA-DAI in OMII-Europe Neil Chue Hong EPCC, University of Edinburgh.

Published byThomasine Chase Modified over 8 years ago

Similar presentations

Presentation on theme: "OGSA-DAI in OMII-Europe Neil Chue Hong EPCC, University of Edinburgh."— Presentation transcript:

1 OGSA-DAI in OMII-Europe Neil Chue Hong EPCC, University of Edinburgh

2 EU project: RIO31844-OMII-EUROPE 2 Overview Data Services Introduction to OGSA-DAI OMII-Europe and OGSA-DAI

3 EU project: RIO31844-OMII-EUROPE 3 It’s all about DATA location administration description diversity scale security longevity integration discovery processing transfer storage access

4 EU project: RIO31844-OMII-EUROPE 4 Data Service Goals Make access transparent Make integration easy Make management simple

5 EU project: RIO31844-OMII-EUROPE 5 Data Service Challenges Diversity Scale Ownership Security of data resource types, vendors, middleware, schema, metadata of collections, formats, geographical, political and social distance on individual, group, and organisation levels; intersecting yet independent for client, service and data owner; at many levels, with many tradeoffs

6 EU project: RIO31844-OMII-EUROPE 6 OGSA-DAI In One Slide An extensible framework for data access and integration. Expose heterogeneous data resources to a grid through web services. Interact with data resources: – Queries and updates. – Data transformation / compression – Data delivery. Customise for your project using – Additional Activities – Client Toolkit APIs – Data Resource handlers A base for higher-level services – federation, mining, visualisation

7 EU project: RIO31844-OMII-EUROPE 7 MySQL OGSA-DAI service Engine SQLQuery JDBC Data Resources Activities DB2 The OGSA-DAI Framework GZipGridFTPXPath XMLDB XIndice readFile File SWISS PROT XSLT SQL Server Data- bases Application Client Toolkit

8 EU project: RIO31844-OMII-EUROPE 8 MySQL OGSA-DAI service Engine SQLQuery JDBC SQL JDBC SQL JDBC SQL JDBC SQL JDBC Multiple SQL GDS SQLQuery

9 EU project: RIO31844-OMII-EUROPE 9 Challenges for OMII-Europe Diversity Scale Ownership Security of data resource types, vendors, middleware, schema, metadata of collections, formats, geographical, political and social distance on individual, group, and organisation levels; intersecting yet independent for client, service and data owner; at many levels, with many tradeoffs OMII-Europe OGSA-DAI

10 EU project: RIO31844-OMII-EUROPE 10 Challenge 1: Grid Middleware OGSA-DAI currently runs on GT4, OMII_2 and Axis 1.2 –want to extend this to UNICORE(GS), EGEE, CrownGrid Different, but similar architectural models –addressing and naming –versioning Unicore/GS prototype developed (no security) MUST keep client APIs the same –ideally service code and configuration will stay similar

11 EU project: RIO31844-OMII-EUROPE 11 Challenge 2: Security OGSA-DAI uses GSI for GT4, and WSS4J for Axis/OMII –x509 cert based, TLS and MLS –many security levels: macro, service, resource, activity Want to utilise standards where possible –move to SAML –interaction with other OMII-Europe work Delegation, authorisation, etc., should support a single developer model, multiple provider implementations

12 EU project: RIO31844-OMII-EUROPE 12 Challenge 3: Interoperation and Intersection The technology must work together in mixed and dynamic domains –security is of primary importance –also data transfer –both together would be nice Many other “supplemental” components will need to interoperate for full functionality –e.g. discovery services, auditing services If we solve this, we make the Grid useful

13 EU project: RIO31844-OMII-EUROPE 13 Admin domain 3 Admin domain 2 Admin domain 1 Three Challenges Together How do we handle? –security delegation between middleware –addressing DBs across domains DB1 MyNotes OGSA-DAI DS1 GT4 OGSA-DAI DS2 EGEE OGSA-DAI DS3 UNICORE DB2 Results1 DB3 Results2 DB4 GroupDB Distributed query Resilient query Update Results transfer Data operation workflow

14 EU project: RIO31844-OMII-EUROPE 14 Summary Data services provide a means of addressing the challenges of managing and using increasing amounts of data OGSA-DAI provides components which present a model of transparency and abstraction for data resources OMII-Europe aims to extend OGSA-DAI services to address challenges of differing middleware, diverse security domains and interoperation between intersecting dynamic virtual organisations

15 EU project: RIO31844-OMII-EUROPE 15 Thank you for listening Any questions? http://www.omii-europe.com http://www.ogsadai.org.uk

Download ppt "OGSA-DAI in OMII-Europe Neil Chue Hong EPCC, University of Edinburgh."

Similar presentations

© 2007 Open Grid Forum Data Management Challenge - The View from OGF OGF22 – February 28, 2008 Cambridge, MA, USA Erwin Laure David E. Martin Data Area.

© 2007 Open Grid Forum Data Management Challenge - The View from OGF OGF22 – February 28, 2008 Cambridge, MA, USA Erwin Laure David E. Martin Data Area.
Open Grid Service Architecture - Data Access & Integration (OGSA-DAI) Dr Martin Westhead Principal Consultant, EPCC Telephone:+44 131 650 5958 Fax:+44.

Open Grid Service Architecture - Data Access & Integration (OGSA-DAI) Dr Martin Westhead Principal Consultant, EPCC Telephone: Fax:+44.
An Overview of OGSA-DAI Kostas Tourlas

An Overview of OGSA-DAI Kostas Tourlas
Data Grid: Storage Resource Broker Mike Smorul. SRB Overview Developed at San Diego Supercomputing Center. Provides the abstraction mechanisms needed.

Data Grid: Storage Resource Broker Mike Smorul. SRB Overview Developed at San Diego Supercomputing Center. Provides the abstraction mechanisms needed.
Connect. Communicate. Collaborate Click to edit Master title style MODULE 1: perfSONAR TECHNICAL OVERVIEW.

Connect. Communicate. Collaborate Click to edit Master title style MODULE 1: perfSONAR TECHNICAL OVERVIEW.
EGEE is a project funded by the European Union under contract IST-2003-508833 International Summer School on Grid Computing Vico Equense, 16 th July 2005.

EGEE is a project funded by the European Union under contract IST International Summer School on Grid Computing Vico Equense, 16 th July 2005.
Amy Krause Applications Consultant, EPCC Tom Sugden Applications Consultant, EPCC OGSA-DAI Client Toolkit Principles.

Amy Krause Applications Consultant, EPCC Tom Sugden Applications Consultant, EPCC OGSA-DAI Client Toolkit Principles.
NextGRID & OGSA Data Architectures: Example Scenarios Stephen Davey, NeSC, UK ISSGC06 Summer School, Ischia, Italy 12 th July 2006.

NextGRID & OGSA Data Architectures: Example Scenarios Stephen Davey, NeSC, UK ISSGC06 Summer School, Ischia, Italy 12 th July 2006.
1 An Introduction to OGSA-DAI Konstantinos Karasavvas 13 th September 2005.

1 An Introduction to OGSA-DAI Konstantinos Karasavvas 13 th September 2005.
1 Lecture 13: Database Heterogeneity Debriefing Project Phase 2.

1 Lecture 13: Database Heterogeneity Debriefing Project Phase 2.
Mike Jackson EPCC OGSA-DAI Today Release 2.2 Principles and Architectures for Structured Data Integration: OGSA-DAI.

Mike Jackson EPCC OGSA-DAI Today Release 2.2 Principles and Architectures for Structured Data Integration: OGSA-DAI.
17 July 2006ISSGC06, Ischia, Italy1 Agenda Session 26 – 14:30-16:00 An Overview of OGSA-DAI OGSA-DAI today – and future features How to extend OGSA-DAI.

17 July 2006ISSGC06, Ischia, Italy1 Agenda Session 26 – 14:30-16:00 An Overview of OGSA-DAI OGSA-DAI today – and future features How to extend OGSA-DAI.
Web-based Portal for Discovery, Retrieval and Visualization of Earth Science Datasets in Grid Environment Zhenping (Jane) Liu.

Web-based Portal for Discovery, Retrieval and Visualization of Earth Science Datasets in Grid Environment Zhenping (Jane) Liu.
Digital Object: A Virtual Online Storage Solution 598C Course Project Huajing Li.

Digital Object: A Virtual Online Storage Solution 598C Course Project Huajing Li.
LHC Experiment Dashboard Main areas covered by the Experiment Dashboard: Data processing monitoring (job monitoring) Data transfer monitoring Site/service.

LHC Experiment Dashboard Main areas covered by the Experiment Dashboard: Data processing monitoring (job monitoring) Data transfer monitoring Site/service.
Geographical Information System Implementation Rottnest Island Authority.

Geographical Information System Implementation Rottnest Island Authority.
GRID job tracking and monitoring Dmitry Rogozin Laboratory of Particle Physics, JINR 07/08/2006 - 29/09/2006.

GRID job tracking and monitoring Dmitry Rogozin Laboratory of Particle Physics, JINR 07/08/ /09/2006.
OGSA-DAI: Future Work and Wrap-up The OGSA-DAI Team

OGSA-DAI: Future Work and Wrap-up The OGSA-DAI Team
1 Dr. Markus Hillenbrand, ICSY Lab, University of Kaiserslautern, Germany A Generic Database Web Service for the Venice Service Grid Michael Koch, Markus.

1 Dr. Markus Hillenbrand, ICSY Lab, University of Kaiserslautern, Germany A Generic Database Web Service for the Venice Service Grid Michael Koch, Markus.
GT Components. Globus Toolkit A “toolkit” of services and packages for creating the basic grid computing infrastructure Higher level tools added to this.

GT Components. Globus Toolkit A “toolkit” of services and packages for creating the basic grid computing infrastructure Higher level tools added to this.

Similar presentations

Ads by Google