Www.g-vo.org SimDB as a TAP service various TIG members (IVOA.IVOATheorySimDB)IVOA.IVOATheorySimDB.

Slides:



Advertisements
Similar presentations
IVOA Interop, Cambridge UK, IVOA Data Access Layer Table Access Protocol Analysis Doug Tody (NRAO/NVO ) I NTERNATIONAL V IRTUAL O BSERVATORY A LLIANCE.
Advertisements

/13SNAP data model Simulation data model.
May 14, 2007TIG, opening plenary Beijing 2007 Theory IG plans Editors: Claudio Gheller, Patrizia Manzato, Laurie Shaw, Herve Wozniak, GL Other participants:
28 October 2008 IVOA Interoperability Meeting -- Baltimore T HE I NTERNATIONAL V IRTUAL O BSERVATORY ALLIANCE TAP/VOTable Registry Interface Reg 1 – G.
USERS COMPUTERS USER LAYER RESOURCE LAYER USING SHARING VO CORE PROVIDERS IVOA Architecture VOSpec.
IVOA 2010, Nara TAP implementation on SimDB Application to DEUVO Jonathan Normand VO-Paris Data Centre.
Victoria, May Session III Theory Interest Group Session III Victoria, May
SimDB and SimTAP Dealing with a complex data model Gerard Lemson, Nara,
May 18, 2007TIG, closing plenary Conclusions from theory IG sessions, Beijing 2007.
16 October 2003IVOA Interoperability Conference Registry Working Group VOResource (v0.8.4) XML Schema defining core metadata applicable to all resources.
23 May 2008 IVOA Interoperability Meeting -- Trieste T HE I NTERNATIONAL V IRTUAL O BSERVATORY ALLIANCE Resource Registries Closing Plenary Integration.
27 October 2008 IVOA Interoperability Meeting -- Baltimore T HE I NTERNATIONAL V IRTUAL O BSERVATORY ALLIANCE Resource Registries Opening Plenary Registry.
Victoria, May Breakout Session III Theory Interest Group Breakout Session III Victoria, May
SLAP: Simple Line Access Protocol v0.5
The transformation of an ER or EER model into a relational model
OASIS OData Technical Committee. AGENDA Introduction OASIS OData Technical Committee OData Overview Work of the Technical Committee Q&A.
Metadata in the TAP context (1) The Problem: learn about which tables, tablesets,... are available from a TAP server for each of the tables / tablesets,
Chapter 10: Designing Databases
DM: Simulation Data Model RFC and other comments Tuesday, , A.
Relational Database Design Via ER Modelling
Relational Database. Relational database: a set of relations Relation: made up of 2 parts: − Schema : specifies the name of relations, plus name and type.
Shelley Powers, O’Reilly SNU IDB Lab. Hyewon Kim
Advanced Data Modeling
Database Systems: Design, Implementation, and Management Eighth Edition Chapter 6 Advanced Data Modeling.
Database Systems: Design, Implementation, and Management Tenth Edition
Chapter 6 Advanced Data Modelling
1 Class Number – CS 304 Class Name - DBMS Instructor – Sanjay Madria Instructor – Sanjay Madria Lesson Title – EER Model –21th June.
Introduction to Structured Query Language (SQL)
SQL DDL constraints Restrictions on the columns and tables 1SQL DDL Constraints.
Exam 2 Review Dr. Bernard Chen Ph.D. University of Central Arkansas.
Database Systems: Design, Implementation, and Management Tenth Edition Chapter 5 Advanced Data Modeling.
Mapping Data Models to VOTable The specification Published version dml/doc/MappingDMtoVOTable-v pdf.
Data Access Patterns Some of the problems with data access from OO programs: 1.Data source and OO program use different data modelling concepts 2.Decoupling.
INTEGRITY. Integrity constraint Integrity constraints are specified on a database schema and are expected to hold on every valid database state of the.
SimDB and DM WG Summary SimDB session this morning.
HSCI 709 SQL Data Definition Language. SQL Standard SQL-92 was developed by the INCITS Technical Committee H2 on Databases. SQL-92 was designed to be.
Chapter 8 Data Modeling Advanced Concepts Database Principles: Fundamentals of Design, Implementation, and Management Tenth Edition.
SQL Data Definition Language (DDL) Using Microsoft SQL Server 1SDL Data Definition Language (DDL)
Chapter 5: Part 1: DDL STRUCTURED QUERY LANGUAGE (SQL)
7 1 Chapter 7 Introduction to Structured Query Language (SQL) Database Systems: Design, Implementation, and Management, Seventh Edition, Rob and Coronel.
SimDB: mainly DM thanks to usual suspects: Claudio, Franck, Herve, Igor, Laurent, Mireille, Norman, Patrizia, Rick, Ugo.
SQL: DDL. SQL Statements DDL - data definition language –Defining and modifying data structures (metadata): database, tables, views, etc. DML - data manipulation.
SimDB. Where are we regarding... SimDB note SimDB data model (SimDB/DM) SimDB protocol (SimDB/TAP,..) SimDB prototypes (Rick, Franck etal,
16 October 2003Registry Interface CallsIVOA Interoperability, Strasbourg IVOA Interoperability Elizabeth Auden & Registry Workgroup 16 – 17 October 2003.
The International Virtual Observatory Alliance (IVOA) interoperability in action.
ER/EER to Relational Mapping Chapter 9. STEP 1 ENTITY TYPE E (non weak) -> NEW RELATION T RELATION T: – includes all simple attributes (non composite,
SimDB Implementation & Browser IVOA InterOp 2008 Meeting, Theory Session 1. Baltimore, 26/10/2008 Laurent Bourgès This work makes use of EURO-VO software,
21-jun-2009 IVOA Standards Pedro Osuna ESA-VO Project Science Archives and Computer Support Engineering Unit (SRE-OE) Science Operations Department (SRE-O)
Gerard Lemson Theory in the VO and the SimDB specification Euro-VO DCA workshop Garching, June 26, 2008 Feedback questionnaire.
Database Systems: Design, Implementation, and Management Ninth Edition
UCL DEPARTMENT OF SPACE AND CLIMATE PHYSICS MULLARD SPACE SCIENCE LABORATORY Taverna Plugin VAMDC and HELIO (part of the ‘taverna-astronomy’ edition) Kevin.
IVOA, Trieste, DM Gerard Lemson SimDB Data Model IVOA interop, DM WG session Trieste,
ITS232 Introduction To Database Management Systems Siti Nurbaya Ismail Faculty of Computer Science & Mathematics, Universiti Teknologi MARA (UiTM), Kedah.
USERS COMPUTERS USER LAYER RESOURCE LAYER USING SHARING VO CORE PROVIDERS IVOA Architecture GETTINGGETTING FINDINGFINDING LEVEL 0.
State of the TCG Christophe Arviset for the IVOA Technical Coordination Group.
Experience with XML Schema Ashok Malhotra Schema Usage  Mapping XML Schema and XML documents controlled by the Schema to object classes and instances.
Coordination Portal/Data sources L2:Data access & Handling Points to be raised : - Downloading data sources/data via the Portal…keeping visibility of data.
IVOA Interop, Beijing, China, May IVOA Data Access Layer Working Group Sessions Doug Tody (NRAO/NVO ) Markus Dolensky (ESO/EuroVO) Data Access Layer.
Simulation Databases for the Virtual Observatory Work in progress and application to the StarFormat Project Patrick Hennebelle Franck Le Petit Benjamin.
LM 5 Introduction to SQL MISM 4135 Instructor: Dr. Lei Li.
Lecture # 14 Chapter # 5 The Relational Data Model and Relational Database Constraints Database Systems.
IT 5433 LM3 Relational Data Model. Learning Objectives: List the 5 properties of relations List the properties of a candidate key, primary key and foreign.
USERS COMPUTERS USER LAYER RESOURCE LAYER USING SHARING VO CORE PROVIDERS IVOA Architecture DATAACCESSDATAACCESS PROTOCOLSPROTOCOLS REGISTRYREGISTRY.
SQL: Schema Definition and Constraints Chapter 6 week 6
Data and Metadata Collection
Accomplishments RSM v0.7 First draft XML Schema completed: VOResource.xsd NVO: Working prototype resource using VOResource as format for metadata exchange.
LEVEL 0 G E T I N F I N D G.
CS4222 Principles of Database System
Technical Coordination Group
Utypes for Model Referencing
Presentation transcript:

SimDB as a TAP service various TIG members (IVOA.IVOATheorySimDB)IVOA.IVOATheorySimDB

Overview History of SimDB SimDB is a TAP service –protocol –metadata Object relational mapping TAP as information integration protocol

History Simple Numeric Access Protocol (SNAP) –Cambridge 2006 –Victoria 2006 follow DAL v2 S*AP (ala SSAP) –data model –queryData –getData (accessURL) LARGE simulations (3+1D/ cosmological/...) –too large for accessURL –getData more complex: cut-outs etc Separated in 2 –Simulation database (SimDB) –Simulation Data Access Protocol (SimDAP)

SimDB SimDB is a protocol for a database containing metadata about simulations –like a Simulation registry (DONT MENTION REGISTRY) SimDBs data model (SimDB/DM) prescribes the databases data model Should support discovery of simulations, i.e. queryData of SNAP –query expressions –result format

SimDB/DM relatively complex (see tomorrow)

SimDB/TAP Claim: such a omplex model requires flexible query language –Choose ADQL Consequently(?) SimDB is a TAP service Special: Predefined data model Restrictions on required functionality –sync-only ADQL queries mandated –no upload –... (discuss tomorrow, TIG session) TAP 0.5, p10, comment about inheriting services

SimDB/TAP_SCHEMA Requires relational model for SimDB/DM –Object-Relational mapping –Impedance mismatch –some standard approaches Expressed as –VODataService –TAP_SCHEMA inserts –empty VOTable VOTable serialisation of the TAP_SCHEMA tables

OR mapping class table attribute column reference foreign key composition foreign key to container inheritance

class table CREATE TABLE t_Experiment ( ID BIGINT NOT NULL, -- Surrogate key publisherDID VARCHAR(128) NOT NULL,... ) ALTER TABLE t_Experiment ADD CONSTRAINT pk_t_Experiment_ID PRIMARY KEY(ID);

attribute column CREATE TABLE t_InputParameter ( ID BIGINT NOT NULL, name VARCHAR(128) NOT NULL, ucd varchar(128, datatype varchar(32) NOT NULL, multiplicity varchar(10),... ) Note: data type mapping required

reference foreign key CREATE TABLE t_Experiment ( ID BIGINT NOT NULL, protocolID BIGINT NOT NULL,... ) ALTER TABLE t_Experiment ADD CONSTRAINT fk_t_Experiment_protocol FOREIGN KEY (protocolId) REFERENCES t_Protocol(ID);

composition foreign key to container CREATE TABLE t_Column (... containerId BIGINT NOT NULL, -- Table... ); ALTER TABLE t_Column ADD CONSTRAINT fk_t_Column_container FOREIGN KEY (containerId) REFERENCES t_Table(ID);

inheritance Requirement: Each class, abstract and concrete, can be queried on –select * from Simulation –select * from Experiment –Select * from Resource Obtains all attributes, including inherited ones.

inheritance Some standard approaches 1.1 table per class, no inherited attributes primary key = foreign key to base table 2.1 table per hierarchy gather columns from subclasses DTYPE column 3.1 table per concrete (= non-abstract) class, all attributes

inheritance following 1 CREATE TABLE t_Resource ( ID BIGINT IDENTITY NOT NULL, DTYPE VARCHAR(32),... ); CREATE TABLE t_WebService ( ID BIGINT NOT NULL,... ); ALTER TABLE t_WebService ADD CONSTRAINT fk_t_WebService_extends FOREIGN KEY (ID) REFERENCES t_Resource(ID);

Add views, one per class CREATE VIEW Resource AS SELECT ID, DTYPE, name, description, referenceURL, created, updated, status FROM t_Resource CREATE VIEW WebService AS SELECT b.*, t.baseURL, t.type, t.registryId FROM t_WebService t, Resource b WHERE b.ID = t.ID

Comments (discussed tomorrow) Implementations in progress Heterogeneity and quantities cause problems for ADQL –Albertos proposal might help: fix units for quantities (defined by vocabulary) –May need simpler, dedicated protocols How to register SimDB/TAP? Extensions to DM allowed? SimDB/REST+XML as well? VOExplorer-like approach to browsing a SimDB

Conclusions Approach might be used for –SIAP, SSA, Registry Not for –STC, Characterisation Is (??) already used/planned for –Atomic/molecular lines, Source catalogue Complexity of SimDB caused be heterogeneity –simpler for other cases Finally, need participation in SimDB effort.