IVOA, Trieste, DM 2008-05-22Gerard Lemson SimDB Data Model IVOA interop, DM WG session Trieste, 2008-05-22.

Slides:

Advertisements

Similar presentations

Characterisation of observations François Bonnarel, Mireille Louys, Anita Richards, Alberto Micol, Jonathan McDowell, Igor Chilingarian, et al.

Advertisements

State of the TCG Christophe Arviset For the TCG. TCG State of the TCG 17 May 2010 Christophe Arviset – TCG chair Page 2 Technical Coordination Group Technical.

/13SNAP data model Simulation data model.

VOQL WG May 24 & 25, 2004 Masatoshi Ohishi. Agreement at the Cambridge Meeting Two level approach Level-1 : Extended SQL-based QL as the first version,

UCD-WG Report Set up the Sci-Board and Tech-Board Done, Jun 2005 Reach the status of IVOA Rec for the UCD document Done, Sep 2005 List of UCD-words from.

May 14, 2007TIG, opening plenary Beijing 2007 Theory IG plans Editors: Claudio Gheller, Patrizia Manzato, Laurie Shaw, Herve Wozniak, GL Other participants:

VOQL WG Plenary Session Sept 27, 2004 William OMullane for Masatoshi Ohishi.

28 October 2008 IVOA Interoperability Meeting -- Baltimore T HE I NTERNATIONAL V IRTUAL O BSERVATORY ALLIANCE TAP/VOTable Registry Interface Reg 1 – G.

USERS COMPUTERS USER LAYER RESOURCE LAYER USING SHARING VO CORE PROVIDERS IVOA Architecture VOSpec.

Gerard Lemson, IVOA DM 28/5/2004. Unified domain model for Astronomy Much maligned and misunderstood (anonymous) with Pat Dowler and Tony Banday (MPA)

SimDB and SimTAP Dealing with a complex data model Gerard Lemson, Nara,

May 18, 2007TIG, closing plenary Conclusions from theory IG sessions, Beijing 2007.

Proposal for change to VOTable schema Without changing set of valid documents (modulo undesired ones)

23 May 2008 IVOA Interoperability Meeting -- Trieste T HE I NTERNATIONAL V IRTUAL O BSERVATORY ALLIANCE Resource Registries Closing Plenary Integration.

27 October 2008 IVOA Interoperability Meeting -- Baltimore T HE I NTERNATIONAL V IRTUAL O BSERVATORY ALLIANCE Resource Registries Opening Plenary Registry.

Victoria, May Breakout Session III Theory Interest Group Breakout Session III Victoria, May

USERS COMPUTERS USER LAYER RESOURCE LAYER USING SHARING VO CORE PROVIDERS IVOA Architecture Data Models Semantics Browser Based Apps Script Based.

SimDB as a TAP service various TIG members (IVOA.IVOATheorySimDB)IVOA.IVOATheorySimDB.

Theory Interest Group Victoria INTEROP May 2010.

Footprint Service Specification NVO Summer School 2008 Gretchen Greene (thanks to Tamas Budavari and Francois Bonnarel) T HE US N ATIONAL V IRTUAL O BSERVATORY.

Metadata in the TAP context (1) The Problem: learn about which tables, tablesets,... are available from a TAP server for each of the tables / tablesets,

DM: Simulation Data Model RFC and other comments Tuesday, , A.

Theory Interest Group H. Wozniak May-19H. Wozniak / Obs. Strasbourg / VO-France2.

The CERIF-2000 Implementation. Andrei S. Lopatenko CERIF Implementation Guidelines Andrei Lopatenko Vienna University of Technology

VO-URP: on data modeling, UTYPEs and more Gerard Lemson Laurent Bourges.

Framework for Model Creation and Generation of Representations DDI Lifecycle Moving Forward.

26 May 2004IVOA Interoperability Meeting - Boston1 Recommendations for Revisions to the VOResource XML Schema IVOA Registry Working Group.

IVOA Interop Beijing, DM I Analysis of Characterisation in Domain Model Context With application to (SNAP) simulations Gerard Lemson DWith feedback.

Metadata Tools and Methods Chris Nelson Metanet Conference 2 April 2001.

3D Spectroscopy in the Virtual Observatory: Current Status Igor Chilingarian (Observatoire de Paris, France/SAI MSU, Russia) Ivan Zolotukhin (SAI MSU,

Astronomical Data Query Language Simple Query Protocol for the Virtual Observatory Naoki Yasuda 1, William O'Mullane 2, Tamas Budavari 2, Vivek Haridas.

Theory interest group wiki: see also

IVOA Interop, Victoria Canada, May IVOA Data Access Layer Closing Plenary Summary, Victoria May 2006 Doug Tody (NRAO/NVO/IVOA) I NTERNATIONAL V IRTUAL.

SimDB and DM WG Summary SimDB session this morning.

IVOA Registry videocon 2004/05/13-14 Gerard Lemson1 Model based schema.

IVOA Interop, SL de El Escorial, Oct IVOA DAL - Madrid DAL WG Summary October 7, 2005.

Footprint Service Specification IVOA Interop Meeting Trieste 2008 Gretchen Greene and Tamas Budavari.

SimDB: mainly DM thanks to usual suspects: Claudio, Franck, Herve, Igor, Laurent, Mireille, Norman, Patrizia, Rick, Ugo.

Publications Office Metadata Registry (MDR) INSPIRE Registry and Registers Workshop Willem van Gemert Publications Office of the EU Dissemniation and Reuse.

IVOA InterOperability Meeting Overview Dave De Young Baltimore 26 – 31 October 2008.

Victoria, May Closing plenary Theory Interest Group Closing plenary Victoria, May

SKOS. Ontologies Metadata –Resources marked-up with descriptions of their content. No good unless everyone speaks the same language; Terminologies –Provide.

CMU-CS lunch talk, Gerard Lemson1 Computational and statistical problems for the Virtual Observatory With contributions from/thanks to: GAVO.

SimDB. Where are we regarding... SimDB note SimDB data model (SimDB/DM) SimDB protocol (SimDB/TAP,..) SimDB prototypes (Rick, Franck etal,

IVOA, Trieste, DM Gerard Lemson Data Modelling Standards (contd.) IVOA interop, DM WG session Trieste,

16 October 2003Registry Interface CallsIVOA Interoperability, Strasbourg IVOA Interoperability Elizabeth Auden & Registry Workgroup 16 – 17 October 2003.

The International Virtual Observatory Alliance (IVOA) interoperability in action.

WP 7 - JRA2 - Data Access Protocols and Data Models EuroVO-AIDA – Final review – 5 October 2010 Christophe Arviset (ESA) Work Package 7 - JRA2 Data Access.

State of the TCG São Paulo Séverin Gaudet For the TCG.

May 24, 2004IVOA Interop Meeting1 An AXIS-based Java SkyNode Ramon Williamson NCSA T HE US N ATIONAL V IRTUAL O BSERVATORY.

SimDB Implementation & Browser IVOA InterOp 2008 Meeting, Theory Session 1. Baltimore, 26/10/2008 Laurent Bourgès This work makes use of EURO-VO software,

Gerard Lemson, chair WP4 Activities DCA WP4 Third PCT meeting Strasbourg, May 29, 2008.

Gerard Lemson Theory in the VO and the SimDB specification Euro-VO DCA workshop Garching, June 26, 2008 Feedback questionnaire.

Inference-based Semantic Mediation and Enrichment for the Semantic Web AAAI SSS-09: Social Semantic Web: Where Web 2.0 Meets Web 3.0 March 25, 2009 Dan.

Mireille Louys et al., OV-France Theory WG meeting, LYON, June DALIA : an observation vs simulation comparison frame work What could be a Model.

WP4: Theory in the VObs EuroVO-DCA Final Review, 29 April 2009 Gerard Lemson WP4: Theory in the VObs.

Working with XML. Markup Languages Text-based languages based on SGML Text-based languages based on SGML SGML = Standard Generalized Markup Language SGML.

State of the TCG Christophe Arviset For the TCG. TCG State of the TCG 6 December 2010 Christophe Arviset – TCG chair Page 2 Technical Coordination Group.

State of the TCG Christophe Arviset for the IVOA Technical Coordination Group.

Coordination Portal/Data sources L2:Data access & Handling Points to be raised : - Downloading data sources/data via the Portal…keeping visibility of data.

Simulation Databases for the Virtual Observatory Work in progress and application to the StarFormat Project Patrick Hennebelle Franck Le Petit Benjamin.

Sept. 2004IVOA Meeting / Pune1 Virtual Observatory Query Language (VOQL) Working Group William O’Mullane For Masatoshi Oishi T HE US N ATIONAL V IRTUAL.

XML and Distributed Applications By Quddus Chong Presentation for CS551 – Fall 2001.

JENAM 2008 Theory Standards for the Virtual Observatory SimDB + SimDAP.

Virtual Observatory for cosmological simulations

IVOA Provenance METAdata

Analysis of Characterisation in Domain Model Context

IVOA Status Christophe Arviset

S3 from the point of view of SimDB

Footprint Service Specification

Presentation transcript:

IVOA, Trieste, DM Gerard Lemson SimDB Data Model IVOA interop, DM WG session Trieste,

IVOA, Trieste, DM Gerard Lemson “tiger team” Laurent Bourges Gerard Lemson Rick Wagner Claudio Gheller Mireille Louys Patrizia Manzato Herve Wozniak Ackn: Ugo Becciani, Jeremy Blaizot, Francois Bonnarel, Igor Chillingarian, Norman Gray, Jaiwon Kim, Franck LePetit, Alex Szalay

IVOA, Trieste, DM Gerard Lemson What is SimDB ? = “Simulation Database” - registry ? - portal ? Online service for discovering and accessing numerical simulations Exposes a relational database containing metadata describing simulations Focused on “3+1D simulations” Provides for XML representation Defines access protocols for online access to the database: put/get/query

IVOA, Trieste, DM Gerard Lemson SimDB ADQL VOTable query put SimDB/XML 1 2 get simdbId (=ivoID?) SimDB/XML 3 SimDB architecture (schematic)

IVOA, Trieste, DM Gerard Lemson SimDB use cases Management of institute’s simulation resources San Diego (legacy) Trieste (legacy) Catania Horizon (Lyon (reference), Paris) MPA (reference) Publication of resources local/remote (ala registry) generate metadata in simulation pipe line Link resources to (SimDAP) services theory session 11AM

IVOA, Trieste, DM Gerard Lemson SimDB/RDB Why Relational Database? because we have a complex, normalised model for which we need an expressive query language and the IVOA has such a language (ADQL) which is relational (ref Will O’Mullane, 2003)

IVOA, Trieste, DM Gerard Lemson SimDB/XML Why custom XML (and not VOTable) ? because we have a complex, highly hierarchical model and because it is the (IVOA) mandated language for expressing such complex resources

IVOA, Trieste, DM Gerard Lemson SimDB/DM = UML2 Why UML? because it is the de facto standard for data models, with free tool support and a standard XML representation (XMI) with standardised extension and specialisation mechanisms (Profiles) because it is highly expressive and implementation neutral and because it is the adopted IVOA DM WG standard for expressing data models (Cambridge 2003)

IVOA, Trieste, DM Gerard Lemson And because we can generate all the other representations from it! RDB schema XML schema UTYPE-s TAP metadata tap_schema tableset VODataService Java/JPA+JAXB HTML See tomorrow’s DM session (GL + Laurent Bourges)

IVOA, Trieste, DM Gerard Lemson SimDB links Development completely open: UML: XMI: input/SimDB_DM.xmlinput/SimDB_DM.xml images : input/images/input/images/ representations, “physical models” (auto-generated): “intermediate representation” output /SimDB_DM_INTERMEDIATE.xmloutput /SimDB_DM_INTERMEDIATE.xml RDB: output/ddl/output/ddl/ XML schema: output/schema/output/schema/ HTML: output/html/ (with UTYPEs)output/html/ TAP: output/tap/output/tap/ Java: output/java/output/java/ Documentation Note (HTML): doc/note/SimDB-note.html first draft, in need of updates after this weekdoc/note/SimDB-note.html

IVOA, Trieste, DM Gerard Lemson SimDB/DM elements Packages simdb (root) object protocol experiment project Resource Protocol Experiment Project

IVOA, Trieste, DM Gerard Lemson SimDB/DM elements ObjectType TargetObjectType, TargetProcess, RepresentationObjectType Property property group Snapshot ObjectCollection Characterisation Webservice (link to SimDAP)

IVOA, Trieste, DM Gerard Lemson SimDB/DM issues Profile Normalisation level, e.g. Experiment —> Protocol ParameterSetting —> InputParameter Semantic vocabularies Quantity (i.e. units) value/unit conversion factor to standard (per physical quantity) ? Representing references others ??

IVOA, Trieste, DM Gerard Lemson SimDB future Move to recommendation track cross-WG Focus Group Members from current tiger team + DM, Registry, Semantics, DAL/TAP Formal details in discussion in exec (I hope). More via .