The need for a stronger IVOA review process An SDM+SSA correctness assessment Bruno Rino, Nov. 8 2009.

Slides:



Advertisements
Similar presentations
Characterisation of observations François Bonnarel, Mireille Louys, Anita Richards, Alberto Micol, Jonathan McDowell, Igor Chilingarian, et al.
Advertisements

IVOA, Pune India September Data Access Layer Working Group Pune Workshop Summary Doug Tody National Radio Astronomy Observatory International.
DM WORKING GROUP MADRID OCT WG STATUS Spectral DM: document updated and reformatted Spectral DM Java library prototype nearly ready Characterization:
Victoria, May Session III Theory Interest Group Session III Victoria, May
SSA Query Interface M. Dolensky, ESO Data Access Layer Working Group Interoperability Workshop, Pune, India 27-Sep-2004.
IVOA, Pune September Data Access Layer Working Group SSA Overview and Status Doug Tody National Radio Astronomy Observatory International V.
SLAP: Simple Line Access Protocol v0.5
IVOA, Kyoto May Data Access Layer Working Group Working Group Report and Summary Doug Tody National Radio Astronomy Observatory International.
6 September 2008NVO Summer School 2008 – Santa Fe1 DAL Clients: Scripting Data Access with Python Ray Plante T HE US N ATIONAL V IRTUAL O BSERVATORY.
NVO Summer School, Santa Fe Sept Access to Spectroscopic Data In the VO Doug Tody (NRAO/US-NVO ) I NTERNATIONAL V IRTUAL O BSERVATORY A LLIANCE.
2008 NVO Summer School1 Data Access Layer Services Doug Tody (NRAO) T HE US N ATIONAL V IRTUAL O BSERVATORY.
NVO Summer School, Aspen Sept Data Access Layer Working Group Image and Spectral Access Doug Tody National Radio Astronomy Observatory National.
NVOSS 2008 Santa Fe1 Space Time Coordinates Gretchen Greene (many thanks to Arnold Rots) T HE US N ATIONAL V IRTUAL O BSERVATORY Sept 2008.
Defect Tracking and Management
SYSTEM PROGRAMMING & SYSTEM ADMINISTRATION
Lessons learnt with Aladin and characterization experience for SIA2.0 F.Bonnarel, CDS (credit to Aladin developpers, CADC,ECF,ESAC, ESO VO people, DAL.
McGraw-Hill/Irwin Copyright © 2007 by The McGraw-Hill Companies, Inc. All rights reserved. Chapter 5 Understanding Entity Relationship Diagrams.
Resource Description Framework ( RDF ) Xinxia An.
About the Presentations The presentations cover the objectives found in the opening of each chapter. All chapter objectives are listed in the beginning.
Data Management: Documentation & Metadata Types of Documentation.
Systems Analysis I Data Flow Diagrams
Introduction to XML This material is based heavily on the tutorial by the same name at
Exploring Microsoft® Office Grauer and Barber 1 Committed to Shaping the Next Generation of IT Experts. Robert Grauer and Maryann Barber Using.
Using Dynamic Lists in SAS Stored Processes for Genetic Toxicity Historical Control Data Volker Harm, PhUSE Conference 2011, Brighton.
The following are instructions for public health officials and hospital users to conduct syndromic surveillance on influenza-like illnesses using ESSENCE.
CHAPTER 11 Tables. How Are Tables Used Data Display  Very tidy and very useful Better Text Alignment  Putting text in tables allows you to format indents.
Nov China-VO 架起 VO 与桌面应用的桥梁 崔辰州 China-VO Project 中科院国家天文台 The Chinese V IRTUAL O BSERVATORY.
Mapping Data Models to VOTable The specification Published version dml/doc/MappingDMtoVOTable-v pdf.
3D Spectroscopy in the Virtual Observatory: Current Status Igor Chilingarian (Observatoire de Paris, France/SAI MSU, Russia) Ivan Zolotukhin (SAI MSU,
IVOA Interop, Victoria Canada, May IVOA Data Access Layer Closing Plenary Summary, Victoria May 2006 Doug Tody (NRAO/NVO/IVOA) I NTERNATIONAL V IRTUAL.
What is XML?  XML stands for EXtensible Markup Language  XML is a markup language much like HTML  XML was designed to carry data, not to display data.
16-17 Oct 2003IVOA Data Access Layer, Strasbourg IVOA Data Access Layer (DAL) Working Group Doug Tody National Radio Astronomy Observatory International.
29-30 April 2004NVO Team Meeting NCSA1 Data Access Layer (DAL) SSA, SIA Enhancement Doug Tody National Radio Astronomy Observatory National Virtual Observatory.
Return to the Word 2007 web page Lesson 5: Using Mail Merge.
Handling 3D Data in the Virtual Observatory
Spectroscopy in VO, ESAC Mar Access to Spectroscopic Data In the VO Doug Tody (NRAO/US-NVO ) for the IVOA DAL working group I NTERNATIONAL.
IVOA Interop, SL de El Escorial, Oct IVOA DAL - Madrid DAL WG Summary October 7, 2005.
XCAP Needed Diffs Jonathan Rosenberg Cisco Systems.
Formal Report Organization Engl 3365 Copyright 2012 by Art Fricke.
Paths towards the Sustainable Consumption of Semantic Data on the Web Aidan Hogan & Claudio Gutierrez.
11 F.Bonnarel (CDS) Kyoto IVOA Interoperabilty Meeting DAL: a mechanism for Metadata extensions F.Bonnarel In behalf of T.Boch, M. Louys, P.Fernique (CDS)
Comparison of CEN, FGDC and ISO standards for metadata Ing. Jan Ruzicka Institute of Economics and Control Systems VŠB – Technical university Ostrava 17.
| ICD-11 Field Trials update | 16 Oct |1 | ICD-11 Field Trials Progress & Way forward Nenad Kostanjsek Classifications, Terminologies, Standards.
Workshop on How to Publish Data in VO ESAC, June 25-June DAL (Data Access Layer) protocols Jesus Salgado
AIDA WP7, Task 2 Third Technology Forum, 16 March 2009, Strasbourg Bruno Rino WP7, Task 2 Server conversion libraries from spectra native format to IVOA.
Discussed in Kyoto Schema changes for the next version (Gerard Lemson)  will be included in VOTable1.2 Schema changes for the next version (Gerard Lemson)
12 Oct 2003VO Tutorial, ADASS Strasbourg, Data Access Layer (DAL) Tutorial Doug Tody, National Radio Astronomy Observatory T HE US N ATIONAL V IRTUAL.
ISO 191** Overview A “Family” of Standards. Resources ISO Standards Web Page – Technical.
VOTable agenda Current VOTable status Current VOTable status News from Applications News from Applications Questions about VOTable schema Questions about.
Publishing Combined Image & Spectral Data Packages Introduction to MEx M. Sierra, J.-C. Malapert, B. Rino VO ESO - Garching Virtual Observatory Info-Workshop.
IVOA Interop, Beijing, China, May IVOA Data Access Layer Working Group Sessions Doug Tody (NRAO/NVO ) Markus Dolensky (ESO/EuroVO) Data Access Layer.
VO Data Access Layer IVOA Cambridge, UK 12 May 2003 Doug Tody, NRAO.
CLUE Framework 01 – comments and issues Interim meeting October 2011 Roni Even.
Database Design, Application Development, and Administration, 6 th Edition Copyright © 2015 by Michael V. Mannino. All rights reserved. Chapter 5 Understanding.
Recommended modeling approach Version 2.0. The law of conflicting data Axiom Data is true Implication Conflicting data implies model misspecification.
Submission doc.: IEEE /0052r1 March 2016 Sho Furuichi, SonySlide 1 Supplemental document for text proposal on amendment to entity operations Date:
Understanding the Value and Importance of Proper Data Documentation 5-1 At the conclusion of this module the participant will be able to List the seven.
IAEA E-learning Program
P O S T E R T I T L E Authors & Institutions
MODULE 7 Microsoft Access 2010
Mapping Data Models to VOTable
Observation/dataset datamodel: Restart non-characterization efforts?
Measurement reporting in TGh
Utypes for Model Referencing
UTYPES Jonathan McDowell.
VOTable Meetings: Conclusions
Requirement Validation
P O S T E R T I T L E Authors & Institutions
LOOPS Generic Information Set draft-welzl-loops-gen-info-00
Presentation transcript:

The need for a stronger IVOA review process An SDM+SSA correctness assessment Bruno Rino, Nov

I am here today… Not as IVOADoc, but As a Data Provider – Doing an audit to ESO’s SSA Two reference documents – Spectrum Data Model (SDM), Oct 2007 – Simple Spectral Access (SSA), Feb 2008 I will show you inconsistencies – Not on the text itself, but from tables: where there is no place to interpretation

Huh? But… how is it possible? In SSA: “In this document we refer to the underlying data model interchangeably as the SSA data model or the Spectrum or spectral data model. The data model used in SSA is described in (McDowell, Tody, et.al, 2007).” “UTYPEs of standard fields are required for identification of interface elements and must be given and must comply with the SSA protocol (this document) and the Spectrum data model (McDowell, Tody, et. al. 2007).” But the SSA document repeats the SDM – Convenient, but error prone… and fallacious And also tries to fix the SDM – But with a wrong approach: the SDM should reflect the fixes!

Sources of information Spectrum Data Model (SDM) – Fields (3.6) – FITS serialization (9) Simple Spectral Access (SSA) – Query Response (4.2) – Data Model Summary (Appendix D)

General notes utype names – In the SDM, all utypes are prefixed by "Spectrum". – In the SSA, this prefix is dropped on most cases (on purpose!), except for the "Dataset" category, where "Spectrum" is replaced by "Dataset”. Often, a utype or a UCD have a “*” – What does it mean? Does it mean anything? A common typo in UCDs is extra whitespace

How to read the “merged table” utype SSA: Query Response SSA: Appendix SDM: Fields SDM: FITS serialization UCD utype notes: When utypes are inconsistent UCD notes: When UCDs are inconsistent FITS

Conclusion SSA and SDM are – Plenty of typos Mostly SDM? – Inconsistent within themselves – Inconsistent about the metadata requirements SSA is in general more lax than SDM, on purpose (but the reasoning would imply a more requirements, not less!): “When a generic data model is applied in a specific context, the requirements for what is required, what is optional, and flexibility in what is permitted will vary depending upon how the data model is being used. Hence when data model attributes are indicated as mandatory or recommended in this document, this overrides any similar requirements specified in the Spectrum data model document.”