Observation/dataset datamodel: Restart non-characterization efforts?

Slides:



Advertisements
Similar presentations
Registries Work Package 2 Requirements, Science Cases, Use Cases, Test Cases Charter: Focus on science case scenarios, and use cases related specifically.
Advertisements

Characterisation of observations François Bonnarel, Mireille Louys, Anita Richards, Alberto Micol, Jonathan McDowell, Igor Chilingarian, et al.
/13SNAP data model Simulation data model.
IVOA, Pune India September Data Access Layer Working Group Pune Workshop Summary Doug Tody National Radio Astronomy Observatory International.
Victoria, May Session III Theory Interest Group Session III Victoria, May
SSA Query Interface M. Dolensky, ESO Data Access Layer Working Group Interoperability Workshop, Pune, India 27-Sep-2004.
Characterization 2 and Provenance data models. Use cases and first roadmap F.Bonnarel (CDS)
Interop May 2007 Spectrum Data Model Jonathan McDowell.
/13SNAP data model Introduction to the workshop.
MEx Metadata extraction. IVOA Interop, Moscow, 19-Sep-2006 Metadata extraction The problem The problem Data centres need their data described homogeneously.
IVOA Interop meeting 05/17/2006 Victoria F.Bonnarel (CDS) Generic Data discovery, Cube acces: CGPS Archive browser F.Bonnarel,T.Boch,D.Durand (CDS, CADC)
The VAO is operated by the VAO, LLC. Alternative Protocols for Discovery & Access Mike Fitzpatrick NOAO.
SLAP: Simple Line Access Protocol v0.5
NVO Summer School, Santa Fe Sept Access to Spectroscopic Data In the VO Doug Tody (NRAO/US-NVO ) I NTERNATIONAL V IRTUAL O BSERVATORY A LLIANCE.
Footprint Service Specification NVO Summer School 2008 Gretchen Greene (thanks to Tamas Budavari and Francois Bonnarel) T HE US N ATIONAL V IRTUAL O BSERVATORY.
NVO Summer School, Aspen Sept Data Access Layer Working Group Image and Spectral Access Doug Tody National Radio Astronomy Observatory National.
NVOSS 2008 Santa Fe1 Space Time Coordinates Gretchen Greene (many thanks to Arnold Rots) T HE US N ATIONAL V IRTUAL O BSERVATORY Sept 2008.
DM: Simulation Data Model RFC and other comments Tuesday, , A.
Lessons learnt with Aladin and characterization experience for SIA2.0 F.Bonnarel, CDS (credit to Aladin developpers, CADC,ECF,ESAC, ESO VO people, DAL.
© Tefko Saracevic, Rutgers University1 metadata considerations for digital libraries.
Data Management: Documentation & Metadata Types of Documentation.
Improving Data Discovery in Metadata Repositories through Semantic Search Chad Berkley 1, Shawn Bowers 2, Matt Jones 1, Mark Schildhauer 1, Josh Madin.
Characterisation Data Model applied to simulated data Mireille Louys, CDS and LSIIT Strasbourg.
The need for a stronger IVOA review process An SDM+SSA correctness assessment Bruno Rino, Nov
IVOA Interop, Victoria Canada, May IVOA Data Access Layer Closing Plenary Summary, Victoria May 2006 Doug Tody (NRAO/NVO/IVOA) I NTERNATIONAL V IRTUAL.
16-17 Oct 2003IVOA Data Access Layer, Strasbourg IVOA Data Access Layer (DAL) Working Group Doug Tody National Radio Astronomy Observatory International.
29-30 April 2004NVO Team Meeting NCSA1 Data Access Layer (DAL) SSA, SIA Enhancement Doug Tody National Radio Astronomy Observatory National Virtual Observatory.
European Space Astronomy Centre (ESAC) Villafranca del Castillo, MADRID (SPAIN) Jesús Salgado SLAP Implementations May 2007, Beijing, China Simple Line.
Spectroscopy in VO, ESAC Mar Access to Spectroscopic Data In the VO Doug Tody (NRAO/US-NVO ) for the IVOA DAL working group I NTERNATIONAL.
OneM2M-ARC Enhancement_on_resources Some thoughts on oneM2M resources Group Name: WG2 Source: Norio Uchida, NEC, Barbara.
IVOA Interop, SL de El Escorial, Oct IVOA DAL - Madrid DAL WG Summary October 7, 2005.
1 Schema Registries Steven Hughes, Lou Reich, Dan Crichton NASA 21 October 2015.
IVOA, Kyoto May Data Access Layer Working Group Status and Plans for this Workshop Doug Tody National Radio Astronomy Observatory International.
Footprint Service Specification IVOA Interop Meeting Trieste 2008 Gretchen Greene and Tamas Budavari.
VOTECH meeting 03/06-09/2006 Sorrento F.Bonnarel (CDS) CDS DS6 cycle 3 plans F.Bonnarel In behalf of CDS team.
Aladin, VO standards, spectra and datacubes T.Boch, F.Bonnarel, P.Fernique (CDS, Aladin development group)
PhotDM implementation feedback | Jesus Salgado | ESAC | 18 October 2011 | IVOA Pune 2011 | Pag. 1 Photometry DM implementation feedback Jesus.
Workshop on How to Publish Data in VO ESAC, June 25-June DAL (Data Access Layer) protocols Jesus Salgado
Access and Query Task Force Status at F2F1 Simon Miles.
Discussed in Kyoto Schema changes for the next version (Gerard Lemson)  will be included in VOTable1.2 Schema changes for the next version (Gerard Lemson)
12 Oct 2003VO Tutorial, ADASS Strasbourg, Data Access Layer (DAL) Tutorial Doug Tody, National Radio Astronomy Observatory T HE US N ATIONAL V IRTUAL.
Obscore DM v 1.1 Mireille Louys, Doug Tody, Patrick Dowler, Daniel Durand, Laurent Michel, François Bonnarel, Alberto Micol and the IVOA DataModel working.
Lecture 4 Mechanisms & Kernel for NOSs. Mechanisms for Network Operating Systems  Network operating systems provide three basic mechanisms that support.
Publishing Combined Image & Spectral Data Packages Introduction to MEx M. Sierra, J.-C. Malapert, B. Rino VO ESO - Garching Virtual Observatory Info-Workshop.
IVOA Interop, Beijing, China, May IVOA Data Access Layer Working Group Sessions Doug Tody (NRAO/NVO ) Markus Dolensky (ESO/EuroVO) Data Access Layer.
Describing 3D Datasets Igor Chilingarian (CRAL Observatoire de Lyon/Sternberg Astronomical Institute of the Moscow State University) IVOA DM & DAL WG –
VO Data Access Layer IVOA Cambridge, UK 12 May 2003 Doug Tody, NRAO.
IVOA Interop, Beijing, China, May IVOA Data Access Layer Working Group Sessions Doug Tody (NRAO/NVO ) Markus Dolensky (ESO/EuroVO) Data Access Layer.
1 The Metadata Groups - Keith G Jeffery. 2 Positioning  Raise profile of metadata  Data first  Also software, resources, users  Achieve outputs/outcomes.
IVOA Interop, Beijing, China, May IVOA Data Access Layer Working Group Sessions Doug Tody (NRAO/NVO ) Markus Dolensky (ESO/EuroVO) Data Access Layer.
Introduction to the SAM System at DØ Physics 5391 July 1, 2002 Mark Sosebee U.T. Arlington.
1 Workflows Access and Massage VO Data José Enrique Ruiz on behalf of the Wf4Ever Team IVOA INTEROP SPRING MEETING 2013 HEIDELBERG, MAY16th 2013.
End of the Beginning for IVOA is now Roy Williams IVOA Technical Lead.
GCI Architecture GEOSS Information System Meeting 20 September 2013, ESA/ESRIN (Frascati, Italy) M.Albani (ESA), D.Nebert (USGS/FGDC), S.Nativi (CNR)
Machine Learning with Spark MLlib
Discussions on Heterogeneous Identification Service
Accomplishments RSM v0.7 First draft XML Schema completed: VOResource.xsd NVO: Working prototype resource using VOResource as format for metadata exchange.
Iterative design and prototyping
Virtual Observatory for cosmological simulations
DAL concluding remarks
Data Management: Documentation & Metadata
ESCWA SDMX Workshop Session: Constraints.
Session 2: Metadata and Catalogues
Registry Applications Data Model
Module P4 Identify Data Products and Views So Their Requirements and Attributes Can Be Controlled Learning Objectives: Understand the value of data. Understand.
Publishing image services in ArcGIS
Utypes for Model Referencing
Footprint Service Specification
Classifications and Linked Open Data Formalizing the structure and content of statistical classifications Item 9.1 Standards Working Group Luxembourg,
Presentation transcript:

Observation/dataset datamodel: Restart non-characterization efforts? F.Bonnarel (CDS), M.Louys (ULP/LSIIT) IVOA Interop meeting 05/19/2006 Victoria F.Bonnarel (CDS)

Global observation data model Global observation datamodel has been discussed from 2002 to 2004. Boston meeting was the last time it was considered as a whole After that we concentrated on characterization Other components: Provenance (software, observation, simulation) Curation (like in Spectrum ?) Packaging, Missing Practical Stuff and Data Access and Views. Restart effort on this, in the scope of a General Dataset Model? IVOA Interop meeting 05/19/2006 Victoria F.Bonnarel (CDS)

IVOA Interop meeting 05/19/2006 Victoria F.Bonnarel (CDS)

IVOA Interop meeting 05/19/2006 Victoria F.Bonnarel (CDS)

IVOA Interop meeting 05/19/2006 Victoria F.Bonnarel (CDS)

Need for a Provenance describe the history of the data.... Understand where the difference between the characterization of the data is coming from. necessary for correlation of data from various origins reprocessing For managing links between several stages in Observation. IVOA Interop meeting 05/19/2006 Victoria F.Bonnarel (CDS)

Provenance Observing Components and Software components List them Describe how they affect the characterization of the data (reuse of char in this context?) See Frederic/mireille talk for Simulated data IVOA Interop meeting 05/19/2006 Victoria F.Bonnarel (CDS)

DataAccessAndViews Driver: The Generic DataSet Discovery (see DAL session 3) Purpose: formal definition for describing the various access modes , references and views for the same (« complex ») dataset. Provide utypes and structure for Generic Data Set Discovery Protocols IVOA Interop meeting 05/19/2006 Victoria F.Bonnarel (CDS)

AccessAndViews components AccessAndViewsReference: URL, URI, etc... as in SSA AccessAndViewsFormat: mime/type image/fits image/jpeg spectrum/fits spectrum/votable spectrum/xml text/ascii text/html text/xml text/votable (etc ...) as in SSA (more values) AccessAndViewsSize: size in bytes as in SSA AccessAndViewsProductType: cube, image, spectrum, catalog, metadata Different from the DataSetType of the DataSEt itself, (Type of the Specific view). catalog, as a result of source extraction metadata to allow the retrieval of full metadata descriptions such as characterisation ... IVOA Interop meeting 05/19/2006 Victoria F.Bonnarel (CDS)

IVOA Interop meeting 05/19/2006 Victoria F.Bonnarel (CDS)

AccessAndViews attributes AccessAndViewsTransform: FullDataSet, Cutout, Reprojection, as developped in Doug's document AccessAndViewsGenerationParameters: location, bounds, wcs, sampling, resolution, kernel    These parameters, similar to the Image Generation Parameter   necessary to generate a real view according to a specific transform. exact list is dependant on specific transforms AccessAndViewsRoleName: free string: eg "Full retrieval" , Preview, "Deconvoluated Image" What the Views are intended to be used to in the discovery/access process. AccessAndViewsRetrieval: true/false True would allow direct retrieval while false would initiate a new "query response" IVOA Interop meeting 05/19/2006 Victoria F.Bonnarel (CDS)

AccessAndViews attributes Reprojection or processing types distinguish between several subtypes of "projection" including some kind of processing: Registering/Resampling, Mosaicing, Deconvolution, Filtering, Segmentation Deconvolution, filtering and Segmentation: can they be seen as special case of projection ? Or should we group them in a 4th category: let say "Processing" or "Interpretation"? Transform /Generation Parameters dependancy FullDataSet: none Cutout: location, bounds Registering: wcs Resampling: sampling, kernel Mosaicing: location, bounds, wcs, sampling, kernel Deconvolution; resolution: kernel Filtering: kernel Segmentation: ad hoc parameters of the dedicatec algorithm? IVOA Interop meeting 05/19/2006 Victoria F.Bonnarel (CDS)