Www.csiro.au Managing different views of data Simon Cox CSIRO Exploration and Mining 29 November 2006.

Slides:



Advertisements
Similar presentations
The Next Generation Network Enabled Weather (NNEW) SWIM Application Asia/Pacific AMHS/SWIM Workshop Chaing Mai, Thailand March 5-7, 2012 Tom McParland,
Advertisements

Observations, Features, Coverages, SOS Simon Cox CSIRO Exploration and Mining 9 September 2006.
Information Modelling MOLES Metadata Objects for Linking Environmental Sciences S. Ventouras Rutherford Appleton Laboratory.
1 OGC Web Services Kai Lin San Diego Supercomputer Center
Using the Assay Data Exchange standard with WFS to build a complete minerals exploration data-transfer chain Simon CoxA.Dent, S.Girvan, R.Atkinson.
Center for Modeling & Simulation.  A Map is the most effective shorthand to show locations of objects with attributes, which can be physical or cultural.
Community semantics and interoperability: the ISO/TC 211 framework and the “Hollow World” Simon Cox CSIRO Exploration and Mining 6 September.
AN ORGANISATION FOR A NATIONAL EARTH SCIENCE INFRASTRUCTURE PROGRAM Information modelling – tools Simon Cox.
Designing GML application schemas for Observations and Measurements Simon Cox CSIRO Exploration and Mining 6 January 2006.
Sensitivities in rock mass properties A DEM insight Cédric Lambert (*) & John Read (**) (*) University of Canterbury, New Zealand (**) CSIRO - Earth Science.
A standard information transfer model scopes the ontologies required for observations Simon Cox, Laurent Lefort TDWG, Fremantle,
Pacific Island Countries GIS/RS User Conference 2010, Suva, November 2010 Sensor Web Enablement for the Pacific Vulnerability and adaptation of coastal.
©2005 Austin Troy. All rights reserved Lecture 3: Introduction to GIS Part 1. Understanding Spatial Data Structures by Austin Troy, University of Vermont.
New ways to geo-reference and classify spatial data in Annex II & III data specifications Clemens Portele interactive instruments GmbH Drafting Team „Data.
AN ORGANISATION FOR A NATIONAL EARTH SCIENCE INFRASTRUCTURE PROGRAM Information modelling – standards context Simon Cox.
N 2401/N 2402 New Work Item Proposal - Observation and Sampling schema Simon Cox Research Scientist 28 May 2008.
Preparation of Geological Data Standards of Turkey Based on INSPIRE Directives A joint project completed by General Directorate of Geographical Information.
Domain Modelling and Implementation Standards context Simon Cox Research Scientist Sydney - December, 3 rd 2010.
Random Sampling, Point Estimation and Maximum Likelihood.
Conceptual Design versus Logical Design. Conceptual Data Design Prepared at beginning of project High level view of how the client sees the data Top down.
Basic Geographic Concepts GEOG 370 Instructor: Christine Erlien.
® The sampled feature of hydrologic observation Hydrology Domain Working Group at the OGC/TC Meeting, Austin, 2012, Mar Irina Dornblut, Global Runoff.
Interoperability and architectures Simon Cox CSIRO Exploration and Mining 23 May 2006.
Mapping between SOS standard specifications and INSPIRE legislation. Relationship between SOS and D2.9 Matthes Rieke, Dr. Albert Remke (m.rieke,
Data Mining & Knowledge Discovery Lecture: 2 Dr. Mohammad Abu Yousuf IIT, JU.
8. Geographic Data Modeling. Outline Definitions Data models / modeling GIS data models – Topology.
How do we represent the world in a GIS database?
How do you want that data? Spatial information models and web interfaces Simon Cox CSIRO Exploration and Mining 7 September 2005.
Information Viewpoints and Geoscience Service Architectures Simon Cox Research Scientist 13 December 2007.
© Tan,Steinbach, Kumar Introduction to Data Mining 4/18/ Data Mining Basics: Data Remark: Discusses “basics concerning data sets (first half of Chapter.
® Sponsored by GroundWater ML 2 IE (GW2IE) GroundWater ML 2 IE (GW2IE) Progress Report 95th OGC Technical Committee Boulder, Colorado USA Bruce Simons.
What is Information Modelling (and why do we need it in NEII…)? Dominic Lowe, Bureau of Meteorology, 29 October 2013.
Variables, sampling, and sample size. Overview  Variables  Types of variables  Sampling  Types of samples  Why specific sampling methods are used.
Designing GML application schemas for Observations and Measurements Simon Cox CSIRO Exploration and Mining 22 March 2006.
OM-JSON Simon Cox | Research Scientist | Environmental Information Infrastructures 21 st September 2015 LAND AND WATER, DATA61 a JSON implementation of.
® GRDC Hydrologic Metadata - core concepts - 5 th, WMO/OGC Hydrology DWG New York, CCNY, August 11 – 15, 2014 Irina Dornblut, GRDC of WMO at BfG Copyright.
Exploiting the Observations and Measurements Standard for interoperability in the Earth Sciences and beyond Lesley Wyborn Simon Cox.
Observations and sampling: common patterns Simon Cox CSIRO Exploration and Mining 7 March 2007.
XMML – a standards-conformant XML language for geology features Simon Cox CSIRO Exploration & Mining
Applications of Spatial Statistics in Ecology Introduction.
1 Spatial Data Models and Structure. 2 Part 1: Basic Geographic Concepts Real world -> Digital Environment –GIS data represent a simplified view of physical.
Web Services and Geologic Data Interchange Simon Cox CSIRO Exploration & Mining
Page 1 CSISS Center for Spatial Information Science and Systems Access HDF-EOS data with OGC Web Coverage Service - Earth Observation Application Profile.
Standards-based methodology for developing a geoscience markup language Simon Cox Research Scientist 9 August 2008.
Introduction to GeoSciML: standard encoding for transfer of geoscience information Simon Cox CSIRO Exploration and Mining 11 September 2006.
© 2006, Open Geospatial Consortium, Inc. The OGC Sensor Web Enablement framework Simon CoxMike Botts CSIRO Exploration & MiningNational Space Science &
Observations & Measurements & SWE in Inspire OGC Hydro DWG Workshop – Reading – Sylvain Grellet Office International de l’Eau.
Exchanging observations and measurements: a generic model and encoding Simon Cox Research Scientist 22 May 2007.
WIGOS Data model – standards introduction.
Analysis Yaodong Bi. Introduction to Analysis Purposes of Analysis – Resolve issues related to interference, concurrency, and conflicts among use cases.
Exchanging observations and measurements: applications of a generic model and encoding Simon Cox CSIRO Exploration and Mining 15 December.
Object Modeling THETOPPERSWAY.COM. Object Modelling Technique(OMT)  Building a model of an application domain and then adding implementation.
® Hosted and Sponsored by Observed Observable Properties - from HY_Features perspective - OGC Hydrology Domain Working Group 3 rd Meeting, Reading, UK,
Leverage and Delegation in Developing an Information Model for Geology Simon Cox Research Scientist 14 December 2007.
® Sponsored by OGC TimeseriesML Domain Range Web Service Use Case for The National Weather Service's National Digital Forecast Database 95th OGC Technical.
Logical Database Design and Relation Data Model Muhammad Nasir
Class Diagrams Revisited. Parameterized Classes Parameterized Classes - are used to represent relationships between templates.
Leverage and Delegation in Developing an Information Model for Geology Simon Cox Research Scientist 14 December 2007.
Tutorial 1 Description of a Weather Station using SensorML Alexandre Robin
OGC TC Washington – HydroDWG meeting – Inspire O&M & SWE requirements - profile BRGM – S.Grellet 52N – S.Jirka.
Implementing distributed geoscience information systems using Open GIS Web Services Simon Cox CSIRO Exploration & Mining
U.S. Department of the Interior U.S. Geological Survey WaterML Presentation to FGDC SWG Nate Booth January 30, 2013.
® OGC Sensor Web Enablement Dr Andrew Woolf STFC e-Science Centre Rutherford Appleton Laboratory, UK.
1 of 42 Lecture 5 Data Model Design Jeffery S. Horsburgh Hydroinformatics Fall 2013 This work was funded by National Science Foundation Grants EPS
Jeffery S. Horsburgh Hydroinformatics Fall 2014
The Next Generation Network Enabled Weather (NNEW) SWIM Application
Logical Database Design and the Rational Model
Lecture Notes for Chapter 2 Introduction to Data Mining
108th OGC Technical Committee
Session 2: Metadata and Catalogues
Presentation transcript:

Managing different views of data Simon Cox CSIRO Exploration and Mining 29 November 2006

2 of 24 Observations, Features and Coverages Outline OGC/ISO meta-models for information objects  Features and coverages Property estimation events  Observations Transforming viewpoints

3 of 24 Observations, Features and Coverages Conceptual object model: features Digital objects correspond with identifiable, typed, objects in the real world  mountain, road, specimen, event, tract, catchment, wetland, farm, bore, reach, property, license-area, station Feature-type is characterised by a specific set of properties Specimen  ID (name)  description  mass  processing details  sampling location  sampling time  related observation  material ……

4 of 24 Observations, Features and Coverages ISO 19101, General Feature Model Properties include  attributes  associations between objects  value may be object with identity  operations Metaclass diagram

5 of 24 Observations, Features and Coverages Geology domain model - feature type catalogue Borehole  collar location  shape  collar diameter  length  operator  logs  related observations  … Fault  shape  surface trace  displacement  age  … Ore-body  commodity  deposit type  host formation  shape  resource estimate  … Conceptual classification Multiple geometries Geologic Unit  classification  shape  sampling frame  age  dominant lithology  … License area  issuer  holder  interestedParty  shape(t)  right(t)  …

6 of 24 Observations, Features and Coverages Water resources feature type catalogue Aquifer Storage Stream Well Entitlement Observation …

7 of 24 Observations, Features and Coverages Meteorology feature type catalogue Front Jetstream Tropical cyclone Lightning strike Pressure field Rainfall distribution … Bottom two are a different kind of feature

8 of 24 Observations, Features and Coverages Spatial function: coverage (x 1,y 1 ) (x 2,y 2 ) Variation of a property across the domain of interest  For each element in a spatio-temporal domain, a value from the range can be determined  Used to analyse patterns and anomalies, i.e. to detect features (e.g. storms, fronts, jetstreams) Discrete or continuous domain  Domain is often a grid  Time-series are coverages over time

9 of 24 Observations, Features and Coverages ISO Coverage model

10 of 24 Observations, Features and Coverages Discrete coverage model

11 of 24 Observations, Features and Coverages Features vs Coverages Feature  object-centric  heterogeneous collection of properties  “summary-view” Coverage  property-centric  variation of homogeneous property  patterns & anomalies Both needed; transformations required

12 of 24 Observations, Features and Coverages “Cross-sections” through collections SpecimenAu (ppm) Cu-a (%)Cu-b (%)As (ppm)Sb (ppm) ABC A Row gives properties of one feature A Column = variation of a single property across a domain (i.e. set of locations)

13 of 24 Observations, Features and Coverages Assignment of property values For each property of a feature, the value is either i.asserted  name, owner, price, boundary (cadastral feature types) ii.estimated  colour, mass, shape (natural feature types)  i.e. error in the value is of interest

14 of 24 Observations, Features and Coverages Value estimation process: observation An Observation is a kind of “Event Feature type”, whose result is a value estimate, and whose other properties provide metadata concerning the estimation process

15 of 24 Observations, Features and Coverages Observation model – Value-capture-centric view An Observation is an Event whose result is an estimate of the value of some Property of the Feature-of-interest, obtained using a specified Procedure

16 of 24 Observations, Features and Coverages “Cross-sections” through collections SpecimenAu (ppm) Cu-a (%)Cu-b (%)As (ppm)Sb (ppm) ABC A Row gives properties of one feature A Column = variation of a single property across a domain (i.e. set of features) A Cell describes the value of a single property on a feature, often obtained by observation or measurement

17 of 24 Observations, Features and Coverages Feature of interest may be any feature type from any domain-model … observations provide values for properties whose values are not asserted i.e. the application-domain supplies the feature types

18 of 24 Observations, Features and Coverages Observations support property assignment These must match if the observation is coherent with the feature property Some properties have interesting types …

19 of 24 Observations, Features and Coverages Variable property values Some property values are not constant  colour of a Scene or Swath varies with position  shape of a Glacier varies with time  temperature at a Station varies with time  rock density varies along a Borehole Variable values may be described as a Coverage over some axis of the feature

20 of 24 Observations, Features and Coverages Observations and coverages If the property value is not constant across the feature-of- interest  varies by location, in time the corresponding observation result is a coverage individual samples must be tied to the location within the domain, so result is set of e.g.  time-value  position-value  (stationID-value ?) Time-series observations are a particularly common use-case

21 of 24 Observations, Features and Coverages Observations, features and coverages Feature summary Property-value evidence Multiple observations one feature, different properties: feature summary evidence A property-value may be a coverage Same property on multiple samples is a another kind of coverage Multiple observations different features, one property: coverage evidence

22 of 24 Observations, Features and Coverages Features, Coverages & Observations (1) Observations and Features  An observation provides evidence for estimation of a property value for the feature-of-interest Features and Coverages (1)  The value of a property that varies on a feature defines a coverage whose domain is the feature Observations and Coverages (1)  An observation of a property sampled at different times/positions on a feature-of-interest estimates a discrete coverage whose domain is the feature-of-interest  feature-of-interest is one big feature – property value varies within it

23 of 24 Observations, Features and Coverages Features, Coverages & Observations (2) Observations and Features  An observation provides evidence for estimation of a property value for the feature-of-interest Features and Coverages (2)  The values of the same property from a set of features constitutes a discrete coverage over a domain defined by the set of features Observations and Coverages (2)  A set of observations of the same property on different features provides an estimate of the range-values of a discrete coverage whose domain is defined by the set of features-of-interest  feature-of-interest is lots of little features – property value constant on each one

24 of 24 Observations, Features and Coverages Conclusions Feature and coverage viewpoints used for different purposes  Summary vs. analysis Some values are determined by observation  Sometimes the description of the estimation process is necessary Transformation between feature and coverage views depends on the “feature-type” Management of observation evidence depends on feature-of- interest-type  One big feature, with internal variation, vs  Aggregation of many small features

Thank You CSIRO Exploration and Mining NameSimon Cox TitleResearch Scientist Phone Webwww.seegrid.csiro.au Contact CSIRO Phone Webwww.csiro.au

26 of 24 Observations, Features and Coverages premises: O&M is the high-level information model SOS is the primary information-access interface SOS can serve: an Observation (Feature)  getObservation == “getFeature” (WFS/Obs) operation a feature of interest (Feature)  getFeatureOfInterest == getFeature (WFS) operation or Observation/result (often a time-series == discrete Coverage)  getResult == “getCoverage” (WCS) operation or Sensor == Observation/procedure (SensorML document)  describeSensor == “getFeature” (WFS) or “getRecord” (CSW) operation Sensor service optional – probably required for dynamic sensor use-cases

27 of 24 Observations, Features and Coverages SOS vs WFS, WCS, CS/W? WFS/ Obs getFeature, type=Observation WCS getCoverage getCoverage (result) Sensor Registry getRecord SOS getObservation getResult describeSensor getFeatureOfInterest WFS getFeature SOS interface is effectively a composition of (specialised) WFS+WCS+CS/W operations e.g. SOS::getResult == “convenience” interface for WCS

28 of 24 Observations, Features and Coverages Some feature types only exist to support observations

29 of 24 Observations, Features and Coverages Observation model Generic Observation has dynamically typed result

30 of 24 Observations, Features and Coverages Observation specializations Override result type

31 of 24 Observations, Features and Coverages Observation specializations Override result type Primary use-case for “CommonObservation” matches “CoverageObservation”  N.B. CommonObservation is an implementation

32 of 24 Observations, Features and Coverages Observations and Features An estimated value is determined through observation i.e. by application of an observation procedure

33 of 24 Observations, Features and Coverages Invariant property values: cross-sections through collections SpecimenAu (ppm) Cu-a (%)Cu-b (%)As (ppm)Sb (ppm) ABC A Row gives properties of one feature A Column = variation of a single property across a domain (i.e. set of features) A Cell describes the value of a single property on a feature, often obtained by observation or measurement

34 of 24 Observations, Features and Coverages Variable property values Each property value is either  constant on the feature instance  e.g. name, identifier  non-constant  colour of a Scene or Swath varies with position  shape of a Glacier varies with time  temperature at a Station varies with time  rock density varies along a Borehole Variable values may be described as a Coverage over some axis of the feature

35 of 24 Observations, Features and Coverages Observations support property assignment