Semantic Web underpinnings of the IRI Data Library Semantic Web as a Framework for Multiple Metadata IRI Data Library: presenting Data in multiple frameworks.

Slides:



Advertisements
Similar presentations
Can I Use It, and If so, How? Christian Lieske SAP AG – MultiLingual Technology Discussion of Consortium Proposal for OLIF2 File Header.
Advertisements

Dr. Leo Obrst MITRE Information Semantics Information Discovery & Understanding Command & Control Center February 6, 2014February 6, 2014February 6, 2014.
Semantically-Assisted Geospatial Workflow Design Gobe Hobona, David Fairbairn, Philip James ACM GIS – 8 th November Seattle.
GridVine: Building Internet-Scale Semantic Overlay Networks By Lan Tian.
Using the Semantic Web to Construct an Ontology- Based Repository for Software Patterns Scott Henninger Computer Science and Engineering University of.
CSCI 572 Project Presentation Mohsen Taheriyan Semantic Search on FOAF profiles.
Crossing the Digital Divide
Linking Disparate Datasets of the Earth Sciences with the SemantEco Annotator Session: Managing Ecological Data for Effective Use and Reuse Patrice Seyed.
PREMIS Tools and Services Rebecca Guenther Network Development & MARC Standards Office, Library of Congress NDIIPP Partners Meeting July 21,
1 Foundations V: Infrastructure and Architecture, Middleware Deborah McGuinness and Peter Fox CSCI Week 9, October 27, 2008.
EARTH SCIENCE MARKUP LANGUAGE “Define Once Use Anywhere” INFORMATION TECHNOLOGY AND SYSTEMS CENTER UNIVERSITY OF ALABAMA IN HUNTSVILLE.
AIRNow Web Services Data to Go! Prepared by Steven A. Ludewig, Timothy S. Dye Sonoma Technology, Inc. Petaluma, CA John E. White U.S. Environmental Protection.
Unidata’s TDS Workshop TDS Overview – Part II October 2012.
DM_PPT_NP_v01 SESIP_0715_AJ HDF Product Designer Aleksandar Jelenak, H. Joe Lee, Ted Habermann Gerd Heber, John Readey, Joel Plutchak The HDF Group HDF.
The MMI Tools Carlos Rueda Monterey Bay Aquarium Research Institute OOS Semantic Interoperability Workshop Marine Metadata Interoperability Project Boulder,
1 Foundations V: Infrastructure and Architecture, Middleware Deborah McGuinness TA Weijing Chen Semantic eScience Week 10, November 7, 2011.
1 Foundations V: Infrastructure and Architecture, Middleware Deborah McGuinness and Joanne Luciano With Peter Fox and Li Ding CSCI Week 10, November.
The IRI Climate Data Library: translating between data cultures Benno Blumenthal International Research Institute for Climate Prediction Columbia University.
Metadata and Geographical Information Systems Adrian Moss KINDS project, Manchester Metropolitan University, UK
Accomplishments and Remaining Challenges: THREDDS Data Server and Common Data Model Ethan Davis Unidata Policy Committee Meeting May 2011.
Metadata. Generally speaking, metadata are data and information that describe and model data and information For example, a database schema is the metadata.
NERC DataGrid NERC DataGrid Vocabulary Server Use Cases Vocabulary Workshop, RAL, February 25, 2009.
IRI Data Library: enhancing accessibility of climate knowledge M. Benno Blumenthal, Michael Bell, John del Corral, Rémi Cousin, and Igor Khomyakov.
Documentation from NcML to ISO Ted Habermann, NOAA NESDIS NGDC.
M.Benno Blumenthal and John del Corral International Research Institute for Climate and Society OpenDAP 2007
Semantic Technologies and Application to Climate Data M. Benno Blumenthal IRI/Columbia University CDW /04-01.
Unidata’s TDS Workshop TDS Overview – Part I July 2011.
Server-side Analysis and a Semantic Framework for Metadata M. Benno Blumenthal International Research Institute for Climate and Society Columbia University.
Introduction to the Semantic Web and Linked Data Module 1 - Unit 2 The Semantic Web and Linked Data Concepts 1-1 Library of Congress BIBFRAME Pilot Training.
M.Benno Blumenthal, Michael Bell, John del Corral, and Emily Grover-Kopec International Research Institute for Climate and Society Columbia University.
User Profiling using Semantic Web Group members: Ashwin Somaiah Asha Stephen Charlie Sudharshan Reddy.
The HDF Group Data Interoperability The HDF Group Staff Sep , 2010HDF/HDF-EOS Workshop XIV1.
Exporting WaterML from the Earth System Modeling Framework Xinqi Wang Louisiana State University NCAR SIParCS Program August 4, 2009.
Issues in Ontology-based Information integration By Zhan Cui, Dean Jones and Paul O’Brien.
Distributed Data Analysis & Dissemination System (D-DADS ) Special Interest Group on Data Integration June 2000.
Data Interoperability at the IRI: translating between data cultures Benno Blumenthal International Research Institute for Climate Prediction Columbia University.
1 Open Ontology Repository initiative - Planning Meeting - Thu Co-conveners: PeterYim, LeoObrst & MikeDean ref.:
Working with XML. Markup Languages Text-based languages based on SGML Text-based languages based on SGML SGML = Standard Generalized Markup Language SGML.
Data Stewardship at the NOAA Data Centers Sub Topic - Value Added Products ESIP Federation Meeting, Washington, DC January 6-8, 2009.
M.Benno Blumenthal and John del Corral International Research Institute for Climate and Society IRI Data Library.
Glossary WMS – OGC Web Mapping Services WFS – OGC Web Feature Services XML- Extensible Markup Language OGC – Open GIS Consortium ADN –
IRI/LDEO Climate Data Library M.Benno Blumenthal, Michael Bell, John del Corral, Remi Cousin, and Haibo Liu International Research Institute for Climate.
M.Benno Blumenthal and John del Corral International Research Institute for Climate and Society Using a Resource.
CGI – GeoSciML Testbed 3 Status for BRGM Jean-Jacques Serrano.
OGC Web Services with complex data Stephen Pascoe How OGC Web Services relate to GML Application Schema.
Semantic Interoperability in GIS N. L. Sarda Suman Somavarapu.
1 2.5 DISTRIBUTED DATA INTEGRATION WTF-CEOP (WGISS Test Facility for CEOP) May 2007 Yonsook Enloe (NASA/SGT) Chris Lynnes (NASA)
IRI Data Library Faceted Search: an example of RDF-based faceted search for climate data Drawing on multiple ontologies to build an application Using inference.
M.Benno Blumenthal and John del Corral International Research Institute for Climate and Society Use of RDF/OWL.
M. Benno Blumenthal International Research Institute for Climate and Society Connecting netcdf/CF to a semantic.
Using the Semantic Web M. Benno Blumenthal International Research Institute for Climate and Society Columbia University 31 July 2012 CU Metadata Group.
An Introduction to the Semantic Web M. Benno Blumenthal International Research Institute for Climate and Society Columbia University 2 November 2011.
IRI/LDEO Climate Data Library M.Benno Blumenthal, Michael Bell, and John del Corral International Research Institute for Climate and Society Columbia University.
IRI Data Library Overview
The IRI was founded approximately 12 years ago with a mission To enhance society’s capability to understand, anticipate and manage the impacts of climate.
Transport and Access of Data, Metadata, and Semantics using RDF
IRI/LDEO Climate Data Library
IRI/LDEO Climate Data Library
IRI/LDEO Climate Data Library
IRI/LDEO Climate Data Library
IRI/LDEO Climate Data Library
IRI Data Library Overview
Connecting netcdf/CF to a semantic framework
Data Standards at the IRI Data Library
RDF Standard Data Model Exchange
IRI Data Library Faceted Search: an example of
M.Benno Blumenthal, Michael Bell,
IN32A-05 The IRI/LDEO Climate Data Library: Helping People use Climate Data M.Benno Blumenthal, Emily Grover-Kopec, Michael Bell, and John del Corral.
ExPLORE Complex Oceanographic Data
IRI/LDEO Climate Data Library
Presentation transcript:

Semantic Web underpinnings of the IRI Data Library Semantic Web as a Framework for Multiple Metadata IRI Data Library: presenting Data in multiple frameworks Pure RDF Faceted Data Search Metadata interoperability using adiabatic XML Schema to OWL mapping

blind monks examining an elephant John Godfrey Saxe ( ) Multiple partial representations of objects described by data

Semantic Web as a Framework for Multiple Metadata: The Data Problem Users Datasets

The Tool Interface Users Datasets Tools

Standard Metadata Users Datasets Tools Standard Metadata Schema/Data Services

Many Data Communities Tools Users Datasets Standard Metadata Schema Tools Users Datasets Standard Metadata Schema Tools Users Datasets Standard Metadata Schema Tools Users Datasets Standard Metadata Schema Tools Users Datasets Standard Metadata Schema

Super Schema Tools Users Datasets Standard Metadata Schema Tools Users Datasets Standard Metadata Schema Tools Users Datasets Standard Metadata Schema Tools Users Datasets Standard Metadata Schema Tools Users Datasets Standard Metadata Schema Standard metadata schema

Tools Users Datasets Standard Metadata Schema RDF Tools Users Datasets Standard Metadata Schema RDF Tools Users Datasets Standard Metadata Schem RDF RDF Data Model Exchange RDF Tools Users Datasets Standard Metadata Schema RDF Tools Users Datasets Standard Metadata Schema RDF

RDF Architecture RDF Virtual (derived) RDF queries

Where we are coming from – the IRI Data Library presenting Data in multiple frameworks

IRI Data Library Overview IRI Data Collection Generalized Data Tools Specialized Data Tools Dataset Variable ivar multidimensional Data Viewer Data Language Maproom URL/URI for data, calculations, figs, etc

Data Flow based Analysis with explicit semantics Results data analysis Data analysis Semantic Web

IRI Data Collection Dataset Variable ivar multidimensional Economics Public Health “geolocated by entity” GIS “geolocation by vector object or projection metadata” Ocean/Atm “geolocated by lat/lon” multidimensional spectral harmonics equal-area grids GRIB grid codes climate divisions IRI Data Collection

IRI Data Collection Dataset Variable ivar Servers OpenDAP THREDDS GRIB netCDF images binary Database Tables queries spreadsheetsshapefiles images w/proj IRI Data Collection

IRI Data Collection Dataset Variable ivar Calculations “virtual variables” images graphics descriptive and navigational pages OpenGIS WMS/WCS KML Data Files netcdf binary images Clients OpenDAP THREDDS Tables Servers OpenDAP THREDDS GRIB netCDF images binary Database Tables queries spreadsheetsshapefiles images w/proj IRI Data Collection

IRI General Data Tools Data Page

IRI General Data Tools Data Viewer

Calculations: svd (link: svdview) (link: svd results dataset) (link: svd documentation)

WMS and KML: land cover (link:figure page)

Malaria Early Warning System Front page illustrates most recent dekadal rainfall estimates (FEWS RFE) Change dates to view different time periods Administrative and epidemiological overlays available Click and drag box across map to zoom IRI Map Room

IRI Data Library Faceted Search: an example of RDF-based faceted search for climate data Drawing on multiple ontologies to build an application Using inference to connect ontologies describing different parts of the framework

Search Interface as Multiple Ontologies Search Interface Users Datasets Search Ontology Dataset Ontology Additional Semantics

Faceted Search

Distinctive Features of the search Search terms are interrelated terms that describe the set of returns are displayed (spanning and not) Returned items also have structure (sub- items and superseded items are not shown)

Architectural Features of the search Interface is generated from a set of Terms connected to a set of Items Multiple search structures possible Multiple languages possible Search structure is kept in the database, not in the code

Term Ontology Concepts as individuals (unlike conceptual ontology with concepts as classes) Simple Knowledge Organization System (SKOS) is a prime example The ontology used here is slightly different than SKOS: facets are classes of terms rather than being top_concepts

Nuanced tagging Concepts as objects can be interrelated: specific terms imply broader terms Object ends up being tagging with terms ranging from general to specific. Search can then be nuanced tagging can proceed in absence of perfect information

Faceted Search Explicated

Search Interface Items (datasets/maps) Terms Facets Taxa

Search Interface Semantic API {item} dc:title dc:description rss:link iridl:icon dcterm:isPartOf {item2} dcterm:isReplacedBy {item2} {item} trm:isDescribedBy {term} {term} a {facet} of {taxa} of {trm:Term}, {facet} a {trm:Facet}, {taxa} a {trm:Taxa}, {term} trm:directlyImplies {term2}

Faceted Search w/Queries

RDF Architecture RDF Virtual (derived) RDF queries

Data Servers Ontologies MMI JPL Standards Organizations Start Point RDF/XML-Schema Crawler XML Schema to OWL translation Owl Semantics SWRL Rules SeRQL CONSTRUCT Search Queries Location Canonicalizer Time Canonicalizer Sesame Search Interface bibliography IRI RDF Architecture

Cast of Characters NC – netcdf data file format CF – Climate and Forecast metadata convention for netcdf (includes controlled vocabulary for physical quantities) SWEET - Semantic Web for Earth and Environmental Terminology (OWL Ontology) IRIDL – IRI Data Library

CF attributes SWEET Ontologies (OWL) Search Terms CF Standard Names (RDF object) IRIDL Terms NC basic attributes IRIDL attributes/objects SWEET as Terms CF Standard Names As Terms Gazetteer Terms CF data objects Location

XML Schema to OWL ontologies Semantically-mediated translation between Web Coverage Service (WCS) and OPeNDAP (data as multiple-dimension variable) WCS is defined in XML Schema (57!) Sample Schema to OWL Translation Method to return JDOM element (XML) containing requested XML property from RDF triple-store (element maps to (Resource,class) pair) Sample Datasets/Coverages

Please Visit IRI Data Library: IRI ontology work: Or contact: Benno Blumenthal John del Corral Haibo Liu