TRAMM HYDROSYS SENSORSCOPE GSN SENSORMAP BIGLINK RECORD APUNCH EXTREMES MOUNTLAND COGEAR HYDROMON PERMASENSE Swiss Experiment Interdisciplinary Environmental Research Nicholas Dawes, Ashwin Kumar, Sebastian Michel, Karl Aberer, Michael Lehning Ecole Polytechnique Fédérale de Lausanne, Switzerland Swiss Federal Institute for Snow and Avalanche Research (SLF), Davos, Switzerland

TRAMM HYDROSYS SENSORSCOPE GSN SENSORMAP BIGLINK RECORD APUNCH EXTREMES MOUNTLAND COGEAR HYDROMON PERMASENSE Swiss Experiment Interdisciplinary Environmental Research Outline Introduction to Swiss Experiment (SwissEx) Problem Statement and Motivation The SwissEx Wiki SwissEx Infrastructure (Data) Semantic Forms Querying Metadata Conclusion and Future Work

TRAMM HYDROSYS SENSORSCOPE GSN SENSORMAP BIGLINK RECORD APUNCH EXTREMES MOUNTLAND COGEAR HYDROMON PERMASENSE Swiss Experiment Interdisciplinary Environmental Research Swiss Experiment Interdisciplinary Environmental Research Swiss Experiment (SwissEx Aims): Provision of a generic infrastructure of: web based technologies wireless communications low cost high density sensors to serve the environmental science community, encourage collaboration and provide a portal for public information on environmental research Climate change forecasts show the greatest impact in high alpine scenarios. These changes are already being observed and answers to environmental questions need to be found quickly. The Swiss Experiment infrastructure aims to speed up that process

TRAMM HYDROSYS SENSORSCOPE GSN SENSORMAP BIGLINK RECORD APUNCH EXTREMES MOUNTLAND COGEAR HYDROMON PERMASENSE Swiss Experiment Interdisciplinary Environmental Research SwissEx Infrastructure Black boxes indicate widespread research areas with multiple experiments within SwissEx infrastucture is built to serve many environmental research projects Where experimental areas overlap, projects can work more efficiently by sharing data Projects can benefit from external data sources

TRAMM HYDROSYS SENSORSCOPE GSN SENSORMAP BIGLINK RECORD APUNCH EXTREMES MOUNTLAND COGEAR HYDROMON PERMASENSE Swiss Experiment Interdisciplinary Environmental Research Requirement for Metadata Temperatures from Wannengrat, Davos 22/01/07 – 28/01/07 Seem legitimate for 2400m altitude in winter?

TRAMM HYDROSYS SENSORSCOPE GSN SENSORMAP BIGLINK RECORD APUNCH EXTREMES MOUNTLAND COGEAR HYDROMON PERMASENSE Swiss Experiment Interdisciplinary Environmental Research Requirement for Metadata Temperature/Humidity sensor 25/01/07 Sensor opening covered in reim The data from this sensor during the preceding period is unusable, but indistinguishable from the data after this photo was taken. …….never trust somebody elses data without the associated metadata

TRAMM HYDROSYS SENSORSCOPE GSN SENSORMAP BIGLINK RECORD APUNCH EXTREMES MOUNTLAND COGEAR HYDROMON PERMASENSE Swiss Experiment Interdisciplinary Environmental Research The SwissEx Wiki Information, Data Portal and Metadata Database Interface Central to the functioning of the project Incorporates SensorMap and GSN access: If you can access the data, this is the place to have the metadata access MediaWiki uses RDF format to store semantics RDF enables structure to be added to a mass of web based data

TRAMM HYDROSYS SENSORSCOPE GSN SENSORMAP BIGLINK RECORD APUNCH EXTREMES MOUNTLAND COGEAR HYDROMON PERMASENSE Swiss Experiment Interdisciplinary Environmental Research SwissEx Infrastructure

TRAMM HYDROSYS SENSORSCOPE GSN SENSORMAP BIGLINK RECORD APUNCH EXTREMES MOUNTLAND COGEAR HYDROMON PERMASENSE Swiss Experiment Interdisciplinary Environmental Research SwissEx Metadata Data provided by the sensor Streaming data stored using GSN, manually sampled data storage tbc Sensor data Background information on the experiment, the overall structure and the phenomena which the sensor network is there to measure, which must be stored once Stored in the wiki Experiment centric static information Background information such as the type and location of each sensor, which must be stored once Stored in the wiki (using semantics) Sensor centric static information Information on the servicability of the sensor i.e. whether it is deployed, stored, broken etc. Stored in the wiki (using semantics) Dynamic sensor information A measure of the quality of the data which requires a continuous variable To be calculated and stored using GSN Dynamic data quality information

TRAMM HYDROSYS SENSORSCOPE GSN SENSORMAP BIGLINK RECORD APUNCH EXTREMES MOUNTLAND COGEAR HYDROMON PERMASENSE Swiss Experiment Interdisciplinary Environmental Research Observation with station no. The Metadata Model The metadata model: Invalid data registration Observation Invalid data registration Observation Observation with station no. Can also be viewed as: Parameter

TRAMM HYDROSYS SENSORSCOPE GSN SENSORMAP BIGLINK RECORD APUNCH EXTREMES MOUNTLAND COGEAR HYDROMON PERMASENSE Swiss Experiment Interdisciplinary Environmental Research Label Model entities Semantic Annotations A Station Station name, General information, Geographical coordinate B Action Station name, Parameter, Observation/Invalid data, Start data, End date C Sensor Sensor Serial no, Model no D Model Model no, Manufacturer, Measured quantities, Units E Parameter Parameter name, Station name, Sensor serial no, Measured quantity, Units, Sampling frequency, Measurement accuracy Semantic Annotations

TRAMM HYDROSYS SENSORSCOPE GSN SENSORMAP BIGLINK RECORD APUNCH EXTREMES MOUNTLAND COGEAR HYDROMON PERMASENSE Swiss Experiment Interdisciplinary Environmental Research Semantic Forms Metadata Database Interface We can use semantic wiki language to store data in the background as RDF Semantic wiki language is complicated, not what scientists need to deal with when they come back from the field Semantic Forms take away this complexity at the expense of flexibility - a well designed system can simplify data entry

TRAMM HYDROSYS SENSORSCOPE GSN SENSORMAP BIGLINK RECORD APUNCH EXTREMES MOUNTLAND COGEAR HYDROMON PERMASENSE Swiss Experiment Interdisciplinary Environmental Research Use of forms in entering semantics

TRAMM HYDROSYS SENSORSCOPE GSN SENSORMAP BIGLINK RECORD APUNCH EXTREMES MOUNTLAND COGEAR HYDROMON PERMASENSE Swiss Experiment Interdisciplinary Environmental Research Station (Model Entity A) General info on the station/vs Addition of observations to the data or station/vs and notation of invalid data periods Parameters All possible sensor models List of assigned sensors Observations pertianing to the overall station

TRAMM HYDROSYS SENSORSCOPE GSN SENSORMAP BIGLINK RECORD APUNCH EXTREMES MOUNTLAND COGEAR HYDROMON PERMASENSE Swiss Experiment Interdisciplinary Environmental Research Action (Model Entity B) Observation or invalid data between 2 dates

TRAMM HYDROSYS SENSORSCOPE GSN SENSORMAP BIGLINK RECORD APUNCH EXTREMES MOUNTLAND COGEAR HYDROMON PERMASENSE Swiss Experiment Interdisciplinary Environmental Research Associated parameter names Sensor (Model Entity C) Association between parameter name and model

TRAMM HYDROSYS SENSORSCOPE GSN SENSORMAP BIGLINK RECORD APUNCH EXTREMES MOUNTLAND COGEAR HYDROMON PERMASENSE Swiss Experiment Interdisciplinary Environmental Research Model information Sensor Model (Model Entity D) Association sensor instances (serial numbers)

TRAMM HYDROSYS SENSORSCOPE GSN SENSORMAP BIGLINK RECORD APUNCH EXTREMES MOUNTLAND COGEAR HYDROMON PERMASENSE Swiss Experiment Interdisciplinary Environmental Research Parameter (Virtual Sensor) (Model Entity E) Parameter information Registered invalid data periods and observations Dependencies

TRAMM HYDROSYS SENSORSCOPE GSN SENSORMAP BIGLINK RECORD APUNCH EXTREMES MOUNTLAND COGEAR HYDROMON PERMASENSE Swiss Experiment Interdisciplinary Environmental Research How do we make the tables? Semantic Queries {{#ask:[[station name::{{{stationname}}}]] [[Sensor serialno::+]]|?Sensor serialno|?Action|?Action at|format=table}} Standard Wiki query SPARQL query PREFIX a: SELECT DISTINCT ?smodel WHERE {?page a:Property:Sensor_model?smodel} Query languages for RDF databases:

TRAMM HYDROSYS SENSORSCOPE GSN SENSORMAP BIGLINK RECORD APUNCH EXTREMES MOUNTLAND COGEAR HYDROMON PERMASENSE Swiss Experiment Interdisciplinary Environmental Research Semantic Queries BUT…. SPARQL can query multiple sources PREFIX a: PREFIX b: SELECT ?smodel FROM NAMED WHERE { GRAPH { ?x a:Property:Sensor_model ?smodel. }. GRAPH { ?y b:Property:Sensor_model ?smodel. }. } So metadata from A,B,C,D and E can be queried simultaneously SPARQL also gives us the possibility to query across metadata from different experiments……so we have the possibility of querying the data based on its metadata

TRAMM HYDROSYS SENSORSCOPE GSN SENSORMAP BIGLINK RECORD APUNCH EXTREMES MOUNTLAND COGEAR HYDROMON PERMASENSE Swiss Experiment Interdisciplinary Environmental Research Metadata Export using SPARQL SPARQL is already used to query the wiki and import metadata to SensorMap

TRAMM HYDROSYS SENSORSCOPE GSN SENSORMAP BIGLINK RECORD APUNCH EXTREMES MOUNTLAND COGEAR HYDROMON PERMASENSE Swiss Experiment Interdisciplinary Environmental Research Can I use the wiki as a front end for any database? Importing to the Wiki from a relational database: Using R2D2 ( SPARQL queries can be translated to SQL for querying a relational database. The result is translated back to RDF format using the same tool. The RDF files can be imported to a wiki page. Why is this interesting? If there are external data sources with metadata, we can query it and give the results in the same place as the rest of the data Exporting to a relational database from the wiki: A script should be written to perform the relevant SPARQL query and wrap the result into a SQL query.

TRAMM HYDROSYS SENSORSCOPE GSN SENSORMAP BIGLINK RECORD APUNCH EXTREMES MOUNTLAND COGEAR HYDROMON PERMASENSE Swiss Experiment Interdisciplinary Environmental Research Conclusion Framework for Metadata capturing Integrated in a Wiki Intuitive to use Provide query interface to applications Support for import/export to relational DBs

TRAMM HYDROSYS SENSORSCOPE GSN SENSORMAP BIGLINK RECORD APUNCH EXTREMES MOUNTLAND COGEAR HYDROMON PERMASENSE Swiss Experiment Interdisciplinary Environmental Research Questions