PermaSense Data Management Jan Beutel, Mustafa Yuecel, Roman Lim, Tonio Gsell, ETH Zurich.

Slides:



Advertisements
Similar presentations
KANSEI TESTBED OHIO STATE UNIVERSITY. HETEREGENOUS TESTBED Multiple communication networks, computation platforms, multi-modal sensors/actuators, and.
Advertisements

Possibility in Digital Collection Management Introduction to CONTENTdm TM Hitoshi Kamada University of Arizona Presentation for OCLC-CJK Users Group Annual.
Future Directions and Initiatives in the Use of Remote Sensing for Water Quality.
Roman Kvasov. Polar - Cartesian conversions Polar - Cartesian image processing.
Eye on Earth Mashup example. Create and share maps Add map layers from different sources ‘mashed’ into one map Translate complex scientific data into.
GSN Related Developments Jan Beutel, Tonio Gsell, Roman Lim, Mustapha Yuecel, Christoph Walser, Matthias Keller, Bernhard Buchli, Josua Hunziker, Felix.
NetworkedPlanet Networked Information – Networked Knowledge Topic Maps & Web 3.0 © 2007 Networked Planet Limited. Web 3.0 Technology Platform to enable.
Zero-programming Sensor Network Deployment 學生:張中禹 指導教授:溫志煜老師 日期: 5/7.
Swiss Experiment EPFL-LSIR Report Hoyoung Jeung SwissEx Annual Meeting, Zurich 15 th June.
LSIR Developments for SiwssEx Hoyoung Jeung EPFL-LSIR SwissEx Annual Meeting, Zurich 15 th July.
Generic Sensor Platform for Networked Sensors Haywood Ho.
25 April Securing Wireless Sensor Networks Cheyenne Hollow Horn SFS Presentation 2005.
CS 441: Charles Durran Kelly.  What are Wireless Sensor Networks?  WSN Challenges  What is a Smartphone Sensor Network?  Why use such a network? 
Tools for Publishing Environmental Observations on the Internet Justin Berger, Undergraduate Researcher Jeff Horsburgh, Faculty Mentor David Tarboton,
Distributed Data Analysis & Dissemination System (D-DADS) Prepared by Stefan Falke Rudolf Husar Bret Schichtel June 2000.
Robots at Work Dr Gerard McKee Active Robotics Laboratory School of Systems Engineering The University of Reading, UK
Digital Object: A Virtual Online Storage Solution 598C Course Project Huajing Li.
Data Communications and Networks
February Semantion Privately owned, founded in 2000 First commercial implementation of OASIS ebXML Registry and Repository.
SERNEC Image/Metadata Database Goals and Components Steve Baskauf
Windows Internet Connection Sharing Dave Eitelbach Program Manager Networking And Communications Microsoft Corporation.
Site-Specific Management Factors influencing plant growth Water Light Temperature Soil Compaction Drainage.
8/98 1 A Two-Tier Model for Internet Resource Management Lixia Zhang UCLA IETF RSVP WG August 26, 1998.
An approach to Intelligent Information Fusion in Sensor Saturated Urban Environments Charalampos Doulaverakis Centre for Research and Technology Hellas.
DESIGN & IMPLEMENTATION OF SMALL SCALE WIRELESS SENSOR NETWORK
Swiss Experiment Progress Report 2011 ETHZ/TIK
PermaDAQ A Scientific Instrument for Precision Sensing and Data Recovery in Environmental Extremes Jan Beutel, Stephan Gruber †, Andreas Hasler †, Roman.
Updates from EOSDIS -- as they relate to LANCE Kevin Murphy LANCE UWG, 23rd September
 Copyright 2006 Digital Enterprise Research Institute. All rights reserved. Large-Scale Sensor Networks Prof. Manfred Hauswirth (joint work.
Summary - Part 3 - Objectives The purpose of this basic IP technology training is to explain video over IP network. This training describes how video can.
NEPTUNE Canada Workshop Oceans 2.0 Project Environment NEPTUNE Canada DMAS Team Victoria, BC February 16, 2009.
C2-SENSE WP 3 / Task 3.5 (AIT) Bojan Božić, Gerald Schimak, Refiz Duro C2-SENSE WP3 Meeting Paris
Module 4: Fundamentals of Communication Technologies.
The ICDP Information Network Telework and Information Management in Scientific Drilling Projects Jens Klump and Ronald Conze GeoForschungsZentrum Potsdam.
D EPT. OF I NFO. & C OMM., KJIST Access Grid with High Quality DV Video JongWon Kim, Ph.D. 17 th APAN Meeting /JointTech WS Jan. 29 th, 2004 Networked.
PermaSense III Sensor Networks in Extreme Environments Jan Beutel, Stephan Gruber, Christian Tschudin, Lothar Thiele.
Samad Paydar Web Technology Lab. Ferdowsi University of Mashhad 10 th August 2011.
Issues in (Financial) High Performance Computing John Darlington Director Imperial College Internet Centre Fast Financial Algorithms and Computing 4th.
 Copyright 2006 Digital Enterprise Research Institute. All rights reserved. Global Sensor Networks Manfred Hauswirth (joint work with Karl.
Computer Engineering and Networks Technische Informatik und Kommunikationsnetze PermaSense Sensing in Disruptive Environments Jan Beutel.
B3AS Joseph Lewthwaite 1 Dec, 2005 ARL Knowledge Fusion COE Program.
Distributed Computing Environment (DCE) Presenter: Zaobo He Instructor: Professor Zhang Advanced Operating System Advanced Operating System.
Future PermaSense Challenges – Technology Jan Beutel.
PermaSense III Sensor Networks in Extreme Environments Jan Beutel, Stephan Gruber, Christian Tschudin, Lothar Thiele.
PermaSense SwissEx Integration Project Status and Future Workplan Jan Beutel, Lothar Thiele, ETH Zurich Stephan Gruber, Uni Zurich.
Information Management Jornada Basin LTER. Jornada Information management system Six major components: a)Data management implementation/process b)Management.
A. Hangan, L. Vacariu, O. Cret, H. Hedesiu Technical University of Cluj-Napoca A Prototype for the Remote Monitoring of Water Parameters.
Powered by Microsoft Azure, PointMatter Is a Flexible Solution to Move and Share Data between Business Groups and IT MICROSOFT AZURE ISV PROFILE: LOGICMATTER.
Distributed Data Analysis & Dissemination System (D-DADS ) Special Interest Group on Data Integration June 2000.
Internet of Things. IoT Novel paradigm – Rapidly gaining ground in the wireless scenario Basic idea – Pervasive presence around us a variety of things.
1 Order Reconstruction and Data Integrity Testing of Sensor Network Data Matthias Keller, ETH Zürich MICS Workshop,
The PermaSense Project Wireless Sensor Technology for Extreme Environments Jan Beutel, Mustafa Yuecel, Roman Lim, Tonio Gsell, ETH Zurich.
T-T-2 Testing Tinyos-2.x Jan Beutel, ETH Zurich With the help of Roman Lim, Mustafa Yuecel, Matthias Woehrle, the T2-core and testbed WG’s and many others…
Communication for the Wearable Platform Jan Beutel Computer Engineering and Networks Lab Swiss Federal Institute of Technology (ETH) Zurich October 19,
Steps to integrate XML How does XML processing work? Simple uses of passive DOM objects Adding behaviour to information A converter and translator subsystem.
Site Visit 2008 PERMASENSE Geo-science and engineering functioning together Stephan Gruber, Jan Beutel, Andreas Hasler, Igor Talzi, Christian Plessl, Mustafa.
Computer Engineering and Networks Lab, ETH Zurich Geography Department, University of Zurich Department of Computer Science, University of Basel The PermaSense.
Computer Engineering and Networks Technische Informatik und Kommunikationsnetze Networked Embedded Systems Term and Master Thesis Topics 2012 Jan Beutel.
Sensor Network Platform Kit (SNPK) Overview and Applications Jan Beutel, ETH Zurich with Roman Lim, Mustafa Yücel and the MICS team.
Sensor Network Platform Kit (SNPK) Jan Beutel, ETH Zurich with Roman Lim, Mustafa Yücel and the MICS team.
1 Mind Mapping. 2 A Pictorial representation of an idea, a concept or a topic. Mind mapping helps to: o Provide an overview of a topic and its complex.
Remote / Conferencing Tools – ILP Training. CONFIDENTIAL Virtual Meeting Audio Conferencing Web Conferencing Video Conferencing Virtual meetings use advanced.
Cyberinfrastructure Overview of Demos Townsville, AU 28 – 31 March 2006 CREON/GLEON.
Source : 2014 IEEE Ninth International Conference on Intelligent Sensors, Sensor Networks and Information Processing (ISSNIP) Auther : Nacer Khalil, Mohamed.
CloudMAC: Moving MAC frames processing of the Sink to Cloud.
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Nagios Grid Monitor E. Imamagic, SRCE OAT.
Staying afloat in the sensor data deluge
Sensor Networks – Motes, Smart Spaces, and Beyond
Geoinformation support for exploratory teams
Closing Remarks.
Presentation transcript:

PermaSense Data Management Jan Beutel, Mustafa Yuecel, Roman Lim, Tonio Gsell, ETH Zurich

What we have today: PermaSense Starting Points

Low-power Wireless Sensors Static, low-rate sensing (2 min) Temperatures, crack meters, resistivity 3 years operation < 0.1 Mbyte/node/day

Base Station for Data Collection

High Resolution Imaging – Mountainview Camera Dual network (TinyNode, WLAN) 12 Megapixel D-SLR imager Calibrated optics Remotely configurable ~ 1 Gbyte/camera/day

Long-haul Communication 7.5 km from weather radar on Klein Matterhorn Leased fiber/DSL from Zermatt Bergbahnen AG Collaboration with APUNCH/CCES

Data Backend Integration and Tools Based on GSN (EPFL research project) Collaboration with SwissEx/EPFL Slowly gaining in-house knowledge Limited visualization capabilities Many different other components necessary for 24/7 operation and debugging

The Big Picture – Network System Integration

Data Management Tools and Dataflow

Data Management – Online Semantic Data Global Sensor Network (GSN) –Data streaming framework from EPFL –Organized in “virtual sensors”, i.e. data types/semantics –Hierarchies and concatenation of virtual sensors enable on-line processing –Translates data from machine representation to SI values –Adds metadata PrivatePublic Metadata ============== Position Sensor type … Import from field GSN Web export

Multi-site, Multi-station Data Integration

TinyOS Multiplexing Data Flow

Example: Sensor Network and Backlog/CoreStation

Example: Private GSN Data Intake

Example: Public GSN Data Mapping and Conversion

Sensor Type Mapping

Sensor Node DAQ Routines

Simple - One Sensor Type - One Usage - One Packet

Harder - Two Packets, Multiple Sensor Types

Complex - Multiple Configs, Reuse of MUX resource

Position/Type Mapping: XYZ_nodepositions.xls

Open Problems

Open Problems - Random Order Merging of multi-packet data (ADCMUX1/2) Multi-sink deployments –Upstream/downstream data (protocol and control issue) Multi-core station integration (proposal) Visualization Integration of further processing steps Documentation …