The Design of an Acquisitional Query Processor For Sensor Networks

Slides:



Advertisements
Similar presentations
Analysis of : Operator Scheduling in a Data Stream Manager CS561 – Advanced Database Systems By Eric Bloom.
Advertisements

Berkeley dsn declarative sensor networks problem David Chu, Lucian Popa, Arsalan Tavakoli, Joe Hellerstein approach related dsn architecture status  B.
Energy-Efficient Computing for Wildlife Tracking: Design Tradeoffs and Early Experiences with ZebraNet Presented by Eric Arnaud Makita
한국기술교육대학교 컴퓨터 공학 김홍연 TinyDB : An Acquisitional Query Processing System for Sensor Networks. - Samuel R. Madden, Michael J. Franklin, Joseph M. Hellerstein,
Towards a Sensor Network Architecture: Lowering the Waistline Culler et.al. UCB.
1 Sensor Network Databases Ref: Wireless sensor networks---An information processing approach Feng Zhao and Leonidas Guibas (chapter 6)
Fjording the Stream: An Architecture for Queries over Streaming Sensor Data Samuel Madden, Michael J. Franklin University of California, Berkeley Proceedings.
1 Supporting Aggregate Queries Over Ad-Hoc Wireless Sensor Networks Samuel Madden UC Berkeley With Robert Szewczyk, Michael Franklin, and David Culler.
The Cougar Approach to In-Network Query Processing in Sensor Networks By Yong Yao and Johannes Gehrke Cornell University Presented by Penelope Brooks.
Dissemination protocols for large sensor networks Fan Ye, Haiyun Luo, Songwu Lu and Lixia Zhang Department of Computer Science UCLA Chien Kang Wu.
Adaptive Sampling in Distributed Streaming Environment Ankur Jain 2/4/03.
Sensor Database: Querying Sensor Networks Yinghua Wu, Haiyong Xie.
A Survey of Wireless Sensor Network Data Collection Schemes by Brett Wilson.
Approximate data collection in sensor networks the appeal of probabilistic models David Chu Amol Deshpande Joe Hellerstein Wei Hong ICDE 2006 Atlanta,
1 Acquisitional Query Processing in TinyDB Sam Madden UC Berkeley NEST Winter Retreat 2003.
The Design of an Acquisitional Query Processor For Sensor Networks Samuel Madden, Michael J. Franklin, Joseph M. Hellerstein, and Wei Hong Presentation.
Model-driven Data Acquisition in Sensor Networks Amol Deshpande 1,4 Carlos Guestrin 4,2 Sam Madden 4,3 Joe Hellerstein 1,4 Wei Hong 4 1 UC Berkeley 2 Carnegie.
Data Management for Sensor Networks Zachary G. Ives University of Pennsylvania CIS 650 – Database & Information Systems April 4, 2005.
Top-k Monitoring in Wireless Sensor Networks Minji Wu, Jianliang Xu, Xueyan Tang, and Wang-Chien Lee IEEE TRANSACTIONS ON KNOWLEDGE AND DATA ENGINEERING,
TAG: A TINY AGGREGATION SERVICE FOR AD-HOC SENSOR NETWORKS Presented by Akash Kapoor SAMUEL MADDEN, MICHAEL J. FRANKLIN, JOSEPH HELLERSTEIN, AND WEI HONG.
TAG: a Tiny Aggregation Service for Ad-Hoc Sensor Networks Paper By : Samuel Madden, Michael J. Franklin, Joseph Hellerstein, and Wei Hong Instructor :
Optimizing Queries and Diverse Data Sources Laura M. Hass Donald Kossman Edward L. Wimmers Jun Yang Presented By Siddhartha Dasari.
INF5100 Autumn 2007 © Ellen Munthe-Kaas and Jarle Søberg 1 Data Management in Sensor Networks Ellen Munthe-Kaas Jarle Søberg.
Context Tailoring the DBMS –To support particular applications Beyond alphanumerical data Beyond retrieve + process –To support particular hardware New.
The Design of an Acquisitional Query Processor For Sensor Networks Samuel Madden, Michael J. Franklin, Joseph M. Hellerstein, and Wei Hong.
March 6th, 2008Andrew Ofstad ECE 256, Spring 2008 TAG: a Tiny Aggregation Service for Ad-Hoc Sensor Networks Samuel Madden, Michael J. Franklin, Joseph.
1 Pradeep Kumar Gunda (Thanks to Jigar Doshi and Shivnath Babu for some slides) TAG: a Tiny Aggregation Service for Ad-Hoc Sensor Networks Samuel Madden,
TAG: a Tiny Aggregation Service for Ad-Hoc Sensor Networks Authors: Samuel Madden, Michael Franklin, Joseph Hellerstein Presented by: Vikas Motwani CSE.
1 TAG: A Tiny Aggregation Service for Ad-Hoc Sensor Networks Samuel Madden UC Berkeley with Michael Franklin, Joseph Hellerstein, and Wei Hong December.
INT 598 Data Management for Sensor Networks Silvia Nittel Spatial Information Science & Engineering University of Maine Fall 2006.
The Design of an Acquisitional Query Processor for Sensor Networks CS851 Presentation 2005 Presented by: Gang Zhou University of Virginia.
Wireless Sensor Networks In-Network Relational Databases Jocelyn Botello.
CS542 Seminar – Sensor OS A Virtual Machine For Sensor Networks Oct. 28, 2009 Seok Kim Eugene Seo R. Muller, G. Alonso, and D. Kossmann.
1 Fjording The Stream An Architecture for Queries over Streaming Sensor Data Samuel Madden, Michael Franklin UC Berkeley.
한국기술교육대학교 컴퓨터 공학 김홍연 Habitat Monitoring with Sensor Networks DKE.
Multi-Criteria Routing in Pervasive Environment with Sensors Santhanakrishnan, G., Li, Q., Beaver, J., Chrysanthis, P.K., Amer, A. and Labrinidis, A Department.
REED: Robust, Efficient Filtering and Event Detection in Sensor Networks Daniel Abadi, Samuel Madden, Wolfgang Lindner MIT United States VLDB 2005.
1 REED: Robust, Efficient Filtering and Event Detection in Sensor Networks Daniel Abadi, Samuel Madden, Wolfgang Lindner MIT United States VLDB 2005.
DATA AGGREGATION Siddhartha Sarkar Roll no: CSE-4 th Year-7 th semester Sensor Networks (CS 704D) Assignment.
Workshop on Sensor Fusion/Data Integration for CBR Defense Salt Lake City, Utah September 2003 Atmospheric Modeling, Data Assimilation, and Sensor.
Data Collection and Dissemination. Learning Objectives Understand Trickle – an data dissemination protocol for WSNs Understand data collection protocols.
Energy-Efficient Wake-Up Scheduling for Data Collection and Aggregation Yanwei Wu, Member, IEEE, Xiang-Yang Li, Senior Member, IEEE, YunHao Liu, Senior.
By: Gang Zhou Computer Science Department University of Virginia 1 Medians and Beyond: New Aggregation Techniques for Sensor Networks CS851 Seminar Presentation.
Aggregation and Secure Aggregation. Learning Objectives Understand why we need aggregation in WSNs Understand aggregation protocols in WSNs Understand.
W. Hong & S. Madden – Implementation and Research Issues in Query Processing for Wireless Sensor Networks, ICDE 2004.
In-Network Query Processing on Heterogeneous Hardware Martin Lukac*†, Harkirat Singh*, Mark Yarvis*, Nithya Ramanathan*† *Intel.
TreeCast: A Stateless Addressing and Routing Architecture for Sensor Networks Santashil PalChaudhuri, Shu Du, Ami K. Saha, and David B. Johnson Department.
Review Lecture DB A/18-849B/95-811A/19-729A Internet-Scale Sensor Systems: Design and Policy Review Lecture Databases Phil Gibbons May 1, 2003.
REED : Robust, Efficient Filtering and Event Detection in Sensor Network Daniel J. Abadi, Samuel Madden, Wolfgang Lindner Proceedings of the 31st VLDB.
INF5100 Autumn 2008 © Ellen Munthe-Kaas and Jarle Søberg 1 Data Management in Sensor Networks Ellen Munthe-Kaas Jarle Søberg.
Aggregation and Secure Aggregation. [Aggre_1] Section 12 Why do we need Aggregation? Sensor networks – Event-based Systems Example Query: –What is the.
Sep Multiple Query Optimization for Wireless Sensor Networks Shili Xiang Hock Beng Lim Kian-Lee Tan (ICDE 2007) Presented by Shan Bai.
Lecture A/18-849B/95-811A/19-729A Internet-Scale Sensor Systems: Design and Policy Lecture 15 Sensor Databases & Data Stream Systems Phil Gibbons.
Building Wireless Efficient Sensor Networks with Low-Level Naming J. Heihmann, F.Silva, C. Intanagonwiwat, R.Govindan, D. Estrin, D. Ganesan Presentation.
The Design of an Acquisitional Query Processor For Sensor Networks Samuel Madden, Michael J. Franklin, Joseph M. Hellerstein, and Wei Hong Presentation.
STREAMS & SENSOR NETWORKS “ Query Processing in Sensor Networks ”
Tiny Aggregation ©Thomas Haenselmann – Department of Computer Science IV – University of Mannheim^ Lecture on Sensor Networks Historical Development time.
Data Query in Sensor Networks Carmelissa Valera Jason Torre Carmelissa Valera Jason Torre.
TAG: a Tiny AGgregation service for ad-hoc sensor networks Authors: Samuel Madden, Michael J. Franklin, Joseph M. Hellerstein, Wei Hong Presenter: Mingwei.
Introduction to Wireless Sensor Networks
Querying Sensor Networks
Distributed database approach,
ABSTRACT   Recent work has shown that sink mobility along a constrained path can improve the energy efficiency in wireless sensor networks. Due to the.
MANAGING DATA RESOURCES
Database.
Distributing Queries Over Low Power Sensor Networks
REED : Robust, Efficient Filtering and Event Detection
Aggregation.
Query Processing.
The Gamma Database Machine Project
Presentation transcript:

The Design of an Acquisitional Query Processor For Sensor Networks Samuel Madden, Michael J. Franklin, Joseph M. Hellerstein, and Wei Hong Presentated By Muhammed Z. Miah May 02, 2006

Goals Provide a query processor for data collection in sensor networks Use acquisitional techniques to reduce power consumption compared to traditional passive systems 05/02/2006

Acquisitional Issues What is meant by acquisitional techniques? Where, when, and how often data is physically acquired (sampled) and delivered to query processing operators 05/02/2006

Four ACQP-related questions When should samples for a particular query be taken? What sensors nodes have relevant data to a particular query? In what order should samples for this query be taken, and how should sampling be interleaved with other operations? Is it worth expending computational power or bandwidth to process and relay a particular sample? 05/02/2006

Basic Architecture 05/02/2006

Query Flow Queries are submitted at a powered PC (base station) Parsed, optimized and then sent into the sensor network, where they are disseminated and processed, With results following back up the routing tree was formed as the query propagated 05/02/2006

Data Model Sensors Table – one row/node per instant in time Records in these table are materialized (acquired) only as needed to satisfy the query, and are stored only for a short period of time or delivered directly out of the network Projections and/or transformations of tuples from sensors table may be stored in materialized points Missing sensor produce NULLs NULLs are filtered out in WHERE clause Reading from sensors table of each node must be collected at some common node 05/02/2006

Acquisitional Query Language SQL-like queries in the form of SELECT-FROM-WHERE Support for selection, join, projection, and aggregation Also support for sampling, windowing, and sub-queries Not mentioned is the ability to log data and actuate physical hardware 05/02/2006

Acquisitional Query Language Example: SELECT nodeid, light, temp FROM sensors SAMPLE INTERVAL 1s FOR 10s Once per second for 10 seconds 05/02/2006

Queries as a Stream Sensors table is (conceptually) an unbounded, continuous data stream Operations such as sort and symmetric join are not allowed on streams They are allowed on bounded subsets of the stream (windows) 05/02/2006

Windows Windows in TinyDB are fixed-size materialization points over the sensor streams Materialization points accumulate a small buffer of data that may be used in other queries Example CREATE STORAGE POINT recentlight SIZE 8 AS (SELECT nodeid, light FROM sensors SAMPLE INTERVAL 10s) SELECT COUNT(*) FROM sensors AS s, recentlight AS r1 WHERE r.nodeid = s.nodeid AND s.light < r1.light SAMPLE INTERVAL 10s 05/02/2006

Temporal Aggregation In addition to aggregation over values, also supports temporal aggregation Example SELECT WINAVG(volume, 30s, 5s) FROM sensors SAMPLE INTERVAL 1s Average volume over last 30 secs once every 5 secs (6 readings), sampling once per sec 05/02/2006

Event-Based Queries An alternative to continuous polling for data Example ON EVENT bird-detector(loc): SELECT AVG(light), AVG(temp), event.loc FROM sensors AS s WHERE dist(s.loc, event.loc) < 10m SAMPLE INTERVAL 2s FOR 30s 05/02/2006

Lifetime-Based Queries Example SELECT nodeid, accel FROM sensors LIFETIME 30 days Nodes perform cost-based analysis in order to determine data rate Nodes must transmit at the root’s rate or at an integral divisor of it 05/02/2006

Power-Based Optimization Queries optimized by base station before dissemination Cost-based optimization to yield lowest overall power consumption Cost dominated by sampling and transmitting Optimizer focuses on ordering joins, selections, and sampling on individual nodes 05/02/2006

Metadata Each node contains metadata about its attributes Nodes periodically send metadata to root Metadata also contains information about aggregate functions Information about cost, time to fetch, and range is used in query optimization 05/02/2006

Dissemination and Routing Build semantic routing tree (SRT) SRT nodes choose parents based on semantic properties as well as link quality Parent nodes keep track of the ranges of values for children 05/02/2006

Evaluation of SRT SRT are limited to constant attributes Even so, maintenance is required Possible to use for non-constant attributes but cost can be prohibitive Can reduce no. of nodes that must disseminate queries for highly correlated attributes in routing tree 05/02/2006

Query Execution First nodes sleep, then they wake, sample sensors and apply operators to generated locally and received from neighbors, and then delivers results to their parents Aggregate data that is sent back to the root Prioritize data that needs to be sent Naïve – FIFO and tuples dropped if do not fit in queue Winavg – Two results at the head of queue are averaged Delta – Send result with most change 05/02/2006

Conclusion TinyDB provides a simple yet powerful interface to sensor networks TinyDB takes measures to conserve power at all phases of query processing 05/02/2006

THANK YOU 05/02/2006