MINT Views: Materialized In-Network Top-k Views in Sensor Networks Demetrios Zeinalipour-Yazti (Uni. of Cyprus) Panayiotis Andreou (Uni. of Cyprus) Panos.

Slides:



Advertisements
Similar presentations
1 Top-K Algorithms: Concepts and Applications by Demetris Zeinalipour Visiting Lecturer Department of Computer Science University of Cyprus Department.
Advertisements

Aggregate Query Processing in Cache- Aware Wireless Sensor Networks Khaled Ammar University of Alberta.
Towards a Network-aware Middleware for Wireless Sensor Networks University of Cyprus Department of Computer Science Panayiotis G. Andreou, Demetrios Zeinalipour-Yazti,
A Generic Framework for Handling Uncertain Data with Local Correlations Xiang Lian and Lei Chen Department of Computer Science and Engineering The Hong.
1 Introduction to Wireless Sensor Networks. 2 Learning Objectives Understand the basics of Wireless Sensor Networks (WSNs) –Applications –Constraints.
1 Ranked Queries over sources with Boolean Query Interfaces without Ranking Support Vagelis Hristidis, Florida International University Yuheng Hu, Arizona.
A Survey of Wireless Sensor Network Data Collection Schemes by Brett Wilson.
Probabilistic Data Aggregation Ling Huang, Ben Zhao, Anthony Joseph Sahara Retreat January, 2004.
SIGMOD'061 Energy-Efficient Monitoring of Extreme Values in Sensor Networks Adam Silberstein Kamesh Munagala Jun Yang Duke University.
Perimeter-based Data Acquisition and Replication in Mobile Sensor Networks Panayiotis Andreou (Univ. of Cyprus) Demetrios Zeinalipour-Yazti (Univ. of Cyprus)
SenseSwarm: A Perimeter-based Data Acquisition Framework for Mobile Sensor Networks Demetrios Zeinalipour-Yazti (Open Univ. of Cyprus) Panayiotis Andreou.
1 Distributed Top-K Ranking Algorithms Demetris Zeinalipour Lecturer School of Pure and Applied Sciences Open University of Cyprus Monday, December 15.
1 Ranking Query Results in a Networked World Demetris Zeinalipour Lecturer Department of Computer Science University of Cyprus Thursday, July 23rd, 2010.
Mobile Agents in Wireless Sensor Networks Ivan Vukasinovic Zoran Babovic Goran Rakocevic.
Adaptive Stream Filters for Entity-based Queries with Non-value Tolerance VLDB 2005 Reynold Cheng (Speaker) Ben Kao, Alan Kwan Sunil Prabhakar, Yicheng.
Dagstuhl Seminar 10042, Demetris Zeinalipour, University of Cyprus, 26/1/ th IEEE International Conference on Mobile Data Management (MDM’11), June.
Panayiotis G. Andreou, George Constantinou, Demetrios Zeinalipour-Yazti, George Samaras Department of Computer Science, University of Cyprus Panayiotis.
On the Construction of Data Aggregation Tree with Minimum Energy Cost in Wireless Sensor Networks: NP-Completeness and Approximation Algorithms National.
Mehdi Kargar Aijun An York University, Toronto, Canada Keyword Search in Graphs: Finding r-cliques.
Ranking Queries on Uncertain Data: A Probabilistic Threshold Approach Wenjie Zhang, Xuemin Lin The University of New South Wales & NICTA Ming Hua,
Introduction to Wireless Sensor Networks
Demetris Zeinalipour MHS: Minimum-Hot-Spot Query Trees for Wireless Sensor Networks Georgios Chatzimilioudis University of California - Riverside, USA.
Workload-aware Optimization of Query Routing Trees in Wireless Sensor Networks Panayiotis Andreou (Univ. of Cyprus) Demetris Zeinalipour-Yazti (Open Univ.
Towards Robust Indexing for Ranked Queries Dong Xin, Chen Chen, Jiawei Han Department of Computer Science University of Illinois at Urbana-Champaign VLDB.
Sensor Database System Sultan Alhazmi
ETC: Energy-driven Tree Construction in Wireless Sensor Networks Panayiotis Andreou (Univ. of Cyprus) Andreas Pamboris (Univ. of California – San Diego)
Multi-Criteria Routing in Pervasive Environment with Sensors Santhanakrishnan, G., Li, Q., Beaver, J., Chrysanthis, P.K., Amer, A. and Labrinidis, A Department.
Computer Science and Engineering Efficiently Monitoring Top-k Pairs over Sliding Windows Presented By: Zhitao Shen 1 Joint work with Muhammad Aamir Cheema.
Mehdi Kargar Aijun An York University, Toronto, Canada Keyword Search in Graphs: Finding r-cliques.
1 Top-K Query Processing Techniques for Distributed Environments by Demetris Zeinalipour Visiting Lecturer Department of Computer Science University of.
Zone Sharing: A Hot-Spots Decomposition Scheme for Data-Centric Storage in Sensor Networks Mohamed Aly Nicholas Morsillo Panos K. Chrysanthis Kirk Pruhs.
1 REED: Robust, Efficient Filtering and Event Detection in Sensor Networks Daniel Abadi, Samuel Madden, Wolfgang Lindner MIT United States VLDB 2005.
Energy-Efficient Monitoring of Extreme Values in Sensor Networks Loo, Kin Kong 10 May, 2007.
Distributed Spatio-Temporal Similarity Search Demetrios Zeinalipour-Yazti University of Cyprus Song Lin
ResTAG: Resilient Event Detection with TinyDB Angelika Herbold -Western Washington University Thierry Lamarre -ENSEIRB Systems Software Laboratory, OGI.
MicroHash:An Efficient Index Structure for Flash-Based Sensor Devices Demetris Zeinalipour [ ] School of Pure and Applied Sciences.
Efficient Processing of Top-k Spatial Preference Queries
Spatio-temporal Pattern Queries M. Hadjieleftheriou G. Kollios P. Bakalov V. J. Tsotras.
Bounded relay hop mobile data gathering in wireless sensor networks
Energy conservation in Wireless Sensor Networks Sagnik Bhattacharya, Tarek Abdelzaher University of Virginia, Department of Computer Science School of.
Secure In-Network Aggregation for Wireless Sensor Networks
1 Ranking Query Results in a Networked World Demetris Zeinalipour Lecturer Department of Computer Science University of Cyprus Thursday, May 27th, 2010.
1 The Threshold Join Algorithm for Top-k Queries in Distributed Sensor Networks D. Zeinalipour-Yazti, Z. Vagena, D. Gunopulos, V. Kalogeraki, V. Tsotras.
Ching-Ju Lin Institute of Networking and Multimedia NTU
Web Service-Based Remote Monitoring System for Smart Home Space Sheng Cai Joshua Ferguson Xinhui Hu Wei Wu Project for CSE535 Mobile Computing.
By: Gang Zhou Computer Science Department University of Virginia 1 Medians and Beyond: New Aggregation Techniques for Sensor Networks CS851 Seminar Presentation.
Aggregation and Secure Aggregation. Learning Objectives Understand why we need aggregation in WSNs Understand aggregation protocols in WSNs Understand.
Introduction to Information Retrieval Introduction to Information Retrieval CS276 Information Retrieval and Web Search Chris Manning and Pandu Nayak Efficient.
W. Hong & S. Madden – Implementation and Research Issues in Query Processing for Wireless Sensor Networks, ICDE 2004.
1 CSIS 7101: CSIS 7101: Spatial Data (Part 1) The R*-tree : An Efficient and Robust Access Method for Points and Rectangles Rollo Chan Chu Chung Man Mak.
In-Network Query Processing on Heterogeneous Hardware Martin Lukac*†, Harkirat Singh*, Mark Yarvis*, Nithya Ramanathan*† *Intel.
FSort: External Sorting on Flash-based Sensor Devices Panayiotis Andreou, Orestis Spanos, Demetrios Zeinalipour-Yazti, George Samaras University of Cyprus,
FERMA: An Efficient Geocasting Protocol for Wireless Sensor Networks with Multiple Target Regions Young-Mi Song, Sung-Hee Lee and Young- Bae Ko Ajou University.
Introduction to Wireless Sensor Networks
EASE: An Energy-Efficient In-Network Storage Scheme for Object Tracking in Sensor Networks Jianliang Xu Department of Computer Science Hong Kong Baptist.
Aggregation and Secure Aggregation. [Aggre_1] Section 12 Why do we need Aggregation? Sensor networks – Event-based Systems Example Query: –What is the.
Sep Multiple Query Optimization for Wireless Sensor Networks Shili Xiang Hock Beng Lim Kian-Lee Tan (ICDE 2007) Presented by Shan Bai.
Top-k Queries in Wireless Sensor Networks Amber Faucett, Dr. Longzhuang Li, In today’s world, wireless.
The Design of an Acquisitional Query Processor For Sensor Networks Samuel Madden, Michael J. Franklin, Joseph M. Hellerstein, and Wei Hong Presentation.
1 An Overview of Distributed Top-K Ranking Algorithms 30-min presentation by Demetris Zeinalipour Lecturer School of Pure and Applied Sciences Open University.
Dense-Region Based Compact Data Cube
Demetrios Zeinalipour-Yazti (Univ. of Cyprus)
Introduction to Wireless Sensor Networks
Distributed database approach,
Infer: A Bayesian Inference Approach towards Energy Efficient Data Collection in Dense Sensor Networks. G. Hartl and B.Li In Proc. of ICDCS Natalia.
Spatio-temporal Pattern Queries
Aggregation.
D. ZeinalipourYazti, Z. Vagena, D. Gunopulos, V. Kalogeraki, V
Efficient Processing of Top-k Spatial Preference Queries
Presentation transcript:

MINT Views: Materialized In-Network Top-k Views in Sensor Networks Demetrios Zeinalipour-Yazti (Uni. of Cyprus) Panayiotis Andreou (Uni. of Cyprus) Panos Chrysanthis (Uni. of Pittsburgh, USA) George Samaras (Uni. of Cyprus) MDM 2007 © Zeinalipour-Yazti, Andreou, Chrysanthis, Samaras

2 Wireless Sensor Networks Resource constrained devices utilized for monitoring and understanding the physical world at a high fidelity. Applications have already emerged in: –Environmental and habitant monitoring –Seismic and Structural monitoring –Understanding Animal Migrations & Interactions between species. Great Duck Island – Maine (Temperature, Humidity etc). Golden Gate – SF, Vibration and Displacement of the bridge structure Zebranet (Kenya) GPS trajectory

3 Wireless Sensor Networks Distributed Sensing of the environment. Hierarchical Transfer of readings to the sink. Sink

4 Coarse Data Acquisition Available at: Drawback Retrieving every single reading  too coarse and too energy demanding Out-of-Network computation (at the sink) –No in-network Aggregation –No in-Network Filtering Example: Crossbow’s Moteview software

5 In-Network Computation Available at: Drawback The Answer set might be very large (e.g. temp>70) In-Network Aggregation In-Network Filtering (i.e., WHERE clause) Example: TinyDB: A Declarative Interface for Data Acquisition in Sensor Networks.

6 Top-K Queries Example: SELECT room, Avg(temp) FROM sensors GROUP BY room EPOCH DURATION 1 min Goal: Trade the number of answers with the execution cost, i.e., –Return less results (K<<n tuples) –Minimize retrieval cost (i.e., disk I/Os, network I/Os, CPU etc). TOP-K

7 Centralized Top-K Pruning Example: Four rooms {A,B,C,D}, 9 sensors {s1,…,s9} Query (Q): Find the room with the highest average temperature (TOP-1) Avg:74.5 Avg:41 Avg:64 S0 Avg:75 Answer C, 75F A, 74,5F D, 64F B, 41F Drawback: No energy savings!

8 Naïve In-Network Top-K Pruning Each node eliminates any tuple with a score lower than its top-1 result. Drawback: We received a incorrect answer i.e. (D,76.5) instead of (C,75). This happens because we eliminated (D,39) that would have changed the result. D,76.5 C,75 B,41 (B,40)

9 Our Approach Design and Implement framework that enables: –In-Network Aggregation –In-Network Filtering (i.e., WHERE clause) –In-Network Top-K Pruning Problem - Challenges –Determine Correct Top-K Results –Continuous Top-K Execution –Energy Constraints

10 Presentation Outline  Introduction and Motivation  Materialized In-Network Top-K Views Construction Phase Pruning Phase Maintenance Phase  Experimentation  Conclusions & Future Work

11 MINT Framework The MINT Framework works in three phases: A)Creation Phase: Executed during the first acquisition of readings which results in n distributed views, V i (i<=n) B)Pruning Phase: Each sensor s i locally prunes V i and generates V i ‘ (  V i ). C) Update Phase: Executed once per epoch, during which s i updates its parent with V i ‘.

12 MINT: Creation Phase Execute Q locally Aggregate the result with the Query Answers from children. This generates a local View V i. V4V4 V9V9 V5V5 V2V2 V1V1

13 MINT: Pruning Phase Each sensor node s i now locally prunes V i and generates V i ‘ (  V i ). Problem: Each s i needs to know which tuples will be required by its parent. –Recall the elimination of (D,39) that lead to wrong answer at the sink.

14 MINT: Pruning Phase Pruning Algorithm Outline –Bounding Step: Locally Bound (above) each tuple in V i with its maximum possible value. –Elimination Step: Prune away any tuple in V i that can not be among the K highest- ranked answers.

15 MINT: Pruning Phase Bounding Step s i maintains a list of (room,sum) tuples. s i knows some meta-information about the network, e.g., –γ1 = «max possible temperature» = 120, and –γ2 = «sensors in each room» = 5. sum’ is an upper bound for sum ViVi sum’=sum+(γ2-count)*γ1

16 MINT: Pruning Phase The running time of the pruning algorithm is O(|Vi|) Elimination Step Prune-away any tuple outside the K-covered-bound set. K-covered Bound-set (V i ’): Includes all the tuples which have an upper bound (v ub ) greater or equal to the kth highest lower bound (v k lb ), i.e., v ub >=v k lb

17 MINT: Update Phase We assumed so far that each s i is state-less (it does not remember the V i of the previous time chronon). This defines an INT View that is appropriate for devices with limited SRAM or FLASH storage. Now assume that we have adequate space to store the V i of the previous chronon, as PV i.

18 MINT: Update Phase Core idea of the update phase: “Utilize PV i in order to update the parent’s View” v k lb Tuple update ignorea) Vi’ update b) c) Update cases:

19 Presentation Outline  Introduction and Motivation  Materialized In-Network Top-K Views Construction Phase Pruning Phase Maintenance Phase  Experimentation  Conclusions & Future Work

20 ΜΙΝΤ Views: Experimentation Datasets: 1.Great Duck Island (GDI): 14 sensors deployed on the Great Duck Island (Maine) in Sensors: Temperature, Light, Humidity, Voltage... 2.Washington State Climate (Atmomon): 32 sensors deployed in Washington and Oregon for 208 days in ( ). Sensors: Temperature and Wind speed.

21 ΜΙΝΤ Views: Experimentation Query: SELECT TOP-K area, Avg(temp) FROM sensors GROUP BY area EPOCH DURATION 1 min Sensing Device –We utilize the energy model of Crossbow’s TELOSB Sensor (250Kbps, RF On: 23mA) –Trace-driven experimentation using Energy = Volts x Amperes x Seconds.

22 Energy Consumption Atmomon Dataset 83% 100% 42% 32%

23 Energy Consumption Great Duck Island Dataset Surges 87% 100% 78% 70% Top-k Pruning is less efficient for shallow query acquisition trees (depth=3 with 14 nodes).

24 0% 39% 77% 34% 12% Pruning Magnitude (at each level) Atmomon Dataset MINT eliminates 48% of the tuples.(29K / 60K). Nodes closer to sink eliminate more tuples.

25 Presentation Outline  Introduction and Motivation  Materialized In-Network Top-K Views Construction Phase Pruning Phase Maintenance Phase  Experimentation  Conclusions & Future Work

26 Conclusions We have presented MINT, a new framework for the execution of continuous queries in WSN. We devised efficient Construction, Pruning and Maintenance for such In-Network Views. Experimentation reveals that MINT can be the premise for energy efficiency in WSN.

27 Future Work We are currently implementing a nesC prototype of the MINT View Framework. Deferred View Maintenance: instead of updating the view on each change, propagate changes periodically (after a certain number of changes or randomly).

MINT Views: Materialized In-Network Top-k Views in Sensor Networks Thank you! This presentation is available at: Related Publications available at: Questions? MDM 2007 © Zeinalipour-Yazti, Andreou, Chrysanthis, Samaras