Niosha Behnam CMPE 259 – Fall 2011.  Real-time data availability is not required for all sensor networks.  Robust disconnected operation is a needed.

Slides:



Advertisements
Similar presentations
Cognitive Radio Communications and Networks: Principles and Practice By A. M. Wyglinski, M. Nekovee, Y. T. Hou (Elsevier, December 2009) 1 Chapter 9 Fundamentals.
Advertisements

Mendel Rosenblum and John K. Ousterhout Presented by Travis Bale 1.
Virtual Memory Introduction to Operating Systems: Module 9.
The Zebra Striped Network File System Presentation by Joseph Thompson.
Input/Output Management and Disk Scheduling
Lecture 6 – Google File System (GFS) CSE 490h – Introduction to Distributed Computing, Winter 2008 Except as otherwise noted, the content of this presentation.
Operating System Support Focus on Architecture
Shivkumar KalyanaramanRensselaer Q1-1 ECSE-6600: Internet Protocols Quiz 1 Time: 60 min (strictly enforced) Points: 50 YOUR NAME: Be brief, but DO NOT.
Chapter 8 Operating System Support
Computer Organization and Architecture
Computer Science Storage Systems and Sensor Storage Research Overview.
Ad Hoc Wireless Routing COS 461: Computer Networks
File System. NET+OS 6 File System Architecture Design Goals File System Layer Design Storage Services Layer Design RAM Services Layer Design Flash Services.
Sensor Coordination using Role- based Programming Steven Cheung NSF NeTS NOSS Informational Meeting October 18, 2005.
Presentation on Osi & TCP/IP MODEL
File Systems and Disk Management. File system Interface between applications and the mass storage/devices Provide abstraction for the mass storage and.
Segmentation & O/S Input/Output Chapter 4 & 5 Tuesday, April 3, 2007.
Internet Addresses. Universal Identifiers Universal Communication Service - Communication system which allows any host to communicate with any other host.
Scalable Web Server on Heterogeneous Cluster CHEN Ge.
BitTorrent enabled Ad Hoc Group 1  Garvit Singh( )  Nitin Sharma( )  Aashna Goyal( )  Radhika Medury( )
Sensor Database System Sultan Alhazmi
1 EnviroStore: A Cooperative Storage System for Disconnected Operation in Sensor Networks Liqian Luo, Chengdu Huang, Tarek Abdelzaher John Stankovic INFOCOM.
Infocom’07 Authors:Liqian Luo, Chengdu Huang, Tarek Abdelzaher John Stankovic Presented By Rohini Kurkal Under Guidance of Dr.Bin Tang.
Enabling Large-Scale Storage in Sensor Networks with the Coffee File System ISPN 2009 Lawrence.
ELF: An Efficient Log-Structured Flash File System For Micro Sensor Nodes Hui Dai Michael Neufeld Richard Han University of Colorado at Boulder Computer.
Log-structured Memory for DRAM-based Storage Stephen Rumble, John Ousterhout Center for Future Architectures Research Storage3.2: Architectures.
Chapter 4 Memory Management Virtual Memory.
File Structures. 2 Chapter - Objectives Disk Storage Devices Files of Records Operations on Files Unordered Files Ordered Files Hashed Files Dynamic and.
Process Architecture Process Architecture - A portion of a program that can run independently of and concurrently with other portions of the program. Some.
I MPLEMENTING FILES. Contiguous Allocation:  The simplest allocation scheme is to store each file as a contiguous run of disk blocks (a 50-KB file would.
Tufts Wireless Laboratory School Of Engineering Tufts University Paper Review “An Energy Efficient Multipath Routing Protocol for Wireless Sensor Networks”,
11.1 Silberschatz, Galvin and Gagne ©2005 Operating System Principles 11.5 Free-Space Management Bit vector (n blocks) … 012n-1 bit[i] =  1  block[i]
GPFS: A Shared-Disk File System for Large Computing Clusters Frank Schmuck & Roger Haskin IBM Almaden Research Center.
Chapter 5 Record Storage and Primary File Organizations
Efficient Opportunistic Sensing using Mobile Collaborative Platform MOSDEN.
Computer Science Lecture 19, page 1 CS677: Distributed OS Last Class: Fault tolerance Reliable communication –One-one communication –One-many communication.
File Systems and Disk Management
Disk Cache Main memory buffer contains most recently accessed disk sectors Cache is organized by blocks, block size = sector’s A hash table is used to.
CS222: Principles of Data Management Lecture #4 Catalogs, Buffer Manager, File Organizations Instructor: Chen Li.
CS 540 Database Management Systems
Virtual memory.
Transactions and Reliability
CS522 Advanced database Systems
Multiway Search Trees Data may not fit into main memory
FileSystems.
Database Management Systems (CS 564)
Transport layer.
A comparison of Ad-Hoc Routing Protocols
CONGESTION CONTROL.
The Google File System Sanjay Ghemawat, Howard Gobioff and Shun-Tak Leung Google Presented by Jiamin Huang EECS 582 – W16.
What’s “Inside” a Router?
Chapter 11: File System Implementation
File Systems and Disk Management
Page Replacement.
Network Core and QoS.
ExaO: Software Defined Data Distribution for Exascale Sciences
Outline Midterm results summary Distributed file systems – continued
Introduction to Database Systems
Overview Continuation from Monday (File system implementation)
File Systems and Disk Management
File Systems and Disk Management
Chapter 2: Operating-System Structures
Introduction to Operating Systems
Outline Announcement Distributed scheduling – continued
File Systems and Disk Management
File Systems and Disk Management
by Mikael Bjerga & Arne Lange
Chapter 2: Operating-System Structures
COMP755 Advanced Operating Systems
Network Core and QoS.
Presentation transcript:

Niosha Behnam CMPE 259 – Fall 2011

 Real-time data availability is not required for all sensor networks.  Robust disconnected operation is a needed for some applications. Environment & wildlife monitoring, for example.  Growing size of low-power flash memory points to greater capacity in sensor nodes.  In-network storage and opportunistic upload a model for such networks. Minimize data loss through:  Redistribution & data mules.

 Redistribution within network islands between sensor nodes.  Redistribution between islands via data mules.  Delivery to sink via data mules.

 Service running on a PC/Server.  Identified by IP address & TCP Port.  Alternatively/Additionally, interface to redirect data to Sink File Service.  Receive data uplinked from data mules (generally).

 Mule Types: Intentional; data mules that visit for the purpose of data recovery or redistribution from network islands. (ex. maintenance operators) Unintentional; data mules with mobility patterns independent of data upload needs.

 Energy Efficient Does not attempt to perfectly balance storage amongst nodes. Lazy Offload delays redistribution until necessary.  Neighborhood-Based Redistribution Algorithm Local remaining storage information utilized to determine in-network redistribution.

 Periodic Storage Information Advertisement. Low frequency, for energy efficiency. (~1 min.) Additional updates if storage changes exceed an advertisement threshold.  Redistribution to Under-Loaded Nodes Non-zero possibility to redistribute to any under- loaded node.  Data Transfers Prevent Thrashing

 Energy Aware Balances storage and energy depletion.

 Accomplished Via Data Mules Intentional & unintentional. Mules advertised storage based on global average storage usage. Mule advertisements occur more often than those of sensor nodes. Under-loaded nodes re-advertise in presence of mules for redistribution.

 Local Storage Structure – Continuous log based storage.  Local Log Access – Writing / reading log items.  Neighborhood Monitor – sends advertisements and tracks neighbor status via table.  Data Transfer – Initiates transfer to neighbor.  Reliable Onehop Unicast – Verifies successful log reception.  User Interface – Handles writes from application layer. Written as Log-Arrays or Log Sequences.

 Deployment Configuration:  Impact of In-network Redistribution

 Comparison of Data Storage Rate  Data Dist. w/wo Mules

 Strengths: Describes design in an intuitive manner. Solution for application set not previously addressed in storage architectures.  Weaknesses: Does not describe certain anomalies in results. Evaluation relies on extreme inequalities in sensing.  Summary: EnviroStore provides greatly increased in-network storage capacity in unbalanced sensor networks in disconnected operation.

Niosha Behnam CMPE 259 – Fall 2011

 File-based storage abstraction inappropriate for all sensing applications.  “Rich” object storage abstraction better aligned with applications usage. Include streams, queues, lists, arrays, and files.  Growing size of low-power NAND flash memory aligned with use as application backing store.  Optimize storage around energy and memory constraints.

 Applications – varied, favoring differing object storage paradigms  Object Storage Layer – exposes data structure like interface for objects.  Checkpoints – provides rollback and checkpoint support for objects  Flash Abstraction Layer (FAL) – log structured storage with write caching and compaction  Flash Storage – NAND / NOR Flash

 Fixed Costs for accessing pages.  Per-Byte cost for writing/reading.  Write fixed costs are significantly greater than read costs.  Overwriting requires erasing data.  Limitations on simultaneous writes.

 Buffered Log Based Data in a interleaved and written in an append- only manner. Direct Flash access for raw reads/writes supporting checkpointing. Entries have 2 byte header from object layer.  Memory Reclamation Spaces exhaustion dealt with by deleting data through cleaner task. Coordinates with object layer for cleaning, requiring the objects to perform required cleaning/compaction.

 Error Handling Due to Flash memory single bit errors, checksums are utilized. Page level single-error-correction double-error- detection (SECDED).  Block Allocation Block access to flash for checkpoint support and application needs.

 Basic Objects Stack Queue Stream Static-Index  Composite Objects Files Stream-Index  Checkpointing and Rollback

 FAL Write Buffer Size Ideally, Maximize to Page Size for Energy Efficiency.  Object Layer Read Buffering Diminishing returns after 64 bytes.

 Energy Consumption By Object Operation Write operations less expensive due to FAL write buffering. Reads relatively expensive.  Sequential vs. Random Array Operation Cost Significant difference in performance depending on node size.

 Compaction Cost Energy & Time  Component Energy Consumption  Performance Comparison

 Strengths: Storage concept aligns well with the way applications use data. Methodical and well organized.  Weaknesses: Lack of performance comparison in real sensing application.  Summary: Capsule provides storage better aligning with application needs. Efficient data centric flash storage abstraction through buffered log based writing.