Modeling and Analysis of Random Walk Search Algorithms in P2P Networks Nabhendra Bisnik, Alhussein Abouzeid ECSE, Rensselaer Polytechnic Institute.

Slides:



Advertisements
Similar presentations
Replication Strategies in Unstructured Peer-to-Peer Networks Edith Cohen Scott Shenker This is a modified version of the original presentation by the authors.
Advertisements

Queuing Network Models for Delay Analysis of Multihop Wireless Ad Hoc Networks Nabhendra Bisnik and Alhussein Abouzeid Rensselaer Polytechnic Institute.
Weak State Routing for Large Scale Dynamic Networks Utku Günay Acer, Shivkumar Kalyanaraman, Alhussein A. Abouzeid Rensselaer Polytechnic Institute Department.
Experimental Design, Response Surface Analysis, and Optimization
VDR: Proactive element Conclusions VDR reaches 3.5% more nodes than VDR-R and 9% more nodes than our modified random walk routing strategy (RWR) VDR shows.
Delay and Throughput in Random Access Wireless Mesh Networks Nabhendra Bisnik, Alhussein Abouzeid ECSE Department Rensselaer Polytechnic Institute (RPI)
Network Coding in Peer-to-Peer Networks Presented by Chu Chun Ngai
Technion –Israel Institute of Technology Computer Networks Laboratory A Comparison of Peer-to-Peer systems by Gomon Dmitri and Kritsmer Ilya under Roi.
1 An Overview of Gnutella. 2 History The Gnutella network is a fully distributed alternative to the centralized Napster. Initial popularity of the network.
Search and Replication in Unstructured Peer-to-Peer Networks Pei Cao, Christine Lv., Edith Cohen, Kai Li and Scott Shenker ICS 2002.
Farnoush Banaei-Kashani and Cyrus Shahabi Criticality-based Analysis and Design of Unstructured P2P Networks as “ Complex Systems ” Mohammad Al-Rifai.
LightFlood: An Optimal Flooding Scheme for File Search in Unstructured P2P Systems Song Jiang, Lei Guo, and Xiaodong Zhang College of William and Mary.
CHAPTER 16 MARKOV CHAIN MONTE CARLO
1 Stochastic Event Capture Using Mobile Sensors Subject to a Quality Metric Nabhendra Bisnik, Alhussein A. Abouzeid, and Volkan Isler Rensselaer Polytechnic.
Small-world Overlay P2P Network
Kuang-Hao Liu et al Presented by Xin Che 11/18/09.
P2p, Spring 05 1 Topics in Database Systems: Data Management in Peer-to-Peer Systems March 29, 2005.
1 Data Persistence in Large-scale Sensor Networks with Decentralized Fountain Codes Yunfeng Lin, Ben Liang, Baochun Li INFOCOM 2007.
UNIVERSITY OF JYVÄSKYLÄ Yevgeniy Ivanchenko Yevgeniy Ivanchenko University of Jyväskylä
Technion –Israel Institute of Technology Software Systems Laboratory A Comparison of Peer-to-Peer systems by Gomon Dmitri and Kritsmer Ilya under Roi Melamed.
Reinforcement Learning Rafy Michaeli Assaf Naor Supervisor: Yaakov Engel Visit project’s home page at: FOR.
1 Replication Strategies in Unstructured Peer-to-Peer Networks Edith Cohen, Scott Shenker ACM SIGCOMM Computer Communication Review, Proceedings of the.
Hardware-based Load Generation for Testing Servers Lorenzo Orecchia Madhur Tulsiani CS 252 Spring 2006 Final Project Presentation May 1, 2006.
Efficient Content Location Using Interest-based Locality in Peer-to-Peer Systems Presented by: Lin Wing Kai.
Distributed Priority Scheduling and Medium Access in Ad Hoc Networks Distributed Priority Scheduling and Medium Access in Ad Hoc Networks Vikram Kanodia.
Search and Replication in Unstructured Peer-to-Peer Networks Pei Cao Cisco Systems, Inc. (Joint work with Christine Lv, Edith Cohen, Kai Li and Scott Shenker)
Performance Evaluation of Peer-to-Peer Video Streaming Systems Wilson, W.F. Poon The Chinese University of Hong Kong.
Vassilios V. Dimakopoulos and Evaggelia Pitoura Distributed Data Management Lab Dept. of Computer Science, Univ. of Ioannina, Greece
1 EE 616 Computer Aided Analysis of Electronic Networks Lecture 9 Instructor: Dr. J. A. Starzyk, Professor School of EECS Ohio University Athens, OH,
Maximum Network lifetime in Wireless Sensor Networks with Adjustable Sensing Ranges Mihaela Cardei, Jie Wu, Mingming Lu, and Mohammad O. Pervaiz Department.
Searching in Unstructured Networks Joining Theory with P-P2P.
Scalable and Distributed GPS free Positioning for Sensor Networks Rajagopal Iyengar and Biplab Sikdar Department of ECSE, Rensselaer Polytechnic Institute.
UNIVERSITY OF JYVÄSKYLÄ Resource Discovery in Unstructured P2P Networks Distributed Systems Research Seminar on Mikko Vapa, research student.
On Self Adaptive Routing in Dynamic Environments -- A probabilistic routing scheme Haiyong Xie, Lili Qiu, Yang Richard Yang and Yin Yale, MR and.
MATE: MPLS Adaptive Traffic Engineering Anwar Elwalid, et. al. IEEE INFOCOM 2001.
Determining the Significance of Item Order In Randomized Problem Sets Zachary A. Pardos, Neil T. Heffernan Worcester Polytechnic Institute Department of.
1 Napster & Gnutella An Overview. 2 About Napster Distributed application allowing users to search and exchange MP3 files. Written by Shawn Fanning in.
09/07/2004Peer-to-Peer Systems in Mobile Ad-hoc Networks 1 Lookup Service for Peer-to-Peer Systems in Mobile Ad-hoc Networks M. Tech Project Presentation.
On the Construction of Data Aggregation Tree with Minimum Energy Cost in Wireless Sensor Networks: NP-Completeness and Approximation Algorithms National.
 1  Outline  stages and topics in simulation  generation of random variates.
Optimal Degree Distribution for LT Codes with Small Message Length Esa Hyytiä, Tuomas Tirronen, Jorma Virtamo IEEE INFOCOM mini-symposium
An affinity-driven clustering approach for service discovery and composition for pervasive computing J. Gaber and M.Bakhouya Laboratoire SeT Université.
1 BitHoc: BitTorrent for wireless ad hoc networks Jointly with: Chadi Barakat Jayeoung Choi Anwar Al Hamra Thierry Turletti EPI PLANETE 28/02/2008 MAESTRO/PLANETE.
By: Sraddha Adhikari St TC/SET Thesis Examination Committee: Dr. Teerapat Sanguankotchakorn (Chairperson) Assoc. Prof. Tapio J. Erke Dr. Poompat.
A Distributed Clustering Framework for MANETS Mohit Garg, IIT Bombay RK Shyamasundar School of Tech. & Computer Science Tata Institute of Fundamental Research.
A Prediction-based Fair Replication Algorithm in Structured P2P Systems Xianshu Zhu, Dafang Zhang, Wenjia Li, Kun Huang Presented by: Xianshu Zhu College.
Stochastic Linear Programming by Series of Monte-Carlo Estimators Leonidas SAKALAUSKAS Institute of Mathematics&Informatics Vilnius, Lithuania
윤언근 DataMining lab.  The Web has grown exponentially in size but this growth has not been isolated to good-quality pages.  spamming and.
Energy Efficient Phone-to-Phone Communication Based on WiFi Hotspots in PSN En Wang 1,2, Yongjian Yang 1, and Jie Wu 2 1 Dept. of Computer Science and.
Packet Dispersion in IEEE Wireless Networks Mingzhe Li, Mark Claypool and Bob Kinicki WPI Computer Science Department Worcester, MA 01609
Project funded by the Future and Emerging Technologies arm of the IST Programme Analytical Insights into Immune Search Niloy Ganguly Center for High Performance.
NEAREST NEIGHBORS ALGORITHM Lecturer: Yishay Mansour Presentation: Adi Haviv and Guy Lev 1.
User-Centric Data Dissemination in Disruption Tolerant Networks Wei Gao and Guohong Cao Dept. of Computer Science and Engineering Pennsylvania State University.
LightFlood: An Efficient Flooding Scheme for File Search in Unstructured P2P Systems Song Jiang, Lei Guo, and Xiaodong Zhang College of William and Mary.
P2p, Fall 06 1 Topics in Database Systems: Data Management in Peer-to-Peer Systems Search in Unstructured P2p.
Marwan Al-Namari Hassan Al-Mathami. Indexing What is Indexing? Indexing is a mechanisms. Why we need to use Indexing? We used indexing to speed up access.
1 Presented by Sarbagya Buddhacharya. 2 Increasing bandwidth demand in telecommunication networks is satisfied by WDM networks. Dimensioning of WDM networks.
Cooperative Location- Sensing for Wireless Networks Authors : Haris Fretzagias Maria Papadopouli Presented by cychen IEEE International Conference on Pervasive.
Aug 22, 2002Sigcomm 2002 Replication Strategies in Unstructured Peer-to-Peer Networks Edith Cohen AT&T Labs-research Scott Shenker ICIR.
Data Consolidation: A Task Scheduling and Data Migration Technique for Grid Networks Author: P. Kokkinos, K. Christodoulopoulos, A. Kretsis, and E. Varvarigos.
Load Balanced Link Reversal Routing in Mobile Wireless Ad Hoc Networks Nabhendra Bisnik, Alhussein Abouzeid ECSE Department RPI Costas Busch CSCI Department.
School of Electrical Engineering &Telecommunications UNSW Cost-effective Broadcast for Fully Decentralized Peer-to-peer Networks Marius Portmann & Aruna.
1 Random Walks on the Click Graph Nick Craswell and Martin Szummer Microsoft Research Cambridge SIGIR 2007.
Incrementally Improving Lookup Latency in Distributed Hash Table Systems Hui Zhang 1, Ashish Goel 2, Ramesh Govindan 1 1 University of Southern California.
1 “Hybrid Search Schemes for Unstructured Peer- to-Peer Networks” “Random Walks in Peer-to-Peer Networks” Christos Gkantsidis, Milena Mihail, Amin Saberi.
Distributed Caching and Adaptive Search in Multilayer P2P Networks Chen Wang, Li Xiao, Yunhao Liu, Pei Zheng The 24th International Conference on Distributed.
GeoTORA: A Protocol for Geocasting in Mobile Ad Hoc Networks
Author:Zarei.M.;Faez.K. ;Nya.J.M.
OBJECT LOCATION IN UNSTRUCTURED P2P NETWORKS USING RANDOM WALK
Indexing and Hashing Basic Concepts Ordered Indices
Presentation transcript:

Modeling and Analysis of Random Walk Search Algorithms in P2P Networks Nabhendra Bisnik, Alhussein Abouzeid ECSE, Rensselaer Polytechnic Institute

Contributions  Analytical expressions for performance metrics of random walk search in decentralized P2P networks  An algorithm, called equation based adaptive search (EBAS), that uses analytical results to set the parameters of random walk  Feedback based mechanism for maintaining popularity estimates 1 1 Popularity of an item equals the fraction of nodes in the network that have the item

Outline  Search mechanisms and trade-offs involved  Analytical results  EBAS  Simulation results  Conclusion and future work

 Search mechanisms and trade-offs involved  Analytical results  EBAS  Simulation Results  Conclusion and future Work

Search Algorithms  Stateless search algorithms  No state information about network or links maintained  e.g. Flooding, Iterative Deepening, Random Walk, k- Random Walk  State-full search algorithms  Improvement in performance by maintaining state information (goodness of neighbors, resource indices)  Better performance but more complex  e.g. Directed BFS, Local Indices, APS

Search Algorithms (cont.)  Desired performance  Low overhead  Low delay  High success rate  Trade-offs  Overhead and success rate  Overhead and delay

The k-Random Walk Nodes With the Resources Nodes Without the Resources Querying Node Initiates search with k = 2, T = 3

The k-Random Walk Nodes With the Resources Nodes Without the Resources Querying Node Initiates search with k = 2, T = 3

The k-Random Walk Nodes With the Resources Nodes Without the Resources Querying Node Initiates search with k = 2, T = 3 Successful Termination

The k-Random Walk Nodes With the Resources Nodes Without the Resources Querying Node Initiates search with k = 2, T = 3 Successful Termination Unsuccessful Termination

The k-Random Walk Nodes With the Resources Nodes Without the Resources Querying Node Initiates search with k = 2, T = 3 Successful Termination Unsuccessful Termination Search Successful Overhead = 5 Delay = 2

The k-Random Walk (cont.)  Popular alternative to flooding [3]  So far focus is on adaptively forwarding queries to ‘‘good’’ neighbors  Performance depends on parameters k and T and popularity of resource (p)  low k and T => high delay and low success rate  high k and T => high overhead  Problem: Number of nodes queried are either more or less than what is required  Solution: Adaptively set parameters of random walk according to popularity of resource

 Search mechanisms and trade-offs involved  Analytical results  EBAS  Simulation Results  Conclusion and future Work

Analytical results  Random walk has statistical properties similar to sampling from uniform distribution [1]  Using above we found analytical expressions of success rate, overhead and delay in terms of number of random walkers (k), TTL (T) and popularity (p)

Verification of Analytical Results Search Overhead vs. popularity Search delay vs. popularity Success rate vs. popularity Analytical results agree closely with the simulation results

 Search mechanisms and trade-offs involved  Analytical results  EBAS  Simulation Results  Conclusion and future Work

EBAS  Objective: Set parameters (k,T) of random walk such that  EBAS consists of two components:  Popularity estimation module  Parameter selection module (1) (2) (3)

Popularity Estimator Module  Popularity estimator is based on exponentially weighted moving average  Uses the fraction of successful searches in an update interval ( ) to obtain current estimate according to  Popularity estimate for next update interval is updated according to (4) (5)

Parameter selection module  Uses in order to set and such that (1), (2) and (3) are satisfied  Inequality (1) is satisfied if  Inequalities (2) and (3) may be solved numerically in order to obtain a the range of feasible k and T  The parameter selection module may be implemented by means of a parameter selection table in which feasible values of k and T corresponding to various range of popularities (6)

Block diagram showing main components of EBAS Popularity Estimator Module Parameter Selection Module P2P Network Delay (Update Interval) (k,T) Success Rate Popularity Estimate

 E[O] and E[D] as a function of T are plotted in the figure, for kT = 300  According to the figure and is a feasible (k,T) pair An Example  Consider a case where and  Inequality (1) is satisfied if

 Search mechanisms and trade-offs involved  Analytical results  EBAS  Simulation Results  Conclusion and future Work

Simulation Scenario  Extensive simulations done for  Evaluating performance of popularity estimator  Comparing performance EBAS with non- adaptive random walk  Network for simulation  10 4 nodes  px10 4 nodes randomly chosen and marked to have resource  Network grown according to [2]

Simulation Results – Popularity Estimator Module The popularity estimate maintained by Popularity Estimator Module closely follows actual popularity of the resource

Simulation Results - EBAS Scenario-1 : Popularity increases with time EBAS reduces overhead by adaptively decreasing the number of random walkers

Simulation Results - EBAS Scenario-2 : Popularity decreases with time EBAS maintains required success rate by adaptively increasing number of random walkers

 Search mechanisms and trade-offs involved  Analytical results  EBAS  Simulation Results  Conclusion and future Work

Conclusion & Future Work  EBAS effectively maintains popularity estimates and performs better than random walk  EBAS performs best in scenarios where same or “similar’’ item is searched several times  Modeling problem of choosing optimal parameters as control theoretic problem  Model performance of other state-full search mechanisms such as APS

References [1] C. Gkantsidis, M. Mihail, and A. Saberi. Random walks in peer-to-peer networks. In Proc. of IEEE INFOCOM, Mar [2] P. Holme and B. J. Kim. Growing Scale-free Networks with Tunable Clustering. Physical Review E (Statistical, Nonlinear, and Soft Matter Physics), 65, 2002 [3] Q. Lv, P. Cao, E. Cohen, K. Li, and S. Shenker. Search and Replication in Unstructured Peer-to-Peer Networks. In Proceedings of the 2002 ACM SIGMETRICS international conference on Measurement and modeling of computer systems, pages 258–259. ACM Press, 2002.

Thank You