UNIVERSITY OF JYVÄSKYLÄ Topology Management in Unstructured P2P Networks Using Neural Networks Presentation for IEEE Congress on Evolutionary Computing.

Slides:



Advertisements
Similar presentations
Optimal Resource Discovery Paths of Gnutella2 The IEEE 22nd International Conference on Advanced Information Networking and Applications (AINA 2008)
Advertisements

UNIVERSITY OF JYVÄSKYLÄ Chedar: Peer-to-Peer Middleware Presentation for 8 th International Workshop on Java tm for Parallel and Distributed Computing.
UNIVERSITY OF JYVÄSKYLÄ P2PRealm – Peer-to-Peer Simulator Presentation for 11 th International Workshop on Computer- Aided Modeling, Analysis and Design.
UNIVERSITY OF JYVÄSKYLÄ Resource Discovery in P2P Networks Using Evolutionary Neural Networks Presentation for International Conference on Advances in.
UNIVERSITY OF JYVÄSKYLÄ P2PDisCo – Java Distributed Computing for Workstations Using Chedar Peer-to-Peer Middleware Presentation for 7 th International.
UNIVERSITY OF JYVÄSKYLÄ New Topology Management Algorithms for Unstructured P2P Networks Presentation for The Second International Workshop on P2P Systems.
Embedded Algorithm in Hardware: A Scalable Compact Genetic Algorithm Prabhas Chongstitvatana Chulalongkorn University.
Playback delay in p2p streaming systems with random packet forwarding Viktoria Fodor and Ilias Chatzidrossos Laboratory for Communication Networks School.
UNIVERSITY OF JYVÄSKYLÄ Building NeuroSearch – Intelligent Evolutionary Search Algorithm For Peer-to-Peer Environment Master’s Thesis by Joni Töyrylä
Particle Swarm Optimization (PSO)  Kennedy, J., Eberhart, R. C. (1995). Particle swarm optimization. Proc. IEEE International Conference.
1 An Overview of Gnutella. 2 History The Gnutella network is a fully distributed alternative to the centralized Napster. Initial popularity of the network.
Farnoush Banaei-Kashani and Cyrus Shahabi Criticality-based Analysis and Design of Unstructured P2P Networks as “ Complex Systems ” Mohammad Al-Rifai.
LightFlood: An Optimal Flooding Scheme for File Search in Unstructured P2P Systems Song Jiang, Lei Guo, and Xiaodong Zhang College of William and Mary.
Parallelized Evolution System Onur Soysal, Erkin Bahçeci Erol Şahin Dept. of Computer Engineering Middle East Technical University.
UNIVERSITY OF JYVÄSKYLÄ Yevgeniy Ivanchenko Yevgeniy Ivanchenko University of Jyväskylä
Prénom Nom Document Analysis: Artificial Neural Networks Prof. Rolf Ingold, University of Fribourg Master course, spring semester 2008.
UNIVERSITY OF JYVÄSKYLÄ Chedar P2P platform InBCT 3.2 Peer-to-Peer communication Cheese Factory -project Research Assistant.
On the Construction of Energy- Efficient Broadcast Tree with Hitch-hiking in Wireless Networks Source: 2004 International Performance Computing and Communications.
1 SLIC: A Selfish Link-based Incentive Mechanism for Unstructured P2P Networks Qixiang Sun Hector Garcia-Molina Stanford University.
Introduction to Evolutionary Computation  Genetic algorithms are inspired by the biological processes of reproduction and natural selection. Natural selection.
1 Maximizing Remote Work in Flooding-based P2P Systems Qixiang Sun Neil Daswani Hector Garcia-Molina Stanford University.
UNIVERSITY OF JYVÄSKYLÄ Distributed computing in peer-to-peer environment InBCT 3.2 Peer-to-Peer communication Cheese Factory -project
An Authentication Service Against Dishonest Users in Mobile Ad Hoc Networks Edith Ngai, Michael R. Lyu, and Roland T. Chin IEEE Aerospace Conference, Big.
Evolutionary Games The solution concepts that we have discussed in some detail include strategically dominant solutions equilibrium solutions Pareto optimal.
UNIVERSITY OF JYVÄSKYLÄ Peer-to-Peer Algorithms and Prototypes in Jyväskylä Mikko Vapa, research student Department of Mathematical Information.
UNIVERSITY OF JYVÄSKYLÄ Resource Discovery Using NeuroSearch Presentation for the Agora Center InBCT-seminar Mikko Vapa, researcher InBCT 3.2.
UNIVERSITY OF JYVÄSKYLÄ Resource Discovery in Unstructured P2P Networks Distributed Systems Research Seminar on Mikko Vapa, research student.
UNIVERSITY OF JYVÄSKYLÄ Topology Management Algorithms in Chedar InBCT 3.2 Peer-to-Peer communication Cheese Factory -project
UNIVERSITY OF JYVÄSKYLÄ Topology Management in Unstructured P2P Networks Distributed Systems Research Seminar on Annemari Auvinen, Research Student.
INTRODUCTION TO PEER TO PEER NETWORKS Z.M. Joseph CSE 6392 – DB Exploration Spring 2006 CSE, UT Arlington.
CHAPTER 12 ADVANCED INTELLIGENT SYSTEMS © 2005 Prentice Hall, Decision Support Systems and Intelligent Systems, 7th Edition, Turban, Aronson, and Liang.
IEEE P2P, Aachen, Germany, September Ad-hoc Limited Scale-Free Models for Unstructured Peer-to-Peer Networks Hasan Guclu
Evolutionary Algorithms BIOL/CMSC 361: Emergence Lecture 4/03/08.
Self-organizing Maps Kevin Pang. Goal Research SOMs Research SOMs Create an introductory tutorial on the algorithm Create an introductory tutorial on.
Introduction to Genetic Algorithms and Evolutionary Computation
11 CSE 4705 Artificial Intelligence Jinbo Bi Department of Computer Science & Engineering
Swarm Intelligence 虞台文.
Study on Genetic Network Programming (GNP) with Learning and Evolution Hirasawa laboratory, Artificial Intelligence section Information architecture field.
Boltzmann Machine (BM) (§6.4) Hopfield model + hidden nodes + simulated annealing BM Architecture –a set of visible nodes: nodes can be accessed from outside.
A Graph-based Friend Recommendation System Using Genetic Algorithm
Evolving Virtual Creatures & Evolving 3D Morphology and Behavior by Competition Papers by Karl Sims Presented by Sarah Waziruddin.
EE459 I ntroduction to Artificial I ntelligence Genetic Algorithms Kasin Prakobwaitayakit Department of Electrical Engineering Chiangmai University.
Random Graph Generator University of CS 8910 – Final Research Project Presentation Professor: Dr. Zhu Presented: December 8, 2010 By: Hanh Tran.
ELeaRNT: Evolutionary Learning of Rich Neural Network Topologies Authors: Slobodan Miletic 3078/2010 Nikola Jovanovic 3077/2010
Blondie24 Presented by Adam Duffy and Josh Hill. Overview Introduction to new concepts Design of Blondie24 Testing and results Other approaches to checkers.
Sampling Techniques for Large, Dynamic Graphs Daniel Stutzbach – University of Oregon Reza Rejaie – University of Oregon Nick Duffield – AT&T Labs—Research.
LightFlood: An Efficient Flooding Scheme for File Search in Unstructured P2P Systems Song Jiang, Lei Guo, and Xiaodong Zhang College of William and Mary.
CS 484 Load Balancing. Goal: All processors working all the time Efficiency of 1 Distribute the load (work) to meet the goal Two types of load balancing.
Coevolutionary Automated Software Correction Josh Wilkerson PhD Candidate in Computer Science Missouri S&T.
Alice E. Smith and Mehmet Gulsen Department of Industrial Engineering
Project funded by the Future and Emerging Technologies arm of the IST Programme Are Proliferation Techniques more efficient than Random Walk with respect.
UNIVERSITY OF JYVÄSKYLÄ UBIWARE Nokia Research Center Case Meeting on Mikko Vapa, research student P2P Computing Group Department of Mathematical.
Design of a Robust Search Algorithm for P2P Networks
Data Consolidation: A Task Scheduling and Data Migration Technique for Grid Networks Author: P. Kokkinos, K. Christodoulopoulos, A. Kretsis, and E. Varvarigos.
Stefanos Antaris Distributed Publish/Subscribe Notification System for Online Social Networks Stefanos Antaris *, Sarunas Girdzijauskas † George Pallis.
Project funded by the Future and Emerging Technologies arm of the IST Programme Search in Unstructured Networks Niloy Ganguly, Andreas Deutsch Center for.
Example Apply hierarchical clustering with d min to below data where c=3. Nearest neighbor clustering d min d max will form elongated clusters!
Distributed Caching and Adaptive Search in Multilayer P2P Networks Chen Wang, Li Xiao, Yunhao Liu, Pei Zheng The 24th International Conference on Distributed.
An Evolutionary Algorithm for Neural Network Learning using Direct Encoding Paul Batchis Department of Computer Science Rutgers University.
A Presentation on Adaptive Neuro-Fuzzy Inference System using Particle Swarm Optimization and it’s Application By Sumanta Kundu (En.R.No.
Genetic Algorithm(GA)
Hirophysics.com The Genetic Algorithm vs. Simulated Annealing Charles Barnes PHY 327.
 Negnevitsky, Pearson Education, Lecture 12 Hybrid intelligent systems: Evolutionary neural networks and fuzzy evolutionary systems n Introduction.
Presented by Edith Ngai MPhil Term 3 Presentation
On Growth of Limited Scale-free Overlay Network Topologies
Training Neural networks to play checkers
Training Neural networks to play checkers
Boltzmann Machine (BM) (§6.4)
Evolutionary Ensembles with Negative Correlation Learning
Coevolutionary Automated Software Correction
Presentation transcript:

UNIVERSITY OF JYVÄSKYLÄ Topology Management in Unstructured P2P Networks Using Neural Networks Presentation for IEEE Congress on Evolutionary Computing Annemari Auvinen, research student Department of Mathematical Information Technology University of Jyväskylä, Finland With co-authors Teemu Keltanen and Mikko Vapa

UNIVERSITY OF JYVÄSKYLÄ Topology Management Algorithms Topology management algorithms affect the logical topology by making network more scalable and effective for resource discovery Use local information the nodes are collecting about their neighbors –Interest based clustering –Technical characteristics of the peers

UNIVERSITY OF JYVÄSKYLÄ NeuroTopology Uses evolutionary neural networks to form efficient P2P topologies for resource queries We determine the characteristics that the neural network should take into account –These characteristics are given to the neural network as inputs and can be e.g. bandwidth or information about the previous resource queries As a result is obtained dynamic P2P network, where the topology takes shape in interaction with the resource discovery algorithm

UNIVERSITY OF JYVÄSKYLÄ NeuroTopology Algorithm is executed in every peer after a predefined amount of resource queries Algorithm goes through all neighbor candidates To establish a connection mutual agreement from both nodes is needed

UNIVERSITY OF JYVÄSKYLÄ NeuroTopology Keep neighbor? New neighbor? Neighbor Node Neighbor’s neighbor P2P Node

UNIVERSITY OF JYVÄSKYLÄ Structure of NeuroTopology

UNIVERSITY OF JYVÄSKYLÄ Training Program Neural network weights define how neural network behaves so they must be adjusted to right values This is done using iterative optimization process based on evolution and Gaussian mutation Define the P2P network conditions Define the fitness requirements for the algorithm Create candidate algorithms randomly Select the best ones for next generation Breed a new population Finally select the best algorithm for these conditions Iterate thousands of generations

UNIVERSITY OF JYVÄSKYLÄ Neural Network Optimization Evolutionary computing for optimizing the weights Fitness of the used neural network is defined based on the amount of traffic in the P2P network. –Algorithm should locate half of the available resources for each query –Algorithm should use as minimal number of packets and create as minimum number of new connections as possible Mutation is based on the Gaussian random variation and uses the weighted mutation parameter to improve the adaptability of the evolutionary search Random variation function was introduced by Fogel and Chellapilla[1]

UNIVERSITY OF JYVÄSKYLÄ Simulation Environment P2P network with 100 peers Resources power-law distributed Breadth-first search (BFS), highest degree search (HDS) and random walker (RW) were used as resource discovery algorithms The test case was divided to: –Training environment –Generalization environment

UNIVERSITY OF JYVÄSKYLÄ Simulation Environment In the training set each generation is started with a grid topology P2P network and follows the algorithm: 1.Do 20 times 1.10 random peers execute resource queries 2.Execute NeuroTopology algorithm in every peer using information from resource queries 2.Execute 10 resource queries in the P2P network 3.Calculate the fitness for the neural network using information from step 2

UNIVERSITY OF JYVÄSKYLÄ Simulation Environment Training of the neural networks was done using the HDS algorithm and the amount of generations was 5000 Generalization set was the same as the training set, except that resource queries were executed by every peer in the P2P network

UNIVERSITY OF JYVÄSKYLÄ Fitness in training environment

UNIVERSITY OF JYVÄSKYLÄ Fitness in generalization environment

UNIVERSITY OF JYVÄSKYLÄ Resource query packets and replies in generalization environment

UNIVERSITY OF JYVÄSKYLÄ Topology packets and changes in generalization environment

UNIVERSITY OF JYVÄSKYLÄ Failed queries in generalization environment

UNIVERSITY OF JYVÄSKYLÄ Simulation Results Tested in grid topology, power-law topology and a random graph topology with 3 resource discovery algorithms and with and without NeuroTopology

UNIVERSITY OF JYVÄSKYLÄ Convergence Changing the inefficient grid topology on the early rounds and limiting the changes when the efficient topology has been reached

UNIVERSITY OF JYVÄSKYLÄ References [1] K. Chellapilla and D. Fogel. Evolving neural networks to play checkers without relying on expert knowledge. IEEE Trans. on Neural Networks, 10 (6), pp , 1999.