1. UNIVERSITY OF JYVÄSKYLÄ Distributed computing in peer-to-peer environment InBCT 3.2 Peer-to-Peer communication Cheese Factory -project http://tisu.it.jyu.fi/cheesefactory Research Assistant Niko Kotilainen University of Jyväskylä Agora Center Niko.Kotilainen@cc.jyu.fi

2. UNIVERSITY OF JYVÄSKYLÄ 2003 Problem Evolving neural networks needs a lot of computing power One computer is not enough for many research cases

3. UNIVERSITY OF JYVÄSKYLÄ 2003 Solution Distribute computation across desktop computers all over Agora It has to be as invisible as possible to the user of the network simulator The simulator should not interfere with the desktop use of the distributed computers

4. UNIVERSITY OF JYVÄSKYLÄ 2003 Architecture Chedar node Chedar node Chedar node Chedar node Chedar node Master

5. UNIVERSITY OF JYVÄSKYLÄ 2003 Architecture Chedar node Chedar node Chedar node Chedar node Chedar node Master

6. UNIVERSITY OF JYVÄSKYLÄ 2003 Architecture Chedar node Chedar node Chedar node Chedar node Chedar node Master Query Query: who has the resource ”NetSimulator” available?

7. UNIVERSITY OF JYVÄSKYLÄ 2003 Architecture Chedar node Chedar node Chedar node Chedar node Chedar node Master Reply Reply: I do! Reply

8. UNIVERSITY OF JYVÄSKYLÄ 2003 Architecture Chedar node Chedar node Chedar node Chedar node Chedar node Master Task

9. UNIVERSITY OF JYVÄSKYLÄ 2003 Architecture Chedar node Chedar node Chedar node Chedar node Chedar node Master Computation…

10. UNIVERSITY OF JYVÄSKYLÄ 2003 Architecture Chedar node Chedar node Chedar node Chedar node Chedar node Master Result Results are sent back to the master node. Calculation ends and everybody is happy. Result

11. UNIVERSITY OF JYVÄSKYLÄ 2003 What happens inside a Chedar node Task Chedar-node starts the distributed program, hijacking its file operations. Chedar Distributed program Result Any Java program that uses files to read input and store output can be distributed

12. UNIVERSITY OF JYVÄSKYLÄ 2003 Advantages over ordinary clusters Minimal costs –No need for new hardware More dynamic, better fault-tolerance –Computers can join or leave the network at any time More scalable –Network size can be huge

13. UNIVERSITY OF JYVÄSKYLÄ 2003 Future of the system At this time just a tool for the project to speed up computations Larger deployment Possible improvements –Master can leave the network and gather results afterwards –Load balancing between peer nodes