Presentation is loading. Please wait.

Presentation is loading. Please wait.

P2P Distributed Computing Platform: C.Y. ‘Connor’ Park KISTI Supercomputing Center.

Similar presentations


Presentation on theme: "P2P Distributed Computing Platform: C.Y. ‘Connor’ Park KISTI Supercomputing Center."— Presentation transcript:

1 P2P Distributed Computing Platform: Korea@Home C.Y. ‘Connor’ Park chan@kisti.re.kr KISTI Supercomputing Center

2 - 2 - 16 th APAN Meetings, BUSAN, KOREA Overview Korea@Home ( KatH ) : A Software Platform for Distributed Computing using Volunteer Computer Resources Features Hybrid Peer-to-Peer architecture Secure PKI-based Security and Digital Signature Web Services with SOAP messaging

3 - 3 - 16 th APAN Meetings, BUSAN, KOREA Motivation To take advantage of and stimulate ‘Advanced Network Infrastructure in Korea’ To meet the growing needs of computing power for applications Funded by ‘Ministry of Information and Communication (MIC)’

4 - 4 - 16 th APAN Meetings, BUSAN, KOREA Infrastructure Over 10,000,000 Broadband network (xDSL, Cable) households - 2002. 11. Over 58.4% of PCs with Pentium3+

5 - 5 - 16 th APAN Meetings, BUSAN, KOREA Intention of Participation Korea@Home UnderstandingIntention of Providing Resources Well-Understanding (44.9%) Understanding roughly (21.8%) Don’t Know (33.3%) Keep up Providing (59.5%) Providing later (30.4%) Providing with Compensation (7.2%) Don’t (2.9%) 67.7% of Netizen already know what is Distributed Computing and Korea@Home. 89.9% of Netizen have intention of providing their PC resources.

6 - 6 - 16 th APAN Meetings, BUSAN, KOREA Similar Projects Science SETI@Home, climateprediction.net Life Science Folding@Home, FightAIDS@Home Cryptography Distributed.net, RSAttack576 Mathematics Mersenne Prime Search, Pi(x) Project Internet Grub, CycleTrader Financial MoneyBee Games ChessBrain Miscellaneous DALiWorld from http://www.aspenleaf.com/distributed/index.html

7 - 7 - 16 th APAN Meetings, BUSAN, KOREA Project History 2002. 4. MIC launched the pilot project ‘Korea@Home’ Application : Virtual Screening for New Drug Design 2002. 8. First pilot production and test Client/Server Architecture Model 2002. 12. Second pilot production and test 2003. 4. Regularize the project “P2P Internet-based Distributed Computing Platform Development” 2003. 9. Announcement of Hybrid P2P-style Distributed Computing Platform

8 - 8 - 16 th APAN Meetings, BUSAN, KOREA Architecture Cooperation Internet Large-scale Application Resource Management Subscription Distribution Agent Job Request

9 - 9 - 16 th APAN Meetings, BUSAN, KOREA Design Goals Application Developers (Job Requester) Convenience They should be able to use easily. Flexibility The platform is general enough to be used by various applications. Correctness The platform should return correct results.

10 - 10 - 16 th APAN Meetings, BUSAN, KOREA Design Goals PC agents (Resource Providers) Transparency PC users are not disturbed in their own works. Reliability It’s reliable not to make any security and privacy problem. Reward There is any kind of compensation, even just in mind.

11 - 11 - 16 th APAN Meetings, BUSAN, KOREA Design Goals Platform Scalability Performance should be improved according to the growth of agents. Adaptability It should put up with the dynamic features of Internet.

12 - 12 - 16 th APAN Meetings, BUSAN, KOREA Implementation Choices Web Services SOAP messaging over https Request-Response Model It is Agents’ duty to make most decisions. PKI-based certification and Digital Signature for files Make server as simple as possible, and Make PC agents more intelligent

13 - 13 - 16 th APAN Meetings, BUSAN, KOREA Functional Classification Resource Management Authentication, Certification Simple accounting Scheduling and Job distribution Job distribution with hybrid P2P style Result gathering Client Management Client authentication Application preparation to work Digital signing Result returning to client

14 - 14 - 16 th APAN Meetings, BUSAN, KOREA Job Distribution Internet KatH Server Agent  Authentication  Working Specification Request Is there any job for me to work? Who has the job data?  Getting data, working, and returning result to server

15 - 15 - 16 th APAN Meetings, BUSAN, KOREA Networking Issues Network Security DoS, Spoofing, Sniffing, … Variable Connection Dial-up, cable, xDSL, T1/E1, … IPv6, WiFi, Bluetooth, … Network Unobtrusiveness Background/shared communication Transparency (Firewall/NAT)

16 - 16 - 16 th APAN Meetings, BUSAN, KOREA 2002 Pilot Projects Application : Virtual Screening for New Drug Design Client-Server Architecture An Agent Receives about 400KB-size file Executes during 20 minutes per working unit Returns about 190KB-size file Total number of working job units : 50,000

17 - 17 - 16 th APAN Meetings, BUSAN, KOREA Virtual Screening Structure Analysis Target Protein Share Analysis Chemical DB Disease Protein Ligand DB Server + + Client 1 + + + + Client 2 Client 3 Virtual High-Throughput Screening Internet Calculating Ligand PMI Looking for Drug Candidate Clinical Demo New Drug Mass-produce Calculating Active Site PMI

18 - 18 - 16 th APAN Meetings, BUSAN, KOREA Experimental Results 1st Test 1,217 installed agents 2002.8.22-9.2 Max 53.5 Gflops / Avg. 31.78 Gflops 2nd Test 6,472 installed agents 2003.2.6-2.14 Max 644 Gflops / Avg. 470.6 Gflops ※ World Top Rank 124 - 629.7 Gflops: IBM xSeries Cluster Xeon 2.8 GHz - Myrinet/ 192 (from http://www.top500.org, 2003.6)http://www.top500.org

19 - 19 - 16 th APAN Meetings, BUSAN, KOREA 2003 Progresses P2P data distribution New Applications Virtual Screening for New Drug Design Global Risk Management for financial investment 3D image rendering Supplementary plug-in Remote backup service

20 - 20 - 16 th APAN Meetings, BUSAN, KOREA Future works Make agents more intelligent with P2P MPI-like API for application developer Fault-tolerance : checkpointing & rollback recovery IPv6 enables Open-Source

21 - 21 - 16 th APAN Meetings, BUSAN, KOREA Thanks a lot! ^^ chan@kisti.re.kr


Download ppt "P2P Distributed Computing Platform: C.Y. ‘Connor’ Park KISTI Supercomputing Center."

Similar presentations


Ads by Google