Grid Appliance The World of Virtual Resource Sharing Group # 14 Dhairya Gala Priyank Shah

Agenda Introduction to Grid Appliances Implementation Results and Conclusions Knowledge Gained Implementation Timeline Future Work Acknowledgements

Introduction to Grid Appliance The Grid appliance is a plug-and-play virtual machine appliance intended for Grid computing to execute many long-running simulations concurrently in resources across virtual machines that can be distributed across the world.

Features  Setting up on demand ad-hoc virtual resource pools.  OS independent.  Use of VM’s helps run multiple operating systems simultaneously and isolated from each other, but on the same computer.  Application independent.  Easy to configure and use.  Plug and play solution that can run on the desktop.

Grid Appliance - Insight  Virtual machine with its own operating system.  Linux and Grid middleware  Connects individual appliances in the virtual network using IPOP at P2P level.  Uses Condor for job scheduling.

Implementation  Configure Twister Appliance environment  Package Twister Iterative Map-Reduce along with the Grid Appliance framework  Run distributed applications over the configured Twister Appliance Virtual network  Run distributed applications with same configuration over a standard cluster  Evaluate the computational performance of the two environments

Evaluation Parameters  Applications  Kmeans Clustering  WordCount  PageRank Algorithm  Number of compute nodes  Nodes  Input data size  Kmeans Clustering - 80K to 3 million (data points)  WordCount GB to 0.5 GB (text file size)  PageRank Algorithm - 50K to 300K (number of URL’s)

Results(1) Execution Time: Grid Appliance > Standard Cluster

Results(2) With increase in the number of nodes, it behaves as any other environment running distributed application would.

Results(3) Speed-up: Not ideal but acceptable.

Conclusions  Grid Appliance brings with it a small but an acceptable dip in the system performance,  But is accompanied by,  Independence from cloud service providers  Expected results  Ease of configuration  Ease of resource availability due to its ad-hoc nature  Real World Applicability

Knowledge Gained  In-depth understanding of Grid Appliance Framework  Closer look at Twister Framework  Team Work  Designing a Poster

Timeline TaskSchedule Configure Twister Appliance environmentOct 24, 2011 Running distributed applications over a standard cluster Oct 31, 2011 Run distributed applications over the configured Twister Appliance Virtual network Nov 14, 2011 Evaluate the computational performance of the two environments Nov 28, 2011

Future Work Perform intensive Testing by:  Running more data parallel applications  Increasing the number of compute nodes  Increasing the data size used for the applications  Running the application for a large number of times and at different times of the day  Conducting some kind of a reliability check

Acknowledgements  Prof. Judy Qiu  Stephen Wu  FutureGrid Team Special Thanks to Prof. Renato Figueiredo (University of Florida)

Thank You !! Questions ??