E-science grid facility for Europe and Latin America Bridging the High Performance Computing Gap with OurGrid Francisco Brasileiro Universidade Federal de Campina Grande Brazil 4 th BELIEF International Symposium Future trends and e-Infrastructures application: towards sustainable development São Paulo,

4th BELIEF International Symposium, São Paulo, Brazil, Outline The High Performance Computing gap Bridging the HPC gap with P2P grids The OurGrid middleware for P2P grids –Architecture –Features –Applications Interoperability with other grid middleware Concluding remarks

4th BELIEF International Symposium, São Paulo, Brazil, Grid computing and e-Science The grid computing technology is one of the main enablers of e-Science –Facilitates the sharing of instruments, computers, storage, data, information, expertise, etc. –Allows the federation of large amounts of resources –Provides access to resources, otherwise, unreachable –Does all that in a dependable way  Secure, safe, reliable, highly available, manageable, etc.

4th BELIEF International Symposium, São Paulo, Brazil, Examples of production grids Several grid facilities are currently in production They can be broadly divided in two classes –Dedicated service grids  EGEE, TeraGrid, OSG and many others –Voluntary computing grids  BOINC 

4th BELIEF International Symposium, São Paulo, Brazil, The High Performance Computing gap Mainstream technologies are not affordable for most users –Need of negotiation to have access to grid resources –Complex software installation, configuration and maintenance Most small and medium-sized labs cannot afford the cost of these technologies Negotiating their entry in established infrastructure is also difficult, cause the usually have little to offer as counterpart

4th BELIEF International Symposium, São Paulo, Brazil, Peer-to-Peer grids Demand for local resources is not uniform Labs could exchange their idle resources 1 time CPU utilization for lab B 1 time CPU utilization for the P2P grid combining resources from labs A and B 1 time CPU utilization for lab A

4th BELIEF International Symposium, São Paulo, Brazil, The OurGrid architecture Security Site and resource sharing management Rendezvous service User interface and scheduling of jobs

4th BELIEF International Symposium, São Paulo, Brazil, Main OurGrid features Easy to install, manage and use –Firewall and NAT friendly Specialised support for bag-of-task applications –Efficient scheduling of jobs Built-in prioritisation mechanism for the exchange of idle resources –Robust incentive mechanism prevents free-riding –No need of central authority to negotiate entrance in the grid Flexible security portfolio –Optional support for PKI based on X.509 certificates

4th BELIEF International Symposium, São Paulo, Brazil, Applications already supported Simulations –Grid scheduling research –Optimization of oil pumping (PETROBRAS) –Weather and climate forecast (BRAMS) –Management of water resources (SegHidro applications, EPANET) Genecodis and BLAST (Bioinformatics) Protein folding Image rendering (Blender) E-Gov Software engineering (GridUnit: parallel jUnit tests) and many others …

4th BELIEF International Symposium, São Paulo, Brazil, Interoperability OurGrid can interoperate with other grid middleware –Bridging (uses technology developed by the EDGeS project)  Jobs submitted using any grid middleware are sent to a gateway that store them in a canonical format A web service interface provides a generic interface to the gateway and we currently support the submission of OurGrid and gLite jobs to the gateway  The gateway invokes plug-ins for different grid middleware, allowing the execution of the stored jobs in a grid running the particular grid middleware Currently we have plug-ins for OurGrid and gLite –Co-existence  Allows idle cycles of resources managed by a different middleware to be used opportunistically by a grid running OurGrid

4th BELIEF International Symposium, São Paulo, Brazil, Concluding remarks OurGrid is fast, secure and easy to use It is open-source –Contributions are welcome Supports several grid communities since December 2004 –Access status.ourgrid.org for a fresh snapshot of the public OurGrid Community Joining is automatic –Just go to and download the software –No paperwork required

What does OurGrid has to do with sustainability? For a grid infrastructure to be sustainable we must have its profit (the difference between its utility and its cost) as large as possible OurGrid helps in: –Reducing the entrance barrier by:  Allowing any available resource to be tapped into the grid (possibly in a shared way)  Lowering costs of deployment and maintenance –Increasing the impact of grids by:  Allowing many more users to have access and make good use of the technology

4th BELIEF International Symposium, São Paulo, Brazil, How to join OurGrid? Install an XMPP server in your site (we suggest FireFox) Configure the firewall to allow: –Local XMPP clients to connect to your site’s XMPP server –Remote XMPP servers to connect to your site’s XMPP server Install the Java package of the OurGrid peer in one of the machines in your site Install the Java package for the OurGrid broker in the machines of the grid users Install a virtual machine manager and the Java package of the OurGrid Worker in all machines that will be made available in the grid Edit the configuration files for the peer, broker and workers You are done!

4th BELIEF International Symposium, São Paulo, Brazil, Contacts Francisco Brasileiro OurGrid site ( –There are many research papers on OurGrid available at the web site –A good starting point is:  Labs of the world, unite!!! W. Cirne, F. Brasileiro, N. Andrade, L. Costa, A. Andrade, R. Novaes, M. Mowbray. Journal of Grid Computing 4 (3) (2006) Thanks for your attention! Questions?