1. FutureGrid Cyberinfrastructure for Computational Research

2. FutureGrid Goals  An environment that can be used for middleware developers to develop and test middleware  An environment that can instantiate a wide variety of computing environments (ranging from current TeraGrid software, VMs, cloud, grid systems other than TG) for development and testing of applications on experimental basis in a test bed, in replicable ways  Education related to all of the above  US Industry research related to the above

3. FutureGrid Components Compute – flexible deployment of images, VM's, clouds Storage – local storage sufficient to facilitate projects, Lustre for larger projects Network – Dedicated networks between FutureGrid sites, Impairment Device

4. Compute Hardware System type# CPUs# CoresTFLOPSTotal RAM (GB) Secondary Storage (TB) Site Status Dynamically configurable systems IBM iDataPlex2561024113072339*IU New System Dell PowerEdge1927688115230TACC New System IBM iDataPlex16867272016120UC New System IBM iDataPlex1686727268896SDSC Existing System Subtotal7843136338928585 Systems not dynamically configurable Cray XT5m16867261344339*IU New System Shared memory system TBD 404804640339*IU New System 4Q2010 IBM iDataPlex6425627681UF New System High Throughput Cluster 1923844192PU Existing System Subtotal46417921629441 Total124849284911872586

5. Storage Hardware System TypeCapacity (TB)File SystemSiteStatus DDN 9550 (Data Capacitor) 339LustreIUExisting System DDN 6620120GPFSUCNew System SunFire x417096ZFSSDSCNew System Dell MD300030NFSTACCNew System FutureGrid has a dedicated network (except to TACC) and a network fault and delay generator Experiments can be isolated by request Additional partner machines may run FutureGrid software and be supported (but allocated in specialized ways)

6. Logical Network Diagram

7. Network Impairments Device Spirent XGEM Network Impairments Simulator for jitter, errors, delay, etc Full Bidirectional 10G w/64 byte packets up to 15 seconds introduced delay (in 16ns increments) 0-100% introduced packet loss in.0001% increments Packet manipulation in first 2000 bytes up to 16k frame size TCL for scripting, HTML for manual configuration

8. 08/25/10http://futuregrid.org

9. FutureGrid Architecture Open Architecture allows to configure resources based on images Managed images allows to create similar experiment environments Experiment management allows reproducible activities Through our modular design we allow different clouds and images to be “rained” upon hardware. Will support deployment of preconfigured middleware including TeraGrid stack, Condor, BOINC, gLite, Unicore, Genesis II

10. Software Goals Open-source, integrated suite of software to – instantiate and execute grid and cloud experiments. – perform an experiment – collect the results – tools for instantiating a test environment TORQUE, Moab, xCAT, bcfg, and Pegasus, Inca, ViNE, a number of other tools from our partners and the open source community Portal for interacting with tools – Benchmarking 08/25/10http://futuregrid.org10

11. Draft GUI for FutureGrid Dynamic Provisioning Draft GUI for FutureGrid Dynamic Provisioning

12. Command line fg-deploy-image – host name – image name – start time – end time – label name fg-add – label name – framework hadoop – version 1.0 Deploys an image on a host Adds a feature to a deployed image 08/25/10http://futuregrid.org12

13. FG Stratosphere Objective – Higher than a particular cloud – Provides all mechanisms to provision a cloud on a given FG hardware – Allows the management of reproducible experiments – Allows monitoring of the environment and the results Risks – Lots of software – Possible multiple path to do the same thing Good news – We worked in a team, know about different solutions and have identified a very good plan – We can componentize Stratosphere 08/25/10http://futuregrid.org13

14. Change underlying system to support current user demands Linux, Windows, Xen/KVM, Nimbus, Eucalyptus Stateless images Shorter boot times Easier to maintain Stateful installs Windows Use Moab to trigger changes and xCAT to manage installs 08/25/1014http://futuregrid.org Dynamic Provisioning

15. Experiment Manager Objective – Manage the provisioning for reproducible experiments – Coordinate workflow of experiments – Share workflow and experiment images – Minimize space through reuse 08/25/10http://futuregrid.org15

16. Getting started with FutureGrid www.futuregrid.org Account/Project request – Nimbus/Eucalyptus account for those systems, if needed Getting started information at www.futuregrid.org/tutorials www.futuregrid.org/tutorials Mail help@futuregrid.org for any issueshelp@futuregrid.org

17. Acknowledgements FutureGrid - http://www.futuregrid.org/ NSF Award OCI-0910812 NSF Solicitation 08-573 – http://www.nsf.gov/pubs/2008/nsf08573/nsf08573.htm ViNe - http://vine.acis.ufl.edu/ Nimbus - http://www.nimbusproject.org/ Eucalyptus - http://www.eucalyptus.com/ VAMPIR - http://www.vampir.eu/ Pegasus - http://pegasus.isi.edu/