1. Virtual Laboratories VGL and Friends R.Fraser, T.Rankine, J.Vote, R.Woodcock AuScope Grid Roadshow 2014 CSIRO | MINERAL RESOURCES FLAGSHIP

2. Messy desk 2 | – where’s your analysis?

3. Let’s map it out… Hardcopy of data SSH Client Maths Package Proprietary Package Transform to a regular grid Crop data to area of interest Reformat data for processing Upload data to HPC resource Configure job and start processing Download results Get field data Visualise data 3 |

4. Components of a Virtual Laboratory Data Services Toolboxes Compute Services Enablers Virtual Laboratory 4 |

5. …to this 5 | Virtual Geophysics Laboratory Build “science” from existing libraries Run job Collect and publish results Discover (raw) data Select spatial bounds

6. Virtual Laboratories – Scientific Workflows Automated - Simplify access and integration Reproducible process Flexible – reusable, support differing licensing Allow scientists to focus on the science and not the tech Exploiting the Cloud and HPC Operational or education tool 6 |

7. Components of a Virtual Laboratory ToolboxesData Services Compute Services EnablersVirtual Laboratory 7 |

8. Data discovery 8 |

9. Data discovery 9 | Some data services support subsetting Some data services support reformatting e.g. CSV, NetCDF, GeoTIFF

10. Components of a Virtual Laboratory Data Services ToolboxesCompute Services EnablersVirtual Laboratory 10 |

11. Toolboxes & Compute Services 11 | A variety of different Toolboxes (scientific codes) are available Flexibility in what compute services to utilise

12. Toolboxes 12 | The steps so far have been building an environment to run a processing script...or build from existing templates Either write your own...

13. Components of a Virtual Laboratory Data Services ToolboxesCompute Services (OGC, Provenance) Virtual Laboratory Enablers 13 |

14. Virtual Geophysics Laboratory Build “science” from existing libraries Run job Collect and publish results Discover (raw) data Select spatial bounds Published Record Enablers/Provenance 14 | Standards are used to enable….”enough said” Provenance – information that describes creation of something Process record Audit trail Publish the actual method/process used to create the results!

15. What have we gained? 15 | Provenance “....documenting their procedures.......in VGL it is all recorded for us.” Data Access - “Geophysicists no longer have to spend days searching for data from multiple sources, downloading........ reformatting....” Reproducibility “......collaboration and sharing now possible” Barrier to Entry “......making geophysical processing and modelling tools available to the broader community at a far lower cost. It lowers the skills barrier to entry”

16. Components of the Virtual Geophysics Laboratory Data Services ToolboxesCompute Services Dynamic Virtual Geophysics Laboratories Magnetics Gravity DEM eScript Under world Petascale Compute Org. Cloud NeCTAR Cloud Amazon Cloud Desktop Service Orchestration VGL Portal Provenance Metadata Scripting Tool eScript Mag.Grav. Org. Cloud VGL Portal DEM Mag.Grav. Petascale Compute Org. Cloud Under world Enablers (OGC, Provenance) 16 |

17. Repurposing to a Virtual Hazards Laboratory (VHIRL) Dynamic Virtual Hazards Laboratories Magnetics Gravity DEM ANUGA eScript Petascale Org. Cloud NeCTAR Cloud Amazon Cloud Desktop Service Orchestration VHIRL Portal Provenance Metadata Scripting Tool ANUGA Mag.Grav. Petascale VHIRL Portal DEM BathyDEM Amazon Cloud Org. Cloud Landsat Bathymetry eScript Unchanged Data Services ToolboxesCompute Services Enablers (OGC, Provenance) 17 |

18. VL: Engagement My job (Provenance) Reproducible process My toolbox (Market Place) Analogous to cloud application store Automation My Field(VL core) Flexibility 18 |