1. www.verce.eu VERCE Cloud presentation. EGI CF 2014. www.verce.eu VERCE & Cloud Steffen Claus Lion Krischer Andre Gemünd Virtual Earthquake and seismology Research Community e-science environment in Europe Project 283543 – FP7-INFRASTRUCTURES-2011-2 – www.verce.eu – info@verce.eu

2. www.verce.eu VERCE Cloud presentation. EGI CF 2014. Project FP7 CP-CSA INFRA No. 283543 10/2011 – 09/2015 10 partners Coordinator: CNRS IPGP Partners in EPOS (ESFRI) 19/05/2014

3. www.verce.eu VERCE Cloud presentation. EGI CF 2014. 19/05/2014

4. www.verce.eu VERCE Cloud presentation. EGI CF 2014. Goals “The VERCE project is designing and developing a research platform to deliver a seismology and earthquake community e-Infrastructure, an integrated computational and data environment that presents a coherent virtual environment in which to conduct research.” 19/05/2014

5. www.verce.eu VERCE Cloud presentation. EGI CF 2014. Goals Easy-to-use platform to carry out recurrent tasks – Identified use-cases by questionnaire, extract schemes – not too abstract: keep power in the hands of the researchers. Efficiently use available resources – e-Infras: HPC, Grid, Cloud, e.g. PRACE, EGI – Seismology resources, e.g. European Integrated Data Archive (EIDA) Incorporated Research Institutions for Seismology (IRIS) – Institutional resources, e.g. private clusters, storage etc. 19/05/2014

6. www.verce.eu VERCE Cloud presentation. EGI CF 2014. Current middleware stack 19/05/2014

7. www.verce.eu VERCE Cloud presentation. EGI CF 2014. Current middleware stack 19/05/2014 VERCE iRODS federation (will be presented)

8. www.verce.eu VERCE Cloud presentation. EGI CF 2014. Current middleware stack 19/05/2014 Running verce.eu VO in EGI - ESR as alternative

9. www.verce.eu VERCE Cloud presentation. EGI CF 2014. Use cases Result of a survey at the start of the project Data intensive – Noise cross-correlations at the Valhall field – L'Aquila 2009 earthquake - crustal velocity variation by means of seismic noise cross correlation – Relative crustal velocity variations – Automatic Detection and High Resolution Location of Italian Seismicity – Automatic high resolution location of Maule aftershocks CPU intensive – High Resolution Tomography from 3D full waveform inversion in Italy – Forward Modelling and Inversion – TSUMAPS 19/05/2014

10. www.verce.eu VERCE Cloud presentation. EGI CF 2014. Use cases Prioritized for implementation 1.Seismic noise cross-correllation example for data-oriented processing DISPEL workflow enactment stream-based OGSA-DAI / Storm cluster processing 2.Forward modelling and Inversion computational intensive – makes use of HPC resources 19/05/2014

11. www.verce.eu VERCE Cloud presentation. EGI CF 2014. Use cases Forward modelling and Inversion Discover and collect data from different seismological data centres, networks, etc. Pre-process data Simulate event – Setup: input parameters, meshes, partitioning … – Submission to HPC resource » SeisSol, SpecFEM3D, Axisem, Ses3d/Sec3d, COMCOT… – Collect results Post-process, analyse, misfits etc. Adjoint simulation -> model update -> forward simulation again 19/05/2014

12. www.verce.eu VERCE Cloud presentation. EGI CF 2014. venue, date

13. www.verce.eu VERCE Cloud presentation. EGI CF 2014. venue, date

14. www.verce.eu VERCE Cloud presentation. EGI CF 2014. Cloud in VERCE Simulation is on HPC – resource intensive computations, often communication-bound MPI codes – still, it could be run on Cloud resources, but implementation was not first priority. Complementary: – Elastic service hosting (Gateway, Databases, etc.) – Prototyping – Pre-/Postprocessing – Comparison, filtering, etc. – Mining in result and measurement data 19/05/2014

15. www.verce.eu VERCE Cloud presentation. EGI CF 2014. Cloud in VERCE Providing images for direct use: – Client VM: contains all middleware clients (Globus, gLite, UNICORE, iRODS, …) – App VM: contains validated applications (Specfem3D, Obspy, etc.) – Full VM: both of the above – Docker image: Obspy recipe based on Debian 6 19/05/2014

16. www.verce.eu VERCE Cloud presentation. EGI CF 2014. Cloud in VERCE Cloud-enable verce.eu VO: – Working with EGI FedCloud TaskForce to provide Cloud resources to verce.eu VO – Instantiate virtual machines etc. using your VOMS proxy credentials – Openstack @ SCAI will be usable soon, hopefully more sites will follow 19/05/2014

17. www.verce.eu VERCE Cloud presentation. EGI CF 2014. Distributed trace processing Software as a Service offering Comfortable data discovery with Map interface Automatic download of data and station meta data from data center web services (fdsn-ws) Process downloaded data with ObsPy, transparently scaling in the background Input and processed output plotted for first inspection and accessible for download or further processing (staging to other resources) as miniseed files Submitted as EGI FedCloud Use-Case 19/05/2014

18. www.verce.eu VERCE Cloud presentation. EGI CF 2014. Python Toolbox for seismology/seismological observatories: facilitate rapid application development for seismology. Read and write waveform data in various formats (MiniSEED, SAC, GSE, SEG Y,... ) with a unified interface. Database and webservice access clients for NERIES, IRIS DMC, ArcLink, SeisHub and Earthworm. Many seismological signal processing routines like filters, trigger, instrument correction, array analysis, beamforming,... Support for inventory data (SEED, XSEED, RESP, StationXML…) Experimental event data handling Waveform, spectrogram and beachball plotting, data availability http://obspy.org 19/05/2014

19. www.verce.eu VERCE Cloud presentation. EGI CF 2014. Distributed trace processing Motivation: – Most seismological webservices only offer raw data which is usually not directly usable for science. – If they allow processing, then only a few parameters and not very flexible. – Scientists spend a lot of time on selecting, acquiring, and processing data. – Our approach allows for interactive selection, automatic acquisition, and the application of arbitrarily complex processing in a framework thats easy to use for domain scientists => Faster time to research – Visual verification of the result. 19/05/2014

20. www.verce.eu VERCE Cloud presentation. EGI CF 2014. Distributed trace processing Architecture – Two types of Virtual Machines: frontend & worker Frontend – GWT-based GUI, can also be embedded in Liferay as portlet (e.g. VERCE Science Gateway) – message queue (beanstalkd) Worker – run python daemons that retrieve jobs including FDSN parameters & source code – batch download of event data from dataselect service and corresponding station meta data (e.g. instrument repsonse) from station service – spawn processing in Sandbox (isolated Docker container) 19/05/2014

21. www.verce.eu VERCE Cloud presentation. EGI CF 2014. 19/05/2014 Cloud-Storage Web- App Python Frontend VM n Browser 2 2 Python VM 1 Message queue Sandbox FDSN Service 1 1 query 3 3 Jobs 4 4 4 4 store results 5 5 Load 6 6 results 7 7

22. www.verce.eu VERCE Cloud presentation. EGI CF 2014. Distributed trace processing Usage scenarios: – User spawns frontend & arbitrary workers in private account – Group like VERCE hosts service for external access Easy scaling through message queue communication – VMs require network access to frontend and shared (e.g. object) storage for file exchange 19/05/2014

23. www.verce.eu VERCE Cloud presentation. EGI CF 2014. WORK IN PROGRESS DEMO 19/05/2014

24. www.verce.eu VERCE Cloud presentation. EGI CF 2014. Event search Discover events through querying fdsnws-event service. Search by date, magnitude, coordinates, bounding box, depth, etc. 19/05/2014

25. www.verce.eu VERCE Cloud presentation. EGI CF 2014. Event search Choose event from metadata 19/05/2014

26. www.verce.eu VERCE Cloud presentation. EGI CF 2014. Station search Search for stations offering data from date and location corresponding to selected event. User can also start here by specifying these parameters directly instead of through an event. 19/05/2014

27. www.verce.eu VERCE Cloud presentation. EGI CF 2014. Data selection Selecting instrument and channels on which to work through Obspy. Corresponding data will be batch-downloaded on a worker VM from fdsnws-dataselect. 19/05/2014

28. www.verce.eu VERCE Cloud presentation. EGI CF 2014. Scripting Write ObsPy code to execute (GUI will be changed to a more comfortable code editor soon). Access to all ObsPy functionality, a Stream object grouping traces of different directions (XY?, e.g. East, North, Z (vertical)) and an Inventory containing the station and instrument response data retrieved from fdsnws-station. 19/05/2014

29. www.verce.eu VERCE Cloud presentation. EGI CF 2014. Example code # Detrend stream.detrend("linear") stream.detrend("demean") # Taper stream.taper(type="cosine",max_percentage=0.05) # Remove response stream.attach_response(inventory) stream.remove_respomnse(output="VEL", water_level=20, pre_filt=[0.01, 0.05, 1, 10]) # Filter stream.filter("bandpass", freqmin=0.1, freqmax=0.5) 19/05/2014

30. www.verce.eu VERCE Cloud presentation. EGI CF 2014. Preview & download results Preview results as they arrive from the workers. Shows plots of original and processed traces. Download miniseed files. 19/05/2014

31. www.verce.eu VERCE Cloud presentation. EGI CF 2014. Outlook Future plans – Deploy on FedCloud with autoscaling using OCCI with certificates – Improve user interface (code editor, instant response) – Provide quick access to library of common processing tasks – Improve scalability (improved code execution, caching, VM instantiation) – Upload results to VERCE iRODS federation 19/05/2014

32. www.verce.eu VERCE Cloud presentation. EGI CF 2014. QUESTIONS? Thanks for your attention. 19/05/2014