1. IST-2006-026409 www.eu-eela.org E-infrastructure shared between Europe and Latin America Music from Volcanoes on the Network Domenico Vicinanza CERN – Geneva – Switzerland University of Salerno - INFN Catania - Italy Conservatory of Music of Salerno - Italy Hugo Yepez Istituto Geofisico – EPN – Quito - Ecuador

2. IST-2006-026409 E-infrastructure shared between Europe and Latin America www.eu-eela.org TNC2007 - Copenhagen, May 21st 2007 2 Volcano eruption forecasting Currently no definitive method to predict the eruption of a volcano has been discovered or implemented (yet). Scientists monitor –seismic waves –number of earthquakes and the intensity of a specific type of quake (harmonic tremors) in the run up to eruptions. –changes in the shape of the volcano or concentrations of gases emitted from the cone.

3. IST-2006-026409 E-infrastructure shared between Europe and Latin America www.eu-eela.org TNC2007 - Copenhagen, May 21st 2007 3 The hope: music for forecasting By correlating spectra and melodies with precise stages of volcanic activity we hope to discover a sort of “signature tune” of an imminent eruption or earthquake. By identifying musical patterns that warn of an eruption it would be possible to implement civil protection measures, days or even hours before the event

4. IST-2006-026409 E-infrastructure shared between Europe and Latin America www.eu-eela.org Data audification can be considered as the acoustic counterpart of data graphic visualization, a mathematical mapping of information from data sets to sounds. Data audification is currently used in several fields, for different purposes: – science and engineering, – education and training, mainly as data analysis and interpretation tool. Although most data analysis techniques are exclusively visual in nature, data presentation and exploration systems could benefit greatly from the addition of sonification capabilities. Data Audification

5. IST-2006-026409 E-infrastructure shared between Europe and Latin America www.eu-eela.org Sonic representations are particularly useful when dealing with complex, high-dimensional data, or in data monitoring tasks where it is practically impossible to use the visual inspection, or for pattern detection. Research has shown that people are quite more confident in recognizing patterns audibly rather then visually Music theorists and researchers have carried out in centuries of history lots of techniques and methods to detect, study and classify musical phrases Main idea: Music as a language and music analysis as a tool to inspect scientific data Motivations

6. IST-2006-026409 E-infrastructure shared between Europe and Latin America www.eu-eela.org TNC2007 - Copenhagen, May 21st 2007 6 Advantages of hearing Hearing is non-directional It is surely easier to recognize a change in a sound with respect to a modification in something which has to be looked at. It is quite impossible to distinguish a blinking light flashing 100 times a second from another one flashing at 200, 1000, or 10000 times a second, while anyone can recognize periodic signals from 20 Hz to (almost) 20000 Hz

7. IST-2006-026409 E-infrastructure shared between Europe and Latin America www.eu-eela.org TNC2007 - Copenhagen, May 21st 2007 7 Sonification on the GRID network First experiments involving sound production with INFN-GRID facilities started during the last months of 2003. In September 2003, it was installed CSound, a free and cross-platform acoustic compiler, on a GRID test site, the Catania INFN-GRID computer farm The compiler was tested within the new environment and since its beginning, the test phase produced interesting results: efficient use of the calculus resources, customizable quality of the audio files.

8. IST-2006-026409 E-infrastructure shared between Europe and Latin America www.eu-eela.org TNC2007 - Copenhagen, May 21st 2007 8 Computing power The computing power needed to run data sonification (and analyze patterns) and the mass storage to keep results are really large To create one minute of music coming from volcanoes, the algorithm has to process: –more than 2.6 Millions data –taking more than 100 Mb of disk space –and 10-12 CPU hours This is why GRID is a natural platform for this kind of studies Moreover the possibility granted by the Grid to have a unique distributed shared database accessible from the researcher of all the word will pave the way for an effective interaction among researchers

9. IST-2006-026409 E-infrastructure shared between Europe and Latin America www.eu-eela.org Sound production suite based on Java (equipped with the standard audio and math libraries), more flexible and easy to manage. All the results presented in this website have been carried on using this last approach: sample computation, audio rendering, DFT computing were obtained with the Java sonification program on the GRID Executable = "/bin/sh"; StdOutput = "sonification.out"; StdError = "sonification.err"; InputSandbox = {"sonification.sh", "Sonification.java", "etna.dat"}; OutputSandbox = {"Sonification.aiff", "Sound.dat","Spectrum.dat", "sonification.out","sonification.err", "logfile"}; RetryCount = 7; Arguments = "sonification.sh"; Java Sound Production Package

10. IST-2006-026409 E-infrastructure shared between Europe and Latin America www.eu-eela.org Sonified data were geophysical data collected by digital seismographs placed on the Etna volcano in Catania (Italy) and on Tungurahua volcano in Ecuador. Data from Tungurahua are transferred from the Ecuadorian NREN, CEIDA, to GARR in Italy via RedCLARA’s 622 Mbps connection to GEANT2 We carried out two sonifications: – seismogram straight sonification (tranformation into an audible waveform) – seismogram melodisation (tranformation into a melody) Sound form volcanoes Tungurahua (Picture: M. Monzier IRD/IG-EPN) Etna Volcano

11. IST-2006-026409 E-infrastructure shared between Europe and Latin America www.eu-eela.org TNC2007 - Copenhagen, May 21st 2007 11 About seismograms audification In both the cases, structural properties of the seismographic information would be straightly mapped into sound or melody properties In the first case, regularities in the seismograms will be reflected into spectral lines in the sonified signal In the second case, regularities in the seismograms will be transferred into regularities in the melody (such as a repeated set of data will become a repeated musical phrase)

12. IST-2006-026409 E-infrastructure shared between Europe and Latin America www.eu-eela.org Example of ASCII files processed (sample from Etna data): Starting time: 15/06/2001 00:03:39.920 Frequency: 100.1603 Hz Samples: 168960 44 43 42 44 44 46 43 45 Original data

13. IST-2006-026409 E-infrastructure shared between Europe and Latin America www.eu-eela.org TNC2007 - Copenhagen, May 21st 2007 13 First Sonification: From data to waveform Scaling procedure to properly arrange the samples in the [-1,1] interval, according to their sampling frequency. Users can specify in the sonification program a certain resample frequency (pitch shift). Setting resample factors in the Java code greater than 1 won't preserve the original pitch, allowing a frequency shift.......making audible regular phenomena happening at very low frequencies. In this way it is possible to observe and study periodical patterns, regular behaviors, long-range correlations, which can happen at different time scales.

14. IST-2006-026409 E-infrastructure shared between Europe and Latin America www.eu-eela.org The waveform coded in the audio file will have exactly the same regularities, also recognizable thanks to the presence of some higher lines in the spectrum. The order of magnitude of the frequency of quasi- regular phenomena is in the range 0-50 Hz, with a spectral envelope centered around 25-30 Hz. Quasi-regular phenomena 20x resampled Etna seismogram

15. IST-2006-026409 E-infrastructure shared between Europe and Latin America www.eu-eela.org Etna waveform and sonogram

16. IST-2006-026409 E-infrastructure shared between Europe and Latin America www.eu-eela.org TNC2007 - Copenhagen, May 21st 2007 16 Tungurahua Waveform

17. IST-2006-026409 E-infrastructure shared between Europe and Latin America www.eu-eela.org TNC2007 - Copenhagen, May 21st 2007 17 Spectral lines = Regular patterns Tungurahua Spectrum

18. IST-2006-026409 E-infrastructure shared between Europe and Latin America www.eu-eela.org TNC2007 - Copenhagen, May 21st 2007 18 Tungurahua Sonogram Time evolution of the spectrum. Each vertical slice is the spectrum at a certain time Oscillation pattern variations are clearly visible in the pattern

19. IST-2006-026409 E-infrastructure shared between Europe and Latin America www.eu-eela.org Etna Sonogram Etna sonogram

20. IST-2006-026409 E-infrastructure shared between Europe and Latin America www.eu-eela.org TNC2007 - Copenhagen, May 21st 2007 20 Data melodization The whole data set interval is mapped on the (equally tempered) piano keyboard The min value of the seismographic data will correspond to the lowest playable note on the piano keyboard The max value to the highest playable note

21. IST-2006-026409 E-infrastructure shared between Europe and Latin America www.eu-eela.org TNC2007 - Copenhagen, May 21st 2007 21 Main advantages Already available tools to manage MIDI files and analyze them Tracking the evolution of the musical intervals, the dynamics of their patterns, it is possible to detect, with an high level and in a customizable way, any kind of modifications in the shape of seismogram. Two example of MIDI analysis (free) software: Rubato (www.rubato.org)www.rubato.org MIDI Toolbox (http://www.jyu.fi/musica/miditoolbox/)http://www.jyu.fi/musica/miditoolbox/

22. IST-2006-026409 E-infrastructure shared between Europe and Latin America www.eu-eela.org TNC2007 - Copenhagen, May 21st 2007 22 MIDI Toolbox

23. IST-2006-026409 E-infrastructure shared between Europe and Latin America www.eu-eela.org TNC2007 - Copenhagen, May 21st 2007 23 Dynamic evolution of the tonalities (related to couples of adjacent values)

24. IST-2006-026409 E-infrastructure shared between Europe and Latin America www.eu-eela.org 0.0 0.587785252292 0.951056516295 0.951056516295 0.587785252292 0.0 -0.587785252292 -0.951056516295 -0.951056516295 -0.587785252292 0.0 0.587785252292 0.951056516295 0.951056516295 0.587785252292 0.0 Original data Example: Sinusoidal behavior Graphical representation

25. IST-2006-026409 E-infrastructure shared between Europe and Latin America www.eu-eela.org Sinus melodization Music representation (of the same set of data) Data are periodic, so the melody is periodic, with the same period

26. IST-2006-026409 E-infrastructure shared between Europe and Latin America www.eu-eela.org TNC2007 - Copenhagen, May 21st 2007 26 Melodization: a pictorial view Pictorially we can say that the melodization works by overlaying seismograms with music notes To create the volcanic score, we take a seismogram and trace the shape on to blank music bars. Then we overlay the contours with musical notes.

27. IST-2006-026409 E-infrastructure shared between Europe and Latin America www.eu-eela.org Seismograms Melodisation

28. IST-2006-026409 E-infrastructure shared between Europe and Latin America www.eu-eela.org Seismograms Melodisation

29. IST-2006-026409 E-infrastructure shared between Europe and Latin America www.eu-eela.org Seismograms Melodisation

30. IST-2006-026409 E-infrastructure shared between Europe and Latin America www.eu-eela.org … have you ever heard a volcano playing a piano ? Seismograms Melodisation

31. IST-2006-026409 E-infrastructure shared between Europe and Latin America www.eu-eela.org TNC2007 - Copenhagen, May 21st 2007 31 Melody follows the shape of the oscillation

32. IST-2006-026409 E-infrastructure shared between Europe and Latin America www.eu-eela.org TNC2007 - Copenhagen, May 21st 2007 32 First Etna-Tungurahua duet Players: Mt Etna: Piano Mt Tungurahua: Guitar

33. IST-2006-026409 E-infrastructure shared between Europe and Latin America www.eu-eela.org TNC2007 - Copenhagen, May 21st 2007 33 Reference sites: Etna Sonification website: http://grid.ct.infn.it/etnasound http://grid.ct.infn.it/etnasound Tungurahua Sonification web repository: http://grid.ct.infn.it/tungurahuasound http://grid.ct.infn.it/tungurahuasound MIDI Toolbox manual: http://www.jyu.fi/musica/miditoolbox/MIDI_Toolbox_Ma nual.pdf http://www.jyu.fi/musica/miditoolbox/MIDI_Toolbox_Ma nual.pdf

34. IST-2006-026409 E-infrastructure shared between Europe and Latin America www.eu-eela.org TNC2007 - Copenhagen, May 21st 2007 34 Thanks! …Questions