Presentation on theme: "Ghost, phantoms and illusions are the neural basis of tonal music Dante R. Chialvo Northwestern University. Chicago, IL. ChialvoLab.Northwestern.Edu."— Presentation transcript:
Ghost, phantoms and illusions are the neural basis of tonal music Dante R. Chialvo Northwestern University. Chicago, IL. firstname.lastname@example.org ChialvoLab.Northwestern.Edu
Si el ojo puede ser considerado una cámara fotográfica, el oido seguro que No es un microfono Short Summary: If the eye can be seen as a camera, the ear surely is NOT a microphone Resumen corto:
We look at mathematical models to determine how the auditory periphery (the 1 st neuron) could solve complex problems usually attributed to central processors. First, we solve a problem first investigated by Pythagoras, later by Ohm and von Helmholtz: how the brain determines the pitch of a complex sound. We will make three points: 1)The output of even a single noisy neuron driven by multiple frequencies are spikes spaced at the inverse of the ghost frequency we call pitch. 2) We find an expression to predict the frequency of the ghost resonance for some arbitrary inputs. 3)The ghost resonance suggests the presence of phantoms and other sensory illusions which will be discussed ten years from now. Then, we look at the neural mechanism of consonance, the basis of tonal music, finding that can be mapped almost trivially to the same pitch problem we just solved. Last, investigating ways to falsify the theory we found new results applying to another classic unsolved problem, the octave enlargement.
The problem: How do we perceive pitch of a complex tone ?
The big big picture The general tendency in the field is: More complex acoustic attributes => much higher cortical process. Notice that this chart starts at the brainstem…
Algo asi como que puede hacer una neurona por si sola? Tres cosas preliminares: 1) Miremos como luce el input 2) Que sabemos acerca de como responden las neuronas - a señales periodicas sin ruido (deterministic) 3) Que sabemos acerca de como responden las neuronas - a señales periodicas ruidosos (stochastic) Instead we look at generic dynamical properties of neurons
Time 1 2 3 4 5 6 7 8 The fundamental is not so fundamental! x(t) x(t) = (cos f 1 t + cos f 2 t +cos f 3 t+ … cos f n t) /n f n = q f 0 Frequency q Spectrum
The fundamental is not so fundamental (Regardless of phase or harmonicity) x(t) shifted Frequency Time f f Random phase Equal phase q Spectrum 1 2 3 4 5 6 7 8 x(t) = (cos f 1 t + cos f 2 t +cos f 3 t+ … cos f n t) /n f n = q f 0 + f
N:M 1:11:0 2:1 n:m n+N:m+M 3:23:1 5:2 5:3 4:3 4:1 … Patterns of spikes are predicted by Fareys series* continue *Chialvo, Nature 330, 1987 M/N 2:1 3:2 5:3 3:1
1:1 1:0 2:1 no3:1 no 4:1 The average pattern of spikes are period adding (N:1) sequences etc:1 Inter-spike interval Log # Spikes
How we perceive pitch of a complex tone ? Cual es el proceso neuronal mas simple que produce spike trains conteniendo el codigo del pitch de un tono complejo? Respuesta corta: The non dynamical threshold-crossing model If x(t) > U th the system emits a spike
Ghost Stochastic Resonance = noise intensity at the largest proportion of spikes with intervals ~ 1/ f0 The neuron respond to a frequency not present in the input (ghost) f2 = 3*f0 f1 = 2*f0
Ghost resonance for mistuned two-frequencies signals x(t)= A (cos f 1 t + cos f 2 t ) + f 1 = qf o + f f 2 = (q+1)f o + f Neuron response to two-frequencies tones for increasing f plotted as a function of f 1 with k=2k=3k=4 k=5 k=6 f p ~ 1/(k+1/2)
The neuron response to mistuned complex tones can be generalized for even or odd number of tones For inputs composed of N sinusoidal signals of frequencies: the resonance occur at frequencies: Two freq. Three freq.
Data, Theory and Numerics overimposed (no fitting)
Cariani P.A. and Delgutte B., J. Neurophysiol. 76, 1698-1716, 1996 How it compares with In Vivo Experiments (Cariani) Our theory
Short list of recent Ghost Stochastic Resonance work: Molecular motors (ratchets) driven by 2F ( Fabio Marchesoni and colleagues). Models of climate changes (Holger Braun and colleagues). Lasers (Martin Buldu, Jordi Garcia-Ojalvo and colleagues). Electric fish sensory system (Longtin and colleagues) Ghost resonance is a general phenomenon
Missing Fundamental Ghost resonance in vision* *K. Fujii et al, Psychological Research (2000) 64:149-154.
Another twist: As seen, the intervals between spikes is determined by the shape in time of the complex tone, Thus, what will be perceived for amplitude modulated white noise? Shhhh…Shhhh…Shhhh…Shhhh…Shhhh… From Ghosts to Phantoms
The input signal frequency spectrum Input Signal Notice that the input signal spectrum is flat noise 1/fo
The input spectrum is flat The ouput spikes at preferred intervals ~ 1/f0 White noise is perceived not as noise but as a periodic signal with 1/fo frequency Obviamente si el oido fuese un microfono, debieramos percibir ruido....
White noise is perceived not as noise but as a periodic signal with 1/fo frequency
A short list of what we have learned: 1)The output of even a single noisy neuron driven by multiple frequencies are spikes spaced at the inverse of the pitch. 2) A simple expression predicts the pitch for many arbitrary inputs (which perfectly agrees with both psychophysics and neural data). 3)The mechanism (ghost stochastic resonance) suggests the presence of phantoms and other sensory illusions. 4)The perception of ghosts and phantoms clearly show that the ear is not a microphone.
Pythagoras discovered that two similar strings under the same tension sounded together sound pleasant if the length of the strings are in the ratio of two small integers …. (1:1, 2:1, 3:2… n:m ) The problem: What is the neural mechanism of consonance The first law of nature ruled by arithmetic of integers: Consonance
Inconsistent! According with this picture pure tones consonance is left undefined A tendency is to think on terms of frequency More coincident harmonics imply better consonance 1:1 > 2:1 > 3:2 > 4:3 > 45:32
Unison Octave Galileo (and independently Mersenne) explained consonance as the regularity of the intervals such that the eardrum is not kept at perpetual torment La solucion: Tonos puros que suenan consonante tienen la misma altura y la neurona descarga a intervals de 1/altura
Interval is more telling than 1/Frequency Unison Octave La solucion: Tonos complejos que suenan consonante tienen la misma altura y la neurona descarga a intervals de 1/altura
Conclusion 1:Two tones (simple or complex) sound consonance when they have the same pitch Conclusion 2: Altua y consonance son la misma cosa para una neuroan Conclusion 3:The model objectively judges both pitch and consonance (algo asi como un pichichometro o consonometro) Conclusion 4: Dynamical properties of the auditory periphery can do highly non- trivial processing including the extraction of the pitch of arbitrarily complex tones and the judgment of consonance. What else?
The problem: to be consonant higher octaves need a few more % Psycho-acoustic DataSpike Trains Data So called enlargement of the octave
The solution: Enlargement of the octave can be explained again on the basis of dynamical properties of neurons, (i.e., incomplete recovery from the previous spike) but I am out of time… Time to summarize:
BlahBlahlogy By looking at the dynamics of toy neuron models we work out a long unsolved problem: The brain (can) determine(s) the pitch of a complex sound by the combination of a linear superposition plus a nonlinear noisy threshold crossing process. We find the expression predicting the frequency of the ghost resonance for some arbitrary inputs. Phantoms and other illusions can be created in similar ways and surely are hiding new surprises. Consonance can be judged even by a single neuron in exactly the same way than pitch. The ear is not a microphone Papers: www.chialvo.net
How we perceive pitch of a complex tone ? Labeling the time of each spike as t spike, average the forcing for t=t spike - t,t spike + t. What do you see for the case of SR? Answer: The input periodic forcing What do you see for the case of Ghost SR? Answer: The ghost What do you see for the case of AM white noise? Answer: Nothing.
Replicated experimentally in semiconductor lasers with optical feedback UPC (Barcelona): Javier Martin-Buldu, Jordi Garcia Ojalvo, Carme Torrent and UIB (Mallorca): Claudio Mirasso Ghost Resonance in a Semiconductor Laser with Optical Feedback