1. Neural Network Models in Vision Peter Andras peter.andras@ncl.ac.uk

2. The Visual System R LGNV1 V2 V4 V3 V5 Higher Lower

3. Neurons Rod Horizontal Bipolar Amacrine Ganglion

4. Neuron Models The McCullogh-Pitts model Inputs Output w2w2 w1w1 w3w3 wnwn w n-1... x 1 x 2 x 3 … x n-1 x n y

5. Neuron Models The Hodgkin-Huxley Model Na + K+K+ K+K+ K+K+ K+K+ K+K+ K+K+ K+K+ K+K+

6. Modelling Methodology Physiological measurements Stimulus Response Electrode Other methods: EEG, MRI, PET, MEG, optical recording, metabolic recording

7. Modelling Methodology Response characterisation in terms of stimulus properties Stimulus

8. Modelling Methodology Models: A. Statistical models: large number of neurons, with a few well-defined properties, the response is analysed at the population level;

9. B. Macro-neural models: simplified model neurons organised in relatively simple networks, the overall input-output relationship of the full network is analysed; Modelling Methodology Models:

10. C. Micro-neural models: the neurons are modelled with many details and models of individual neurons or networks of few detailed neurons are analysed. Modelling Methodology Models:

11. Modelling Methodology Physiological measurements Response characterisation Model selection OBJECTIVE 1: match the measured response properties by the response properties of the model. OBJECTIVE 2: test the theories, generate predictions.

12. Neural Network Models Retina: ON and OFF centre ganglion cells Bipolar cells +1 ONOFF Preferred stimulus

13. Neural Network Models Retina: ON and OFF centre ganglion cells Measured response of an ON cellThe response of a model ON cell

14. Neural Network Models V1: Orientation selective cells Preferred stimulus LGN cells

15. Neural Network Models V1: Orientation selective cells MeasurementModel

16. Neural Network Models V1: Ocular dominance patterns and orientation maps

17. Neural Network Models V1: Ocular dominance patterns and orientation maps Neuron = Feature vector: orientation preference; spatial frequency; eye preference; temporal frequency; Training principles: the neuron fires maximally when the stimulus matches its preferences set by the feature vector; the neuron fires if its neighbours fire; when the neuron fires it adapts its feature vector to the received stimulus.

18. Neural Network Models V1: Ocular dominance patterns and orientation maps Mathematically: Neurons: (w i, c i ); w i – feature vector; c i – position vector; Training set: x t, training vectors, they have the same dimensionality as the feature vectors; Training: i* = index of the neuron for which d(w i*, x t ) < d(w i, x t ), for every i  i*; w i = (1- ) w i + x t, for all neurons with index i, for which d(c i, c i* ) < .

19. Neural Network Models V1: Contour detection Stimulus

20. Neural Network Models V1: Contour detection Neural interactions: specified by interconnection weights. Mechanism: constraint satisfaction by mutual modification of the firing rates. Result: the neurons corresponding to the contour position remain active and the rest of the neurons become silent.

21. Neural Network Models V5: Motion direction selective cells Orientation selective cells delay effect +1 Preferred stimulus

22. Neural Network Models Visual object detection Object Features: colour; texture; edge distribution; contrast distribution; etc. Invariant combination of features Object detection

23. Neural Network Models Visual object detection Method 1: Hierarchical binary binding of features Colour Texture Edges Contrast This method leads to combinatorial explosion.

24. Neural Network Models Visual object detection Method 2: Non-linear segmentation of the feature space. Colour Texture Edges Contrast Learning by back-propagation of the error signal and modification of connection weights.

25. Neural Network Models Visual object detection Method 3: Feature binding by synchronization.

26. Critical Evaluation Neural network models typically explain certain selected behavioural features of the modelled neural system, and they ignore most of the other aspects of neural activity. These models can be used to test theoretical assumptions about the functional organization of the neurons and of the nervous system. They provide predictions with which we can determine the extent of the validity of the model assumptions. One common error related to such models is to invert the causal relationship between the assumptions and consequences: i.e., the fact that a model produces the same behavior as the modelled, does not necessarily mean that the modelled has exactly the same structure as the model.

27. Revised View of the Neural Network Models Revised interpretation: neurons = anatomical / functional modules (e.g., cortical columns or cortical areas); connections = causal relationships (e.g., activation of bits of LGN causes activation of bits of V1); activity function of a neuron = conditional distribution of module responses, conditioned by the incoming stimuli;

28. Revised View of the Neural Network Models Neural network modelBayesian network model x1x1 x2x2 x3x3 x4x4 f 1 (x 1 ) f 2 (x 2 ) f 3 (x 3 ) f 4 (x 4 ) y1y1 y2y2 y3y3 y4y4 f(y 1, y 2, y 3, y 4 ) y y i = f i (x i ) y = f(y 1, y 2, y 3, y 4 ) x1x1 x2x2 x3x3 x4x4 y1y1 y2y2 y3y3 y4y4 y P(y 1 |x 1 ) P(y 2 |x 2 ) P(y 3 |x 3 ) P(y 4 |x 4 ) P(x 1, x 2, x 3, x 4 ) P(y | y 1, y 2, y 3, y 4 ) P(x 1, x 2, x 3, x 4 ) P(y i | x i ) P(y | y 1, y 2, y 3, y 4 )

29. Revised View of the Neural Network Models Advantages of the Bayesian interpretation: relaxes structural restrictions; makes the models conceptually open-ended; allows easy upgrade of the model; allows relaxed analytical search for minimal complexity models on the basis of data; allows statistically sound testing;

30. Conclusions Neuron and neural network models can capture important aspects of the functioning of the nervous system. They allow us to test the extent of validity of the assumptions on which the models are based. A common mistake related to neural network models is to invert the causal relationship between assumptions and consequences. This can lead to far reaching conclusions about the organization of the nervous system on the basis of natural-like functioning of the neural network models that are invalid. The Bayesian reinterpretation of neural network models relaxes many constraints of such models, makes their upgrade and evaluation easier, and prevents to some extent incorrect interpretations.

31. Seminar Papers 1. PNAS, 93, 623-627, Jan. 1996 2. PNAS, 96, 10530-10535, Aug. 1999