1. Self-organizing Maps Kevin Pang

2. Goal Research SOMs Research SOMs Create an introductory tutorial on the algorithm Create an introductory tutorial on the algorithm Advantages / disadvantages Advantages / disadvantages Current applications Current applications Demo program Demo program

3. Self-organizing Maps Unsupervised learning neural network Unsupervised learning neural network Maps multidimensional data onto a 2 dimensional grid Maps multidimensional data onto a 2 dimensional grid Geometric relationships between image points indicate similarity Geometric relationships between image points indicate similarity

4. Algorithm Neurons arranged in a 2 dimensional grid Neurons arranged in a 2 dimensional grid Each neuron contains a weight vector Each neuron contains a weight vector Example: RGB values Example: RGB values

5. Algorithm (continued…) Initialize weights Initialize weights Random Random Pregenerated Pregenerated Iterate through inputs Iterate through inputs For each input, find the “winning” neuron For each input, find the “winning” neuron Euclidean distance Euclidean distance Adjust “winning” neuron and its neighbors Adjust “winning” neuron and its neighbors Gaussian Gaussian Mexican hat Mexican hat

6. Optimization Techniques Reducing input / neuron dimensionality Reducing input / neuron dimensionality Random Projection method Random Projection method Pregenerating neuron weights Pregenerating neuron weights Initialize map closer to final state Initialize map closer to final state Restricting “winning” neuron search Restricting “winning” neuron search Reduce the amount of exhaustive searches Reduce the amount of exhaustive searches

7. Conclusions Advantages Advantages Data mapping is easily interpreted Data mapping is easily interpreted Capable of organizing large, complex data sets Capable of organizing large, complex data sets Disadvantages Disadvantages Difficult to determine what input weights to use Difficult to determine what input weights to use Mapping can result in divided clusters Mapping can result in divided clusters Requires that nearby points behave similarly Requires that nearby points behave similarly

8. Current Applications WEBSOM: Organization of a Massive Document Collection WEBSOM: Organization of a Massive Document Collection

9. Current Applications (continued) Phonetic Typewriter Phonetic Typewriter

10. Current Applications (continued) Classifying World Poverty Classifying World Poverty

11. Demo Program Written for Windows with GLUT support Written for Windows with GLUT support Demonstrates the SOM training algorithm in action Demonstrates the SOM training algorithm in action

12. Demo Program Details Randomly initialized map Randomly initialized map 100 x 100 grid of neurons, each containing a 3- dimensional weight vector representing its RGB value 100 x 100 grid of neurons, each containing a 3- dimensional weight vector representing its RGB value Training input randomly selected from 48 unique colors Training input randomly selected from 48 unique colors Gaussian neighborhood function Gaussian neighborhood function

13. Screenshots

14. Questions?