Presentation is loading. Please wait.

Presentation is loading. Please wait.

S. Mandayam/ ANN/ECE Dept./Rowan University Artificial Neural Networks ECE.09.454/ECE.09.560 Fall 2008 Shreekanth Mandayam ECE Department Rowan University.

Similar presentations


Presentation on theme: "S. Mandayam/ ANN/ECE Dept./Rowan University Artificial Neural Networks ECE.09.454/ECE.09.560 Fall 2008 Shreekanth Mandayam ECE Department Rowan University."— Presentation transcript:

1 S. Mandayam/ ANN/ECE Dept./Rowan University Artificial Neural Networks ECE.09.454/ECE.09.560 Fall 2008 Shreekanth Mandayam ECE Department Rowan University http://engineering.rowan.edu/~shreek/fall08/ann/ Lecture 5 October 6, 2008

2 S. Mandayam/ ANN/ECE Dept./Rowan UniversityPlan Multilayer Perceptrons Recall - Backpropagation Begin Lab Project 2 Radial Basis Function Networks RBF Formulation Network Implementation Matlab Implementation

3 S. Mandayam/ ANN/ECE Dept./Rowan University Multilayer Perceptron (MLP): Architecture 1 1 1         x1x1 x2x2 x3x3 y1y1 y2y2   w ji w kj w lk Input Layer Hidden Layers Output Layer Inputs Outputs

4 S. Mandayam/ ANN/ECE Dept./Rowan University MLP: Signal Flow Function signal Error signal    Computations at each node, j Neuron output, y j Gradient vector, dE/dw ji Forward propagation Backward propagation

5 S. Mandayam/ ANN/ECE Dept./Rowan University MLP Training Forward Pass Fix w ji (n) Compute y j (n) Backward Pass Calculate  j (n) Update weights w ji (n+1) i j k Left Right i j k Left Right x y

6 S. Mandayam/ ANN/ECE Dept./Rowan University Lab Project 2 http://engineering.rowan.edu/~shreek /fall08/ann/lab2.htmlhttp://engineering.rowan.edu/~shreek /fall08/ann/lab2.html UCI Machine Learning Repository: http://www.ics.uci.edu/~mlearn/MLRepository.html

7 S. Mandayam/ ANN/ECE Dept./Rowan University RBF Principle Non-linearly separable classes Linearly separable classes Transform to “higher”-dimensional vector space

8 S. Mandayam/ ANN/ECE Dept./Rowan University Example: X-OR Problem x1x1 x2x2 (x)(x) (x)(x) Decision Boundary

9 S. Mandayam/ ANN/ECE Dept./Rowan University RBF Formulation Problem Statement Given a set of N distinct real data vectors (x j ; j=1,2,…,N) and a set of N real numbers (d j ; j=1,2,…,N), find a function that satisfies the interpolating condition F(x j ) = d j ; j=1,2,…,N

10 S. Mandayam/ ANN/ECE Dept./Rowan University RBF Network RBF Network 1 1 1     x1x1 x2x2 x3x3 y1y1 y2y2   1 w ij Input Layer Hidden Layer Output Layer Inputs Outputs -55 0 0.5 1  (t) t

11 S. Mandayam/ ANN/ECE Dept./Rowan University Matlab Implementation %Radial Basis Function Network %S. Mandayam/ECE Dept./Rowan University %Neural Nets/Fall 08 clear;close all; %generate training data (input and target) p = [0:0.25:4]; t = sin(p*pi); %Define and train RBF Network net = newrb(p,t); plot(p,t,'*r');hold; %generate test data p1 = [0:0.1:4]; %test network y = sim(net,p1); plot(p1,y,'ob'); legend('Training','Test'); xlabel('input, p'); ylabel('target, t') Matlab Demos » demorb1 » demorb3 » demorb4

12 S. Mandayam/ ANN/ECE Dept./Rowan University RBF - Center Selection x1x1 x2x2 Data points Centers

13 S. Mandayam/ ANN/ECE Dept./Rowan University K-means Clustering Algorithm N data points, x i ; i = 1, 2, …, N At time-index, n, define K clusters with cluster centers c j (n) ; j = 1, 2, …, K Initialization: At n=0, let c j (n) = x j ; j = 1, 2, …, K (i.e. choose the first K data points as cluster centers) Compute the Euclidean distance of each data point from the cluster center, d(x j, c j (n) ) = d ij Assign x j to cluster c j (n) if d ij = min i,j {d ij }; i = 1, 2, …, N, j = 1, 2, …, K For each cluster j = 1, 2, …, K, update the cluster center c j (n+1) = mean {x j  c j (n) } Repeat until ||c j (n+1) - c j (n) || < 

14 S. Mandayam/ ANN/ECE Dept./Rowan UniversitySummary


Download ppt "S. Mandayam/ ANN/ECE Dept./Rowan University Artificial Neural Networks ECE.09.454/ECE.09.560 Fall 2008 Shreekanth Mandayam ECE Department Rowan University."

Similar presentations


Ads by Google