Neural Network Recognition of Frequency Disturbance Recorder Signals Stephen Tang REU Final Presentation July 22, 2014

Problem Recognize local differences in grid frequency Difficult because differences are small Approach of Principle Component Analysis (PCA) and Neural Networks (NN) 5-2 Frequency of several units with median removed

Why PCA & NN Both tools for extracting important features NN are strong pattern recognizers 5-3

PCA 5-4 Orders basis vectors according to variation along their direction ~90% of variation accounted for with first 100 principle components Percent Variation vs Number of Components Kept

PCA Results Neural Network Day of Testing SimultaneousNext Day1 Week No PCA With PCA Negligible Difference in Accuracy with PCA

Training a Neural Network Provide training vectors Split into 3 categories  Training  Validation  Testing Apply error minimization algorithm on training set 5-6

Competitive Function Output Weight Matrix/Bias Input Weight Matrix/Bias The Multi-Layer Perceptron Architecture 5-7 Input Vector

MLP over Probabilistic NN PNN does not require training PNN consistently gave almost 100% error PNN involves taking Euclidean distances between vectors 5-8 Distance between Input and Training Activation Decision

Hierarchical Clustering Hierarchical Shortest distance (Euclidean) Number of FDRs as cutoff 5-9 Clustering Distribution

Over Time Results 5-10 Day of Training Day of Testing June 2June 3June 4June 5June 6June 7June 8June 9 June 1June June June June June June Western Interconnection Eastern Interconnection

Conclusions PCA safe for use Most effective for simultaneous inputs Accuracy degrades quickly over time 5-11

Acknowledgements This work was supported primarily by the ERC Program of the National Science Foundation and DOE under NSF Award Number EEC Other US government and industrial sponsors of CURENT research are also gratefully acknowledged. Special Thanks to Yin (Laura) Lei and Dr. Liu Yilu 12

Hidden Layer Size Affects training time Accuracy is sensitive  Large: Over-fits training set  Small: Unable to classify 5-13

Training Duration Results Test SetTraining Duration (hours) Simultaneous Week

Geographic Location Results 5-15