Presentation is loading. Please wait.

Presentation is loading. Please wait.

Corporate Research & Development, BHEL Application of Artificial Neural Network and Soft Computing Techniques to Engineering World Problems By Dr. K.S.

Similar presentations

Presentation on theme: "Corporate Research & Development, BHEL Application of Artificial Neural Network and Soft Computing Techniques to Engineering World Problems By Dr. K.S."— Presentation transcript:

1 Corporate Research & Development, BHEL Application of Artificial Neural Network and Soft Computing Techniques to Engineering World Problems By Dr. K.S. Madhavan, Sr. DGM, Programmable Control Systems, Corporate Research & Development Division, Bharat Heavy Electricals Limited, Hyderabad , India.

2 2010 – 2020 is a decade of innovation primarily to be steered by Research & Development. In India the play has already begun. Act I: Develop products based on global R&D collaboration Act II: Focus on Basic Research Act III: Build a R&D Power-house base within India Developed economies are facing a problem of declining competitiveness on a global scale. We as developing nations have to capitalize on this aspect to strengthen our R&D base. R&D is defined as a creative work undertaken on a systematic basis in order to increase the stock of knowledge including knowledge of man, culture, society and the use of this stock of knowledge to devise new applications. BHEL has invested 2.5% of turnover on R&D. This will shortly be increased to 4% Impact of R&D

3  The term ‘Artificial Intelligence’ was coined by John McCarthy in the Dartmouth Conference in  AI was developed at the initial stages in Laboratories at Princeton, MIT, CMU and Stanford Universities.  Artificial Neural Network is an offshoot of AI called the ‘Weak AI’. It is related to the cognitive and intuitive aspects of the Human Brain. It is to do with the way Humans Act.  In fact ANN evolved even earlier with the formulation of the first Artificial Neuron by Warren McCulloch and Walter Pitts in INTRODUCTION

4 4 Neural => neuron A carbon based chip from the brain- the biological computer

5 5 Neuron is the Basic Building block of our Central Nervous System (CNS) Human Brain has neurons. Human Nervous System has over neurons about the same number as the stars in our galaxy. Each neuron, on an average, process about 10 4 inputs Brain: A carbon-based computer

6 6 Basic Biological Structure of a Neuron Dendrites Soma Axon (Neural output) Synapse Neural Inputs

7 What is Human Intelligence?  The Center for Brains Minds and Machines (CBMM) of MIT has been started for the above purpose: to decipher human intelligence.  Do studies from functional Magnetic Resonance Imaging (fMRI) give predictions about human intelligence?  Or is there a stability-plasticity dilemna associated with this study?  That is to say human brain continues to learn new things while retaining long term memory or retaining learning which was done in the long past.  Human Intelligence still remains an Enigma!

8 Data Requirements for Various Applications of ANN

9 Neural Network Application to Character Recognition using Backpropagation Corporate Research & Development, BHEL Imaging system Noisy Character Recognized Character A is represented As M is represented As

10 Corporate Research & Development, BHEL clf; figure(gcf) echo on [alphabet, targets] = prprob; [R, Q] = size(alphabet); [S2, Q] = size(targets); S1 =13; S2 = 26; net = newff(minmax(alphabet),[S1 S2],{'logsig' 'logsig'}, 'traingdx'); net.LW{2,1} = net.LW{2,1}*0.01; net.b{2} = net.b{2}*0.01; noisyL = alphabet(:,1) + randn(35,1)*0.2; plotchar(noisyL); pause % strike any key to continue... net.performFcn = 'sse'; % Sum-Squared Error performance function net.trainParam.goal = 0.1; % Sum-Squared error goal = 20; % Frequency of progress displays (in epochs) net.trainParam.epochs = 300; % Maximum number of epochs to train = 0.95; % Momentum constant % Training begins...please wait.. P = alphabet; T = targets; [net,tr] = train(net,P,T); A2 = sim(net,noisyL); A2 = compet(A2); answer = find(compet(A2) == 1); plotchar(alphabet(:,answer)); MATLAB Program

11 Corporate Research & Development, BHEL

12 Elman networks are used to predict:  Drum Level  Feed water flow  Furnace Pressure  Steam flow

13 Corporate Research & Development, BHEL Net = newelm([0 1],[10 1],{‘tansig’,’logsig’}); Net.trainparam.epochs = 300/1000/2000*; P = […………………………………….]; T = […………………………………….]; Pseq = con2seq (P); Tseq = con2seq (T); Net = train (net, Pseq, Tseq); Y = sim(net, Pseq); Z = seq2con(Y); Z{1,1}; Diff1 = T – Z{1,1}; Elman Network Program in MATLAB for PHMS

14 Corporate Research & Development, BHEL A time series is a sequence of vectors, x (t), t = 0,1,…where t represents elapsed time. In practice, for any given physical system, x will be sampled to give a series of discrete data points, equally spaced in time. Formally this can be stated as: find a function ƒ: R N → R such as to obtain an estimate of x at time t + d, from the N time steps back from time t, so that: x ( t+ d) = f(x(t),x(t-1)… x(t-N+1)) Normally d will be one, so that f will be forecasting the next value of x. Time Series Prediction of Boiler Drum Level

15 Corporate Research & Development, BHEL b1b1 LW 21 b2b2 a 1 (k) P’ a 2 (k) D LW 11 a 1 (k-1) LW 11 Recurrent Neural Networks a – activation level P’ – input neurons LW – Weights b – bias D - Delay The actual/neural network predicted variation of the drum level parameter and the error.

16 Corporate Research & Development, BHEL Neural Network Input/Output patterns for Drum Level and error obtained after training

17 Corporate Research & Development BHEL

18 Corporate Research & Development, BHEL Residual Life Assessment Studies of Transformers using Artificial Neural Networks

19 Dissolved Gas Analysis using Artificial Neural Networks ijklDiagnosiscode 0000Normal deteriorationn 5000Partial dischargeso 1 or 2000 Slight overheating(< C) p 1 or 2100 Overheating(150 0 C–200 0 C) q 0100 Overheating(200 0 C–300 0 C) r 0010General conductor overheating s 1010Winding circulating currents t 1020Core & tank circulating currents, overheated joints u 0001Flash-over without power follow through v 001 or 2 Arc with power follow through w 0022Continuous sparking to floating potential x 0001 or 2Partial discharge with tracking y Rogers Fault Diagnosis Table

20 Corporate Research & Development, BHEL A common method for identifying incipient faults in power transformers is the Dissolved Gas Analysis (DGA). Analysis of ratios of specific dissolved gas concentrations, their generation rates, and the measure of total combustible gases are used as the attributes for classification of the faults. Thresholds are designed to partition the attributes into intervals. Specific combinations of these intervals are then used to identify the type of fault. However, the conventional fault diagnosis methods, i.e. the ratio methods and the key gas method, have limitations such as the “no-decision” problem. Various Artificial Intelligence (AI) techniques may help to solve the problems and present a better solution. Table-I : Gas Ratio Codes DescriptionCode CH 4 /H 2 i C 2 H 6 /CH 4 j C 2 H 4 /C 2 H 6 k C 2 H 2 /C 2 H 4 l Table-II : Rogers Ratio Codes RatioRangeCode i  0.1  0.1,  1.0  1.0,  3.0  j  1.0  k  1.0  1.0,  3.0  l  0.5  0.5,  3.0 

21 Corporate Research & Development, BHEL Table-III : Rogers Fault Diagnosis Table ijklDiagnosiscode 0000Normal deteriorationn 5000Partial dischargeso 1 or 2 000Slight overheating(< C) p 1 or 2 100Overheating(150 0 C– C) q 0100Overheating(200 0 C– C) r 0010General conductor overheating s 1010Winding circulating currents t 1020Core & tank circulating currents, overheated joints u 0001Flash-over without power follow through v 001 or 2 Arc with power follow through w 0022Continuous sparking to floating potential x 0001 or 2Partial discharge with tracking y Table-IV : IEC Ratio Codes Range of ratioslik < – – 3121 > 3222 Table-V : IEC Fault Diagnosis Table likCharacteristic faultsCode 000No faulta 010Partial discharges of low energy density b 110Partial discharges of high energy density c 1 or 20 Discharges of low energy d 102Discharges of high energy e 001Hot spots (T < C)f 020Hot spots (150 0 C < T < C) g 021Hot spots (300 0 C < T < C) h 022Hot spots (T > C)m

22 Corporate Research & Development, BHEL LIMITATION OF THE RATIO METHODS : THE “NO-DECISION” PROBLEM In real-life situations, Ratio Methods lead to codes that are way off from the norms set by the methods. In such a case inference of fault directly from the code pattern becomes difficult and vague. Interpolations on patterns have to be made which are way beyond normal methods. Sometimes the gas content is undetectable or present as a trace. In such cases assumptions have to be made as to the negligible content of gas present. Ratio Methods fail to give logical diagnosis as to the nature of the fault. No decision can be taken on the diagnostic pattern generated by the Ratio Methods. Artificial Neural Network (ANN) methods have to be used in order to arrive at a decision regarding the faults.

23 Corporate Research & Development, BHEL SIGNIFICANCE OF THE ANN APPROACH ANNs look for patterns in training sets of data, learn these patterns, and develop the ability to correctly classify new patterns or to make forecasts and predictions. Artificial Neural Networks have the remarkable ability to extract meaningful information from incomplete or imprecise data. An Artificial Neural Network does not require intimate knowledge of the system. The network is massively parallel, extremely fast and intrinsically fault-tolerant. Through exposure to many such examples of a situation, the neural network generalises to form its “own rule” to solve a problem.

24 Corporate Research & Development, BHEL TRAINING WITH ANN The neural network used in the present instance is a 3-layer Probabilistic Neural Network (PNN) for analysis. There are 4 neurons in the input layer, 12 in the hidden layer, and 12 in the output layer. A smoothing factor of was decided upon through NET- PERFECT for all the links. The distance metric used is Vanilla Euclidean. PNN networks work by clustering patterns based upon their distance from each other. The Vanilla Euclidean distance metric is recommended for most networks because it works the best. In Vanilla, the output of the network is the square of the distance between the patterns and the weight vector for the neuron; therefore, the winner is the neuron with minimum activation.

25 Corporate Research & Development, BHEL The training of ANN made is based on data shown in Tables I to V. When an input is presented, the first layer computes distances from the input vector to the training input vectors, and produces a vector whose elements indicate how close the input is to a training input. The second layer sums these contributions for each class of inputs to produce as its net output a vector of probabilities. Finally, a transfer function on the output of the second layer picks the maximum of these probabilities, and produces a 1 for that class and 0 for the other classes. The Rogers Ratio Table and IEC Ratio Table with known inputs and outputs have been independently stored and trained in the reference ANN model. TRAINING WITH ANN (Contd.)

26 Corporate Research & Development, BHEL Fault Diagnosis of Generator Transformer of Power Station-I using ANN Approach DateCH 4 /H 2 C 2 H 6 /CH 4 C 2 H 4 /C 2 H 6 C 2 H 2 /C 2 H 4 Fault Predicted Winding circulating currents do do Core & tank circulating currents; overheated joints do Winding circulating currents do do Normal deterioration Overheating (150 0 C – C) Partial discharges Overheating (150 0 C – C) do --

27 Corporate Research & Development, BHEL Data Input Neural Network Based Abnormal Detector Rule Based Abnormal Detector Both indicate “Normal”? Rule Based fault detector Neural Network based fault detector Combined fault diagnosis Maintenance Action Recommendation Outputs Y N Flowchart of ANNRBS (Artificial Neural Network Rule Based System) Suggestion : DGA samples from CTs of EHV transformers can also be tested through ANNRBS

28 Corporate Research & Development, BHEL Limits of Gases Beyond Which Fault Diagnosis Becomes Necessary Source H2H2 CH 4 C2H2C2H2 C2H4C2H4 C2H6C2H6 COCO 2 TDCG Values Used (parts per million : ppm) IEEE(C57.104) Doble GE(Lyke 77) *IEEE(G) *IEEE(T) Manufacturer **Electra CIGRE Dornenburg Note : *Before (C57.104) ** Corrected values 1978 IEEE(G) : Generation; IEEE(T) : Transmission Values in italics are of transformers 6-7 years old Unmarked sources are all cited from [Griffin86, Griffin88] TDCG : Total Dissolved Combustible Gases

29 Estimation of degree of polymerization and residual age of transformers from Furan concentration dissolved in oil Corporate Research & Development, BHEL X1X1 P1 P2 P3 Pn A B Y1Y1 Y2Y2 Input Units Pattern Units Summation Units Output Units (I = 1) (n=31) (O = 2) Σ Y I exp (-D I 2 /2  2 ) I=1  exp (-D I 2 /2  2 ) n I=1 Architecture of the General Regression Neural Network used n

30 Corporate Research & Development, BHEL Furfurals are major degradation products of cellulose insulation paper and are found in insulation oils of operating transformers. Furfural analysis is an indirect method to estimate the integrity of cellulose insulation compared to the direct measurement of Degree of Polymerisation of insulating paper. The tensile strength of the paper decreases corresponding to an increase in the concentrations of the Furfural in the oil. 5- Hydroxymethyl-2-Furfuraldehyde and 2-Furfuraldehyde are present in the oil at significantly greater concentrations than any other Furfural components. Furfural levels range from 0.1 ppm to 10 ppm depending on the age and condition of the transformer insulation. The residual life of the transformer can be predicted by estimating Furfural content in the oil or by the Degree of Polymerisation of cellulose paper taken from lead insulation.

31 The life assessment can be made faster by estimating furfural from oil which can be collected from the transformer in running condition. The collection of cellulose paper involves cumbersome procedure of shutdown of the transformer and removal of paper from lead insulation after opening the transformer. Hence life assessment by furfural estimation is more popular and rapid method as compared to DP estimation of paper.

32 Corporate Research & Development, BHEL Choice of Artificial Neural Networks The Degree of Polymerisation and Residual Age of transformers are continuous functions of Furfural levels of transformers. Therefore continuous function approximation of multiple outputs through Generalized Regression Neural Networks is one solution for predicting output patterns. GRNN based on radial units, giving estimates of continuous variables rather than discrete decisions, overcoming the disadvantage of slow training inherent in backpropagation thereby lending itself well to real-time application, is the appropriate choice for our present analysis. Least square method has been used to minimize the error in prediction.

33 Corporate Research & Development, BHEL Partial Discharge Classification of 145 kV GIS using Artificial Neural Netwo rks

34 Data collection process ModelAccuracy achieved 3-layer BP 79.41% 4-layer BP 88.24% 5-layer BP 91.18% PNN100%

35 Corporate Research & Development, BHEL INTRODUCTION Gas-Insulated Substation (GIS) equipment is being used worldwide in transmission and distribution of electrical energy. However its superior performance severely deteriorates with the presence of foreign particles in the system which causes Partial Discharge, leading to degradation of the insulation. Reduction in the insulation strength to as low as 80% of the value under clean condition, has been reported. Partial Discharge is one of the effective indications of the defect and degradation of GIS. The signals obtained from discharges occurring within GIS equipment due to microprotrusion on the enclosure and spacer, voids in solid insulation or due to floating particles are very stochastic in nature.

36 Corporate Research & Development, BHEL In the present study, the following three types of faults have been investigated : 1.Partial Discharge due to “Protrusion” (P) 2.Partial Discharge due to “Floating Particles” (FP) 3.Partial Discharge due to “Particle Sticking on Insulator” (PSI) The data for these Partial Discharges has been collected from experimentation based on cycle, phase and amplitude in pico-Coulomb (pC).

37 Corporate Research & Development, BHEL Detection of Partial Discharges In order to determine the extent of partial discharge, a specified voltage was applied from the transformer to the busbar. The discharge signal was picked up from the ungrounded outer enclosure. The signal is fed to the partial discharge detector and transmitted to the Computerised Discharge Analyser (CDA) for recording and processing the data. The voltage is slowly increased, from zero, across the test object until corona is noticed in the PD detector. This is the discharge inception voltage. The voltage is continuously increased up to 145/  3 ( 83.72) kV until all the three different kinds of partial discharges in the present study are detected. The voltage is then slowly reduced until the smallest discharge disappears, the discharge extinction voltage. The circuit uses a Straight Detection Method with a potential divider arrangement across the test object.

38 Corporate Research & Development, BHEL PD Data Collection For a given case, the data has been recorded for phase angle varying from 0 0 to After the data has been captured by the CDA, the data has been examined to determine the largest discharge magnitude noticed within each of the 360 equal time windows, and this maximum has been recorded in graphical form. Windowing is done to increase phase resolution and reduce phase suppression noise. For the purpose of simulation, the total phase angle of has been divided into 18 parts (20 0 each). In each part, the total discharge magnitude is summed up and an average is determined. The same procedure was followed in each cycle for all the three types of defects included in the present study. Individual PD records give the following detailed information relative to every partial discharge pulse recorded during the test: cycle number; phase position in degrees; pulse polarity; pulse magnitude in pC; and pulse energy in  J.

39 Floating particles are seen with an applied voltage of 145/  3 (83.72) kV, period 5 seconds, noise 15 dB, pressure 2 bar. PDmax (pC) : , PDavg (pC) : Similar recordings are obtained for protrusion and particles sticking on the surface of insulator. The digital data was recorded by CDA in terms of magnitude (pC) vs phase angle, and number of counts vs phase angle. In order to establish the artificial neural network (ANN) technique, only magnitude vs phase has been considered for simulation. This is considered for all three types of defects simulated for this study.



42 Corporate Research & Development, BHEL Prediction of fault probabilities of rotating machinery using GRNN techniques

43 Corporate Research & Development, BHEL Fault Symptoms of sensors Probability Function Probability of occurrence F1f(S1,S13,S17)P(U,S1Y,S13H,~S1,~S13)1.0,0.7,0.3,0.2,0.4 F2f(S2,S14,S17) P(U,S2L,S14Y, ~S2, ~S14) 1.0,0.7,0.3,0.1,0.3 F3f(S3,S15,S17)P(U,S3H,S15H,~S3,~S15)1.0,0.4,0.6,0.6,0.4 F4f(S5,S6,S17)P(U,S5H,S6L,~S5,~S6)1.0,0.3,0.25,0.05,0.1 F5f(S7,S8,S17)P(U,S7L,S8HvS8L,~S7,~S8)-- F6f(S3,S9,S11,S17)P(U,S3H,S9H,S11H,~S3,~S9,~S11)1.0,0.45,0.6,0.4,0.3,0.2,0.15 F7f(S10,S17)P(U,~S10)1.0,0.5 F8f(S2,S17)P(U,~S2)1.0,0.5 F9f(S12,S17)P(U,~S12)1.0,0.5 F10f(S18,S19,S20,S23,S17)P(U,S18B,S19Y,S20B,S20J,S23Y) 1.0,.6,.3,.5,.4..2,.3,.35,.3,.05,.25,.1,.2,.02,.15,. 2 F11f(S18,S19,S20,S23,S17) P(U,S18B,S19Y,S23Y,(S20A,S20B,S2 0C,S20I,S20H)) 1.0,.7,.5,.7,.4,.4,.6,.3,. 25,.05,.5,.1,.5,.6,.05,.6 F12f(S18,S19,S20,S23,S17)P(U,S18B,S19Y,S23Y,(S20A,S20B)) 1,.75,.6,.8,.4,.5,.55,.3,. 1,.05,.35,.05,.3,.55,.05,.6 F13f(S18,S19,S20,S23,S17)P(U,S18B,S19Y,S23Y,(S20A,S20B)) 1,.7,.65,.7,.15,.5,.45,.3,.05,.02,.4,.1,.5,.55,.1,.6 Y/N – Yes/NO H/N/L – High/Normal/Low

44 Corporate Research & Development, BHEL Table – II Distribution of bit patterns as inputs to GRNN Fault No. Related Symptoms (High/Normal/Low) (Yes/No) (Faulty/Non faulty) X1 P1 P2 P3 Pm A B Y Input Units Pattern Units Summation Units Output Units X2 X3 Xd (Trend in Vibration)

45 Corporate Research & Development, BHEL Actual Network Error

46 Corporate Research & Development, BHEL Evaluation of Gas Turbine Control Constants

47 PREDICTION OF GAS TURBINE CONTROL CONSTANTS Artificial Neural Networks based solution for prediction of only important Site specific tunable control constants has been attempted considering the limitation on the availability of number of data patterns. Data for 8 sites have been taken with 7 site-specific inputs and 21 output control constants.

48 Corporate Research Gas Turbines are mechanical devices operating on a thermodynamic cycle (Brayton cycle) with air as the working fluid. The air is compressed in a compressor, mixed with fuel and burnt in a combustor with the gas expanded in a turbine to generate power used in driving the compressor and external loads (thrust or shaft power) depending on requirements. The thermodynamic cycle that represents the common turbomachine is the "open" Brayton cycle.

49 Corporate Research & Development, BHEL This h-s diagram represents the ideal enthalpy and entropy relationship for the Brayton cycle. Cycle Processes: 1-3 Isentropic Compression (q = 0) 3-4 Isobaric Heat Addition (w = 0) 4-9 Isentropic Expansion (q = 0) 9-1 Isobaric Heat Rejection (w = 0)

50 Corporate Research & Development, BHEL Gas Turbine power-plant performance under ISO conditions (burning a reference fuel, such as natural gas, at 15 0 C, atmospheric pressure and 60% relative humidity) is information provided by machine manufacturers. With the increasing utilization of gas turbines in industrial and cogeneration applications, they are taking on a greater role in base load service. Because of their inherent responsiveness, they also offer operating characteristics that can enhance their contribution to utility systems as a generator prime mover.

51 Corporate Research & Development, BHEL Detailed discussion were held with RCPuram and were informed that there are about 560 control constants required for this type of machine and about 70 machines have been already supplied by BHEL. Also, information had been obtained that these machines have been supplied to 10 sites in all, since multiple machines have been supplied to the same site. GT Engg. RCPuram has identified 183 Tunable Control Constants after analysing the individual Big Blocks of Control Sequence Programs (CSPs) and Control Constants. However, from the overall data for 10 sites provided, only 8 sites are found to be useful since the data patterns provided for 2 sites are matching and 1 data set was for a machine with DLN combustor.

52 Corporate Research & Development, BHEL In this project, Artificial Neural Network (ANN) techniques are applied to analyze, predict the gas turbine control constants from generic blocks and application specific big blocks of the gas turbine control system. Constants from gas flow calculation, comparator, command state, Fuel Stroke Reference (FSR), Inlet Guide Vane (IGV) fault detection, acceleration control of FSR, Temperature control reference were short-listed to be predicted by ANN. A final list of 21 control constants were prepared based on: 1.The data patterns available are enough for training ANN with reasonable accuracy in prediction. 2.Data spread is uniform, without any discontinuities.

53 Corporate Research & Development, BHEL 7 site-specific variants were identified as input to ANN: Machine type Site Elevation (m) Site Design Temperature ( 0 C) Site Relative Humidity (%) Type of Cycle Output (MW) Lower Heating Value of Fuel (Kcal/kg) 21 output variables were identified as output to ANN.

54 Corporate Research & Development, BHEL In order to obtain a best possible solution, ANNs have been trained by changing the following variants. 1.Model / Type of ANN (Training algorithm) 2.No. of Epochs 3.Data formats ANNs have been trained for 2 types of Models and 2 types of data formats by varying the no. of Epochs (Low, Medium & High) for arriving at an optimum solution. The Input/Output data format has been used in engg units as well as normalized for training. The data has been normalised in such a way that the spread is in the range of - 1 to +1.The normalised values for the data patterns are computed using the formula (Actual-Mean) / (Maximum- Minimum)

55 Corporate Research & Development, BHEL The number of neurons in hidden layer are computed as, (No. of input neurons + No. of output neurons)/2 + Sqrt. (No. of patterns). The number of these neurons is either 17 or 19, depending upon the type of input data format. The initial weights of these neurons are assumed to be a low value and are subsequently modified during the training. Selection of very low values for initial weights will result in a longer duration for training and very large values in saturation of the network. Hence, an optimum value of 0.3 has been assumed in this case. The learning rate and momentum are taken to be 0.1 and 0.3 respectively.

56 Corporate Research & Development, BHEL The validation of ANN model is the most essential part of identification process. An engineer would never deliver a product without a mention about its accuracy. The approach to the validation of a trained ANN model is to establish the accuracy to which the model is able to predict. A naïve approach to this problem is to validate the trained ANN models with the data that the model was trained with. This is called Naïve Validation. Under Naïve Validation, an ANN model is always bound to predict closely to the trained data, since it was trained on that data. This does not mean that the ANN model is capable of representing the system, but only that the model is able to adjust to the trained data.

57 Corporate Research & Development, BHEL Overall absolute deviations (max and min) for different sets of ANN Parameters under Naive validation Set.No. ANN Parameters Abs errors(%) Model Model No. of Epochs Data Format MinMax 1 3 layer back propagation 2585Engineer- ing units do Feed Forward BP using combination of linear, Gaussian, tanh, Gaussian complement and logistic do layer back propagation 2122 Normalise d units do Feed Forward BP using combination of linear, Gaussian, tanh, Gaussian complement and logistic do

58 Corporate Research & Development, BHEL Graphs indicating actual/predicted output values of RPCL Kalugurani Graph indicating the error curve Three Layer Backpropagation was used as the neural network model and training was done for 2500 epochs with seven input variables and twenty one output variables

59 Corporate Research & Development, BHEL It is thus necessary, in order to check the ability of the ANN model to “generalise,” to validate the trained models on an independent set of data, called the Validation data. This final and decisive test for any trained model is a Cross Validation, which involves training with new data sets and making predictions and comparison with the actual data. The predicted data should be identical or within the prescribed uncertainty bounds.

60 Corporate Research & Development, BHEL Sets of parameters used for training ANN for cross validation Set 1: Data Type: Engineering units ANN Model: 3-layer Back Propagation (BP) No. of Epochs: 2,500 Set 2: Data Type: Normalised units ANN Model: 3-layer Back Propagation (BP) No. of Epochs: 2,500 Set 3: Data Type: Engineering units ANN Model: Feed Forward BP using combination of linear, Gaussian, tanh, Gaussian complement and logistic No. of Epochs: 1,115 Set 4: Data Type: Normalised units ANN Model: Feed Forward BP using combination of linear, Gaussian, tanh, Gaussian complement and logistic No. of Epochs: 1,087

61 Corporate Research & Development, BHEL Other Applications Neural networks are nothing but a mathematical processing unit. It can be used for various applications, for example in: Neural networks are nothing but a mathematical processing unit. It can be used for various applications, for example in: Image and signal processing; Image and signal processing; Control systems; Control systems; Medical diagnosis; Medical diagnosis; Incipient failures detection, diagnosis & prognosis; Incipient failures detection, diagnosis & prognosis; Power systems reliability; Power systems reliability; Function Approximations; Function Approximations; Speech Processing Speech Processing

62 Corporate Research & Development, BHEL 62 r n y n u d y p y a x e : Input signal[Step or square Inputs] : Neural unit : Control signal for the plant : Desired output : Output of the plant T xxx][ 210 are the neural inputs : Error between the desired output and the output of the plant Dynamic Neural Controller

63 Neural Edge Detector

64 Corporate Research & Development, BHEL Evolutionary Computation Evolutionary Algorithms - Genetic Algorithms - Evolutionary Programming - Evolutionary Strategy - Genetic Programming - Learning Classifier System Swarm Intelligence - Ant Colony Optimization (based on pheromone search) - Particle Swarm Optimization (based on simulated annealing) - Stochastic Diffusion Search Self Organization - Self Organizing Maps - Growing Neural Gas - Competitive Learning

65 Corporate Research & Development, BHEL Differential Evolution (based on Genetic Annealing) - a population based combinatorial algorithm Artificial Life - Strong Alife (based on Cellular Automata inspired by Von Neumann) - Weak Alife (based on Neural Networks) Harmony Search Algorithms - Metaheuristic algorithm mimicking the improvisation of musicians Artificial Immune Systems Learnable Evolution Model Cultural Algorithms - Bridging the gap between Belief Space and Population Space

66 Corporate Research & Development, BHEL Studies done on Supercritical Test Rig Facility Data through Genetic Programming



69 Corporate Research & Development, BHEL To find the correlation between Nusselts number (output) and Reynolds number & Prandtl number (inputs). Does it satisfy the Dittus-Boelter equation? Nu d = 0.023Re d 0.8 Pr 0.4 (for sub-critical conditions satisfying heat transfer in fully developed turbulent flow in smooth tubes) If not find the function linking Nusselts number to Reynolds number & Prandtl number using Genetic Programming.

70 Corporate Research & Development, BHEL


72 #include #define TRUNC(x)(((x)>=0) ? floor(x) : ceil(x)) #define C_FPREM (_finite(f[0]/f[1]) ? f[0]-(TRUNC(f[0]/f[1])*f[1]) : f[0]/f[1]) #define C_F2XM1 (((fabs(f[0])<=1) && (!_isnan(f[0]))) ? (pow(2,f[0])-1) : ((!_finite(f[0]) && !_isnan(f[0]) && (f[0]<0)) ? -1 : f[0])) float DiscipulusCFunction(float v[]) { long double f[8]; long double tmp = 0; int cflag = 0; f[0]=f[1]=f[2]=f[3]=f[4]=f[5]=f[6]=f[7]=0; double Re=v[0] ; double Prandtl=v[1] ; L0: f[0]+= f; L1: f[0]+=Prandtl; L2: f[2]+=f[0]; L3: f[0]*=f[0];

73 Corporate Research & Development, BHEL L4: f[0]*=f[2]; L5: f[0]*=Prandtl; L6: f[1]+=f[0]; L7: f[0]*=f[2]; L8: f[0]*=pow(2,TRUNC(f[1])); L9: f[0]*= f; L10: f[0]/=Re; L11: f[0]=fabs(f[0]); L12: f[0]/= f; L13: f[1]+=f[0]; L14: f[0]*=pow(2,TRUNC(f[1])); L15: f[0]*=f[1]; L16: f[0]+=f[1]; L17: f[0]=-f[0]; L18: f[0]+=f[0]; L19: f[0]+=Re; L20: f[0]=sqrt(f[0]); L21: f[0]-=f[2]; L22: f[0]*= f; L23: if (!_finite(f[0])) f[0]=0; return f[0]; }

74 float DiscipulusCRegressionFunction(float v []) { float ret = DiscipulusCFunction(v) ; return ret; }

75 Corporate Research & Development, BHEL Boiler Performance Analysis Using Soft Computing Techniques

76 Corporate 500 MW BOILER (Sub critical once- through)

77 PROBLEM FORMULATION Presently Boiler performance analysis is being made through standard procedure. But there are deviations in the performance analysed using this procedure. Presently Boiler Performance is estimated based on indirect method of calculating the cumulative losses from different sources and subtracting it from the theoretical design output. But this method does not take into account the variations in the coal quality actually fed into the hopper nor does it take into account the variations in design of the boiler based on site requirements. 77

78 Collaborator’s specifications are based on US grade coal. The deviations arising out of usage of Indian grade coal needs to be studied thoroughly. For this purpose, the black box technique of neural network is being used to study the input-output relationship between various Boiler performance features and relevant inferences are drawn. PROBLEM FORMULATION (Contd.) 78

79 APPROACH  To study the performance aspects of various boiler data supplied by BHEL TRICHY R&D  Establish relationships between critical input-output data (Feature Selection)  Preprocess the data to conform to ANN software  Identify suitable ANN model & train ANN  Carry out analysis and generate DLL that can be deployed on remote computer  Development of ANN Prediction Tool 78

80 FEATURE SELECTION Feature selection encompasses a wide variety of methods for selecting a restricted number of input variables or “features”, which are “relevant” to a problem at hand. Feature selection is a problem pervasive in all domains of application of machine learning and data mining: engineering applications, robotics and pattern recognition (speech, handwriting, and face recognition), Internet applications (text categorization), econometrics and marketing applications and medical applications (diagnosis, prognosis, drug discovery). Restricting the input space to a (small) subset of available input variables has obvious economical benefits in terms of data storage, computational requirements, and cost of future data collection. It often also provides better data or model understanding and even better prediction performance. 79

81 Reasons for performing feature selection include:  Improving performance prediction.  Reducing computational requirements.  Reducing data storage requirements.  Reducing the cost of future measurements.  Improving data or model understanding. 81

82 BURNER TILT Burner Tilt was averaged on all the corner points. Tilt expressed in % was converted to degrees using the formula: ((60/100)*x – 30) Where x is the Tilt in %. Tilt varies from -30 deg. to +30 deg. MILL COMBINATION Mill Combination was taken to be the distance from Platen Super heater to the topmost mill fired. This is calculated as follows: B8 = *1575 = mm Where distance M8 = *1575 = mm from topmost mill is 18525mm & T8 = mm there are 10 mills in total 81

83 EXCESS AIR Excess Air Percentage (Calculated indirectly from dry O 2 percentage in Economizer Outlet by the formula 100 * O 2 / (21 – O 2 )) The average of Left (L) and Right (R) values are taken LOAD Load is expressed in MW REHEATER SPRAY AND SUPERHEATER SPRAY RH Spray & SH Spray are expressed in tonnes per hour and the sum of L & R values are taken. 82


85 ANN DLL ANN DEF File Predicted Sprays Visual Basic Front End GUI Block Diagram indicating dynamic program flow 84

86 The tool will serve as a ready reckoner for operators to predict the quantity of Re Heater Spray and Super Heater Spray, after data entry of other input features like Burner Tilt, Mill Combination, Excess Air and Load. A good understanding of the Boiler performance and the relationship between different input / output parameters will in due course of time lead to quality improvement in Boiler design and performance and acquiring analytical / design / modelling capabilities for better product design. The performance analysis techniques used in this project can be extended to different types of Boilers. Benefits of the ANN Prediction Tool 85

87 Results Achieved Backpropagation was tried to start with for 70 sets of power plant data classified as Training set & Test set. Data is sorted in terms of Burner Tilt, Excess Air, Mill combination and Load individually. Then it is trained with different learning rates, momentum, epochs & events since minimum average error > 40,000. With 90% Training Data,10% Test Data, epochs varying from 2019 to 4765 correlation coefficient of RH Spray is found to vary from to , correlation coefficient of SH Spray is found to vary from to GRNN proved better with correlation coefficient of RH Spray varying from to , correlation coefficient of SH Spray varying from to with an optimum smoothing factor of approx which was generated through genetic algorithm. 80% Training data and 20% Test data was used. Cross Validation (3 rd Data Pattern): TiltMCExcess Air Load RH Spray SH Spray (Actual) (Cross Validation) 7.96% 3.07% (Error) 86

88 Boiler Performance Inputs Training using Back-propagation Training using GRNN Generation of smoothing factor using Genetic Algorithm Boiler Performance Inputs Generation of smoothing factor using Genetic Algorithm Training using Back- propagation Training using GRNN Soft Computing Components Methodology used 87

89 89 Function Approximation (General Regression Neural Network)  One of the most significant characteristics of the neural networks is their ability to approximate any arbitrary nonlinear function to desired degree of accuracy.  Neural networks potentially offer a general framework for modelling and control of nonlinear systems.

90 90 Function Approximation

91  E[y  X  y  (X,y)dy -    (X,y)dy -  n Multiplying the measured value of the output with the appropriate probability density function of the Euclidean distance (Di) of any input variable X from other input variables occurring in the attribute space and averaging yields the estimated value of the predicted output  Y i exp(-D 2 /2  2 ) I=1 n  exp(-D 2 /2  2 ) I=1 Y (X) = Mathematical Model of GRNN

92 Many spheres of influence will be formed for various points. The appropriate sphere of influence is defined as the one that produces the smallest mean square error between the actual and predicted output values. Determination of this appropriate sphere of influence i.e.  (smoothing factor) is where learning takes place in GRNN. In order to find out the optimum smoothing factor, Genetic Algorithms are used. A genetic breeding pool size of 20 is used here. Smoothing Factor

93 What are Genetic Algorithms? Search/Optimization technique by choosing survival of the fittest through chromosome crossover or mutation. Unit of GA is allele. 92

94 Corporate Research & Development, BHEL How Genetic Algorithm Works? (Contd.) After dozens or even hundreds of generations, a population eventually emerges wherein the individuals will solve the problem very well. In fact the most fit (elite) individual will be an optimum or close to optimum solution. The processes of selection, mutation and crossover are called genetic operators. Genetic Algorithm includes additional genetic operators. One is called diversity operator.

95 Corporate Research & Development, BHEL Genetic Algorithm for Boiler Performance Analysis In the project “Boiler Performance Analysis using Soft Computing Techniques”, the twin objectives of minimizing ReHeater Spray as well as SuperHeater Spray become essential. SuperHeater Spray and ReHeater Spray are functions of burner tilt in our curve fits generated. The other parameters like Mill Combination, Excess Air, Load can become part of the Chromosome (continuous type) input into the Genetic Algorithm software. Therefore we now have fitness functions as well as chromosomes to achieve multiple objectives of minimizing ReHeater Spray as well as SuperHeater Spray. The Curves are shown in the following slides:

96 Corporate Research & Development, BHEL Power Station - I

97 Corporate Research & Development, BHEL Power Station II

98 Corporate Research & Development, BHEL HYBRID OPTIMIZATION USING GENETIC ALGORITHMS The coefficients of the trend line equation, centroid of the excess air values after grouping, centroid of the Mass Flow values after grouping, different values of tilt after grouping were all taken as continuous chromosomes to be further treated by Genetic Algorithm (GA). The sum of the squares of the error function between calculated values from the trend line equation and the actual RH, SH Spray were taken as two fitness functions. The multiple objectives were to minimize both the fitness functions for RH as well as SH Spray. The steam temperature corresponding to the data sets were taken as constraints and these were not to exceed 545 deg. C with a tolerance of 5 deg. C. The ranges of all the input chromosomes were defined. The GA was run for 650 generations before it converged on an optimum solution set.


100 Corporate Research & Development, BHEL Development of Artificial Neural Networks (ANN) based Prediction Model for NOx Emissions from Utility Boilers

101 Corporate Research & Development, BHEL  With increasing environmental protection requirements in the Global Scenario reducing NOx emissions from utility boilers becomes mandatory.  The buck does not stop here. In fact there is a research group in Finland working on reducing NOx emissions from Fluidized Bed Combustion boilers.  According to an EPA report from North Carolina, NOx emissions could be broadly categorized into Thermal NOx, Prompt NOx and Fuel NOx. 101

102 Corporate Research & Development, BHEL Thermal NOx and Fuel NOx may be controlled but Prompt NOx remains uncontrolled and is quantitatively less compared to the former two. NOx can be controlled in two phases: 1.During Combustion Process 2.Post Combustion Combustion Controls: 1. Flue Gas Recirculation 2. Over Fire Air 3. Low NOx burners 4. Reburn Post Combustion Controls: 1.Selective Non-Catalytic Reduction (SNCR) 2.Selective Catalytic Reduction (SCR)

103 Corporate Research & Development, BHEL Thermal NOx can be controlled by bringing Temperature down. Also bringing concentration of O 2 or N 2 down. Thermal NOx rises slowly. Fuel NOx can be controlled by delayed mixing of fuel and air to form N 2 rather than NOx. Fuel NOx rises rapidly. Thermal, Prompt and Fuel NOx are controlled by modifying: Combustion Gas Temperature Residence Time Turbulence (The Three T’s) Alternative Techniques for reducing NOx Burner Out Of Service (BOOS): Stopping fuel flow from individual Burners. Air flow is maintained through idle burners.

104 Corporate Research & Development, BHEL Biased Firing (BF): Injecting more fuel to some burners and reducing the amount of fuel to other burners. Close Coupled Over Fire Air (CCOFA): In the Main Wind Box Separated Over Fire Air (SOFA): Installed above main Wind Box using separate ducting. SNCR: By injecting Ammonia in the flue gas. Ammonia is a pollutant and can react with SOx in the flue gas to produce Ammonium salts which can deposit in downstream equipment such as air heaters. SCR: By injecting Ammonia in the presence of catalysts like Platinum or Palladium / Vanadium or Titanium / Zeolites (crystalline ammonio-silicate compounds) Reduce Excess Air

105 Corporate Research & Development, BHEL Features (with units) MAXMINMEAN INPUT C% H% N% O% Total Air Flow (T/Hr.) Excess Air (%) Mill Combination Burner Tilt (deg.) Load (MW) Coal GCV (Kcal/kg) Total Coal Flow (T/Hr.) Capacity Load (MW) Moisture (%) Ash (%) Volatile Matter (%) OUTPUT NOx (ppm) The Inputs and Output to the Neural Network

106 Corporate Research & Development, BHEL NOx Prediction Tool (15 features)

107 Feature Selection was tried out by 1.Weights Method 2.First Order Derivative Method 3.Principal Component Analysis 4.Independent Component Analysis 5.F-distribution Method 1 & 2 results were not consistent and lacked repeatability. Both PCA and ICA were tried out. They turned out to be academic exercises. PCA returned two principal components. On forcing, it returned two more principal components. These were in the form of eigenvalues (by minimizing co-variance and maximizing variance of the input matrix) to which no physical significance could be attributed to. ICA turned out to be slightly better and converged on 3 eigenvalues. These were combined by Linear Algebra for the entire input matrix and could not be unmixed. F-statistics approach based on ANOVA yielded best result.

108 Load Total Coal Flow Total Air Flow Mill Combination N% Moisture C% Coal GCV Excess Air Volatile Matter F Valuep Value Feature Selection based on F-distribution and its corresponding p value Ten dominant features are extracted from 15 features

109 Application of Artificial Neural Networks for NOx Prediction (General Regression Neural Network Model) Network type : GRNN, genetic adaptive Patterns processed: 49 Smoothing factor : Output: NOx (in ppm) R squared : r squared : Mean squared error : Mean absolute error: Min. absolute error : 0 Max. absolute error : Correlation coefficient r: Percent within 5%: Percent within % : Percent within %: Percent within %: 0 Percent over 30% : 0 NOx

110 Corporate Research & Development, BHEL NOx Prediction Tool (10 features )

111 Corporate Research & Development, BHEL Some Suggested Projects !!! An Assessment of Back Propagation Neural Networks for Weather Forecasting This research project looks at using local weather conditions and a Back Propagation neural network to predict the following day's barometric pressure. An Assessment of Brain State in a Box Neural Networks for Database Assessment This research project looks at using Brain State in a Box Neural Networks to assess the contents of a database and find data according to partial patterns provided.

112 1. Course of engineering is most usable in day-to-day life. 2. Engineering course takes background of 12 th standard / pre-university course. 3. It is risky to get admission for engineering during recession. 4. Jobs / opportunities are more in engineering stream. 5. Innovation / discovery opportunity is more in engineering. 6. Relatives taking admission in engineering is an influencer th standard / pre-university teachers inspire engineering study. 8. Foreign opportunity is more after BE, B-Tech. 9. Family members suggest to go for engineering study. 10. Admission into any stream of engineering is OK. 11. Government providing loan for engineering is an enabler for engineering education. 12. Engineering is better than other courses in science, math, arts, fine arts. 13. Entrance exam for engineering is a hectic task. 14. Criteria for admission affects student behaviour. SURVEY OF RURAL STUDENT PROSPECTIVE ANALYSIS We can introduce student behaviour system towards Engineering and Research with the help of artificial neural network model in Microsoft Excel. Excel is a popular and low cost technical education modelling technique with decision analysis.

113 113 Forestry Agriculture Automobile Construction Aerospace Some More Applications Milling / DrillingRobotics

114 114 ! THANK YOU !

Download ppt "Corporate Research & Development, BHEL Application of Artificial Neural Network and Soft Computing Techniques to Engineering World Problems By Dr. K.S."

Similar presentations

Ads by Google