Modelleerimine ja Juhtimine Tehisnärvivõrgudega

Slides:



Advertisements
Similar presentations
A Brief Overview of Neural Networks By Rohit Dua, Samuel A. Mulder, Steve E. Watkins, and Donald C. Wunsch.
Advertisements

1 Image Classification MSc Image Processing Assignment March 2003.
Artificial Neural Networks (1)
Multilayer Perceptrons 1. Overview  Recap of neural network theory  The multi-layered perceptron  Back-propagation  Introduction to training  Uses.
Machine Learning: Connectionist McCulloch-Pitts Neuron Perceptrons Multilayer Networks Support Vector Machines Feedback Networks Hopfield Networks.
PROTEIN SECONDARY STRUCTURE PREDICTION WITH NEURAL NETWORKS.
Decision Support Systems
Carla P. Gomes CS4700 CS 4700: Foundations of Artificial Intelligence Prof. Carla P. Gomes Module: Neural Networks: Concepts (Reading:
1 Chapter 11 Neural Networks. 2 Chapter 11 Contents (1) l Biological Neurons l Artificial Neurons l Perceptrons l Multilayer Neural Networks l Backpropagation.
Neural Networks Dr. Peter Phillips. Neural Networks What are Neural Networks Where can neural networks be used Examples Recognition systems (Voice, Signature,
Neural Networks. R & G Chapter Feed-Forward Neural Networks otherwise known as The Multi-layer Perceptron or The Back-Propagation Neural Network.
MAE 552 Heuristic Optimization Instructor: John Eddy Lecture #30 4/15/02 Neural Networks.
Power Systems Application of Artificial Neural Networks. (ANN)  Introduction  Brief history.  Structure  How they work  Sample Simulations. (EasyNN)
Handwritten Character Recognition Using Block wise Segmentation Technique (BST) in Neural Network 47th Annual Convention of the Computer Society of India.
Neural Networks Lab 5. What Is Neural Networks? Neural networks are composed of simple elements( Neurons) operating in parallel. Neural networks are composed.
S. Mandayam/ ANN/ECE Dept./Rowan University Artificial Neural Networks ECE /ECE Fall 2006 Shreekanth Mandayam ECE Department Rowan University.
Artificial Neural Networks - Introduction -. Overview 1.Biological inspiration 2.Artificial neurons and neural networks 3.Application.
1 Introduction to Artificial Neural Networks Andrew L. Nelson Visiting Research Faculty University of South Florida.
1 st Neural Network: AND function Threshold(Y) = 2 X1 Y X Y.
Multiple-Layer Networks and Backpropagation Algorithms
Artificial Neural Networks
C. Benatti, 3/15/2012, Slide 1 GA/ICA Workshop Carla Benatti 3/15/2012.
Explorations in Neural Networks Tianhui Cai Period 3.
ANNs (Artificial Neural Networks). THE PERCEPTRON.
Appendix B: An Example of Back-propagation algorithm
Neural Networks Kasin Prakobwaitayakit Department of Electrical Engineering Chiangmai University EE459 Neural Networks The Structure.
1 Pattern Recognition: Statistical and Neural Lonnie C. Ludeman Lecture 20 Oct 26, 2005 Nanjing University of Science & Technology.
Radial Basis Function Networks:
Artificial Intelligence Techniques Multilayer Perceptrons.
An informal description of artificial neural networks John MacCormick.
1 Chapter 11 Neural Networks. 2 Chapter 11 Contents (1) l Biological Neurons l Artificial Neurons l Perceptrons l Multilayer Neural Networks l Backpropagation.
Artificial Neural Networks An Introduction. What is a Neural Network? A human Brain A porpoise brain The brain in a living creature A computer program.
Dünaamiliste süsteemide modelleerimine Identification for control in a non- linear system world Eduard Petlenkov, Automaatikainstituut, 2013.
Multi-Layer Perceptron
CS621 : Artificial Intelligence
Neural Networks Demystified by Louise Francis Francis Analytics and Actuarial Data Mining, Inc.
Modelleerimine ja Juhtimine Tehisnärvivõrgudega Identification and Control with artificial neural networks (2nd part) Eduard Petlenkov, Automaatikainstituut.
Neural Networks Vladimir Pleskonjić 3188/ /20 Vladimir Pleskonjić General Feedforward neural networks Inputs are numeric features Outputs are in.
Back-propagation network (BPN) Student : Dah-Sheng Lee Professor: Hahn-Ming Lee Date:20 September 2003.
NEURAL NETWORKS LECTURE 1 dr Zoran Ševarac FON, 2015.
Introduction to Neural Networks Freek Stulp. 2 Overview Biological Background Artificial Neuron Classes of Neural Networks 1. Perceptrons 2. Multi-Layered.
Neural Networks 2nd Edition Simon Haykin
Artificial Neural Networks (ANN). Artificial Neural Networks First proposed in 1940s as an attempt to simulate the human brain’s cognitive learning processes.
Modelleerimine ja Juhtimine Tehisnärvivõrgudega Identification and Control with artificial neural networks.
Perceptrons Michael J. Watts
Neural Networks. Background - Neural Networks can be : Biological - Biological models Artificial - Artificial models - Desire to produce artificial systems.
Data Mining: Concepts and Techniques1 Prediction Prediction vs. classification Classification predicts categorical class label Prediction predicts continuous-valued.
1 Neural Networks MUMT 611 Philippe Zaborowski April 2005.
Business Intelligence and Decision Support Systems (9 th Ed., Prentice Hall) Chapter 6: Artificial Neural Networks for Data Mining.
Multiple-Layer Networks and Backpropagation Algorithms
Neural Networks.
Neural Networks based control of nonlinear systems
Artificial neural networks
CSE 473 Introduction to Artificial Intelligence Neural Networks
FUNDAMENTAL CONCEPT OF ARTIFICIAL NETWORKS
CSE P573 Applications of Artificial Intelligence Neural Networks
Prof. Carolina Ruiz Department of Computer Science
Neural Networks based control of nonlinear systems
Artificial Intelligence Methods
Artificial Neural Network & Backpropagation Algorithm
XOR problem Input 2 Input 1
CSE 573 Introduction to Artificial Intelligence Neural Networks
network of simple neuron-like computing elements
Neural Networks Chapter 5
Multi-Layer Perceptron
Neural Networks References: “Artificial Intelligence for Games”
Lecture 04: Multilayer Perceptron
Fig. 1. A diagram of artificial neural network consisting of multilayer perceptron. This simple diagram is for a conceptual explanation. When the logistic.
Areas under the receiver operating characteristic (ROC) curves for both the training and testing data sets based on a number of hidden-layer perceptrons.
Prof. Carolina Ruiz Department of Computer Science
Presentation transcript:

Modelleerimine ja Juhtimine Tehisnärvivõrgudega ---------------------------------------------- Identification and Control with artificial neural networks Eduard Petlenkov, Eduard Petlenkov, 2013

Artificial neuron Input vector: Vector of weight coeffitients: Weighted sum Nonlinear element Input vector: Vector of weight coeffitients: Weighted sum: Eduard Petlenkov, 2013

Biological neuron and biological neural networks Eduard Petlenkov, 2013

Sigmoid functions are having an "S" shape (sigmoid curve) Activation functions (1) OUT=f(NET) Sigmoid functions are having an "S" shape (sigmoid curve) 1 Logistic function 2 Hyperbolic tangent Eduard Petlenkov, 2013

Types of artificial neural networks Feedforward Feedback internal feedback external feedback Structure: inputs etalon Supervised learning Selflearning (unsupervised) Training/ learning: inputs Training criteria Eduard Petlenkov, 2013

Interpritation of results How to use artificial neural networks Network Data preprocessing Interpritation of results Inputs Outputs Eduard Petlenkov, 2013

Feedforward neural networks and multilayer perceptron Feedforward networks are networks in which an output of a neuron can be connected only with an input of a next layer neuron. - Input layer - Output layer - Hidden layer - Weighting coefficients, where is the number of the neuron’s input “from each to each” - neuron’s number in the layer - number of the layer Eduard Petlenkov, 2013

Mathematical function of a two-layer perceptron - Activation function of the hiddent layer neurons; - Activation function of the output layer neurons. Eduard Petlenkov, 2013