1 Part I Artificial Neural Networks Sofia Nikitaki.

Slides:



Advertisements
Similar presentations
NEURAL NETWORKS Biological analogy
Advertisements

A Brief Overview of Neural Networks By Rohit Dua, Samuel A. Mulder, Steve E. Watkins, and Donald C. Wunsch.
Slides from: Doug Gray, David Poole
NEURAL NETWORKS Backpropagation Algorithm
Artificial Neural Networks
Machine Learning Neural Networks
PROTEIN SECONDARY STRUCTURE PREDICTION WITH NEURAL NETWORKS.
Prénom Nom Document Analysis: Artificial Neural Networks Prof. Rolf Ingold, University of Fribourg Master course, spring semester 2008.
1 Chapter 11 Neural Networks. 2 Chapter 11 Contents (1) l Biological Neurons l Artificial Neurons l Perceptrons l Multilayer Neural Networks l Backpropagation.
Slide 1 EE3J2 Data Mining EE3J2 Data Mining Lecture 15: Introduction to Artificial Neural Networks Martin Russell.
Prénom Nom Document Analysis: Artificial Neural Networks Prof. Rolf Ingold, University of Fribourg Master course, spring semester 2008.
Neural Networks Lab 5. What Is Neural Networks? Neural networks are composed of simple elements( Neurons) operating in parallel. Neural networks are composed.
Image Compression Using Neural Networks Vishal Agrawal (Y6541) Nandan Dubey (Y6279)
Neural Networks. Background - Neural Networks can be : Biological - Biological models Artificial - Artificial models - Desire to produce artificial systems.
Hazırlayan NEURAL NETWORKS Radial Basis Function Networks II PROF. DR. YUSUF OYSAL.
BEE4333 Intelligent Control
Artificial neural networks:
MSE 2400 EaLiCaRA Spring 2015 Dr. Tom Way
1 st Neural Network: AND function Threshold(Y) = 2 X1 Y X Y.
Presentation on Neural Networks.. Basics Of Neural Networks Neural networks refers to a connectionist model that simulates the biophysical information.
Artificial Neural Networks (ANN). Output Y is 1 if at least two of the three inputs are equal to 1.
Multiple-Layer Networks and Backpropagation Algorithms
Artificial Neural Networks
Data Mining and Neural Networks Danny Leung CS157B, Spring 2006 Professor Sin-Min Lee.
© Copyright 2004 ECE, UM-Rolla. All rights reserved A Brief Overview of Neural Networks By Rohit Dua, Samuel A. Mulder, Steve E. Watkins, and Donald C.
Appendix B: An Example of Back-propagation algorithm
Backpropagation An efficient way to compute the gradient Hung-yi Lee.
Machine Learning Dr. Shazzad Hosain Department of EECS North South Universtiy
NEURAL NETWORKS FOR DATA MINING
 Diagram of a Neuron  The Simple Perceptron  Multilayer Neural Network  What is Hidden Layer?  Why do we Need a Hidden Layer?  How do Multilayer.
LINEAR CLASSIFICATION. Biological inspirations  Some numbers…  The human brain contains about 10 billion nerve cells ( neurons )  Each neuron is connected.
Artificial Neural Networks. The Brain How do brains work? How do human brains differ from that of other animals? Can we base models of artificial intelligence.
1 Chapter 11 Neural Networks. 2 Chapter 11 Contents (1) l Biological Neurons l Artificial Neurons l Perceptrons l Multilayer Neural Networks l Backpropagation.
Artificial Neural Networks An Introduction. What is a Neural Network? A human Brain A porpoise brain The brain in a living creature A computer program.
Features of Biological Neural Networks 1)Robustness and Fault Tolerance. 2)Flexibility. 3)Ability to deal with variety of Data situations. 4)Collective.
Neural Networks Steven Le. Overview Introduction Architectures Learning Techniques Advantages Applications.
Non-Bayes classifiers. Linear discriminants, neural networks.
ADALINE (ADAptive LInear NEuron) Network and
Introduction to Neural Networks Introduction to Neural Networks Applied to OCR and Speech Recognition An actual neuron A crude model of a neuron Computational.
Neural Networks Presented by M. Abbasi Course lecturer: Dr.Tohidkhah.
Neural Networks Teacher: Elena Marchiori R4.47 Assistant: Kees Jong S2.22
Hazırlayan NEURAL NETWORKS Backpropagation Network PROF. DR. YUSUF OYSAL.
NEURAL NETWORKS LECTURE 1 dr Zoran Ševarac FON, 2015.
Introduction to Neural Networks Freek Stulp. 2 Overview Biological Background Artificial Neuron Classes of Neural Networks 1. Perceptrons 2. Multi-Layered.
Artificial Neural Networks (ANN). Artificial Neural Networks First proposed in 1940s as an attempt to simulate the human brain’s cognitive learning processes.
Artificial Intelligence Methods Neural Networks Lecture 3 Rakesh K. Bissoondeeal Rakesh K. Bissoondeeal.
Bab 5 Classification: Alternative Techniques Part 4 Artificial Neural Networks Based Classifer.
Neural Networks. Background - Neural Networks can be : Biological - Biological models Artificial - Artificial models - Desire to produce artificial systems.
Kim HS Introduction considering that the amount of MRI data to analyze in present-day clinical trials is often on the order of hundreds or.
Lecture 2 Introduction to Neural Networks and Fuzzy Logic President UniversityErwin SitompulNNFL 2/1 Dr.-Ing. Erwin Sitompul President University
Intro. ANN & Fuzzy Systems Lecture 11. MLP (III): Back-Propagation.
Learning with Neural Networks Artificial Intelligence CMSC February 19, 2002.
Learning with Perceptrons and Neural Networks
Real Neurons Cell structures Cell body Dendrites Axon
CSE 473 Introduction to Artificial Intelligence Neural Networks
بحث في موضوع : Neural Network
FUNDAMENTAL CONCEPT OF ARTIFICIAL NETWORKS
CSE P573 Applications of Artificial Intelligence Neural Networks
CSE 473 Introduction to Artificial Intelligence Neural Networks
Machine Learning Today: Reading: Maria Florina Balcan
Biological and Artificial Neuron
Biological and Artificial Neuron
CSE 573 Introduction to Artificial Intelligence Neural Networks
Neural Network - 2 Mayank Vatsa
Capabilities of Threshold Neurons
Lecture Notes for Chapter 4 Artificial Neural Networks
ARTIFICIAL NEURAL networks.
Introduction to Neural Network
David Kauchak CS158 – Spring 2019
Artificial Neural Network learning
Presentation transcript:

1 Part I Artificial Neural Networks Sofia Nikitaki

2 What is a Neural Network  An information processing paradigm inspired by the biological nervous systems  Key  information processing system  Large number of highly interconnected elements  Learn by example

3 How the Human Brain Learns?  A neuron collects signals  dendrites

4 Artificial Neuron  Many inputs and one output  Modes of operation Training Using

5 How Neural Networks works  Basic features: Construction of network Computation functions of network Training of network

6 Inside the Neural Network  P i : inputs  Σ : sum for each neuron  f : function of the transfer output  f(a i ) = Σ ( W i,i x P i )+b i b i : threshold of each node.

7 Inside the Neural Network (cnt’d)

8 Training of the network  Supervised learning Output target exist Backpropagation technique  Unsupervised learning Output target unknown The network adjust similar output for similar inputs

9 Backpropagation technique 1.Computes the total weight input Xi 2.Calculates the activity yi using the transfer function 3.Computes the error E

10 Backpropagation technique (cnt’d)  How fast the E changes 1.Activity of an output unit is changed  Error derivative (EA)  Yi actual activity  di the desired activity 2.As the total input received by an output unit is changed  Quality (EI) is the answer from step 1 multiplied by the rate at which the output of a unit changes as its total input is changed. 3.As a weight on the connection into an output unit is changed 4.As the activity of a unit in the previous layer is changed

11 Transfer functions

12 Gradient descent method  Algorithm   step searchs locally to find the optimal value the optimal direction of the weight change  Training function – TrainSCG updates  weight, bias values  Adaption Learning Function – LearnGDM updates  weight, bias learning function

13 Performance Function - MSE  Network's performance  the mean of squared errors  Measures the average of the square of the error

14 Part II Neural Networks and Location Sensing for indoor environments

15 CLS – Neural Networks  Input Deciles of Signal Strength values Signal Strength measurements

16 Neural Network  Input : Deciles of Signal Strength values 2 layers Input: 80 SS values per cell Total: 8 APs 85 neurons Tan-sigmoid transfer function POSITION Output:2 values x,y coordinates Linear transfer function

17 Results - Location Error Median 2,6meter

18 Neural Network  Input : Signal Strength values Input: 480 SS values per cell Total: 8 APs 2 layers 100 neurons Tan-sigmoid transfer function POSITION Output:2 values x,y coordinates Linear transfer function

19 Results - Location Error Median 1.8 meter

20 CLS – Comparison of all methods

21