S. Mandayam/ ANN/ECE Dept./Rowan University Artificial Neural Networks 0909.560.01/0909.454.01 Spring 2002 Shreekanth Mandayam Robi Polikar ECE Department.

Slides:

Advertisements

Similar presentations

Multilayer Perceptrons 1. Overview  Recap of neural network theory  The multi-layered perceptron  Back-propagation  Introduction to training  Uses.

Advertisements

Neural Network I Week 7 1. Team Homework Assignment #9 Read pp. 327 – 334 and the Week 7 slide. Design a neural network for XOR (Exclusive OR) Explore.

An Introduction to Artificial Intelligence. Introduction Getting machines to “think”. Imitation game and the Turing test. Chinese room test. Key processes.

Neural NetworksNN 11 Neural Networks Teacher: Elena Marchiori R4.47 Assistant: Kees Jong S2.22

Decision Support Systems

S. Mandayam/ ANN/ECE Dept./Rowan University Artificial Neural Networks / Fall 2004 Shreekanth Mandayam ECE Department Rowan University.

S. Mandayam/ EEMAG-1/ECE Dept./Rowan University Engineering Electromagnetics Fall 2004 Shreekanth Mandayam ECE Department Rowan University.

MFL Signal Matrix Defect Profile Matrix True Defect Profile Defect Characterization System Fig. 1: Desired object transformation system.

S. Mandayam/ ANN/ECE Dept./Rowan University Artificial Neural Networks ECE /ECE Fall 2008 Shreekanth Mandayam ECE Department Rowan University.

S. Mandayam/ ANN/ECE Dept./Rowan University Artificial Neural Networks ECE /ECE Fall 2010 Shreekanth Mandayam ECE Department Rowan University.

S. Mandayam/ ANN/ECE Dept./Rowan University Artificial Neural Networks ECE /ECE Fall 2008 Shreekanth Mandayam ECE Department Rowan University.

S. Mandayam/ ANN/ECE Dept./Rowan University Artificial Neural Networks ECE /ECE Fall 2006 Shreekanth Mandayam ECE Department Rowan University.

S. Mandayam/ ANN/ECE Dept./Rowan University Artificial Neural Networks ECE /ECE Fall 2006 Shreekanth Mandayam ECE Department Rowan University.

November 19, 2009Introduction to Cognitive Science Lecture 20: Artificial Neural Networks I 1 Artificial Neural Network (ANN) Paradigms Overview: The Backpropagation.

S. Mandayam/ ANN/ECE Dept./Rowan University Artificial Neural Networks ECE /ECE Fall 2010 Shreekanth Mandayam ECE Department Rowan University.

S. Mandayam/ ANN/ECE Dept./Rowan University Artificial Neural Networks / Spring 2002 Shreekanth Mandayam Robi Polikar ECE Department.

S. Mandayam/ ANN/ECE Dept./Rowan University Artificial Neural Networks / Fall 2004 Shreekanth Mandayam ECE Department Rowan University.

S. Mandayam/ EEMAG-1/ECE Dept./Rowan University Engineering Electromagnetics Fall 2004 Shreekanth Mandayam ECE Department Rowan University.

S. Mandayam/ ANN/ECE Dept./Rowan University Artificial Neural Networks / Fall 2004 Shreekanth Mandayam ECE Department Rowan University.

S. Mandayam/ ANN/ECE Dept./Rowan University Artificial Neural Networks ECE /ECE Fall 2006 Shreekanth Mandayam ECE Department Rowan University.

S. Mandayam/ ANN/ECE Dept./Rowan University Artificial Neural Networks ECE /ECE Fall 2010 Shreekanth Mandayam ECE Department Rowan University.

S. Mandayam/ ANN/ECE Dept./Rowan University Shreekanth Mandayam ECE Department Rowan University Lecture.

S. Mandayam/ ANN/ECE Dept./Rowan University Artificial Neural Networks ECE /ECE Fall 2006 Shreekanth Mandayam ECE Department Rowan University.

S. Mandayam/ ANN/ECE Dept./Rowan University Artificial Neural Networks / Fall 2004 Shreekanth Mandayam ECE Department Rowan University.

S. Mandayam/ ANN/ECE Dept./Rowan University Artificial Neural Networks ECE /ECE Fall 2010 Shreekanth Mandayam ECE Department Rowan University.

S. Mandayam/ ANN/ECE Dept./Rowan University Artificial Neural Networks / Spring 2002 Shreekanth Mandayam Robi Polikar ECE Department.

S. Mandayam/ ANN/ECE Dept./Rowan University Artificial Neural Networks ECE /ECE Fall 2008 Shreekanth Mandayam ECE Department Rowan University.

Random Administrivia In CMC 306 on Monday for LISP lab.

S. Mandayam/ EEMAG-1/ECE Dept./Rowan University Engineering Electromagnetics Fall 2004 Shreekanth Mandayam ECE Department Rowan University.

Neural Networks An Introduction.

S. Mandayam/ ANN/ECE Dept./Rowan University Artificial Neural Networks ECE /ECE Fall 2006 Shreekanth Mandayam ECE Department Rowan University.

S. Mandayam/ ANN/ECE Dept./Rowan University Artificial Neural Networks ECE /ECE Fall 2010 Shreekanth Mandayam ECE Department Rowan University.

S. Mandayam/ DIP/ECE Dept./Rowan University Digital Image Processing / Fall 2001 Shreekanth Mandayam ECE Department Rowan University.

S. Mandayam/ ANN/ECE Dept./Rowan University Smart Sensors / Spring 2004 Shreekanth Mandayam ECE Department Rowan University Artificial.

S. Mandayam/ ANN/ECE Dept./Rowan University Artificial Neural Networks ECE /ECE Fall 2010 Shreekanth Mandayam ECE Department Rowan University.

Introduction to Artificial Neural Network and Fuzzy Systems

NEURAL NETWORKS Introduction

Artificial Neural Network

Neural Networks. Background - Neural Networks can be : Biological - Biological models Artificial - Artificial models - Desire to produce artificial systems.

Revision Michael J. Watts

1 Introduction to Artificial Neural Networks Andrew L. Nelson Visiting Research Faculty University of South Florida.

Neural Networks.

Soft Computing Colloquium 2 Selection of neural network, Hybrid neural networks.

CS-485: Capstone in Computer Science Artificial Neural Networks and their application in Intelligent Image Processing Spring

Neurons, Neural Networks, and Learning 1. Human brain contains a massively interconnected net of (10 billion) neurons (cortical cells) Biological.

Artificial Intelligence Lecture No. 28 Dr. Asad Ali Safi Assistant Professor, Department of Computer Science, COMSATS Institute of Information Technology.

Artificial Neural Networks Shreekanth Mandayam Robi Polikar …… …... … net k   

Introduction to Neural Networks. Neural Networks in the Brain Human brain “computes” in an entirely different way from conventional digital computers.

A RTIFICIAL I NTELLIGENCE Introduction 3 October

1 Machine Learning The Perceptron. 2 Heuristic Search Knowledge Based Systems (KBS) Genetic Algorithms (GAs)

Neural Networks Kasin Prakobwaitayakit Department of Electrical Engineering Chiangmai University EE459 Neural Networks The Structure.

Lecture 3 Introduction to Neural Networks and Fuzzy Logic President UniversityErwin SitompulNNFL 3/1 Dr.-Ing. Erwin Sitompul President University

Artificial Intelligence Techniques Multilayer Perceptrons.

PSY105 Neural Networks 2/5 2. “A universe of numbers”

From Machine Learning to Deep Learning. Topics that I will Cover (subject to some minor adjustment) Week 2: Introduction to Deep Learning Week 3: Logistic.

Artificial Neural Network Building Using WEKA Software

Mehdi Ghayoumi MSB rm 132 Ofc hr: Thur, a Machine Learning.

Neural Networks Teacher: Elena Marchiori R4.47 Assistant: Kees Jong S2.22

Introduction to Neural Networks Jianfeng Feng School of Cognitive and Computing Sciences Spring 2001.

NEURAL NETWORKS LECTURE 1 dr Zoran Ševarac FON, 2015.

COMP53311 Other Classification Models: Neural Network Prepared by Raymond Wong Some of the notes about Neural Network are borrowed from LW Chan’s notes.

Artificial Intelligence Methods Neural Networks Lecture 1 Rakesh K. Bissoondeeal Rakesh K.

Perceptrons Michael J. Watts

Pattern Recognition. What is Pattern Recognition? Pattern recognition is a sub-topic of machine learning. PR is the science that concerns the description.

Lecture 2 Introduction to Neural Networks and Fuzzy Logic President UniversityErwin SitompulNNFL 2/1 Dr.-Ing. Erwin Sitompul President University

Chapter 13 Artificial Intelligence. Artificial Intelligence – Figure 13.1 The Turing Test.

Classification of models

Artificial Intelligence introduction(2)

Artificial Neural Networks ECE /ECE Fall 2006

Artificial Neural Networks / Spring 2002

Presentation transcript:

S. Mandayam/ ANN/ECE Dept./Rowan University Artificial Neural Networks / Spring 2002 Shreekanth Mandayam Robi Polikar ECE Department Rowan University Lecture 1 January 24, 2002

S. Mandayam/ ANN/ECE Dept./Rowan UniversityPlan What is artificial intelligence? Course introduction Historical development – the neuron model The artificial neural network paradigm What is knowledge? What is learning? The Perceptron The “Future”….?

S. Mandayam/ ANN/ECE Dept./Rowan University Artificial Intelligence Systems that think like humans Cognitive modeling Systems that think rationally Logic Systems that act like humans Natural language processing Knowledge representation Machine learning Systems that act rationally Decision theoretic agents

S. Mandayam/ ANN/ECE Dept./Rowan University Course Introduction Why should we take this course? PR, Applications What are we studying in this course? Course objectives/deliverables How are we conducting this course? Course logistics

S. Mandayam/ ANN/ECE Dept./Rowan University Course Objectives At the conclusion of this course the student will be able to: Identify and describe engineering paradigms for knowledge and learning Identify, describe and design artificial neural network architectures for simple cognitive tasks

S. Mandayam/ ANN/ECE Dept./Rowan University Biological Origins

S. Mandayam/ ANN/ECE Dept./Rowan University Biological Origins

S. Mandayam/ ANN/ECE Dept./Rowan UniversityHistory/People 1940’sTuringGeneral problem solver, “Turing test” 1940’sShannonInformation theory 1943McCulloch and PittsMath of neural processes 1949HebbLearning model 1959RosenblattThe “Perceptron” 1960WidrowLMS training algorithm 1969Minsky and PapertPerceptron deficiency 1985RumelhartFeedforward MLP, backprop 1988Broomhead and LoweRadial basis function neural nets 1990’sVLSI implementations

S. Mandayam/ ANN/ECE Dept./Rowan University Neural Network Paradigm Stage 1: Network Training ArtificialNeuralNetwork Present Examples Indicate Desired Outputs Determine Synaptic Weights ArtificialNeuralNetwork New Data Predicted Outputs Stage 2: Network Testing “knowledge”

S. Mandayam/ ANN/ECE Dept./Rowan University ANN Model ArtificialNeuralNetwork x Input Vector y Output Vector f Complex Nonlinear Function f(x) = y “knowledge”

S. Mandayam/ ANN/ECE Dept./Rowan University Popular I/O Mappings ANN x y Single output y1y1 ANN x 1-out-of-c selector y2y2 ycyc y1y1 ANN x Coder y2y2 ycyc ANN x Associator y

S. Mandayam/ ANN/ECE Dept./Rowan University The Perceptron    (.) w k1 w k2 w km x1x1 x2x2 xmxm Inputs Synaptic weights Bias, b k Induced field, v k Output, y k ukuk Activation/ squashing function

S. Mandayam/ ANN/ECE Dept./Rowan University“Learning” [w] x y ANN Mathematical Model of the Learning Process [w] 0 x y(0) Intitialize: Iteration (0) [w] 1 x y(1) Iteration (1) [w] n x y(n) = d Iteration (n) desired o/p

S. Mandayam/ ANN/ECE Dept./Rowan University The Age of Spiritual Machines When Computers Exceed Human Intelligence by Ray Kurzweil | Penguin paperback | |

S. Mandayam/ ANN/ECE Dept./Rowan UniversitySummary