Learning Feature Mappings Using Evolutionary Computation

Slides:



Advertisements
Similar presentations
1 Connectionist Modeling Jenny Hayes. 2 Overview What are connectionist models? How do they work? How are they used in psychology?
Advertisements

A. Hatzis, P.D. Green, S. Howard (1) Optical Logo-Therapy (OLT) : Visual displays in practical auditory phonetics teaching. Introduction What.
A Brief Overview of Neural Networks By Rohit Dua, Samuel A. Mulder, Steve E. Watkins, and Donald C. Wunsch.
Introduction to Neural Networks 2. Overview  The McCulloch-Pitts neuron  Pattern space  Limitations  Learning.
Building an ASR using HTK CS4706
Fast Fourier Transform Lecture 6 Spoken Language Processing Prof. Andrew Rosenberg.
Competitive Networks. Outline Hamming Network.
Assuming normally distributed data! Naïve Bayes Classifier.
A Batch-Language, Vector-Based Neural Network Simulator Motivation: - general computer languages (e.g. C) lead to complex code - neural network simulators.
Modeling The Spino- Neuromuscular System Terence Soule, Stanley Gotshall, Richard Wells, Mark DeSantis, Kathy Browder, Eric Wolbrecht.
Evolutionary Algorithms Simon M. Lucas. The basic idea Initialise a random population of individuals repeat { evaluate select vary (e.g. mutate or crossover)
Evolutionary Computing and the Traveling Salesman
Optimal Adaptation for Statistical Classifiers Xiao Li.
Classification of Music According to Genres Using Neural Networks, Genetic Algorithms and Fuzzy Systems.
Overview of Back Propagation Algorithm
Authors: Anastasis Kounoudes, Anixi Antonakoudi, Vasilis Kekatos
Hazırlayan NEURAL NETWORKS Radial Basis Function Networks II PROF. DR. YUSUF OYSAL.
IEEE TRANSACTIONS ON AUDIO, SPEECH, AND LANGUAGE PROCESSING MARCH 2010 Lan-Ying Yeh
Optimization of thermal processes2007/2008 Optimization of thermal processes Maciej Marek Czestochowa University of Technology Institute of Thermal Machinery.
Convolutional Neural Networks for Image Processing with Applications in Mobile Robotics By, Sruthi Moola.
Revision Michael J. Watts
Statistical automatic identification of microchiroptera from echolocation calls Lessons learned from human automatic speech recognition Mark D. Skowronski.
A Genetic Algorithms Approach to Feature Subset Selection Problem by Hasan Doğu TAŞKIRAN CS 550 – Machine Learning Workshop Department of Computer Engineering.
Evolving a Sigma-Pi Network as a Network Simulator by Justin Basilico.
Soft Computing Lecture 18 Foundations of genetic algorithms (GA). Using of GA.
An Introduction to Artificial Intelligence and Knowledge Engineering N. Kasabov, Foundations of Neural Networks, Fuzzy Systems, and Knowledge Engineering,
Self organizing maps 1 iCSC2014, Juan López González, University of Oviedo Self organizing maps A visualization technique with data dimension reduction.
What is a neural network? Collection of interconnected neurons that compute and generate impulses. Components of a neural network include neurons, synapses,
Appendix B: An Example of Back-propagation algorithm
Supervisor: Dr. Eddie Jones Co-supervisor: Dr Martin Glavin Electronic Engineering Department Final Year Project 2008/09 Development of a Speaker Recognition/Verification.
Building high-level features using large-scale unsupervised learning Anh Nguyen, Bay-yuan Hsu CS290D – Data Mining (Spring 2014) University of California,
The Perceptron. Perceptron Pattern Classification One of the purposes that neural networks are used for is pattern classification. Once the neural network.
Overview of Part I, CMSC5707 Advanced Topics in Artificial Intelligence KH Wong (6 weeks) Audio signal processing – Signals in time & frequency domains.
A Baseline System for Speaker Recognition C. Mokbel, H. Greige, R. Zantout, H. Abi Akl A. Ghaoui, J. Chalhoub, R. Bayeh University Of Balamand - ELISA.
ELeaRNT: Evolutionary Learning of Rich Neural Network Topologies Authors: Slobodan Miletic 3078/2010 Nikola Jovanovic 3077/2010
Blondie24 Presented by Adam Duffy and Josh Hill. Overview Introduction to new concepts Design of Blondie24 Testing and results Other approaches to checkers.
 Based on observed functioning of human brain.  (Artificial Neural Networks (ANN)  Our view of neural networks is very simplistic.  We view a neural.
Speech Communication Lab, State University of New York at Binghamton Dimensionality Reduction Methods for HMM Phonetic Recognition Hongbing Hu, Stephen.
Introduction to Neural Networks Introduction to Neural Networks Applied to OCR and Speech Recognition An actual neuron A crude model of a neuron Computational.
CSC321: Introduction to Neural Networks and Machine Learning Lecture 19: Learning Restricted Boltzmann Machines Geoffrey Hinton.
Evolutionary Robotics The Genotype-to-Phenotype Map The genotype to phenotype map: the algorithm that transforms the genotype into the phenotype. Direct.
EEL 6586: AUTOMATIC SPEECH PROCESSING Hidden Markov Model Lecture Mark D. Skowronski Computational Neuro-Engineering Lab University of Florida March 31,
1 Voicing Features Horacio Franco, Martin Graciarena Andreas Stolcke, Dimitra Vergyri, Jing Zheng STAR Lab. SRI International.
HIV Mutation Classifier HIV Mutation Classifier Hannah Bier’s Project Proposal.
Neural Networks for EMC Modeling of Airplanes Vlastimil Koudelka Department of Radio Electronics FEKT BUT Metz,
(NetOS Meeting Randomlette) Christian Kreibich ICSI + Bro a.k.a. What I Did Last Summer.
An Evolutionary Algorithm for Neural Network Learning using Direct Encoding Paul Batchis Department of Computer Science Rutgers University.
Artificial Neural Networks By: Steve Kidos. Outline Artificial Neural Networks: An Introduction Frank Rosenblatt’s Perceptron Multi-layer Perceptron Dot.
1 Neural Networks MUMT 611 Philippe Zaborowski April 2005.
Korean Phoneme Discrimination
Deep Reinforcement Learning
EEL 6586: AUTOMATIC SPEECH PROCESSING Hidden Markov Model Lecture
An evolutionary approach to solving complex problems
CSSE463: Image Recognition Day 17
Kohonen Self-organizing Feature Maps
Neural Networks Advantages Criticism
Face Recognition with Neural Networks
network of simple neuron-like computing elements
CSSE463: Image Recognition Day 17
A Proposal Defense On Deep Residual Network For Face Recognition Presented By SAGAR MISHRA MECE
Pattern Recognition & Machine Learning
CSSE463: Image Recognition Day 17
CSSE463: Image Recognition Day 13
Deep Neural Networks: A Hands on Challenge Deep Neural Networks: A Hands on Challenge Deep Neural Networks: A Hands on Challenge Deep Neural Networks:
Neural Networks II Chen Gao Virginia Tech ECE-5424G / CS-5824
CSSE463: Image Recognition Day 17
CSSE463: Image Recognition Day 17
Neural Networks II Chen Gao Virginia Tech ECE-5424G / CS-5824
Introduction to Neural Networks
Outline Announcement Neural networks Perceptrons - continued
Presentation transcript:

Learning Feature Mappings Using Evolutionary Computation Konsta Koppinen Tampere University of Technology Tampere, Finland ICSI Speech Lunch 1/27/04

Overview l v s Labeled speech ey ax-h Feature pool: -mel-band energy -cepstral coeff -harmonicity -… Sparse neural network Phonetic target neurons b d e f ey a jh s z

Neural Network Training Training using evolutionary algorithms mutation change weight add/remove neuron add/remove connection crossover Evaluation using frame-level phonetic targets estimation of performance using sampling penalty for complexity of network 0.2 0.1 0.7 0.1