3 Shihab is Running See http://www.hardrock100.com/index.asp Shihab arriving in Telluride in 2004(should happen around 4PM today)
4 Localization Effort Microphones Speaker ITD estimation from pure tonesInteraural Time Difference (ITD)Estimated from time difference between spikes of two matching channels.Interaural Intensity Difference (IID)Difference of spike counts between two cochleae.Azimuth: Combination of ITD and IIDMicrophonesAzimuth estimation from musicSpeaker
7 FPAA/Mote – Word Recognition Robosapien—listens to the spoken commands….Field Programmable Analog Array (FPAA)—based analog cochlea (non-spiking) with envelope detection.MOTE—based pattern matching using matched filtering with “receptive fields”
8 FPAA/Mote – Word Recognition Status:FPAA – (we are using a new FPAA) 2nd-order sections synthesized but a full auditory filter bank is not yet up.MOTE – real-time communication with Matlab and sampling operational.
9 Relational Network (Simple) Patches of neuronsEach measure one quantityBidirectional relations for feedback/feedforwardThanks to Rodney DouglasXYZMm
11 ASR Relational Network Bidirectional links enforce phoneme/word constraintsPhone RecognizerCochleaWord RecognizerPhone RecognizerDelayA patch of neurons(one of N output)Note: We don’t know how to represent delays
12 Relational Advantages Not an HMMHMMs are great, but…Incorporate other knowledgeBottom-up perceptionTop-down word hypothesisHallucinateBased on experienceHear “ba..” and know thatBad, bat, bar, bass, band follow>
13 Silicon Cochlea (van Schaik, Liu, 2004) high frequency low frequency Basilar membranehigh frequencylow frequencyInner hair cellsBASILAR MEMBRANEINNER HAIR CELLSGanglion cellsGANGLION CELLS(van Schaik, Liu, 2004)
14 Silicon Frequency Response Tone ramps into two cochleas
15 Cochlear Rate Profiles Spikes per utteranceLeft CochleaRight Cochlea
16 Learning Algorithms Statistical Liquid State Machine SAS (Pick best channels for decision)Least squares (for software demo)Liquid State MachineTake input to high dimensions with spiking netSpike Timing Dependent Plasticity (STDP)Giocomo/Srinjoy ChipBrader/FusiLSM Spiking OutputVowel 1Vowel 2
21 Hardware Overview Phoneme Word Cochlea Learning PCI-AER (for remapping)LearningCochleaLearningGiacomo IndiveriShih-Chii LiuPCI-AER (for remapping)Implemented in MATLAB
22 Infrastructure Difficulties RemapperEnsuing the problems surrounding AER mapper boards, remapping the AER data from silicon cochlea to the learning chip had to be done in Matlab. (very slow)PowerThe unpredictable problem caused by the variation in supply voltage as much as 1V.Sharing chipsThe learning chip had to be shared with two other workgroups.PC replacement
Your consent to our cookies if you continue to use this website.