Practical Heirarchical Temporal Memory for Time Series Prediction

Slides:



Advertisements
Similar presentations
TARGET DETECTION AND TRACKING IN A WIRELESS SENSOR NETWORK Clement Kam, William Hodgkiss, Dept. of Electrical and Computer Engineering, University of California,
Advertisements

Universidade Federal do Rio Grande do Sul Instituto de Pesquisas Hidráulicas – IPH IPH-ECO: A complex dynamic model for aquatic ecosystems A Limnologist.
Towards an Implementation of a Theory of Visual Learning in the Brain Shamit Patel CMSC 601 May 2, 2011.
From Cortical Microcircuits to Machine Intelligence
Decentralized Coded Caching Attains Order-Optimal Memory-Rate Tradeoff
Hierarchical Temporal Memory (HTM)
Associative Learning Memories -SOLAR_A
The Role of Competition in Repetition Blindness Mary L. Still Alison L. MorrisIowa State University The Role of Competition in Repetition Blindness Mary.
Chord: A scalable peer-to- peer lookup service for Internet applications Ion Stoica, Robert Morris, David Karger, M. Frans Kaashock, Hari Balakrishnan.
Neural Network of the Cerebellum: Temporal Discrimination and the Timing of Responses Michael D. Mauk Dean V. Buonomano.
Insider Access Behavior Team May 06 Brandon Reher Jake Gionet Steven Bromley Jon McKee Advisor Client Dr. Tom DanielsThe Boeing Company Contact Dr. Nick.
Reading population codes: a neural implementation of ideal observers Sophie Deneve, Peter Latham, and Alexandre Pouget.
The Normal Curve Z Scores, T Scores, and Skewness.
Redundant Logical AND using Artificial Neural Networks
Task1: Predicting Citations Claudia Perlich, Foster Provost & Sofus Macskassy New York University KDD Cup, August 2003.
1 Abstract This paper presents a novel modification to the classical Competitive Learning (CL) by adding a dynamic branching mechanism to neural networks.
Visualizing Eye Tracking Data John Lu Leo Spalteholz Peter Willsey.
Design and Implementation of a True Random Number Generator Based on Digital Circuit Artifacts Michael Epstein 1, Laszlo Hars 2, Raymond Krasinski 1, Martin.
IT 691 Final Presentation Pace University Created by: Robert M Gust Mark Lee Samir Hessami Mark Lee Samir Hessami.
UCF Noise Map, an Android Application Project Presentation Cindy Atherton and Deepa Shinde.
Biologically Inspired Robotics Group,EPFL Associative memory using coupled non-linear oscillators Semester project Final Presentation Vlad TRIFA.
Study of Sparse Online Gaussian Process for Regression EE645 Final Project May 2005 Eric Saint Georges.
The Implementation of a Glove-Based User Interface Chris Carey.
ACM CIKM October 31, 2013 Jeff Hawkins On-line Learning From Streaming Data.
 C. C. Hung, H. Ijaz, E. Jung, and B.-C. Kuo # School of Computing and Software Engineering Southern Polytechnic State University, Marietta, Georgia USA.
Lesson 5 – Looking at the Output MATSim Tutorial, 2011, Shanghai 1.
Image Recognition using Hierarchical Temporal Memory Radoslav Škoviera Ústav merania SAV Fakulta matematiky, fyziky a informatiky UK.
A Shaft Sensorless Control for PMSM Using Direct Neural Network Adaptive Observer Authors: Guo Qingding Luo Ruifu Wang Limei IEEE IECON 22 nd International.
Advances in Modeling Neocortex and its impact on machine intelligence Jeff Hawkins Numenta Inc. VS265 Neural Computation December 2, 2010 Documentation.
Expanding the CASE Framework to Facilitate Load Balancing of Social Network Simulations Amara Keller, Martin Kelly, Aaron Todd.
Hierarchical Temporal Memory as a Means for Image Recognition by Wesley Bruning CHEM/CSE 597D Final Project Presentation December 10, 2008.
A New Theory of Neocortex and Its Implications for Machine Intelligence TTI/Vanguard, All that Data February 9, 2005 Jeff Hawkins Director The Redwood.
John Wordsworth, Peter Ashwin, Gabor Orosz, Stuart Townley Mathematics Research Institute University of Exeter.
Visualizing Peer-to-Peer Networks Final Presentation By Team SPEW.
Design and Implementation of a Dynamic Data MLP to Predict Motion Picture Revenue David A. Gerasimow.
Modeling Neural Networks Christopher Krycho Advisor: Dr. Eric Abraham May 14, 2009.
Speed up the local inhibition Hideaki Suzuki September 5, 2013.
Household Activity Pattern Problem Paper by: W. W. Recker. Presented by: Jeremiah Jilk May 26, 2004 Jeremiah Jilk University of California, Irvine ICS.
An Artificial Neural Network Approach to Surface Waviness Prediction in Surface Finishing Process by Chi Ngo ECE/ME 539 Class Project.
1 The Effects of Ranging Noise on Multihop Localization: An Empirical Study Kamin Whitehouse Joint With: Chris Karlof, Alec Woo, Fred Jiang, David Culler.
Over-Trained Network Node Removal and Neurotransmitter-Inspired Artificial Neural Networks By: Kyle Wray.
Why Can't A Computer Be More Like A Brain?. Outline Introduction Turning Test HTM ◦ A. Theory ◦ B. Applications & Limits Conclusion.
October 1, 2013Computer Vision Lecture 9: From Edges to Contours 1 Canny Edge Detector However, usually there will still be noise in the array E[i, j],
Controlling a Robot with a Neural Network n CS/PY 231 Lab Presentation # 9 n March 30, 2005 n Mount Union College.
SIMULATION OF MULTIPROCESSOR SYSTEM AND NETWORK Manish Patel Nov 8 th 2004 Advisor: Dr. Chung-E-Wang Department of Computer Science California State University,
By: Aaron Dyreson Supervising Professor: Dr. Ioannis Schizas
A Distributed and Adaptive Signal Processing Approach to Reducing Energy Consumption in Sensor Networks Jim Chou, et al Univ. of Califonia at Berkeley.
A New Class of Mobility Models for Ad Hoc Wireless Networks Rahul Amin Advisor: Dr. Carl Baum Clemson University SURE 2006.
Welcome to MM570 Psychological Statistics Unit 5 Introduction to Hypothesis Testing Dr. Ami M. Gates.
Presented By Dr. Paul Cottrell Company: Reykjavik.
A SENSITIVITY ANALYSIS OF A BIOLOGICAL MODULE DISCOVERY PIPELINE James Long International Arctic Research Center University of Alaska Fairbanks March 25,
SPATIAL POOLER BY GIL SHOTAN. PRIMARY GOALS AND OBJECTIVES Move towards pure C++ implementation of CLA Easier to create bindings with other environments.
1 Nicholas Vidovich Software Developer Battelle Memorial Institute Intuitive, Interactive Data Visualization Applications Not for distribution or publication.
HIERARCHICAL TEMPORAL MEMORY WHY CANT COMPUTERS BE MORE LIKE THE BRAIN?
PSY 626: Bayesian Statistics for Psychological Science
Spatial and Temporal Encoding for a PSN
Framework for Realtime Ad-hoc Games
Date of download: 10/24/2017 Copyright © ASME. All rights reserved.
Student: Hao Xu, ECE Department
PSY 626: Bayesian Statistics for Psychological Science
A weight-incorporated similarity-based clustering ensemble method based on swarm intelligence Yue Ming NJIT#:
Resources and Schedule
Regulation Analysis using Restricted Boltzmann Machines
Recurrent Encoder-Decoder Networks for Time-Varying Dense Predictions
Temporal Back-Propagation Algorithm
Information Processing by Neuronal Populations Chapter 5 Measuring distributed properties of neural representations beyond the decoding of local variables:
Patrick Kaifosh, Attila Losonczy  Neuron 
Peter Banis, Klaus Çipi, Michael Kolar, Robert Olsen
Report 7 Brandon Silva.
Patrick Kaifosh, Attila Losonczy  Neuron 
Presentation transcript:

Practical Heirarchical Temporal Memory for Time Series Prediction Author: Nicholas Hainsey Faculty Advisor: Dr. C. David Shaffer

Heirarchical Temporal Memory Neural network Created by Jeff Hawkins Designed to mimic the human neocortex Network A B C INPUT Implemented one region of the neocortex Prediction Time

Input Encoding 1 A B C 1 01110 01000 01000 01000 01110 Time A B C 1 A B C 01110 01000 01000 01000 01110 Time 1 A B C 00100 01010 01110 01010 01010 Time

Spatial Pooler HTM Region 0 1 1 1 0 0 1 0 0 0 0 1 0 0 0 0 1 0 0 0 0 1 1 1 0 Input bits

Spatial Pooler Proximal dendrite 0 1 1 1 0 0 1 0 0 0 0 1 0 0 0 0 1 0 0 0 0 1 1 1 0 Input bits

Spatial Pooler 3 0 2 1 0 2 0 3 0 1 Overlap Score 0 1 1 1 0 0 1 0 0 0 0 1 0 0 0 0 1 0 0 0 0 1 1 1 0 Input bits

Spatial Pooler Goal: Each input will activate a small percentage of the columns Similar inputs will activate overlapping sets of columns

Temporal Pooler Inactive Active Predicted Getting Started Dystal Dendrites, Interconnections between active and predicted Make one of the B cells unpredicted then show bursting How does temporal pooler learn Inactive Active Predicted

Temporal Pooler Inactive Active Predicted Getting Started Dystal Dendrites, Interconnections between active and predicted Make one of the B cells unpredicted then show bursting How does temporal pooler learn Inactive Active Predicted

HTM Implementations HTMCLA HTM-CLA-Visualizer NuPIC A C++ implementation based off Numenta’s CLA white paper HTM-CLA-Visualizer Java interface for visualization of HTMs NuPIC Created by Numenta, used in Nustudio

Nustudio

Nustudio

Nustudio Run Simulation Stop

Nustudio Connect to server

Nustudio Connect to server

Nustudio Run simulation from server

Nustudio Pos (z): 2 Was Predicted: True Is Active: True Activation Rate: .050 Prediction Rate: .500

Nustudio

Nustudio P1: Mean P2: Standard Deviation

Nustudio

Predictions with noise Learning SD: 5.0 SD: 10.0 SD: 20.0

Noise with learning No Noise 5.0 SD 10.0 SD 20.0 SD

Conclusions Additions to Nustudio Noise Comparison Constant simulation from file Live simulation from server Adding noise to incoming data Viewing individual regions of the HTM at any step Noise Comparison Still seems stable under varying levels of noise

Future Work More robust test of noisy data More customization of noise More distributions to choose from More control over where noise is applied Ability to export prediction data

Feedback: Privacy Policy Feedback
Do Not Sell My Personal Information
About project: SlidePlayer Terms of Service

© 2024 SlidePlayer.com Inc. All rights reserved.