A neural mechanism for robust junction representation in the visual cortex University of Ulm Dept. of Neural Information Processing Thorsten Hansen and.

Slides:



Advertisements
Similar presentations
Midterm 1 Oct. 21 in class. Read this article by Wednesday next week!
Advertisements

V1 Physiology. Questions Hierarchies of RFs and visual areas Is prediction equal to understanding? Is predicting the mean responses enough? General versus.
Object recognition and scene “understanding”
Example-Based Fractured Appearance L. Glondu, L. Muguercia, M. Marchal, C. Bosch, H. Rushmeier, G. Dumont and G. Drettakis.
R. DOSIL, X. M. PARDO, A. MOSQUERA, D. CABELLO Grupo de Visión Artificial Departamento de Electrónica e Computación Universidade de Santiago de Compostela.
Analysis of Contour Motions Ce Liu William T. Freeman Edward H. Adelson Computer Science and Artificial Intelligence Laboratory Massachusetts Institute.
Computer Vision Lecture 18: Object Recognition II
for image processing and computer vision
DREAM PLAN IDEA IMPLEMENTATION Introduction to Image Processing Dr. Kourosh Kiani
TP14 - Local features: detection and description Computer Vision, FCUP, 2014 Miguel Coimbra Slides by Prof. Kristen Grauman.
Electrical & Computer Engineering Dept. University of Patras, Patras, Greece Evangelos Skodras Nikolaos Fakotakis.
Computer Vision Lecture 16: Region Representation
A Robust Approach for Local Interest Point Detection in Line-Drawing Images 1 The Anh Pham, Mathieu Delalandre, Sabine Barrat and Jean-Yves Ramel RFAI.
Gain Modulation Huei-Ju Chen Papers: Chance, Abbott, and Reyes(2002) E. Salinas & T. Sejnowski(2001) E. Salinas & L.G. Abbott (1997, 1996) Pouget & T.
Giessen University Dept. of Psychology
Visual Pathways W. W. Norton Primary cortex maintains distinct pathways – functional segregation M and P pathways synapse in different layers Ascending.
How does the visual system represent visual information? How does the visual system represent features of scenes? Vision is analytical - the system breaks.
EE663 Image Processing Edge Detection 2 Dr. Samir H. Abdul-Jauwad Electrical Engineering Department King Fahd University of Petroleum & Minerals.
Intelligent Control Systems Laboratory The Chinese University of Hong Kong Dept. of Mechanical and Automation Engineering Yan Lu, Josh Lam, Yeung Yam Preliminary.
Laurent Itti: CS599 – Computational Architectures in Biological Vision, USC Lecture 6: Low-level features 1 Computational Architectures in Biological.
Segmentation (Section 10.2)
Visual Cognition II Object Perception. Theories of Object Recognition Template matching models Feature matching Models Recognition-by-components Configural.
Michigan State University 1 “Saliency-Based Visual Attention” “Computational Modeling of Visual Attention”, Itti, Koch, (Nature Reviews – Neuroscience.
Overview 1.The Structure of the Visual Cortex 2.Using Selective Tuning to Model Visual Attention 3.The Motion Hierarchy Model 4.Simulation Results 5.Conclusions.
Laurent Itti: CS599 – Computational Architectures in Biological Vision, USC Lecture 5: Introduction to Vision 2 1 Computational Architectures in.
Connected Populations: oscillations, competition and spatial continuum (field equations) Lecture 12 Course: Neural Networks and Biological Modeling Wulfram.
Lecture 6: Feature matching and alignment CS4670: Computer Vision Noah Snavely.
Real-Time Vision on a Mobile Robot Platform Mohan Sridharan Joint work with Peter Stone The University of Texas at Austin
West Virginia University
Computer vision.
Real-Time Human Posture Reconstruction in Wireless Smart Camera Networks Chen Wu, Hamid Aghajan Wireless Sensor Network Lab, Stanford University, USA IPSN.
Lecture 4: Feature matching CS4670 / 5670: Computer Vision Noah Snavely.
Changju Lee Visual System Neural Network Lab. Department of Bio and Brain Engineering.
Clustering of protein networks: Graph theory and terminology Scale-free architecture Modularity Robustness Reading: Barabasi and Oltvai 2004, Milo et al.
Lecture 2b Readings: Kandell Schwartz et al Ch 27 Wolfe et al Chs 3 and 4.
The primate visual systemHelmuth Radrich, The primate visual system 1.Structure of the eye 2.Neural responses to light 3.Brightness perception.
Supervised Learning of Edges and Object Boundaries Piotr Dollár Zhuowen Tu Serge Belongie.
National Taiwan A Road Sign Recognition System Based on a Dynamic Visual Model C. Y. Fang Department of Information and.
Lecture 7: Features Part 2 CS4670/5670: Computer Vision Noah Snavely.
1 Research Question  Can a vision-based mobile robot  with limited computation and memory,  and rapidly varying camera positions,  operate autonomously.
Jaroslaw Kutylowski 1 HEINZ NIXDORF INSTITUTE University of Paderborn Algorithms and Complexity Robust Undetectable Interference Watermarks Ryszard Grząślewicz.
Jack Pinches INFO410 & INFO350 S INFORMATION SCIENCE Computer Vision I.
Efficient Color Boundary Detection with Color-opponent Mechanisms CVPR2013 Posters.
A new theoretical framework for multisensory integration Michael W. Hadley and Elaine R. Reynolds Neuroscience Program, Lafayette College, Easton PA
Multiple watermarking Wu Dan Introduction (I) Multipurpose watermarking Ownership watermarks (very robust) Captioning watermarks ( robust)
Visual Computation I. Physiological Foundations
October 16, 2014Computer Vision Lecture 12: Image Segmentation II 1 Hough Transform The Hough transform is a very general technique for feature detection.
Local features: detection and description
October 1, 2013Computer Vision Lecture 9: From Edges to Contours 1 Canny Edge Detector However, usually there will still be noise in the array E[i, j],
CS 376b Introduction to Computer Vision 03 / 31 / 2008 Instructor: Michael Eckmann.
Object Recognition by Discriminative Combinations of Line Segments and Ellipses Alex Chia ^˚ Susanto Rahardja ^ Deepu Rajan ˚ Maylor Leung ˚ ^ Institute.
Machine Vision Edge Detection Techniques ENT 273 Lecture 6 Hema C.R.
Instructor: Mircea Nicolescu Lecture 5 CS 485 / 685 Computer Vision.
Instructor: Mircea Nicolescu Lecture 10 CS 485 / 685 Computer Vision.
Fast Human Detection in Crowded Scenes by Contour Integration and Local Shape Estimation Csaba Beleznai, Horst Bischof Computer Vision and Pattern Recognition,
1 Computational Vision CSCI 363, Fall 2012 Lecture 32 Biological Heading, Color.
Face Detection 蔡宇軒.
April 21, 2016Introduction to Artificial Intelligence Lecture 22: Computer Vision II 1 Canny Edge Detector The Canny edge detector is a good approximation.
Bayesian Brain - Chapter 11 Neural Models of Bayesian Belief Propagation Rajesh P.N. Rao Summary by B.-H. Kim Biointelligence Lab School of.
1 Nonlinear models for Natural Image Statistics Urs Köster & Aapo Hyvärinen University of Helsinki.
3D Single Image Scene Reconstruction For Video Surveillance Systems
Lecture 07 13/12/2011 Shai Avidan הבהרה: החומר המחייב הוא החומר הנלמד בכיתה ולא זה המופיע / לא מופיע במצגת.
Dynamic Routing Using Inter Capsule Routing Protocol Between Capsules
By Pradeep C.Venkat Srinath Srinivasan
Computer Vision Lecture 9: Edge Detection II
Institute of Neural Information Processing (Prof. Heiko Neumann •
Perception: Structures
Extract Object Boundaries in Noisy Images
Analysis of Contour Motions
Volume 75, Issue 1, Pages (July 2012)
Presentation transcript:

A neural mechanism for robust junction representation in the visual cortex University of Ulm Dept. of Neural Information Processing Thorsten Hansen and Heiko Neumann

Overview of the talk 1. Motivation: Why junctions are important 2. Detection: The basic idea and its failure for natural images 3. Approach and Model 4. Simulations and ROC analysis

Role of junctions for object recognition (Biederman 1987)

Role of junctions for brightness perception (e.g., Adelson 2000):

Definition of corners and junctions (from Adelson 2000) Corners and junctions are points where two or more lines join or intersect

Junction detection in natural images Junctions often cannot be detected locally (McDermott 2001): 13 pixel closeup pixels

Neural representation of corners and junctions 2. Read-out of distributed information measure of circular variance distributed activity for multiple orientations within a cortical hypercolumn 1. Robust generation of coherent contours model of recurrent long-range interactions in V1 Approach:

Key mechanisms of the proposed V1 model 1.Excitatory long-range interactions between cells with colinear aligned RF (Bosking et al. 1997) 2.Inhibitory short-range interactions 3.Modulating feedback Initial bottom-up activity is necessary (Hirsch & Gilbert 1991)

Model architecture

Recurrent interaction modulating feedback inhibition in both spatial and orientational domain divisive inhibition excitatory long-range interaction

Properties of the proposed model input stimuluscomplex cellslong-range background: noise suppression edge: enhancement of coherent structures corner: preservation of circular variance

high significance Read-out of distributed information low significance orientation significance circular variance Batschelet 1981: Circular Statistics Length of the resulting orientation vector

Corner and junction detection Corner candidates: high circular variance and high overall activity: Corner points: sufficiently large local maxima of corner candidates

Simulation I: distance from true location V1 long-range model feedforward complex cells

Simulation II: feedforward vs. feedback complex cellslong-range Real world camera image

Simulation III: feedforward vs. feedback complex cellslong-range Attneave‘s cat

Simulation IV: ROC analysis Comparison of the new scheme to standard methods based on Gaussian curvature and the structure tensor (black) input image

Conclusions corners and junctions can be robustly represented by distributed activity within a cortical hypercolum recurrent colinear long-range interactions serve as a multi-purpose mechanism for contour enhancement noise suppression junction detection model performance superior to local junction detection schemes used in Computer Vision