A Mathematical Theory of Primal Sketch & Sketchability C. Guo, S. C. Zhu, Y. N.Wu UCLA.

Slides:

Advertisements

Similar presentations

Primal-dual Algorithm for Convex Markov Random Fields Vladimir Kolmogorov University College London GDR (Optimisation Discrète, Graph Cuts et Analyse d'Images)

Advertisements

Minimum Likelihood Image Feature and Scale Detection Kim Steenstrup Pedersen Collaborators: Pieter van Dorst, TUe, The Netherlands Marco Loog, ITU, Denmark.

Image acquisition using sparse (pseudo)-random matrices Piotr Indyk MIT.

Visual Dictionaries George Papandreou CVPR 2014 Tutorial on BASIS

University of Ioannina - Department of Computer Science Wavelets and Multiresolution Processing (Background) Christophoros Nikou Digital.

Visual Representation The Frontiers of Vision Workshop, August 20-23, 2011 Song-Chun Zhu.

Patch-based Image Deconvolution via Joint Modeling of Sparse Priors Chao Jia and Brian L. Evans The University of Texas at Austin 12 Sep

Learning Inhomogeneous Gibbs Models Ce Liu

Yuanlu Xu, SYSU, China Primal Sketch & Video Primal Sketch – Methods to Parse Images & Videos.

Image classification by sparse coding.

Computer Vision Group University of California Berkeley Ecological Statistics of Good Continuation: Multi-scale Markov Models for Contours Xiaofeng Ren.

Part II − Application to Markov Structures. A Motivating Example ✕✕✕✕✕✕✕✕

Vladimir Protasov (Moscow State University) Perron-Frobenius theory for matrix semigroups.

1 Image Completion using Global Optimization Presented by Tingfan Wu.

3D Multi-view Reconstruction Young Min Kim Karen Zhu CS 223B March 17, 2008.

Understanding Gestalt Cues and Ecological Statistics using a Database of Human Segmented Images Charless Fowlkes, David Martin and Jitendra Malik Department.

Primal Sketch Integrating Structure and Texture Ying Nian Wu UCLA Department of Statistics Keck Meeting April 28, 2006 Guo, Zhu, Wu (ICCV, 2003; GMBV,

Proposes functions to measure Gestalt features of shapes Adapts [Zhu, Wu Mumford] FRAME method to shapes Exhibits effect of MRF model obtained by putting.

MRF Labeling With Graph Cut CMPUT 615 Nilanjan Ray.

TEXTURE SYNTHESIS PEI YEAN LEE. What is texture? Images containing repeating patterns Local & stationary.

The UNIVERSITY of NORTH CAROLINA at CHAPEL HILL An Incremental Weighted Least Squares Approach To Surface Light Fields Greg Coombe Anselmo Lastra.

Segmentation and Perceptual Grouping Kaniza (Introduction to Computer Vision, )

Associative Learning in Hierarchical Self Organizing Learning Arrays Janusz A. Starzyk, Zhen Zhu, and Yue Li School of Electrical Engineering and Computer.

Lecture 4: Edge Based Vision Dr Carole Twining Thursday 18th March 2:00pm – 2:50pm.

Grammar of Image Zhaoyin Jia, Problems  Enormous amount of vision knowledge:  Computational complexity  Semantic gap …… Classification,

ENG4BF3 Medical Image Processing

CIVS, Statistics Dept. UCLA Deformable Template as Active Basis Zhangzhang Si UCLA Department of Statistics Ying Nian Wu, Zhangzhang Si, Chuck.

Random signals. Histogram of the random signal Continuous Time Sinusoidal signals.

Olshausen’s Demo. 1.The Training set ?  Natural Images (Olhausen’s database)  How much do we learn ?  face database and car database 2.The Sparseness.

T. Mhamdi, O. Hasan and S. Tahar, HVG, Concordia University Montreal, Canada July 2010 On the Formalization of the Lebesgue Integration Theory in HOL On.

Why do we Need Image Model in the first place?

Creating With Code.

INDEPENDENT COMPONENT ANALYSIS OF TEXTURES based on the article R.Manduchi, J. Portilla, ICA of Textures, The Proc. of the 7 th IEEE Int. Conf. On Comp.

Unsupervised Learning of Compositional Sparse Code for Natural Image Representation Ying Nian Wu UCLA Department of Statistics October 5, 2012, MURI Meeting.

WAVELET (Article Presentation) by : Tilottama Goswami Sources:

A Photon Accurate Model Of The Human Eye Michael F. Deering.

Stochastic Sets and Regimes of Mathematical Models of Images Song-Chun Zhu University of California, Los Angeles Tsinghua Sanya Int’l Math Forum, Jan,

Presented by: Mingyuan Zhou Duke University, ECE June 17, 2011

Projects: 1.Predictive coding in balanced spiking networks (Erwan Ledoux). 2.Using Canonical Correlation Analysis (CCA) to analyse neural data (David Schulz).

On Natural Scenes Analysis, Sparsity and Coding Efficiency Redwood Center for Theoretical Neuroscience University of California, Berkeley Mind, Brain.

Learning to Perceive Transparency from the Statistics of Natural Scenes Anat Levin School of Computer Science and Engineering The Hebrew University of.

Fields of Experts: A Framework for Learning Image Priors (Mon) Young Ki Baik, Computer Vision Lab.

Diffusion Geometries in Document Spaces. Multiscale Harmonic Analysis. R.R. Coifman, S. Lafon, A. Lee, M. Maggioni, B.Nadler. F. Warner, S. Zucker. Mathematics.

CHAPTER EIGHT Perception McGraw-Hill/Irwin Copyright © 2004 by The McGraw-Hill Companies, Inc. All rights reserved.

Brownian Bridge and nonparametric rank tests Olena Kravchuk School of Physical Sciences Department of Mathematics UQ.

Latent Variable / Hierarchical Models in Computational Neural Science Ying Nian Wu UCLA Department of Statistics March 30, 2011.

EE565 Advanced Image Processing Copyright Xin Li Why do we Need Image Model in the first place? Any image processing algorithm has to work on a collection.

Patch-based Image Interpolation: Algorithms and Applications

SuperResolution (SR): “Classical” SR (model-based) Linear interpolation (with post-processing) Edge-directed interpolation (simple idea) Example-based.

EE565 Advanced Image Processing Copyright Xin Li Why do we Need Image Model in the first place? Any image processing algorithm has to work on a collection.

Jianchao Yang, John Wright, Thomas Huang, Yi Ma CVPR 2008 Image Super-Resolution as Sparse Representation of Raw Image Patches.

Statistical Modeling and Learning in Vision --- cortex-like generative models Ying Nian Wu UCLA Department of Statistics JSM, August 2010.

1 Nonlinear models for Natural Image Statistics Urs Köster & Aapo Hyvärinen University of Helsinki.

Strategies for Automatic Model Construction Intern : Ezequiel A. Cura Universidad de Buenos Aires Supervisor: Guillaume Charpiat PhD Projet Pulsar - INRIA.

MRFs (X1,X2) X3 X1 X2 4 (X2,X3,X3) X4. MRFs (X1,X2) X3 X1 X2 4 (X2,X3,X3) X4.

Journal of Vision. 2009;9(3):5. doi: /9.3.5 Figure Legend:

Equivalent Ratios.

Nonparametric Semantic Segmentation

Outline Statistical Modeling and Conceptualization of Visual Patterns

Edges/curves /blobs Grammars are important because:

Iterative Optimization

Outline S. C. Zhu, X. Liu, and Y. Wu, “Exploring Texture Ensembles by Efficient Markov Chain Monte Carlo”, IEEE Transactions On Pattern Analysis And Machine.

Estimating Networks With Jumps

Acoustic Array Systems: Theory, Implementation and Application

Resolution Resolution: 6 x 4.

Outline Texture modeling - continued Julesz ensemble.

(c) SNU CSE Biointelligence Lab,

Adding Multiple Vectors

The steps of scientific computation

Presentation transcript:

A Mathematical Theory of Primal Sketch & Sketchability C. Guo, S. C. Zhu, Y. N.Wu UCLA

Sketchability scale-distance-complexity UCLA Bruin Walk

V1 cells: filters or bases?

Two mathematical models 1. Sparse coding (Olshausen, Field) 2. Markov random field (Zhu, Wu, Mumford) Unif{I: subband histograms = p_k} Restrictive, no inhibition, high complex regime Coefficients sparse Constructive, inhibition, low complex regime Complete basis: 1 and 2 are equivalent  ICA, restructive

Complexity scaling global sketchability: entropy rate

Markov random field complexity Sparse coding complexity Connection

Strategy of V1 1.Line-up large filter responses for sketchable 2.Pool weak filter responses for non-sketchable Local sketchability: for a local patch I Two interpretations 1.Likelihood ratio test 2.Coding after lateral inhibition

Gestalt field Model refinements 1.Bases  extendable ridge functions (Kim’s thesis) 2.MRF added  MRF interpolating sketchable

input image fast sketching pursuit result fast sketching refinement result synthesized imagesketch imagefast sketching pursuit and refinement procedure ( gif movie, show slide to view it )

input image fast sketching pursuit result fast sketching refinement result synthesized imagesketch imagefast sketching pursuit and refinement procedure

synthesized imagesketch imagefast sketching pursuit and refinement procedure input image fast sketching pursuit result fast sketching refinement result

input image fast sketching pursuit result fast sketching refinement result synthesized imagesketch imagefast sketching pursuit and refinement procedure

input image fast sketching pursuit result fast sketching refinement result synthesized imagesketch imagefast sketching pursuit and refinement procedure

synthesized imagesketch imagefast sketching pursuit and refinement procedure input image fast sketching pursuit result fast sketching refinement result

input image fast sketching pursuit result fast sketching refinement result synthesized imagesketch imagefast sketching pursuit and refinement procedure