Context-based vision system for place and object recognition

Slides:



Advertisements
Similar presentations
Distinctive Image Features from Scale-Invariant Keypoints David Lowe.
Advertisements

Learning deformable models Yali Amit, University of Chicago Alain Trouvé, CMLA Cachan.
An Approach to ECG Delineation using Wavelet Analysis and Hidden Markov Models Maarten Vaessen (FdAW/Master Operations Research) Iwan de Jong (IDEE/MI)
Human Identity Recognition in Aerial Images Omar Oreifej Ramin Mehran Mubarak Shah CVPR 2010, June Computer Vision Lab of UCF.
Generative learning methods for bags of features
Face Recognition and Biometric Systems
Foreground Modeling The Shape of Things that Came Nathan Jacobs Advisor: Robert Pless Computer Science Washington University in St. Louis.
Global spatial layout: spatial pyramid matching Spatial weighting the features Beyond bags of features: Adding spatial information.
Hilbert Space Embeddings of Hidden Markov Models Le Song, Byron Boots, Sajid Siddiqi, Geoff Gordon and Alex Smola 1.
HMM-BASED PATTERN DETECTION. Outline  Markov Process  Hidden Markov Models Elements Basic Problems Evaluation Optimization Training Implementation 2-D.
1 Image Recognition - I. Global appearance patterns Slides by K. Grauman, B. Leibe.
Statistics of Natural Image Categories Antonio Torralba and Aude Oliva. Network: Computation in Neural Systems, 14(2003) Jonathan Huang
Generic Object Recognition -- by Yatharth Saraf A Project on.
Beyond bags of features: Adding spatial information Many slides adapted from Fei-Fei Li, Rob Fergus, and Antonio Torralba.
Generative learning methods for bags of features
1 Segmentation with Scene and Sub-Scene Categories Joseph Djugash Input Image Scene/Sub-Scene Classification Segmentation.
Object Class Recognition Using Discriminative Local Features Gyuri Dorko and Cordelia Schmid.
ICA Alphan Altinok. Outline  PCA  ICA  Foundation  Ambiguities  Algorithms  Examples  Papers.
Multiple Object Class Detection with a Generative Model K. Mikolajczyk, B. Leibe and B. Schiele Carolina Galleguillos.
Object Detection Using the Statistics of Parts Henry Schneiderman Takeo Kanade Presented by : Sameer Shirdhonkar December 11, 2003.
Discriminative and generative methods for bags of features
Object Recognition by Parts Object recognition started with line segments. - Roberts recognized objects from line segments and junctions. - This led to.
(1) A probability model respecting those covariance observations: Gaussian Maximum entropy probability distribution for a given covariance observation.
Image Representation Gaussian pyramids Laplacian Pyramids
ECE 8443 – Pattern Recognition ECE 8423 – Adaptive Signal Processing Objectives: Example Clustered Transformations MAP Adaptation Resources: ECE 7000:
Machine Learning CUNY Graduate Center Lecture 3: Linear Regression.
Gaussian Mixture Model and the EM algorithm in Speech Recognition
Internet-scale Imagery for Graphics and Vision James Hays cs195g Computational Photography Brown University, Spring 2010.
Alignment and classification of time series gene expression in clinical studies Tien-ho Lin, Naftali Kaminski and Ziv Bar-Joseph.
General Tensor Discriminant Analysis and Gabor Features for Gait Recognition by D. Tao, X. Li, and J. Maybank, TPAMI 2007 Presented by Iulian Pruteanu.
Marcin Marszałek, Ivan Laptev, Cordelia Schmid Computer Vision and Pattern Recognition, CVPR Actions in Context.
Classifying Images with Visual/Textual Cues By Steven Kappes and Yan Cao.
Features-based Object Recognition P. Moreels, P. Perona California Institute of Technology.
SPEECH RECOGNITION Presented to Dr. V. Kepuska Presented by Lisa & Za ECE 5526.
Putting Context into Vision Derek Hoiem September 15, 2004.
Modeling the Shape of a Scene: Seeing the trees as a forest Scene Understanding Seminar
Epitomic Location Recognition A generative approach for location recognition K. Ni, A. Kannan, A. Criminisi and J. Winn In proc. CVPR Anchorage,
Histograms of Oriented Gradients for Human Detection(HOG)
EE4-62 MLCV Lecture Face Recognition – Subspace/Manifold Learning Tae-Kyun Kim 1 EE4-62 MLCV.
Representing hierarchical POMDPs as DBNs for multi-scale robot localization G. Thocharous, K. Murphy, L. Kaelbling Presented by: Hannaneh Hajishirzi.
Context-based vision system for place and object recognition Antonio Torralba Kevin Murphy Bill Freeman Mark Rubin Presented by David Lee Some slides borrowed.
 Present by 陳群元.  Introduction  Previous work  Predicting motion patterns  Spatio-temporal transition distribution  Discerning pedestrians  Experimental.
Color-Attributes-Related Image Retrieval Student: Kylie Gorman Mentor: Yang Zhang.
Contextual models for object detection using boosted random fields by Antonio Torralba, Kevin P. Murphy and William T. Freeman.
CS332 Visual Processing Department of Computer Science Wellesley College High-Level Vision Face Recognition I.
TextonBoost: Joint Appearance, Shape and Context Modeling for Multi-Class Object Recognition and Segmentation J. Shotton ; University of Cambridge J. Jinn,
Statistical Models for Automatic Speech Recognition Lukáš Burget.
1.Learn appearance based models for concepts 2.Compute posterior probabilities or Semantic Multinomial (SMN) under appearance models. -But, suffers from.
1 Hidden Markov Model Observation : O1,O2,... States in time : q1, q2,... All states : s1, s2,..., sN Si Sj.
Using the Forest to see the Trees: A computational model relating features, objects and scenes Antonio Torralba CSAIL-MIT Joint work with Aude Oliva, Kevin.
Finding Clusters within a Class to Improve Classification Accuracy Literature Survey Yong Jae Lee 3/6/08.
Flexible Speaker Adaptation using Maximum Likelihood Linear Regression Authors: C. J. Leggetter P. C. Woodland Presenter: 陳亮宇 Proc. ARPA Spoken Language.
Part 3: Estimation of Parameters. Estimation of Parameters Most of the time, we have random samples but not the densities given. If the parametric form.
Object Recognition by Parts
University of Ioannina
EEL 6586: AUTOMATIC SPEECH PROCESSING Hidden Markov Model Lecture
An opposition to: Context-Based Vision System for Place and Object Recognition Contextual Models for Object Detection Using BRFs.
Object Recognition by Parts
Cheng-Ming Huang, Wen-Hung Liao Department of Computer Science
Detecting Artifacts and Textures in Wavelet Coded Images
Object Recognition by Parts
Object Recognition by Parts
Statistical Models for Automatic Speech Recognition
Eigenfaces for recognition (Turk & Pentland)
Unsupervised learning of models for recognition
Edge Detection in Computer Vision
Wavelet transform application – edge detection
The Cerebral Emporium of Benevolent Knowledge
Object Recognition by Parts
Object Recognition with Interest Operators
Presentation transcript:

Context-based vision system for place and object recognition Torralba, Murphy, Freeman & Rubin (2003)

Context is useful for object recognition

Local and global image representations Local representation (L) Wavelet decomposition N = 24 (6 orientations, 4 scales) Global representation Average across space and downsample to M x M (M = 4) PCA to reduce to 80 dimensions

Place recognition Transition matrix Observation likelihood Count transitions + Dirichlet smoothing Observation likelihood Appearances: mixture of Gaussians Uniform weights

Influence of HMM

Dealing with novel places Separately trained model for categories

Using context for object detection Estimate probability of object presence using global image features (Objects independent given location and image features)

Context for object localization Coarse “expectation mask”