(plain black-on-white slides are Evan’s). Dense NRSFM Approach Overview.

Slides:



Advertisements
Similar presentations
Investigation Into Optical Flow Problem in the Presence of Spatially-varying Motion Blur Mohammad Hossein Daraei June 2014 University.
Advertisements

Face Alignment with Part-Based Modeling
Activity Recognition Aneeq Zia. Agenda What is activity recognition Typical methods used for action recognition “Evaluation of local spatio-temporal features.
3D Reconstruction – Factorization Method Seong-Wook Joo KG-VISA 3/10/2004.
SIGGRAPH Course 30: Performance-Driven Facial Animation For Latest Version of Bregler’s Slides and Notes please go to:
Bayesian Robust Principal Component Analysis Presenter: Raghu Ranganathan ECE / CMR Tennessee Technological University January 21, 2011 Reading Group (Xinghao.
A New Block Based Motion Estimation with True Region Motion Field Jozef Huska & Peter Kulla EUROCON 2007 The International Conference on “Computer as a.
Skill of Climate Field Reconstruction Methods in the Context of Optimal Interpolation Estimates Alexey Kaplan, Jason Smerdon Lamont-Doherty Earth Observatory.
Today Feature Tracking Structure from Motion on Monday (1/29)
1 Face Tracking in Videos Gaurav Aggarwal, Ashok Veeraraghavan, Rama Chellappa.
Structure from motion. Multiple-view geometry questions Scene geometry (structure): Given 2D point matches in two or more images, where are the corresponding.
Many slides and illustrations from J. Ponce
CSc83029 – 3-D Computer Vision/ Ioannis Stamos 3-D Computational Vision CSc Optical Flow & Motion The Factorization Method.
SIGGRAPH Course 30: Performance-Driven Facial Animation Section: Marker-less Face Capture and Automatic Model Construction Part 1: Chris Bregler, NYU Part.
Optical Flow
Image-Based Rendering using Hardware Accelerated Dynamic Textures Keith Yerex Dana Cobzas Martin Jagersand.
Previously Two view geometry: epipolar geometry Stereo vision: 3D reconstruction epipolar lines Baseline O O’ epipolar plane.
Computer Vision Structure from motion Marc Pollefeys COMP 256 Some slides and illustrations from J. Ponce, A. Zisserman, R. Hartley, Luc Van Gool, …
Single-view Metrology and Camera Calibration Computer Vision Derek Hoiem, University of Illinois 02/26/15 1.
CSCE 641 Computer Graphics: Image-based Modeling (Cont.) Jinxiang Chai.
Cameras, lenses, and calibration
Computer Vision Spring ,-685 Instructor: S. Narasimhan Wean 5403 T-R 3:00pm – 4:20pm Lecture #15.
roboticvision.org ARC Centre of Excellence for Robotic Vision Vision-guided medical robotics: From laparoscopic diagnosis towards.
Face Alignment Using Cascaded Boosted Regression Active Shape Models
Matrix Completion IT530 Lecture Notes.
Unwrap Mosaics: A new representation for video editing Alex Rav-Acha et al. In SIGGRAPH 2008 발표 이성호 2009 년 1 월 22 일.
Linearizing (assuming small (u,v)): Brightness Constancy Equation: The Brightness Constraint Where:),(),(yxJyxII t  Each pixel provides 1 equation in.
Y. Moses 11 Combining Photometric and Geometric Constraints Yael Moses IDC, Herzliya Joint work with Ilan Shimshoni and Michael Lindenbaum, the Technion.
The Measurement of Visual Motion P. Anandan Microsoft Research.
An Information Fusion Approach for Multiview Feature Tracking Esra Ataer-Cansizoglu and Margrit Betke ) Image and.
CSCE 643 Computer Vision: Structure from Motion
#MOTION ESTIMATION AND OCCLUSION DETECTION #BLURRED VIDEO WITH LAYERS
Motion Deblurring Using Hybrid Imaging Moshe Ben-Ezra and Shree K. Nayar Columbia University IEEE CVPR Conference June 2003, Madison, USA.
Efficient computation of Robust Low-Rank Matrix Approximations in the Presence of Missing Data using the L 1 Norm Anders Eriksson and Anton van den Hengel.
Over-Parameterized Variational Optical Flow
Feature Reconstruction Using Lucas-Kanade Feature Tracking and Tomasi-Kanade Factorization EE7740 Project I Dr. Gunturk.
Communication Systems Group Technische Universität Berlin S. Knorr A Geometric Segmentation Approach for the 3D Reconstruction of Dynamic Scenes in 2D.
Raquel A. Romano 1 Scientific Computing Seminar May 12, 2004 Projective Geometry for Computer Vision Projective Geometry for Computer Vision Raquel A.
Image Registration with Hierarchical B-Splines Z. Xie and G. Farin.
A Robust Method for Lane Tracking Using RANSAC James Ian Vaughn Daniel Gicklhorn CS664 Computer Vision Cornell University Spring 2008.
EECS 274 Computer Vision Affine Structure from Motion.
Joint Tracking of Features and Edges STAN BIRCHFIELD AND SHRINIVAS PUNDLIK CLEMSON UNIVERSITY ABSTRACT LUCAS-KANADE AND HORN-SCHUNCK JOINT TRACKING OF.
1 Chapter 2: Geometric Camera Models Objective: Formulate the geometrical relationships between image and scene measurements Scene: a 3-D function, g(x,y,z)
Human Activity Recognition at Mid and Near Range Ram Nevatia University of Southern California Based on work of several collaborators: F. Lv, P. Natarajan,
3D Head Pose Tracking with Linear Depth and Brightness Constraints
Composition in Photography
Motion Estimation Today’s Readings Trucco & Verri, 8.3 – 8.4 (skip 8.3.3, read only top half of p. 199) Newton's method Wikpedia page
Robust Principal Components Analysis IT530 Lecture Notes.
Large-Scale Matrix Factorization with Missing Data under Additional Constraints Kaushik Mitra University of Maryland, College Park, MD Sameer Sheoreyy.
Whiteboard Scanning Using Super-resolution Wode Ni Advisor: John MacCormick COMP 491 Final Presentation Dec
Structure from Motion Paul Heckbert, Nov , Image-Based Modeling and Rendering.
Motion Estimation Today’s Readings Trucco & Verri, 8.3 – 8.4 (skip 8.3.3, read only top half of p. 199) Newton's method Wikpedia page
Multi-view Synchronization of Human Actions and Dynamic Scenes Emilie Dexter, Patrick Pérez, Ivan Laptev INRIA Rennes - Bretagne Atlantique
= the matrix for T relative to the standard basis is a basis for R 2. B is the matrix for T relative to To find B, complete:
Types of Information P1 – Explain how organisations use information By.
Reconstruction of a Scene with Multiple Linearly Moving Objects Mei Han and Takeo Kanade CISC 849.
Robust and Fast Collaborative Tracking with Two Stage Sparse Optimization Authors: Baiyang Liu, Lin Yang, Junzhou Huang, Peter Meer, Leiguang Gong and.
Date of download: 11/9/2017 Copyright © ASME. All rights reserved.
Vision Based Motion Estimation for UAV Landing
Tracking parameter optimization
Structure from motion Input: Output: (Tomasi and Kanade)
Categorizing sex and identity from the biological motion of faces
آشنايی با اصول و پايه های يک آزمايش
Effective and Efficient Detection of Moving Targets From a UAV’s Camera
The only requirements are in the directions at the top of each slide.
Comparison of EET and Rank Pooling on UCF101 (split 1)
Types of Smart Art.
Perspective Photos.
Accurate Video Localization
Structure from motion Input: Output: (Tomasi and Kanade)
Presentation transcript:

(plain black-on-white slides are Evan’s)

Dense NRSFM Approach Overview

Multi-Frame Optical Flow Details Set of points to be tracked comes from a reference frame Represent trajectories with a linear basis Penalties for deviating from the low-rank structure Spatial pyramid = Garg, Roussos, Agapito, “Robust Trajectory-Space TV-L1 Optical Flow for Nonrigid Sequences”, EMMCVPR11

Orthographic Projection Orthographic: Perspective: Requires small variation in depth u = s u x + u c v = s v y + v c u = (x – x c ) f / z + u c v = (y – y c ) f / z + v c linear in (x, y, z) nonlinear in (x, y, z)

Optimizing for 3-D Shape becomes

Qualitative Results [online videos]

Quantitative Comparison Top row: ground truth; bottom row: their result RMS reconstruction error, with matrix rank in parens