1 Computational Vision CSCI 363, Fall 2012 Lecture 29 Structure from motion, Heading.

Slides:

Advertisements

Similar presentations

Chapter 10 CIRCULAR MOTION

Advertisements

Physics 1D03 - Lecture 51 Kinematics in 2-D (II) Uniform circular motion Tangential and radial components of Relative velocity and acceleration Serway.

MOTION PERCEPTION Types of Motion Perception Corollary Discharge Theory Movement Detectors Motion Perception and Object Perception Ecological Perception.

Imaging Science FundamentalsChester F. Carlson Center for Imaging Science The Human Visual System Part 2: Perception.

Unit 4: Sensation & Perception

PSYC 1000 Lecture 21. Selective Attention: Stroop.

Oklahoma State University Generative Graphical Models for Maneuvering Object Tracking and Dynamics Analysis Xin Fan and Guoliang Fan Visual Computing and.

CH24 in Robotics Handbook Presented by Wen Li Ph.D. student Texas A&M University.

Tracking Objects with Dynamics Computer Vision CS 543 / ECE 549 University of Illinois Derek Hoiem 04/21/15 some slides from Amin Sadeghi, Lana Lazebnik,

Motion Tracking. Image Processing and Computer Vision: 82 Introduction Finding how objects have moved in an image sequence Movement in space Movement.

PSY 5018H: Math Models Hum Behavior, Prof. Paul Schrater, Spring 2004 Vision as Optimal Inference The problem of visual processing can be thought of as.

Imaging Science FundamentalsChester F. Carlson Center for Imaging Science Binocular Vision and The Perception of Depth.

May 2004Motion/Optic Flow1 Motion Field and Optical Flow Ack, for the slides: Professor Yuan-Fang Wang Professor Octavia Camps.

Probabilistic video stabilization using Kalman filtering and mosaicking.

Optical Illusions KG-VISA Kyongil Yoon 3/31/2004.

Visual motion Many slides adapted from S. Seitz, R. Szeliski, M. Pollefeys.

CS223b, Jana Kosecka Rigid Body Motion and Image Formation.

Computational Architectures in Biological Vision, USC, Spring 2001

Optical flow (motion vector) computation Course: Computer Graphics and Image Processing Semester:Fall 2002 Presenter:Nilesh Ghubade

1B50 – Percepts and Concepts Daniel J Hulme. Outline Cognitive Vision –Why do we want computers to see? –Why can’t computers see? –Introducing percepts.

AIBO Camera Stabilization Tom Stepleton Ethan Tira-Thompson , Fall 2003.

A kinematic cost Reza Shadmehr. Subject’s performanceMinimum jerk motion Flash and Hogan, J Neurosci 1985 Point to point movements generally exhibit similar.

Sensing self motion Key points: Why robots need self-sensing Sensors for proprioception in biological systems in robot systems Position sensing Velocity.

The Science of Biomechanics

1 Computational Vision CSCI 363, Fall 2012 Lecture 26 Review for Exam 2.

The Day the World Stopped Moving Visual Intelligence Chapter 6.

Active Vision Key points: Acting to obtain information Eye movements Depth from motion parallax Extracting motion information from a spatio-temporal pattern.

Ch 81 Sensation & Perception Ch. 8: Perceiving Movement © Takashi Yamauchi (Dept. of Psychology, Texas A&M University) Main topics The functions of motion.

1-1 Measuring image motion velocity field “local” motion detectors only measure component of motion perpendicular to moving edge “aperture problem” 2D.

1 Computational Vision CSCI 363, Fall 2012 Lecture 31 Heading Models.

Computer Vision, Robert Pless Lecture 11 our goal is to understand the process of multi-camera vision. Last time, we studies the “Essential” and “Fundamental”

December 4, 2014Computer Vision Lecture 22: Depth 1 Stereo Vision Comparing the similar triangles PMC l and p l LC l, we get: Similarly, for PNC r and.

1 Computational Vision CSCI 363, Fall 2012 Lecture 20 Stereo, Motion.

10.2 Vectors in the Plane Quick Review What you’ll learn about Two-Dimensional Vectors Vector Operations Modeling Planar Motion Velocity, Acceleration,

1 Perception, Illusion and VR HNRS 299, Spring 2008 Lecture 8 Seeing Depth.

Visual motion Many slides adapted from S. Seitz, R. Szeliski, M. Pollefeys.

1 Computational Vision CSCI 363, Fall 2012 Lecture 28 Structure from motion.

December 9, 2014Computer Vision Lecture 23: Motion Analysis 1 Now we will talk about… Motion Analysis.

1 Computational Vision CSCI 363, Fall 2012 Lecture 21 Motion II.

3D Imaging Motion.

CS332 Visual Processing Department of Computer Science Wellesley College Analysis of Motion Recovering observer motion.

Depth Perception and Perceptional Illusions. Depth Perception The use of visual cues to perceive the distance or three-dimensional characteristics of.

Optical Flow. Distribution of apparent velocities of movement of brightness pattern in an image.

1 Motion Analysis using Optical flow CIS601 Longin Jan Latecki Fall 2003 CIS Dept of Temple University.

CS332 Visual Processing Department of Computer Science Wellesley College Analysis of Motion Recovering 3-D structure from motion.

Chapter 2 Describing Motion: Kinematics in One Dimension.

Visual Perception and Illusions. Optical Illusions Which of the above gray rectangles is darker?

1 Perception and VR MONT 104S, Fall 2008 Lecture 6 Seeing Motion.

Tracking with dynamics

Perception and VR MONT 104S, Fall 2008 Lecture 8 Seeing Depth

By James J. Todd and Victor J. Perotti Presented by Samuel Crisanto THE VISUAL PERCEPTION OF SURFACE ORIENTATION FROM OPTICAL MOTION.

1 Computational Vision CSCI 363, Fall 2012 Lecture 18 Stereopsis III.

1 Computational Vision CSCI 363, Fall 2012 Lecture 2 Introduction to Vision Science.

1 Computational Vision CSCI 363, Fall 2012 Lecture 32 Biological Heading, Color.

Design of Visual Displays for Driving Simulator Research G. John Andersen Department of Psychology University of California, Riverside.

11/25/03 3D Model Acquisition by Tracking 2D Wireframes Presenter: Jing Han Shiau M. Brown, T. Drummond and R. Cipolla Department of Engineering University.

PHY 151: Lecture 4B 4.4 Particle in Uniform Circular Motion 4.5 Relative Velocity.

Chapter 2 – kinematics of particles Tuesday, September 8, 2015: Class Lecture 6 Today’s Objective: Polar Coordinates Relative motion – Translating Axes.

From local motion estimates to global ones - physiology:

CSC2535: Computation in Neural Networks Lecture 11 Extracting coherent properties by maximizing mutual information across space or time Geoffrey Hinton.

Visual motion Many slides adapted from S. Seitz, R. Szeliski, M. Pollefeys.

2D Motion is just the Beginning

Vectors in the Plane Section 10.2.

Measuring motion in biological vision systems

Perception The process of integrating, organizing, and interpreting sensory information.

PROJECTILE MOTION Thrown objects do not travel in a straight line. They tend to curve downward. Anything that is thrown or shot through the air is a.

Ch. 11: Motion 11.1: Distance and Displacement

Measuring image motion

Optical Snow and the Aperture Problem

Optical flow and keypoint tracking

Presentation transcript:

1 Computational Vision CSCI 363, Fall 2012 Lecture 29 Structure from motion, Heading

2 Depth Estimate from 2D velocities We can compare the 2D velocities that would be generated by the estimated depths of each point with the measured 2D velocities. => Estimate depths, Z i, and velocities: Minimize:

3 Combine with Incremental rigidity The full model uses the 2D velocity estimates and the rigidity constraint: Minimize: E D + E R Where E D is from previous slide. E R is rigidity error: Temporal integration: Information from multiple frames is combined using Kalman filters. Velocity computed at one instant is used to predict depths at the next instant. This tends to smooth out errors.

4 Results Estimated dot positions Surface reconstruction. Surface reconstruction uses smoothness and position of image points to interpolate a surface between point positions.

5 Cylinder Perceptions Ramachandran showed that people do not see cylinder structure accurately in some conditions: Cylinders with different speeds. Cylinders with different radii. Perception

6 Model results for illusions Illusion 1: Different speeds Illusion 2: Different radii The model generates structures similar to those perceived by people.

7 Motion Information for a Moving observer When a person moves through a stationary world, the images of objects move across the retina. This image motion carries information about: 1)Relative depth of objects (from Motion parallax) 2)The direction of motion of the observer

8 Motion Parallax For an observer moving in a straight line, the images of nearby objects move more quickly than those of distant objects. object 1 object 2

9 Sources of Information For a moving observer, there are many sources of information that can help determine direction of motion: 1)Visual information 2)Proprioception (information about how we are moving our legs) 3)Vestibular information (information about acceleration). It is clear that under many conditions, vision alone is sufficient. (Video)

10 Questions about Heading 1.How accurately can humans judge heading in different conditions? 2.What visual information do people use to judge heading? 3.What are the neural mechanisms that are used for computing heading?

11 Image motion for a Moving observer: Translation

12 Observer motion toward a surface

13 Translation leads to a Radial pattern of image motion

14 Image Velocities Suppose the observer has velocity T = (T X, T Y, T Z ) We can compute the image velocity, v = (v x, v y ): In the 1950's, Gibson noted that one can find the observer's motion direction (or heading) by finding the intersection of lines through any two of the image velocity vectors.

15 Rotations

16 Translation + Rotation

17 Motion over a Ground Plane

18 Image motion for Translation

19 Image motion for Translation plus Rotation

20 Image velocities for translation plus rotation

21 Models for Dealing with Eye movements

22

23

24 Data from Psychophysics Real eye movements Simulated eye movements True Heading

25 Eye movements vs. Curved Paths Paths traversed by image points.

26 Can we tell them apart?