Signal and Image Processing with Generative Models

Slides:



Advertisements
Similar presentations
Lecture 35: Photometric stereo CS4670 / 5670 : Computer Vision Noah Snavely.
Advertisements

Spherical Convolution in Computer Graphics and Vision Ravi Ramamoorthi Columbia Vision and Graphics Center Columbia University SIAM Imaging Science Conference:
Illumination Model How to compute color to represent a scene As in taking a photo in real life: – Camera – Lighting – Object Geometry Material Illumination.
Machine Vision Basics 1.What is machine vision? 2.Some examples of machine vision applications 3.What can be learned from biological vision? 4.The curse.
Color, lightness & brightness Lavanya Sharan February 7, 2011.
University of New Mexico
Basic Principles of Surface Reflectance Lecture #3 Thanks to Shree Nayar, Ravi Ramamoorthi, Pat Hanrahan.
Photometric Stereo Merle Norman Cosmetics, Los Angeles Readings R. Woodham, Photometric Method for Determining Surface Orientation from Multiple Images.
Chapter 6 Color Image Processing Chapter 6 Color Image Processing.
Lecture 20: Light, reflectance and photometric stereo
Texture Mapping. 2 The Limits of Geometric Modeling Although graphics cards can render over 10 million polygons per second, that number is insufficient.
Shading (introduction to rendering). Rendering  We know how to specify the geometry but how is the color calculated.
Perception Introduction Pattern Recognition Image Formation
Shape from Shading and Texture. Lambertian Reflectance Model Diffuse surfaces appear equally bright from all directionsDiffuse surfaces appear equally.
computer
Announcements Office hours today 2:30-3:30 Graded midterms will be returned at the end of the class.
Monitoring and Enhancing Visual Features (movement, color) as a Method for Predicting Brain Activity Level -in Terms of the Perception of Pain Sensation.
UV Mapping After a 3D object has been modeled it must be prepared for texturing. 3D surfaces can be “unwrapped” into a 2D representation with. This process.
Visual Appearance Chapter 4 Tomas Akenine-Möller Department of Computer Engineering Chalmers University of Technology.
Chris Covington CSCI263 – Final Project May 3, 2005 Changes and Additions: Further implemented the illumination model. Illumination is now calculated in.
Physics.
Active Lighting for Appearance Decomposition Todd Zickler DEAS, Harvard University.
Title Here (Arial, bold, 36 pts.) Presented to Date (Arial, 20 pts.)
Observation vs. Inferences The Local Environment.
Images for reflection. Que
Image-Based Modeling of Complex Surfaces Todd Zickler DEAS, Harvard University.
Properties of Matter. Matter is defined as anything that has mass AND takes up space.
Understanding the effect of lighting in images Ronen Basri.
Image from
From local motion estimates to global ones - physiology:
Main research interest
Advanced Computer Graphics
Electrical Engineering
University of New Mexico
Texture Mapping.
Computer Graphics Texture Mapping
Your Poster Title Goes Here
Visual Appearance Chapter 4
Figure Legend: From: Key characteristics of specular stereo
Introduction to Computer Graphics with WebGL
Chapter 14 Shading Models.
Reflection, Transmission, Absorption, part 2
Physics-based simulation for visual computing applications
Institute of Neural Information Processing (Prof. Heiko Neumann •
Looking Beyond the Pictures: Analyzing Photographs
Human Perception 9: Color.
Reflections Reflect the object in the x axis
Outline H. Murase, and S. K. Nayar, “Visual learning and recognition of 3-D objects from appearance,” International Journal of Computer Vision, vol. 14,
Deep Visual-Semantic Alignments for Generating Image Descriptions
Announcements Today: evals Monday: project presentations (8 min talks)
Using Today’s Technologies to Enhance Documentation of a Project
Your Poster Title Goes Here
Your Poster Title Goes Here
Your Poster Title Goes Here
Your Poster Title Goes Here
Color Image Processing
Your Poster Title Goes Here
Texture Mapping Ed Angel Professor Emeritus of Computer Science
Your Poster Title Goes Here
Your Poster Title Goes Here
Your Poster Title Goes Here
Shape from Shading and Texture
Computer Animation Surface Materials.
Peoples On Gears Teamwork Strategy
Brainstorming and Idea Generation Process PPT Template
Higher School of Economics , Moscow, 2016
Physical Problem of Simultaneous Linear Equations in Image Processing
Your Poster Title Goes Here
Your Poster Title Goes Here
Presentation transcript:

Signal and Image Processing with Generative Models Patrick Wolfe Todd Zickler DEAS, Harvard University

General Framework Source System “Raw Signal” Source Model System Model Enhanced Signal Inference Engine Wolfe/Zickler 2005

General Framework Zickler Wolfe Source Model System Model Modeling visual phenomena Computer vision Source Model System Model Inference Engine Wolfe Some stuff here Some stuff here, too Wolfe/Zickler 2005

Zickler Research Appearance Capture Vision Beyond Lambert “vision” SHAPE REFLECTANCE “vision” Wolfe/Zickler 2005

Modeling Visual Phenomena Example 1: Helmholtz Stereopsis [Helmholtz 1925] Wolfe/Zickler 2005

Modeling Visual Phenomena Example 1: Helmholtz Stereopsis Wolfe/Zickler 2005

Modeling Visual Phenomena Example 2: SUV Color Space DIFFUSE = + SPECULAR [Shafer, 1985] Wolfe/Zickler 2005

Modeling Visual Phenomena Example 2: SUV Color Space R B G S U V Wolfe/Zickler 2005

General Framework Zickler Wolfe Source Model System Model Modeling visual phenomena Computer vision Source Model System Model Inference Engine Wolfe Some stuff here Some stuff here, too Wolfe/Zickler 2005

Wolfe Research Wolfe/Zickler 2005