Announcements Final project presentations on Wednesday Each group has 10 minutes Place.ppt talk in artifact directory Final reports due on Friday at 11:59pm.

Slides:



Advertisements
Similar presentations
Paul Debevec, Tim Hawkins, Chris Tchou, H.P. Duiker, Westley Sarokin, and Mark Sagar Acquiring the Reflectance Field of a Human Face UC.
Advertisements

Fast Separation of Direct and Global Images Using High Frequency Illumination Shree K. Nayar Gurunandan G. Krishnan Columbia University SIGGRAPH Conference.
Lecture 24: Segmentation CS6670: Computer Vision Noah Snavely From Sandlot ScienceSandlot Science.
Procam and Campro Shree K. Nayar Computer Science Columbia University Support: NSF, ONR Procams 2006 PROCAMS Shree K. Nayar,
Micro Phase Shifting Mohit Gupta and Shree K. Nayar Computer Science Columbia University Supported by: NSF and ONR.
--- some recent progress Bo Fu University of Kentucky.
Spherical Convolution in Computer Graphics and Vision Ravi Ramamoorthi Columbia Vision and Graphics Center Columbia University SIAM Imaging Science Conference:
Measuring BRDFs. Why bother modeling BRDFs? Why not directly measure BRDFs? True knowledge of surface properties Accurate models for graphics.
Computational Photography, Fall 2013
Video Matting from Depth Maps Jonathan Finger Oliver Wang University of California, Santa Cruz {jfinger,
Image Compositing and Matting. Introduction Matting and compositing are important operations in the production of special effects. These techniques enable.
1. What is Lighting? 2 Example 1. Find the cubic polynomial or that passes through the four points and satisfies 1.As a photon Metal Insulator.
Illumination Model How to compute color to represent a scene As in taking a photo in real life: – Camera – Lighting – Object Geometry Material Illumination.
Lecture 23: Photometric Stereo CS4670/5760: Computer Vision Kavita Bala Scott Wehrwein.
Copyright  Pat Hanrahan Optical Printing From: “Special Optical Effects,” Zoran Perisic From: “Industrial Light and Magic,” Thomas Smith (p. 181)
Matting and Transparency : Computational Photography Alexei Efros, CMU, Fall 2007.
 P Hanrahan & M Levoy “Pulling a Matte” - Matte Creation From digitized images o Blue-screen matting (Petro Vlahos) Separate blue background from foreground.
CSCE 641: Photon Mapping Jinxiang Chai. Outline Rendering equation Photon mapping.
Computer Graphics (Spring 2008) COMS 4160, Lecture 20: Illumination and Shading 2
Copyright  Pat Hanrahan Composing Two Elements Background ForegroundTraveling Matte Holdout Matte * *+ += =
Natural Video Matting with Depth Jonathan Finger Oliver Wang University of California, Santa Cruz {jfinger,
Light by Ted Adelson Readings Forsyth, Chapters 4, 6 (through 6.2)
Image-based Rendering of Real Objects with Complex BRDFs.
Rendering General BSDFs and BSSDFs Randy Rauwendaal.
1 Lecture 9 Lighting Light Sources Reflectance Camera Models.
Interactive Matting Christoph Rhemann Supervised by: Margrit Gelautz and Carsten Rother.
BSSRDF: Bidirectional Surface Scattering Reflectance Distribution Functions Jared M. Dunne C95 Adv. Graphics Feb. 7, 2002 Based on: "A Practical Model.
Matting and Transparency : Computational Photography Alexei Efros, CMU, Fall 2006.
An Iterative Optimization Approach for Unified Image Segmentation and Matting Hello everyone, my name is Jue Wang, I’m glad to be here to present our paper.
Environment Matting and Compositing CS 395 – Advanced GraphicsPresented by Jay Hetler Douglas E. Zongker ~ Dawn M. Werner ~ Brian Curless ~ David H. Salsin.
Basic Principles of Surface Reflectance Lecture #3 Thanks to Shree Nayar, Ravi Ramamoorthi, Pat Hanrahan.
Copyright  Pat Hanrahan Composing Two Elements Background ForegroundTraveling Matte Holdout Matte * *+ += =
Matting : Rendering and Image Processing Alexei Efros …with many slides from Kyros Kutulakos.
Measure, measure, measure: BRDF, BTF, Light Fields Lecture #6
Specular Reflections from Rough Surfaces Lecture #4 Thanks to Shree Nayar, Ravi Ramamoorthi, Pat Hanrahan.
Announcements Class web site – Handouts –class info –lab access/accounts –survey Readings.
Shading (introduction to rendering). Rendering  We know how to specify the geometry but how is the color calculated.
Image-Based Rendering from a Single Image Kim Sang Hoon Samuel Boivin – Andre Gagalowicz INRIA.
-Global Illumination Techniques
Image-based rendering Michael F. Cohen Microsoft Research.
What Does Motion Reveal About Transparency ? Moshe Ben-Ezra and Shree K. Nayar Columbia University ICCV Conference October 2003, Nice, France This work.
Yu-Wing Tai, Hao Du, Michael S. Brown, Stephen Lin CVPR’08 (Longer Version in Revision at IEEE Trans PAMI) Google Search: Video Deblurring Spatially Varying.
Computer Graphics Global Illumination: Photon Mapping, Participating Media Lecture 12 Taku Komura.
Real-Time Relighting Digital Image Synthesis Yung-Yu Chuang 1/10/2008 with slides by Ravi Ramamoorthi, Robin Green and Milos Hasan.
Rendering Plant Leaves Faithfully Oliver Franzke (Dresden University of Technology) Oliver Deussen (University of Konstanz)
Digital Image Compositing. Compositing for volume rendering c1 c2 c3 The initial pixel color = Black opaque Back-to-Front compositing: use ‘under’ operator.
Image-Based Rendering of Diffuse, Specular and Glossy Surfaces from a Single Image Samuel Boivin and André Gagalowicz MIRAGES Project.
Inverse Global Illumination: Recovering Reflectance Models of Real Scenes from Photographs Computer Science Division University of California at Berkeley.
Rendering Synthetic Objects into Real- World Scenes by Paul Debevec SIGGRAPH 98 Conference Presented By Justin N. Rogers for Advanced Comp Graphics Spring.
Interreflections : The Inverse Problem Lecture #12 Thanks to Shree Nayar, Seitz et al, Levoy et al, David Kriegman.
Diffuse Reflections from Rough Surfaces Lecture #5
Announcements Office hours today 2:30-3:30 Graded midterms will be returned at the end of the class.
- Laboratoire d'InfoRmatique en Image et Systèmes d'information
Photo-realistic Rendering and Global Illumination in Computer Graphics Spring 2012 Material Representation K. H. Ko School of Mechatronics Gwangju Institute.
Vision Review: Miscellaneous Course web page: October 8, 2002.
Computer Vision, CS766 Staff Instructor: Li Zhang TA: Yu-Chi Lai
Multimedia Programming 14: Matting Departments of Digital Contents Sang Il Park.
COMPUTER GRAPHICS CS 482 – FALL 2015 OCTOBER 6, 2015 IMAGE MANIPULATION COMPRESSION COMPOSITING.
Tone mapping Digital Visual Effects, Spring 2007 Yung-Yu Chuang 2007/3/13 with slides by Fredo Durand, and Alexei Efros.
Illumination Model How to compute color to represent a scene As in taking a photo in real life: – Camera – Lighting – Object Geometry Material Illumination.
Matting and Transparency : Computational Photography Alexei Efros, CMU, Spring 2010.
Sub-Surface Scattering Real-time Rendering Sub-Surface Scattering CSE 781 Prof. Roger Crawfis.
Bo Sun Kalyan Sunkavalli Ravi Ramamoorthi Peter Belhumeur Shree Nayar Columbia University Time-Varying BRDFs.
Introduction Computational Photography Seminar: EECS 395/495
Image-based Lighting Computational Photography
Multiplexed Illumination
Shading Variation in observed color across an object
Composing Two Elements
Matting, Transparency, and Illumination
Camera Culture Camera Culture Ramesh Raskar Ramesh Raskar
Presentation transcript:

Announcements Final project presentations on Wednesday Each group has 10 minutes Place.ppt talk in artifact directory Final reports due on Friday at 11:59pm Web page (see project4 web page) Does not have to be long, but should be sufficient to describe what you did, related work, results, and discussion Evals at the end of class today

Matting and Transparency Slides adapted from Alexei Efros, Yung-Yu Chuang, and Shree Nayar

How does Superman fly? Super-human powers? OR Image Matting?

Digital matting Forrest Gump (1994)

Compositing  F B C foreground color alpha matte background plate composite compositing equation B F C  =0

Compositing  F B C composite compositing equation B F C  =1

Compositing  F B C composite compositing equation B F C  =0.6

Matting C observation compositing equation  F B

Matting C compositing equation  F B Three approaches: 1 reduce #unknowns 2 add observations 3 add priors

Matting (reduce #unknowns) C F BB difference matting 

Matting (reduce #unknowns) C F B blue screen matting 

Problems with color difference Background color is usually not perfect! (lighting, shadowing…)

Matting (add observations) F Smith & Blinn, 96  BC

Natural image matting BC Matting (add priors) F  B rotoscopingRuzon-Tomasi FG BG unknown

Bayesian framework f(z)+  zy para- meters observed signal Example: super-resolution de-blurring de-blocking …

Bayesian framework data evidence a-priori knowledge f(z)+  zy para- meters observed signal

Bayesian framework likelihood priors posterior probability

Priors

Bayesian matting

Optimization repeat until converge 1. fix alpha 2. fix F and B

inputtrimap alpha

input composite

Environment Matting and Compositing Video Douglas E. Zongker ~ Dawn M. Werner ~ Brian Curless ~ David H. Salesin

Fast Separation of Direct and Global Images Using High Frequency Illumination Shree K. Nayar Gurunandan G. Krishnan Columbia University SIGGRAPH Conference Boston, July 2006 Support: ONR, NSF, MERL Michael D. Grossberg City College of New York Ramesh Raskar MERL

source surface P Direct and Global Illumination A A : Direct B B : Interrelection C C : Subsurface D participating medium D : Volumetric translucent surface E E : Diffusion camera

direct global radiance Direct and Global Components: Interreflections surface i camera source j BRDF and geometry

High Frequency Illumination Pattern surface camera source fraction of activated source elements + i

High Frequency Illumination Pattern surface fraction of activated source elements camera source + - i

Separation from Two Images directglobal

Other Global Effects: Subsurface Scattering translucent surface camera source i j

Other Global Effects: Volumetric Scattering surface camera source participating medium i j

Diffuse Interreflections Specular Interreflections Volumetric Scattering Subsurface Scattering Diffusion

Scene

DirectGlobal

Real World Examples: Can You Guess the Images?

Eggs: Diffuse Interreflections DirectGlobal

Wooden Blocks: Specular Interreflections DirectGlobal

Kitchen Sink: Volumetric Scattering Volumetric Scattering: Chandrasekar 50, Ishimaru 78 DirectGlobal

Peppers: Subsurface Scattering DirectGlobal

Hand DirectGlobal Skin: Hanrahan and Krueger 93, Uchida 96, Haro 01, Jensen et al. 01, Cula and Dana 02, Igarashi et al. 05, Weyrich et al. 05

Face: Without and With Makeup GlobalDirect GlobalDirect Without Makeup With Makeup

Blonde Hair Hair Scattering: Stamm et al. 77, Bustard and Smith 91, Lu et al. 00 Marschner et al. 03 DirectGlobal