Matting and Transparency 15-463: Computational Photography Alexei Efros, CMU, Fall 2006.

Slides:



Advertisements
Similar presentations
3D Compositing & Special Effects Implementation Pertemuan 07 Matakuliah : U0584 / DIGITAL COMPOSITING II Tahun : 2009.
Advertisements

Real-Time Rendering TEXTURING Lecture 02 Marina Gavrilova.
Computational Photography, Fall 2013
Video Matting from Depth Maps Jonathan Finger Oliver Wang University of California, Santa Cruz {jfinger,
A Gimp Plugin that uses “GrabCut” to perform image segmentation
Natural Video Matting using Camera Arrays Neel S. JoshiWojciech MatusikShai Avidan Mitsubishi Electric Research Laboratory University of California, San.
Image Compositing and Matting. Introduction Matting and compositing are important operations in the production of special effects. These techniques enable.
1 Roey Izkovsky Yuval Kaminka Matting Helping Superman fly since 1978.
Advanced Ray Tracing CMSC 435/634. Basic Ray Tracing For each pixel – Compute ray direction – Find closest surface – For each light Compute direct illumination.
1. What is Lighting? 2 Example 1. Find the cubic polynomial or that passes through the four points and satisfies 1.As a photon Metal Insulator.
Boundary matting for view synthesis Samuel W. Hasinoff Sing Bing Kang Richard Szeliski Computer Vision and Image Understanding 103 (2006) 22–32.
Copyright  Pat Hanrahan Optical Printing From: “Special Optical Effects,” Zoran Perisic From: “Industrial Light and Magic,” Thomas Smith (p. 181)
Matting and Transparency : Computational Photography Alexei Efros, CMU, Fall 2007.
 P Hanrahan & M Levoy “Pulling a Matte” - Matte Creation From digitized images o Blue-screen matting (Petro Vlahos) Separate blue background from foreground.
Copyright  Pat Hanrahan Composing Two Elements Background ForegroundTraveling Matte Holdout Matte * *+ += =
Natural Video Matting with Depth Jonathan Finger Oliver Wang University of California, Santa Cruz {jfinger,
A Closed Form Solution to Natural Image Matting
Background Subtraction and Matting : Computational Photography Alexei Efros, CMU, Fall 2006 © Yuri Bonder.
Advanced Computer Graphics (Spring 2005) COMS 4162, Lecture 6: Image Compositing, Morphing Ravi Ramamoorthi
Announcements Final project presentations on Wednesday Each group has 10 minutes Place.ppt talk in artifact directory Final reports due on Friday at 11:59pm.
Image Enhancement.
Interactive Matting Christoph Rhemann Supervised by: Margrit Gelautz and Carsten Rother.
An Iterative Optimization Approach for Unified Image Segmentation and Matting Hello everyone, my name is Jue Wang, I’m glad to be here to present our paper.
Image Compositing and Blending : Computational Photography Alexei Efros, CMU, Fall 2007 © NASA.
Environment Matting and Compositing CS 395 – Advanced GraphicsPresented by Jay Hetler Douglas E. Zongker ~ Dawn M. Werner ~ Brian Curless ~ David H. Salsin.
Computer Vision (CSE P576) Staff Prof: Steve Seitz TA: Jiun-Hung Chen Web Page
CIS 310: Visual Programming, Spring 2006 Western State College 310: Visual Programming Ray Tracing.
Copyright  Pat Hanrahan Composing Two Elements Background ForegroundTraveling Matte Holdout Matte * *+ += =
Matting : Rendering and Image Processing Alexei Efros …with many slides from Kyros Kutulakos.
Wrap Up : Computational Photography Alexei Efros, CMU, Fall 2005 © Robert Brown.
02/14/02(c) University of Wisconsin 2002, CS 559 Last Time Filtering Image size reduction –Take the pixel you need in the output –Map it to the input –Place.
Announcements Class web site – Handouts –class info –lab access/accounts –survey Readings.
ENERGY THAT TRAVELS IN A STRAIGHT LINE. LIGHT TAKEN IN BY AN OBJECT AND NOT REFLECTED OR REFRACTED.
Reflections Specular reflection is the perfect reflection of light from a surface. The law a reflection states that the direction of the incoming ray and.
-Global Illumination Techniques
Project Raytracing. Content Goals Idea of Raytracing Ray Casting – Therory – Practice Raytracing – Theory – Light model – Practice Output images Conclusion.
Filtering and Color To filter a color image, simply filter each of R,G and B separately Re-scaling and truncating are more difficult to implement: –Adjusting.
Previous lecture Texture Synthesis Texture Transfer + =
Image-Based Lighting © Eirik Holmøyvik …with a lot of slides donated by Paul Debevec CS194: Image Manipulation & Computational Photography Alexei Efros,
Real-Time rendering Chapter 4.Visual Appearance 4.4. Aliasing and antialiasing 4.5. Transparency,alpha,and compositing 4.6. Fog 4.7. Gamma correction
Hosted by M/J Creative Photography Teachers VocabularyThe Basics Types of Photographers Techniques
Using the Elements and Principles of Design in Photography.
Texas 4-H Photography Judging PRACTICE SET - #22 SUNFLOWERS The Photo classes in this Power Point are for you to try your judging skills. Select a class.
Graphics Graphics Korea University cgvr.korea.ac.kr Image Processing 고려대학교 컴퓨터 그래픽스 연구실.
Extracting Depth and Matte using a Color-Filtered Aperture Yosuke Bando TOSHIBA + The University of Tokyo Bing-Yu Chen National Taiwan University Tomoyuki.
Visual Appearance Chapter 4 Tomas Akenine-Möller Department of Computer Engineering Chalmers University of Technology.
Single Pass Point Rendering and Transparent Shading Paper by Yanci Zhang and Renato Pajarola Presentation by Harmen de Weerd and Hedde Bosman.
Multimedia Programming 14: Matting Departments of Digital Contents Sang Il Park.
Improving Image Matting using Comprehensive Sampling Sets CVPR2013 Oral.
Matting and Transparency : Computational Photography Alexei Efros, CMU, Spring 2010.
MINISTRY OF INTERNATIONAL TRADE & INDUSTRY BOOK REVIEW SEE DECEMBER By: ASMAWI YUSOF TO CREATIVELY 2014 LEARNING.
Che-An Wu Background substitution. Background Substitution AlphaMa p Trimap Depth Map Extract the foreground object and put into another background Objective.
2( ) 8x + 14y = 4 -12x – 14y = x = x = 4 8x + 14y = 4 8(4) + 14y = y = y = -28 ___ ___ y = -2 The solution is (4, -2)
MultiPass Rendering & Layering in 3D Pertemuan 08
donated by Paul Debevec
Chapter 10 Computer Graphics
© University of Wisconsin, CS559 Fall 2004
Colorimetry and Beer’s Law
Composing Two Elements
Data-driven methods: Texture 2 (Sz 10.5)
Xiang Liang Natural Image Matting Xiang Liang
Abstract Photography The following photographs are examples of Abstract Photography. In this assignment, I’d like you to think more about line, shape,
(c) 2002 University of Wisconsin
Matting, Transparency, and Illumination
High Dynamic Range Images
PHOTO 2 Digital Photography Project
(c) 2002 University of Wisconsin
INTRO TO COMPOSITION & PHOTOGRAPHY
Reflection & Refraction
Chapter 6 Exploring Space.
Presentation transcript:

Matting and Transparency : Computational Photography Alexei Efros, CMU, Fall 2006

Midterm Statistics

Semi-transparent mattes What we really want is to obtain a true alpha matte, which involves semi-transparency Alpha between 0 and 1

Matting Problem: Mathematical Definition

Why is general matting hard?

Solution #1: No Blue!

Solution #2: Gray or Flesh

Triangulation Matting (Smith & Blinn) How many equations? How many unknowns? Does the background need to be constant color?

The Algorithm

Triangulation Matting Examples

More Examples

More examples

Problems with Matting Images do not look realistic Lack of Refracted Light Lack of Reflected Light Solution: Modify the Matting Equation

Environment Matting and Compositing slides by Jay Hetler Douglas E. Zongker ~ Dawn M. Werner ~ Brian Curless ~ David H. Salsin

Environment Matting Equation C = F + (1-  )B +  C ~ Color F ~ Foreground color B ~ Background color  ~ Amount of light that passes through the foreground  ~ Contribution of light from Environment that travels through the object

Explanation of  R – reflectance image T – Texture image

Environment Mattes

Performance Calibration Matting: minutes extraction time for each texture map (Pentium II 400Mhz) Compositing: 4-40 frames per second Real-Time?

How much better is Environment Matting? Alpha Matte Environment Matte Photograph

How much better is Environment Matting? Alpha Matte Environment Matte Photograph

Movies!