Environment Matting and Compositing CS 395 – Advanced GraphicsPresented by Jay Hetler Douglas E. Zongker ~ Dawn M. Werner ~ Brian Curless ~ David H. Salsin.

Slides:



Advertisements
Similar presentations
Color: This channel applies color, textured patterns, or images to the surface.
Advertisements

3D Compositing & Special Effects Implementation Pertemuan 07 Matakuliah : U0584 / DIGITAL COMPOSITING II Tahun : 2009.
Advanced Effects CMSC 435/634. General Approach Ray Tracing – Shoot more rays Rasterization – Render more images.
CLASS 9 ADVANCE RENDERING RAY TRACING RADIOSITY LIGHT FIELD CS770/870.
Computational Photography, Fall 2013
Video Matting from Depth Maps Jonathan Finger Oliver Wang University of California, Santa Cruz {jfinger,
Aim: How can we extract an image by using the force foreground option?
Image Compositing and Matting. Introduction Matting and compositing are important operations in the production of special effects. These techniques enable.
1 Roey Izkovsky Yuval Kaminka Matting Helping Superman fly since 1978.
Principles of Composition More Ways to Make Photos Look Good.
Advanced Ray Tracing CMSC 435/634. Basic Ray Tracing For each pixel – Compute ray direction – Find closest surface – For each light Compute direct illumination.
1. What is Lighting? 2 Example 1. Find the cubic polynomial or that passes through the four points and satisfies 1.As a photon Metal Insulator.
Boundary matting for view synthesis Samuel W. Hasinoff Sing Bing Kang Richard Szeliski Computer Vision and Image Understanding 103 (2006) 22–32.
Copyright  Pat Hanrahan Optical Printing From: “Special Optical Effects,” Zoran Perisic From: “Industrial Light and Magic,” Thomas Smith (p. 181)
Matting and Transparency : Computational Photography Alexei Efros, CMU, Fall 2007.
CS 325 Introduction to Computer Graphics 04 / 09 / 2010 Instructor: Michael Eckmann.
Chapter 33 Light: Reflection and Refraction Physics for Scientists & Engineers, 3 rd Edition Douglas C. Giancoli © Prentice Hall.
Copyright  Pat Hanrahan Composing Two Elements Background ForegroundTraveling Matte Holdout Matte * *+ += =
Natural Video Matting with Depth Jonathan Finger Oliver Wang University of California, Santa Cruz {jfinger,
Announcements Final project presentations on Wednesday Each group has 10 minutes Place.ppt talk in artifact directory Final reports due on Friday at 11:59pm.
Matting and Transparency : Computational Photography Alexei Efros, CMU, Fall 2006.
An Iterative Optimization Approach for Unified Image Segmentation and Matting Hello everyone, my name is Jue Wang, I’m glad to be here to present our paper.
Computer Vision (CSE P576) Staff Prof: Steve Seitz TA: Jiun-Hung Chen Web Page
Copyright  Pat Hanrahan Composing Two Elements Background ForegroundTraveling Matte Holdout Matte * *+ += =
Matting : Rendering and Image Processing Alexei Efros …with many slides from Kyros Kutulakos.
02/14/02(c) University of Wisconsin 2002, CS 559 Last Time Filtering Image size reduction –Take the pixel you need in the output –Map it to the input –Place.
Transparency Transparency (alpha, opacity) defines a pixel color’s visibility in a layer Every element imported into AE contains an opacity channel If.
Chapter 1: Waves Review PowerPoint.
Announcements Class web site – Handouts –class info –lab access/accounts –survey Readings.
Computer Visualization BIM Curriculum 03. Topics  History  Computer Visualization Methods  Visualization Workflow  Technology Background.
Reflections Specular reflection is the perfect reflection of light from a surface. The law a reflection states that the direction of the incoming ray and.
Simplicity Rule –of-thirds Horizontal Format Photographic Composition Does this picture attract your attention? Does this picture hold your interest?
Filtering and Color To filter a color image, simply filter each of R,G and B separately Re-scaling and truncating are more difficult to implement: –Adjusting.
Hosted by M/J Creative Photography Teachers VocabularyThe Basics Types of Photographers Techniques
The Elements of Art The basic visual symbols in the language of art.
CS559: Computer Graphics Lecture 4: Compositing and Resampling Li Zhang Spring 2008.
Composition
Concepts of Art and Design Line TextureShapeValue ColorSpaceRhythmContrast PatternRepetitionUnity Emphasis SymmetryBalanceVarietyDominance ProportionMovement.
Taking Pictures: What Makes it Great? The “Top 10” Elements That Make a Great Photograph.
Texas 4-H Photography Judging PRACTICE SET - #22 SUNFLOWERS The Photo classes in this Power Point are for you to try your judging skills. Select a class.
Extracting Depth and Matte using a Color-Filtered Aperture Yosuke Bando TOSHIBA + The University of Tokyo Bing-Yu Chen National Taiwan University Tomoyuki.
Color: This channel applies color, textured patterns, or images to the surface.
Refraction and Reflection Test Use Blender 3D and POV-Ray to render a scene in which there is only a single white solid cube. The background color of the.
Overview  Basic requirements of implementation  Image resource  Texture mapping  Advanced requirements of implementation  KGL sprite class.
Improving Image Matting using Comprehensive Sampling Sets CVPR2013 Oral.
Compositon Background Simplified Background Simplified Background Included Background Included Rule of Thirds Rule of Thirds Leading Lines Leading Lines.
Elements & Principles Of Art. Element Line is a mark on a surface that describes a shape or outline.
Matting and Transparency : Computational Photography Alexei Efros, CMU, Spring 2010.
MINISTRY OF INTERNATIONAL TRADE & INDUSTRY BOOK REVIEW SEE DECEMBER By: ASMAWI YUSOF TO CREATIVELY 2014 LEARNING.
Che-An Wu Background substitution. Background Substitution AlphaMa p Trimap Depth Map Extract the foreground object and put into another background Objective.
Photography Filters Module 9. Filters modify the images recorded. They can be used to make subtle or dramatic changes in your photographs.
MultiPass Rendering & Layering in 3D Pertemuan 08
Landscape Photography
Elements of Art and Principles of Design
© University of Wisconsin, CS559 Fall 2004
Composing Two Elements
The Elements of Design.
Matting, Transparency, and Illumination
© University of Wisconsin, CS559 Spring 2004
PHOTO 2 Digital Photography Project
Visual Literacy: An Introduction to Terminology
(c) 2002 University of Wisconsin
Lesson 17 Key Concepts and Notes
Picture Analysis Terms
Elements of Art The Elements of Art are the building blocks for a work of art. Artists use the elements in planned and organized ways. They are organized.
Terms Used When Describing Photographs
Picture Analysis Terms
How might it influence your work?
How might it influence your work?
P12 Photo Composition.
Presentation transcript:

Environment Matting and Compositing CS 395 – Advanced GraphicsPresented by Jay Hetler Douglas E. Zongker ~ Dawn M. Werner ~ Brian Curless ~ David H. Salsin

What is Matting? Extracting the foreground image from the background Describing the opacity of the foreground at every point What is Compositing? Holding back the part of the new background that the foreground blocks. Placing the foreground element in a new background

Original Uses Weather ReportsCinema Special Effects

Matting Equation C = F + (1-  )B C ~ Color F ~ Foreground color B ~ Background color  ~ Amount of light that passes through the foreground

How difficult is Matting?

Matte Image

Good Results?

Problems with Matting Images do not look realistic Lack of Refracted Light Lack of Reflected Light Solution: Modify the Matting Equation

Environment Matting Equation C = F + (1-  )B +  C ~ Color F ~ Foreground color B ~ Background color  ~ Amount of light that passes through the foreground  ~ Contribution of light from Environment that travels through the object

Explanation of   = R M(T, A )  R ~ Reflectance coefficient M ~ Texture mapping operator for axis-aligned rectangle (A) of texture (T) i = 1 i i i m

Environment Mattes

Performance Calibration Matting: minutes extraction time for each texture map (Pentium II 400Mhz) Compositing: 4-40 frames per second Real-Time?

How much better is Environment Matting? Alpha Matte Environment Matte Photograph

How much better is Environment Matting? Alpha Matte Environment Matte Photograph

Movies!

Importance of Sidedrops Light comes from other parts of the environment

Sidedrop Example

Sidedrop x2

Failure Cases Box-filter Gaussian-weighted Photograph

Failure Cases Composite Photograph Failure of Engineering Failure of Theory

Next Steps Depth Accuracy Real-Time Capture

Progress? Depth Accuracy No Real-Time