Accurate Image Based Relighting through Optimization Pieter Peers Philip Dutré Department of Computer Science K.U.Leuven, Belgium.

Slides:

Advertisements

Similar presentations

Ray Tracing Depth Maps Using Precomputed Edge Tables Kevin Egan Rhythm & Hues Studios.

Advertisements

Approximate Ray-Tracing on the GPU with Distance Impostors László Szirmay-Kalos Barnabás Aszódi István Lazányi Mátyás Premecz TU Budapest, Hungary.

Measuring BRDFs. Why bother modeling BRDFs? Why not directly measure BRDFs? True knowledge of surface properties Accurate models for graphics.

Advanced Effects CMSC 435/634. General Approach Ray Tracing – Shoot more rays Rasterization – Render more images.

CLASS 9 ADVANCE RENDERING RAY TRACING RADIOSITY LIGHT FIELD CS770/870.

Temporally Coherent Completion of Dynamic Shapes Hao Li, Linjie Luo, Daniel Vlasic, Pieter Peers, Jovan Popović, Mark Pauly, Szymon Rusinkiewicz ACM Transactions.

Photorealistic Rendering. Ray tracing v. photorealistic rendering What illumination effects are not captured by ray tracing? What illumination effects.

Ray Tracing & Radiosity Dr. Amy H. Zhang. Outline  Ray tracing  Radiosity.

ATEC Procedural Animation Introduction to Procedural Methods in 3D Computer Animation Dr. Midori Kitagawa.

Path Differentials for MC Rendering Frank Suykens Department of Computer Science K.U.Leuven, Belgium Dagstuhl 2001: Stochastic methods in Rendering.

Precomputed Local Radiance Transfer for Real-time Lighting Design Anders Wang Kristensen Tomas Akenine-Moller Henrik Wann Jensen SIGGRAPH ‘05 Presented.

Rasterization and Ray Tracing in Real-Time Applications (Games) Andrew Graff.

10/14/14 Image-based Lighting Computational Photography Derek Hoiem, University of Illinois Many slides from Debevec, some from Efros T2.

A Signal-Processing Framework for Forward and Inverse Rendering COMS , Lecture 8.

Photon Tracing with Arbitrary Materials Patrick Yau.

Advanced Computer Graphics (Fall 2009) CS , Lecture 1: Introduction and History Ravi Ramamoorthi Some.

Flexible Bump Map Capture From Video James A. Paterson and Andrew W. Fitzgibbon University of Oxford Calibration Requirement:

CS 395/495-25: Spring 2003 IBMR: Week 10A Dimensionality of IBMR Methods Jack Tumblin

1 Lecture 9 Lighting Light Sources Reflectance Camera Models.

Exploiting Temporal Coherence for Incremental All-Frequency Relighting Ryan OverbeckRavi Ramamoorthi Aner Ben-ArtziEitan Grinspun Columbia University Ng.

Surface Light Fields for 3D Photography Daniel Wood Daniel Azuma Wyvern Aldinger Brian Curless Tom Duchamp David Salesin Werner Stuetzle.

A Theory of Locally Low Dimensional Light Transport Dhruv Mahajan (Columbia University) Ira Kemelmacher-Shlizerman (Weizmann Institute) Ravi Ramamoorthi.

Direct Volume Rendering w/Shading via Three- Dimensional Textures.

Measure, measure, measure: BRDF, BTF, Light Fields Lecture #6

Computer Graphics Inf4/MSc Computer Graphics Lecture Notes #16 Image-Based Lighting.

The Free-form Light Stage Vincent Masselus Philip Dutré Frederik Anrys Department of Computer Science.

11/15/11 Image-based Lighting Computational Photography Derek Hoiem, University of Illinois Many slides from Debevec, some from Efros T2.

Automatic Registration of Color Images to 3D Geometry Computer Graphics International 2009 Yunzhen Li and Kok-Lim Low School of Computing National University.

Reflections Specular reflection is the perfect reflection of light from a surface. The law a reflection states that the direction of the incoming ray and.

Interactive Virtual Relighting and Remodelling of Real Scenes C. Loscos 1, MC. Frasson 1,2,G. Drettakis 1, B. Walter 1, X. Granier 1, P. Poulin 2 (1) iMAGIS*

November 2012 The Role of Bright Pixels in Illumination Estimation Hamid Reza Vaezi Joze Mark S. Drew Graham D. Finlayson Petra Aurora Troncoso Rey School.

Project Raytracing. Content Goals Idea of Raytracing Ray Casting – Therory – Practice Raytracing – Theory – Light model – Practice Output images Conclusion.

Sebastian Enrique Columbia University Relighting Framework COMS 6160 – Real-Time High Quality Rendering Nov 3 rd, 2004.

Real-Time Relighting Digital Image Synthesis Yung-Yu Chuang 1/10/2008 with slides by Ravi Ramamoorthi, Robin Green and Milos Hasan.

Real-time Shading with Filtered Importance Sampling Jaroslav Křivánek Czech Technical University in Prague Mark Colbert University of Central Florida.

1 Photon-driven Irradiance Cache J. BrouillatP. GautronK. Bouatouch INRIA RennesUniversity of Rennes1.

View-Dependent Precomputed Light Transport Using Nonlinear Gaussian Function Approximations Paul Green 1 Jan Kautz 1 Wojciech Matusik 2 Frédo Durand 1.

Image-based Lighting Design Frederik Anrys Philip Dutré Computer Graphics Group 8 Sept

All-Frequency Shadows Using Non-linear Wavelet Lighting Approximation Ren Ng Stanford Ravi Ramamoorthi Columbia SIGGRAPH 2003 Pat Hanrahan Stanford.

The Quotient Image: Class-based Recognition and Synthesis Under Varying Illumination T. Riklin-Raviv and A. Shashua Institute of Computer Science Hebrew.

Towards a Taxonomy of Global Illumination Algorithms Philip Dutré Program of Computer Graphics Cornell University.

SIGGRAPH 2011 ASIA Preview Seminar Rendering: Accuracy and Efficiency Shinichi Yamashita Triaxis Co.,Ltd.

A Theory for Photometric Self-Calibration of Multiple Overlapping Projectors and Cameras Peng Song Tat-Jen Cham Centre for Multimedia & Network Technology.

Image-Based Rendering of Diffuse, Specular and Glossy Surfaces from a Single Image Samuel Boivin and André Gagalowicz MIRAGES Project.

An Enhanced Splatting Method Graphics and Visualization Group Department of Computer Science The University of Auckland Peter Kulka & Richard Lobb.

Rendering Synthetic Objects into Real- World Scenes by Paul Debevec SIGGRAPH 98 Conference Presented By Justin N. Rogers for Advanced Comp Graphics Spring.

Interreflections : The Inverse Problem Lecture #12 Thanks to Shree Nayar, Seitz et al, Levoy et al, David Kriegman.

Relighting with 4D Incident Light Fields Vincent Masselus Pieter Peers Philip Dutré Yves D. Willems.

- Laboratoire d'InfoRmatique en Image et Systèmes d'information

Mitsubishi Electric Research Labs Progressively Refined Reflectance Fields from Natural Illumination Wojciech Matusik Matt Loper Hanspeter Pfister.

On robust Monte Carlo algorithms for multi-pass global illumination Frank Suykens – De Laet 17 September 2002.

Monte-Carlo Ray Tracing and

Inferring Reflectance Functions from Wavelet Noise Pieter Peers Philip Dutré Pieter Peers Philip Dutré June 30 th 2005 Department of Computer Science.

Compact, Fast and Robust Grids for Ray Tracing Ares Lagae & Philip Dutré 19 th Eurographics Symposium on Rendering EGSR 2008Wednesday, June 25th.

Bidirectional Path Sampling Techniques

Geometry Synthesis Ares Lagae Olivier Dumont Philip Dutré Department of Computer Science Katholieke Universiteit Leuven 10 August, 2004.

Thank you for the introduction

Singular Value Decomposition on solving Least Square optimization and Implementation 陳宏毅.

The Computation of Higher-Order Radiosity Approximations with a Stochastic Jacobi Iterative Method Ph. Bekaert, M. Sbert, Y Willems Department of Computer.

CSE 681 Introduction to Ray Tracing. CSE 681 Ray Tracing Shoot a ray through each pixel; Find first object intersected by ray. Image plane Eye Compute.

Eigen Texture Method : Appearance compression based method Surface Light Fields for 3D photography Presented by Youngihn Kho.

Distributed Ray Tracing. Can you get this with ray tracing?

Distributed Ray Tracing. Can you get this with ray tracing?

All-Frequency Shadows Using Non-linear Wavelet Lighting Approximation Ren Ng Stanford Ravi Ramamoorthi Columbia Pat Hanrahan Stanford.

Image-based Lighting Computational Photography

Reconstruction For Rendering distribution Effect

Removing Highlight Spots in Visual Hull Rendering

Plants from Images CS 658.

Distributed Ray Tracing

Artistic Rendering Final Project Initial Proposal

Presentation transcript:

Accurate Image Based Relighting through Optimization Pieter Peers Philip Dutré Department of Computer Science K.U.Leuven, Belgium

What is Image Based Relighting? Basis Images Processing & Relighting Relit Image

Previous Work The Light Stage (Debevec et al. ’00) Images: ACM SIGGRAPH ‘00

Previous Work Environment Matting (Zonker et al. ’99, Chuang et al. ’00) Images: ACM SIGGRAPH ’99

Previous work Diffuse Materials Specular Materials The Light Stage +- Environment Matting -+ Sparse sampling of light source directions Sufficient angular sampling Large span of incoming light directions Bundled incoming light directions Matusik et al. EGWR’02

Three-step algorithm Basis Image Recording Relit image = Captured reflectance + Light-map Reflectance field calculation

Basis Image Recording

... Basis Image Recording HDR photographs

Practical Setup HDR photographs Monitor calibration 4x4 grid, 9 patterns per lightpatch ±600 basis images

Three-step algorithm Basis Image Recording Relit image = Captured reflectance + Light-map Reflectance field calculation

Support and reflection coefficient

Support and reflectance … Patterns Pixel × R pix,patch Reflection Coefficient = = = = Resulting Value … … → Error 1 → Error 2 → Error n-1 → Error n Find and R pix,patch that minimize:  Error k

cli ck Support and reflectance: examples top left back right

Three-step algorithm Basis Image Recording Relit image = Captured reflectance + Light-map Reflectance field calculation

Re-lighting For each pixel: Pixel value = ∑ Filter i (LightMap) × R pix,i support i

Results A C B D

Results A C B D

Results A C B D

Results A C B D

Comparison Stochastic ray tracing Relit from rendered basis images

Comparison Stochastic ray tracing Relit from rendered basis images

Comparison Stochastic ray tracing Relit from rendered basis images

Conclusion Accurate relighting: –Diffuse materials –Specular materials Combine strengths from: –The Light Stage –Environment matting

Future Work Alternative emitting devices Investigate other patterns & optimization algorithms

Acknowledgements Frank Suykens and Vincent Masselus Some environment maps from:

Thank you… Questions?