Designing a 3D Video Camera Hylke Buisman and Derek Chan Supervisor: Christian Theobalt Real-time depth up-sampling Hylke Buisman and Derek Chan Supervisor:

Slides:

Advertisements

Similar presentations

Eikonal Rendering: View Renderer

Advertisements

Point-based Graphics for Estimated Surfaces

A Robust Super Resolution Method for Images of 3D Scenes Pablo L. Sala Department of Computer Science University of Toronto.

Automatic Color Gamut Calibration Cristobal Alvarez-Russell Michael Novitzky Phillip Marks.

Improving resolution and depth of astronomical observations (via modern mathematical methods for image analysis) M. Castellano, D. Ottaviani, A. Fontana,

CS448f: Image Processing For Photography and Vision Sharpening.

Week 11 - Wednesday.  Image based effects  Skyboxes  Lightfields  Sprites  Billboards  Particle systems.

Accelerating Spatially Varying Gaussian Filters Jongmin Baek and David E. Jacobs Stanford University.

Stereo Many slides adapted from Steve Seitz. Binocular stereo Given a calibrated binocular stereo pair, fuse it to produce a depth image Where does the.

Kernel-based tracking and video patch replacement Igor Guskov

M.S. Student, Hee-Jong Hong

Layered Solid Texture Synthesis from a Single 2D Exemplar Kenshi Takayama 1 Takeo Igarashi 1,2 1 The University of Tokyo 2 JST/ERATO.

Gaussian KD-Tree for Fast High-Dimensional Filtering A. Adams, N. Gelfand, J. Dolson, and M. Levoy, Stanford University, SIGGRAPH 2009.

Filtering CSE P 576 Larry Zitnick

3D Multi-view Reconstruction Young Min Kim Karen Zhu CS 223B March 17, 2008.

LYU0603 A Generic Real-Time Facial Expression Modelling System Supervisor: Prof. Michael R. Lyu Group Member: Cheung Ka Shun ( ) Wong Chi Kin ( )

High-quality Scanning using Time-Of-Flight Depth Superresolution 17nd March 2008 Sebastian Schuon Prepared for: Final Presentation.

High-Quality Video View Interpolation

Hardware-Based Nonlinear Filtering and Segmentation using High-Level Shading Languages I. Viola, A. Kanitsar, M. E. Gröller Institute of Computer Graphics.

1 Image filtering Hybrid Images, Oliva et al.,

Scalable Remote Rendering with Augmented Streaming Dawid Pająk, Robert Herzog, Elmar Eisemann, Karol Myszkowski, Hans-Peter Seidel.

Post-rendering Cel Shading & Bloom Effect

Multi-Aperture Photography Paul Green – MIT CSAIL Wenyang Sun – MERL Wojciech Matusik – MERL Frédo Durand – MIT CSAIL.

Visual Design. What makes something beautiful? (it’s in the eye of the beholder)

My Research Experience Cheng Qian. Outline 3D Reconstruction Based on Range Images Color Engineering Thermal Image Restoration.

CSCE 441: Computer Graphics Image Filtering Jinxiang Chai.

Fast Bilateral Filtering

Recursive Bilateral Filtering F Reference Yang, Qingxiong. "Recursive bilateral filtering." ECCV Deriche, Rachid. "Recursively implementating.

Speaker Min-Koo Kang November 14, 2012 Depth Enhancement Technique by Sensor Fusion: Joint Bilateral Filter Approaches.

High dynamic range imaging. Camera pipeline 12 bits8 bits.

CS448f: Image Processing For Photography and Vision Fast Filtering Continued.

Overview [See Video file] Architecture Overview.

Takuya Matsuo, Norishige Fukushima and Yutaka Ishibashi

Real-time Non-photorealistic ViewfinderReal-time Non-photorealistic Viewfinder.

Reconstructing 3D mesh from video image sequences supervisor : Mgr. Martin Samuelčik by Martin Bujňák specifications Master thesis

2D/3D Shape Manipulation, 3D Printing Shape Representations Slides from Olga Sorkine February 20, 2013 CS 6501.

Yu-Wing Tai, Hao Du, Michael S. Brown, Stephen Lin CVPR’08 (Longer Version in Revision at IEEE Trans PAMI) Google Search: Video Deblurring Spatially Varying.

Image Processing Edge detection Filtering: Noise suppresion.

Stereo Many slides adapted from Steve Seitz.

Asian Institute of Technology

A Gentle Introduction to Bilateral Filtering and its Applications Sylvain Paris – MIT CSAIL Pierre Kornprobst – INRIA Odyssée Jack Tumblin – Northwestern.

The 18th Meeting on Image Recognition and Understanding 2015/7/29 Depth Image Enhancement Using Local Tangent Plane Approximations Kiyoshi MatsuoYoshimitsu.

2D Texture Synthesis Instructor: Yizhou Yu. Texture synthesis Goal: increase texture resolution yet keep local texture variation.

Oliver Klehm, MPI Informatik Hans-Peter Seidel, MPI Informatik Elmar Eisemann, TU Delft.

A Gentle Introduction to Bilateral Filtering and its Applications 10/10: Conclusions Jack Tumblin – EECS, Northwestern University.

Speaker Min-Koo Kang March 26, 2013 Depth Enhancement Technique by Sensor Fusion: MRF-based approach.

A Gentle Introduction to Bilateral Filtering and its Applications 10/10: Conclusions Jack Tumblin – EECS, Northwestern University.

1 Dr. Scott Schaefer Antialiasing. 2/70 What is aliasing?

Filtering (II) Dr. Chang Shu COMP 4900C Winter 2008.

Center for Machine Perception Department of Cybernetics Faculty of Electrical Engineering Czech Technical University in Prague Segmentation Based Multi-View.

Presenter: Jae Sung Park

Design and Calibration of a Multi-View TOF Sensor Fusion System Young Min Kim, Derek Chan, Christian Theobalt, Sebastian Thrun Stanford University.

A Globally Optimal Algorithm for Robust TV-L 1 Range Image Integration Christopher Zach VRVis Research Center Thomas Pock, Horst Bischof.

Hybrid Ray Tracing and Path Tracing of Bezier Surfaces using a mixed hierarchy Rohit Nigam, P. J. Narayanan CVIT, IIIT Hyderabad, Hyderabad, India.

Reconstruction For Rendering distribution Effect

Computational Photography

A Gentle Introduction to Bilateral Filtering and its Applications

Rob Fergus Computer Vision

Interactive MC Ray-Tracing Upsampling

More modeling terms resolution –distinguish separate entities on the display vsync – syncs GPU frame-rate output with monitor refresh rate tessellation.

Introduction to Object Tracking

A connectionist model in action

Patrick Cozzi University of Pennsylvania CIS Spring 2011

Lecture 2: Image filtering

Fig. 2 System and method for determining retinal disparities when participants are engaged in everyday tasks. System and method for determining retinal.

Stereo vision Many slides adapted from Steve Seitz.

An Edge-preserving Filtering Framework for Visibility Restoration

Fig. 2 System and method for determining retinal disparities when participants are engaged in everyday tasks. System and method for determining retinal.

Real-time Global Illumination with precomputed probe

Presentation transcript:

Designing a 3D Video Camera Hylke Buisman and Derek Chan Supervisor: Christian Theobalt Real-time depth up-sampling Hylke Buisman and Derek Chan Supervisor: Christian Theobalt

Designing a 3D Video Camera Hylke Buisman and Derek Chan Supervisor: Christian Theobalt Problem description Primary goals –Super resolution and noise removal Input: low-res depth map, high-res color image Output: 3D mesh of up-sampled and denoised depth –Optimize for (near) real-time processing Data samples

Designing a 3D Video Camera Hylke Buisman and Derek Chan Supervisor: Christian Theobalt Approach Bilateral filter affects only areas of similar color

Designing a 3D Video Camera Hylke Buisman and Derek Chan Supervisor: Christian Theobalt Approach Joint bilateral up-sampling (Kopf et al.): Implementations explored: –Bilateral grid (Paris & Durand 2007) –Separable kernel approximation

Designing a 3D Video Camera Hylke Buisman and Derek Chan Supervisor: Christian Theobalt Results +=

Designing a 3D Video Camera Hylke Buisman and Derek Chan Supervisor: Christian Theobalt Results NaiveOptimized Naïve (Color) Bilateral grid (No color) Separable Kernel (Color) GPU 5 s1 s0.3 s0.6 s75 ms Runtimes (800 x 600 image) + = Input Result

Designing a 3D Video Camera Hylke Buisman and Derek Chan Supervisor: Christian Theobalt Hidden slide Hylke - 50% –Alignment: Extrinsics calibration Homography between depthmap and color image –CPU implementation JBU Separable kernel –Bilateral grid Derek - 50% –Alignment: 3d point cloud tesselation Reprojection into high-res camera –Median filter –GPU implementation of upsampling –3D results with texture