Recent Methods for Image-based Modeling and Rendering Lecture 6: Rendering Darius Burschka Johns Hopkins University Dana Cobzas University of Alberta Zach Dodds Harvey Mudd College Martin Jagersand University of Alberta Keith Yerex Virtual Universe Corporation IEEE VR 2003 tutorial 1

Implementation Matlab for geometric modeling and prototypingMatlab for geometric modeling and prototyping mexVision for tracking (30Hz frame rate)mexVision for tracking (30Hz frame rate) Hardware accelerated OpenGL for rendering (2.8Hz in SW, 18Hz on GeForce 2)Hardware accelerated OpenGL for rendering (2.8Hz in SW, 18Hz on GeForce 2) pthreads and pvm for parallel processingpthreads and pvm for parallel processing MATLAB meXVision OpenGL

Hardware rendering Unsigned basisUnsigned basis Scaling to 8 bitScaling to 8 bit WhereWhere

OpenGL

Geometric SFM and dynamic textures I1I1 ItIt … == + + Warped texture Motion params (R 1 a 1 b 1 ) …(R t a t b t ) Structure P Texture basis y 1 … y t Texture coeff New pose (R a b) Training Model New view (Cobzas, Yerex Jagersand 2002)

Capture system Video and visual tracking from and ieee1394 camVideo and visual tracking from and ieee1394 cam Based on XVision2, PVM and Capture UIBased on XVision2, PVM and Capture UI

Structure editor Verify geometric structure reprojectionsVerify geometric structure reprojections Edit tracking errorsEdit tracking errors

Triangulation and Texture Editor Adjust Delauney triangulationAdjust Delauney triangulation Adjust texture resolution for individual trianglesAdjust texture resolution for individual triangles

Real-Time Renderer Real-Time HW implementation of texture blending in NVIDIA register combinersReal-Time HW implementation of texture blending in NVIDIA register combiners