Presentation is loading. Please wait.

Presentation is loading. Please wait.

Interactive Deformation of Light Fields Billy Chen Eyal Ofek Heung-Yeung Shum Marc Levoy.

Similar presentations


Presentation on theme: "Interactive Deformation of Light Fields Billy Chen Eyal Ofek Heung-Yeung Shum Marc Levoy."— Presentation transcript:

1 Interactive Deformation of Light Fields Billy Chen Eyal Ofek Heung-Yeung Shum Marc Levoy

2 Image-based rendering Levoy et al., 1996Shum et al., 1999 Zitnick et al., 2004Uyttendaele et al., 2004

3 Previous work Seitz, S., Kutulakos, K. N. Plenoptic image editing, In Proc. ICCV Zhang, Z., Wang, L., Guo, B., Shum, H.-Y, Feature-based light field morphing, In Proc. SIGGRAPH Weyrich, T., Pfister, H., Gross, M., Rendering deformable surface reflectance fields, In IEEE Transactions on Computer Graphics and Visualization.

4 Light field deformation

5 Outline Coaxial light fields Framework for deformation Splitting Deforming Rendering Results

6 Outline Coaxial light fields Framework for deformation Splitting Deforming Rendering Results

7 Coaxial light fields … …

8

9

10 Outline Framework for deformation Splitting Deforming Rendering Results

11 Splitting a light field A sub-light field consists of a bundle of rays a deformation box u s

12 Sub-light field example

13 Projector-based light field segmentation

14

15

16 Outline Coaxial light fields Framework for deformation Splitting Deforming Rendering Results

17 Deformation

18 Ray warping preserves mapping specified by the animator preserves C 0 continuity of points maps lines to lines

19 Inverse view ray warping

20

21 Hardware accelerated warping front id mapback id map deformation 256 x 256 resolution texture map anisoptric filter for mip-mapped texture 64 x 64 triangles real-time with a NVIDIA GeForce 3

22 Outline Coaxial light fields Framework for deformation Splitting Deforming Rendering Results

23 For each camera pixel 1.Segment ray 2.Warp ray 3.Render ray 4.Mask ray Rendering and visibility

24 Results

25 Conclusion A pipeline for deforming light fields Light field segmentation Ray warping Rendering multiple light fields Coaxial light fields Enables interactive deformation of photo- realistic objects Applications: photo-realistic rapid prototyping, games

26 Thank you Reviewers NSF (IIS ) DARPA (NBCH ) Elizabeth Chen, Vaibhav Vaish, Gaurav Garg

27 Failure cases

28 Video of acquisition process

29 Deformation and compositing


Download ppt "Interactive Deformation of Light Fields Billy Chen Eyal Ofek Heung-Yeung Shum Marc Levoy."

Similar presentations


Ads by Google