Professor Department of Computer Science & Engineering Indian Institute of Technology Delhi April 26, 2007 Visiting Professor Dayalbagh Educational Institute View Dependent Character Animation Prem K Kalra

Slide 2 Contact Prof Subhashis Banerjee Dr. Parag Chaudhuri URL: Collaborators

Slide 3 Introduction

Slide 4 Introduction Consider the freeze-frame camera rotate shot of Matrix Want to create a similar effect in an animated shot…

Slide 5 Introduction

Slide 6 Introduction

Slide 7 Obvious approach for any camera moving shot The camera-character relationship is very fundamental to animation View dependent animation – animation that automatically changes in response to changes in view point Introduction

Slide 8 View Space

Slide 9 View Space

Slide 10 View Space

Slide 11 View Space

Slide 12 View Space Animation Generation Not just view direction!

Slide 13 View Dependent Animation Using Sketches

Slide 14 Given SketchDesired 3D Pose Creating View Dependent Models

Slide 15 Given SketchDesired 3D Pose ?? Creating View Dependent Models

Slide 16 Inputs Creating View Dependent Models

Slide 17 Inputs Sketches 3D Base Mesh Model SkeletonLattice Creating View Dependent Models

Slide 18 Camera Recovery Creating View Dependent Models

Slide 19 Camera Recovery Joint (rigid) correspondences between sketch and the 3D base model Creating View Dependent Models

Slide 20 Camera Recovery Solve for the best camera Creating View Dependent Models

Slide 21 Pose Estimation Creating View Dependent Models

Slide 22 Pose Estimation Inverse Kinematics and Free Form Deformation Creating View Dependent Models

Slide 23 Pose Estimation Creating View Dependent Models

Slide 24 Deformation Creating View Dependent Models

Slide 25 Deformation Creating View Dependent Models

Slide 26 Deformation Direct Free Form Deformation Creating View Dependent Models

Slide 27 Deformation Direct Free Form Deformation Creating View Dependent Models

Slide 28 The View Space

Slide 29 Some Results

Slide 30 Some Results

Slide 31 Some Results

Slide 32 View Dependent Animation Using Video and Multi Modal Inputs

Slide 33 From Video Input Video Contour Tracking Camera Tracking Resulting Animation

Slide 34 Multi Modal Inputs Video Sketches

Slide 35 Other Possibilities Stylistic re-use Fusing motion capture data and key frame animation Synchronized multiple video streams

Slide 36 Other Possibilities

Slide 37 Conclusion A frame work for view dependent animation Multi modal inputs Sketches, Video, Mixed Semi automatic computer vision techniques

Slide 38 Thank You