1. 2/14/00 Vision based Animation The Inverse of an Inverse Problem Henning Biermann Chris Bregler Aaron Hertzmann Lorie Loeb Kathy Pullen Danny Yang

2. 2/14/00 The Standard Vision Pipeline Image / Video Recognition Modeling Capture

3. 2/14/00 Vision for Graphics / Animation Image / Video Synthesis Modeling Capture

4. 2/14/00 Vision for Graphics / Animation Image / Video Expressive Animations Modeling Capture

5. 2/14/00 The Standard Analogy

6. 2/14/00 The Graphics Problem

7. 2/14/00 The Vision Problem

8. 2/14/00 Vision Based Animation

9. 2/14/00 Vision for Graphics Image / Video Synthesis Modeling Capture

10. 2/14/00 Vision for Graphics Image / Video Synthesis Richer Modeling Capture

11. 2/14/00 Vision for Animation Image / Video Kinematics Dynamics Synthesis Capture Richer Modeling

12. 2/14/00 Models: 2 Issues Explicit / Implicit tradeoff: Hand CodedLearned

13. 2/14/00 Models: 2 Issues Explicit / Implicit tradeoff: Hand CodedLearned M X Y Analytically derived Fit Black-Box

14. 2/14/00 Models: 2 Issues Explicit / Implicit tradeoff: Model / Data tradeoff: Pure ModelPure Data AnalyticalLearned

15. 2/14/00 Models: 2 Issues Explicit / Implicit tradeoff: Model / Data tradeoff: Pure ModelPure Data AnalyticalLearned

16. 2/14/00 Case #1: Models of Kinematics - Approximate Kinematic Chains. - Fine-tune Kinematic Chains. - Acquisition of Nonrigid Models.

17. 2/14/00 Approximate Kinematic Chains - Enough for Animation ?

18. 2/14/00 Case #1: Models of Kinematics - Approximate Kinematic Chains. - Fine-tune Kinematic Chains. - Acquisition of Nonrigid Models.

19. 2/14/00 Fine-Tune Kinematics Anna Rabinowicz

20. 2/14/00 Fine-Tune Kinematics Kathy Pullen

21. 2/14/00 Case #1: Models of Kinematics - Approximate Kinematic Chains. - Fine-tune Kinematic Chains. - Acquisition of Nonrigid Models.

22. 2/14/00 - Acquisition of Nonrigid 3D Kinematics With Gene Alexander, Henning Biermann, Aaron Hertzmann, Lorenzo Torresani, Danny Yang

23. 2/14/00 Solution for Non-rigid Tracking / Reconstruction - Prior Model: 2D: PCA-based (Cootes et al 95) 3D: Blanz+Vetter-99

24. 2/14/00 3D Model Acquisition - Multi-view input: Pighin et al 98

25. 2/14/00 Solution for Rigid 3D Acquisition Structure from Motion: - Tomasi-Kanade-92 Factorization 3D Pose 3D rigid Object

26. 2/14/00 Acquisition without prior model ? No Model available ? Model too generic/specific ? Stock-Footage only in 2D ?

27. 2/14/00 Solution based on Factorization - We want 3 things: - 3D non-rigid shape model - for each frame: - 3D Pose - non-rigid configuration (deformation) -> Tomasi-Kanade-92: W = P S Rank 3

28. 2/14/00 Solution based on Factorization - We want 3 things: - 3D non-rigid shape model - for each frame: - 3D Pose - non-rigid configuration (deformation) -> PCA-based representations: W = P non-rigid S Rank K

29. 2/14/00 Factoring twice -

30. 2/14/00 Nonrigid 3D Kinematics from point tracks -

31. 2/14/00 - Nonrigid 3D Kinematics from dense flow

32. 2/14/00 - Nonrigid 3D Kinematics from dense flow

33. 2/14/00 - Nonrigid 3D Kinematics from dense flow

34. 2/14/00 Motion Capture Modeling Synthesis Nonrigid 3D Kinematics from dense flow

35. 2/14/00 Case #2: Models of Dynamics Pure ModelPure Data

36. 2/14/00 Case #2: Models of Dynamics Pure ModelPure Data Learning ControllerMocap. Library

37. 2/14/00 Case #2: Models of Dynamics Pure ModelPure Data Parametric Non-Parametric

38. 2/14/00 Case #2: Models of Dynamics Pure ModelPure Data Kernel-Based Densities

39. 2/14/00 Case #2: Models of Dynamics Kathy Pullen

40. 2/14/00 Case #2: Models of Dynamics “Motion Texture” Sampling / Matching

41. 2/14/00 Case #2: Models of Dynamics P(Li | Lj) Sampling / Matching:

42. 2/14/00 Synthesizing Subtleties + Variations Kathy Pullen Motion Capture Modeling Synthesis

43. 2/14/00 Synthesizing Subtleties + Variations Kathy Pullen Motion Capture Modeling Synthesis

44. 2/14/00 Synthesizing Subtleties + Variations Kathy Pullen Motion Capture Modeling Synthesis

45. 2/14/00 Synthesizing Subtleties + Variations Kathy Pullen Motion Capture Modeling Synthesis

46. 2/14/00 Synthesizing Subtleties + Variations Kathy Pullen Motion Capture Modeling Synthesis

47. 2/14/00 Vision Based Animation Animations Kinematics Dynamics Richer Modeling

48. 2/14/00 Human Movement Research Computer Science: Vision / Graphics Bio-Mechanics: Motion Models/Analysis Art: Animation / Dance Medicine/ Neurology: Movement Disorders

49. 2/14/00 Model Data

50. 2/14/00 Model Data Expressive Animation

51. 2/14/00 Human Movement Research Computer Science: Vision / Graphics Bio-Mechanics: Motion Models/Analysis Art: Animation / Dance Medicine/ Neurology: Movement Disorders

52. 2/14/00 Project Mariposa: Animation Principles Lorie Loeb

53. 2/14/00 Project Mariposa: Animation Principles Lorie Loeb Realism is out

54. 2/14/00 Project Mariposa: Animation Principles Lorie Loeb Realism is out Expressiveness is in

55. 2/14/00 Model Data Expressive Animation

56. 2/14/00 Model Data Controversy: Motion-Capture based Animation

57. 2/14/00 Model Data Controversy: Motion-Capture based Animation

58. 2/14/00 Model Data Controversy: Motion-Capture based Animation

59. 2/14/00 Model Data Controversy: Motion-Capture based Animation

60. 2/14/00 Synthesis by Analysis Animations

61. 2/14/00 Enough for Animation ? Expressive Animations Video/Mocap

62. 2/14/00 Expressive Animation Expressive Output Cartoon Capture