1. Summary & Homework Jinxiang Chai

2. Outline Motion data process paper summary Presentation tips Homework Paper assignment

3. Skeleton Model Extraction Estimate the skeleton model from motion capture data

4. Motion Data Processing I Operations on single motion sequence Motion warping (cannot satisfy user constraints)

5. Motion Data Processing I Operations on single motion sequence Motion warping (cannot satisfy user constraints) Motion retargeting (can satisfy user constraints but slow)

6. Motion Data Processing I Operations on single motion sequence Motion warping (cannot satisfy user constraints) Motion retargeting (can satisfy user constraints but slow) Motion edit (can satisfy user constraints and fast)

7. Motion Data Processing I Operations on single motion sequence Motion warping (cannot satisfy user constraints) Motion retargeting (can satisfy user constraints but slow) Motion edit (can satisfy user constraints and fast) However: does not work for many user-defined constraints does not utilize spatial-temporal correlation in human motion

8. Motion Data Processing I Operations on single motion sequence Motion warping (cannot satisfy user constraints) Motion retargeting (can satisfy user constraints but slow) Motion edit (can satisfy user constraints and fast) Expression cloning (facial data) (cannot satisfy user constraints)

9. Motion Data Processing I Operations on single motion sequence Motion warping (cannot satisfy user constraints) Motion retargeting (can satisfy user constraints but slow) Motion edit (can satisfy user constraints and fast) Expression cloning (facial data) (cannot satisfy user constraints) Motion synopsis

10. Motion Data Processing I Operations on single motion sequence Motion warping (cannot satisfy user constraints) Motion retargeting (can satisfy user constraints but slow) Motion edit (can satisfy user constraints and fast) Expression cloning (facial data) (cannot satisfy user constraints) Motion synopsis What else?

11. Motion Data Processing I Operations on single motion sequence Motion segmentation? Motion recognition? Motion filtering? More operations in facial data

12. Motion Data Processing II Operations between two motion sequence Motion style translation What else?

13. Motion Data Processing II Operations between two motion sequence Motion style translation What else?

14. Motion Data Processing II Operations between two motion sequence Motion style translation Motion interpolation?

15. Motion Data Processing III Operations on multiple motion sequences/database Motion data compression

16. Motion Data Processing III Operations on multiple motion sequences/database Motion data compression What else?

17. Motion Data Processing III Operations on multiple motion sequences/database Motion data compression Motion Retrieval? Motion synthesis?

18. Presentation Tips Choose right background Use blue or black or dark colors Focus on important things Always talk about what, why, and how Detailize the most important technical content Always talk about the limitations of the paper How to deal with equations Avoid using too many equations Talk about the intuition of the equations Explain each term of the equations

19. Presentation Tips (Cont.) Choose the right background Use dark colors (blue or black) Be consistent Font type, size, color, bullets, figure captions etc. Use short & concise sentences Do not copy & paste from the paper Use images, diagrams, figures, videos to demonstrate ideas

20. Presentation Tips (Cont.) Play videos Explain each video Move the mouse away from the window

21. Example Slides

22. Goal: everyone can generate and control human motion easily and quickly Online animation control Interfaces for Controlling Human Motion

23. Applications: Online Animation Performance-based facial animation for home use Tiger Woods PGA Tour 2005 Mike Tyson Heavyweight Boxing Friday Night 3D Bowling Teleconferencing (from BT) Xbox Outlaw Tennis Multi-user Virtual Worlds Virtual Poker Room Virtual Presenter

24. Reordering motion clip [Lee et al. SIG02, Kovar et al. SIG02, Pullen & Bregler SIG02, Arikan et al. SIG03] Learning model from human motion [Brand & Hertzmann SIG00, Li et al. SIG02] Interpolating motions [Rose et al. CG&A98, Kovar et al. SIG04] Animation from Mocap Data

25. Video Analysis Overview Online motion synthesis Online local modeling Low-dimensional control signals Preprocessed motion capture data Preprocessed motion capture data Online local models

26. Online Motion Optimization Optimizing a nonlinear function in about 7 dimensional space w t : Control term Smoothness term Pose prior term … … ?

27. Outline Motion data paper summary Presentation tips Homework Paper assignment

28. Dimensionality reduction using PCA Current pose Mean pose Eigen-posesLow-dimensional space Linear model: Mean pose Eigen-poses Dim(w t )? Linear Dimensionality Reduction

29. 05 10 15 20253035404550 0 5 10 15 20 25 30 A v e r a g e r e c o n s t r u c t i o n e r r o r ( d e g r e e p e r j o i n t a n g l e ) A large heterogeneous database (1 hour of data) PCA (38D for error<1 o ) Number of dimensions

30. Reconstruction Error Curve 0102030405060 0 0.5 1 1.5 2 2.5 A v e r a g e r e c o n s t r u c t i o n e r r o r ( d e g r e e p e r j o i n t a n g l e ) A large database Number of dimensions of W t

31. Minimal Dimensionality 0102030405060 0 0.5 1 1.5 2 2.5 A v e r a g e r e c o n s t r u c t i o n e r r o r ( d e g r e e p e r j o i n t a n g l e ) A large database Number of dimensions of W t 7 0.8 56 dim7 dim

32. Videos Two Animation videos rendered by Maya Original mocap sequence Reconstructed mocap sequence

33. Startup Codes & Data Motion capture data (.amc files and.asf file) A skinned character model Visualize amc/asf file Read asf/amc file Visualize mocap data Forward kinematics Matlab codes Read and write.amc file

34. Softwares Maya To be installed in Rm 220, HRBB Render each frame based on mocap data and character model Instruction on how to render animation Adobe Premier Installed in Rm 220, HRBB Making video from image sequences

35. Outline Motion data paper summary Presentation tips Homework Paper assignment