Presentation is loading. Please wait.

Presentation is loading. Please wait.

DEPARTMENT OF COMPUTER SCIENCE AND ENGINEERING Automatic Posing of a Meshed Human Model Using Point Clouds Lei Wang Joint work with Tamal K. Dey, Huamin.

Published bySolomon Nicholson Modified over 8 years ago

Similar presentations

Presentation on theme: "DEPARTMENT OF COMPUTER SCIENCE AND ENGINEERING Automatic Posing of a Meshed Human Model Using Point Clouds Lei Wang Joint work with Tamal K. Dey, Huamin."— Presentation transcript:

1 DEPARTMENT OF COMPUTER SCIENCE AND ENGINEERING Automatic Posing of a Meshed Human Model Using Point Clouds Lei Wang Joint work with Tamal K. Dey, Huamin Wang and Bo Fu

2 DEPARTMENT OF COMPUTER SCIENCE AND ENGINEERING Problem Statement Low-end scanning devices are becoming popular. But quality of their output… Reconstruct from problematic human scans by deforming a prior high quality template mesh

3 DEPARTMENT OF COMPUTER SCIENCE AND ENGINEERING Related Work Model-based Registration Parametric human body models Registration without a Model Manual intervention Non-rigid registration by nonlinear optimization Isometric deformations: keep geodesic distance unchanged

4 DEPARTMENT OF COMPUTER SCIENCE AND ENGINEERING Our Method: Outline computing correspondences posingoutput

5 DEPARTMENT OF COMPUTER SCIENCE AND ENGINEERING Computing Correspondences

6 DEPARTMENT OF COMPUTER SCIENCE AND ENGINEERING Computing Correspondences The Global Point Signature (GPS) framework by [Rustamov 2007]: Apply Gaussian-weighted Graph Laplacian on the adjacency graph of input point cloud Graph Laplacian GPS in dimension 1, 2 and 3

7 DEPARTMENT OF COMPUTER SCIENCE AND ENGINEERING Computing Correspondences GPS is invariant under isometric deformation We choose only the first three eigenfunctions

8 DEPARTMENT OF COMPUTER SCIENCE AND ENGINEERING Computing Correspondences Correspondences are expanded from 5 extremums of aligned GPS embeddings

9 DEPARTMENT OF COMPUTER SCIENCE AND ENGINEERING Posing Template Mesh Formulated as an energy minimization problem: is the internal energy of template mesh ○ measures difference between template and the point cloud Solved by Invertible FEM [Irving et al. 2004]

10 DEPARTMENT OF COMPUTER SCIENCE AND ENGINEERING It has two stages Point cloud alignment: deformed by input point cloud Posing Template Mesh Initial alignment: deformed by correspondence

11 DEPARTMENT OF COMPUTER SCIENCE AND ENGINEERING Posing Template Mesh For efficiency, posing is performed on a simplified template mesh, called control mesh Deformed template is recovered by Mean Value Coordinates [Ju et al. 2005], i.e., weighted sum of the control mesh

12 DEPARTMENT OF COMPUTER SCIENCE AND ENGINEERING Results

13 DEPARTMENT OF COMPUTER SCIENCE AND ENGINEERING Results

14 DEPARTMENT OF COMPUTER SCIENCE AND ENGINEERING Results

15 DEPARTMENT OF COMPUTER SCIENCE AND ENGINEERING Results (a) input scan (b) our method (c) SCAPE

16 DEPARTMENT OF COMPUTER SCIENCE AND ENGINEERING Results can be used to control the body size

17 DEPARTMENT OF COMPUTER SCIENCE AND ENGINEERING Supplementary Video

18 DEPARTMENT OF COMPUTER SCIENCE AND ENGINEERING Discussion An automatic approach to align a detailed template mesh with human point clouds in different poses Robust to noise and occlusions Sensitive to topological change Can not handle details like fingers Does not run in real-time

19 DEPARTMENT OF COMPUTER SCIENCE AND ENGINEERING Q & A Thank you!

Download ppt "DEPARTMENT OF COMPUTER SCIENCE AND ENGINEERING Automatic Posing of a Meshed Human Model Using Point Clouds Lei Wang Joint work with Tamal K. Dey, Huamin."

Similar presentations

Using Strong Shape Priors for Multiview Reconstruction Yunda SunPushmeet Kohli Mathieu BrayPhilip HS Torr Department of Computing Oxford Brookes University.

Using Strong Shape Priors for Multiview Reconstruction Yunda SunPushmeet Kohli Mathieu BrayPhilip HS Torr Department of Computing Oxford Brookes University.
Coherent Laplacian 3D protrusion segmentation Oxford Brookes Vision Group Queen Mary, University of London, 11/12/2009 Fabio Cuzzolin.

Coherent Laplacian 3D protrusion segmentation Oxford Brookes Vision Group Queen Mary, University of London, 11/12/2009 Fabio Cuzzolin.
1 Manifold Alignment for Multitemporal Hyperspectral Image Classification H. Lexie Yang 1, Melba M. Crawford 2 School of Civil Engineering, Purdue University.

1 Manifold Alignment for Multitemporal Hyperspectral Image Classification H. Lexie Yang 1, Melba M. Crawford 2 School of Civil Engineering, Purdue University.
MRI Brain Extraction using a Graph Cut based Active Contour Model Noha Youssry El-Zehiry Noha Youssry El-Zehiry and Adel S. Elmaghraby Computer Engineering.

MRI Brain Extraction using a Graph Cut based Active Contour Model Noha Youssry El-Zehiry Noha Youssry El-Zehiry and Adel S. Elmaghraby Computer Engineering.
Junjie Cao 1, Andrea Tagliasacchi 2, Matt Olson 2, Hao Zhang 2, Zhixun Su 1 1 Dalian University of Technology 2 Simon Fraser University Point Cloud Skeletons.

Junjie Cao 1, Andrea Tagliasacchi 2, Matt Olson 2, Hao Zhang 2, Zhixun Su 1 1 Dalian University of Technology 2 Simon Fraser University Point Cloud Skeletons.
Bryan Willimon, Steven Hickson, Ian Walker, and Stan Birchfield IROS 2012 Vila Moura, Algarve An Energy Minimization Approach to 3D Non- Rigid Deformable.

Bryan Willimon, Steven Hickson, Ian Walker, and Stan Birchfield IROS 2012 Vila Moura, Algarve An Energy Minimization Approach to 3D Non- Rigid Deformable.
Multiple Shape Correspondence by Dynamic Programming Yusuf Sahillioğlu 1 and Yücel Yemez 2 Pacific Graphics 2014 Computer Eng. Depts, 1, 2, Turkey.

Multiple Shape Correspondence by Dynamic Programming Yusuf Sahillioğlu 1 and Yücel Yemez 2 Pacific Graphics 2014 Computer Eng. Depts, 1, 2, Turkey.
CSE554Extrinsic DeformationsSlide 1 CSE 554 Lecture 9: Extrinsic Deformations Fall 2012.

CSE554Extrinsic DeformationsSlide 1 CSE 554 Lecture 9: Extrinsic Deformations Fall 2012.
CSE554Extrinsic DeformationsSlide 1 CSE 554 Lecture 10: Extrinsic Deformations Fall 2014.

CSE554Extrinsic DeformationsSlide 1 CSE 554 Lecture 10: Extrinsic Deformations Fall 2014.
E IGEN D EFORMATION OF 3 D M ODELS Tamal K. Dey, Pawas Ranjan, Yusu Wang [The Ohio State University] (CGI 2012)

E IGEN D EFORMATION OF 3 D M ODELS Tamal K. Dey, Pawas Ranjan, Yusu Wang [The Ohio State University] (CGI 2012)
Temporally Coherent Completion of Dynamic Shapes Hao Li, Linjie Luo, Daniel Vlasic, Pieter Peers, Jovan Popović, Mark Pauly, Szymon Rusinkiewicz ACM Transactions.

Temporally Coherent Completion of Dynamic Shapes Hao Li, Linjie Luo, Daniel Vlasic, Pieter Peers, Jovan Popović, Mark Pauly, Szymon Rusinkiewicz ACM Transactions.
Modeling the Shape of People from 3D Range Scans

Modeling the Shape of People from 3D Range Scans
INSTITUTE OF COMPUTING TECHNOLOGYCHINESE ACADEMY OF SCIENCES 1 A Pose-Independent Method of Animating Scanned Human Bodies Yong Yu, Tianlu Mao, Shihong.

INSTITUTE OF COMPUTING TECHNOLOGYCHINESE ACADEMY OF SCIENCES 1 A Pose-Independent Method of Animating Scanned Human Bodies Yong Yu, Tianlu Mao, Shihong.
Semi-Supervised Hierarchical Models for 3D Human Pose Reconstruction Atul Kanaujia, CBIM, Rutgers Cristian Sminchisescu, TTI-C Dimitris Metaxas,CBIM, Rutgers.

Semi-Supervised Hierarchical Models for 3D Human Pose Reconstruction Atul Kanaujia, CBIM, Rutgers Cristian Sminchisescu, TTI-C Dimitris Metaxas,CBIM, Rutgers.
Model base human pose tracking. Papers Real-Time Human Pose Tracking from Range Data Simultaneous Shape and Pose Adaption of Articulated Models using.

Model base human pose tracking. Papers Real-Time Human Pose Tracking from Range Data Simultaneous Shape and Pose Adaption of Articulated Models using.
Modeling 3D Deformable and Articulated Shapes Yu Chen, Tae-Kyun Kim, Roberto Cipolla Department of Engineering University of Cambridge.

Modeling 3D Deformable and Articulated Shapes Yu Chen, Tae-Kyun Kim, Roberto Cipolla Department of Engineering University of Cambridge.
Computer Graphics Group Alexander Hornung Alexander Hornung and Leif Kobbelt RWTH Aachen Robust Reconstruction of Watertight 3D Models from Non-uniformly.

Computer Graphics Group Alexander Hornung Alexander Hornung and Leif Kobbelt RWTH Aachen Robust Reconstruction of Watertight 3D Models from Non-uniformly.
PARAMETRIC RESHAPING OF HUMAN BODIES IN IMAGES SIGGRAPH 2010 Shizhe Zhou Hongbo Fu Ligang Liu Daniel Cohen-Or Xiaoguang Han.

PARAMETRIC RESHAPING OF HUMAN BODIES IN IMAGES SIGGRAPH 2010 Shizhe Zhou Hongbo Fu Ligang Liu Daniel Cohen-Or Xiaoguang Han.
Reverse Engineering Niloy J. Mitra.

Reverse Engineering Niloy J. Mitra.
Computer Vision Group University of California Berkeley Shape Matching and Object Recognition using Shape Contexts Jitendra Malik U.C. Berkeley (joint.

Computer Vision Group University of California Berkeley Shape Matching and Object Recognition using Shape Contexts Jitendra Malik U.C. Berkeley (joint.

Similar presentations

Ads by Google