DEPARTMENT OF COMPUTER SCIENCE AND ENGINEERING Automatic Posing of a Meshed Human Model Using Point Clouds Lei Wang Joint work with Tamal K. Dey, Huamin.

Slides:

Advertisements

Similar presentations

Using Strong Shape Priors for Multiview Reconstruction Yunda SunPushmeet Kohli Mathieu BrayPhilip HS Torr Department of Computing Oxford Brookes University.

Advertisements

Coherent Laplacian 3D protrusion segmentation Oxford Brookes Vision Group Queen Mary, University of London, 11/12/2009 Fabio Cuzzolin.

1 Manifold Alignment for Multitemporal Hyperspectral Image Classification H. Lexie Yang 1, Melba M. Crawford 2 School of Civil Engineering, Purdue University.

MRI Brain Extraction using a Graph Cut based Active Contour Model Noha Youssry El-Zehiry Noha Youssry El-Zehiry and Adel S. Elmaghraby Computer Engineering.

Junjie Cao 1, Andrea Tagliasacchi 2, Matt Olson 2, Hao Zhang 2, Zhixun Su 1 1 Dalian University of Technology 2 Simon Fraser University Point Cloud Skeletons.

Bryan Willimon, Steven Hickson, Ian Walker, and Stan Birchfield IROS 2012 Vila Moura, Algarve An Energy Minimization Approach to 3D Non- Rigid Deformable.

Multiple Shape Correspondence by Dynamic Programming Yusuf Sahillioğlu 1 and Yücel Yemez 2 Pacific Graphics 2014 Computer Eng. Depts, 1, 2, Turkey.

CSE554Extrinsic DeformationsSlide 1 CSE 554 Lecture 9: Extrinsic Deformations Fall 2012.

CSE554Extrinsic DeformationsSlide 1 CSE 554 Lecture 10: Extrinsic Deformations Fall 2014.

E IGEN D EFORMATION OF 3 D M ODELS Tamal K. Dey, Pawas Ranjan, Yusu Wang [The Ohio State University] (CGI 2012)

Temporally Coherent Completion of Dynamic Shapes Hao Li, Linjie Luo, Daniel Vlasic, Pieter Peers, Jovan Popović, Mark Pauly, Szymon Rusinkiewicz ACM Transactions.

Modeling the Shape of People from 3D Range Scans

INSTITUTE OF COMPUTING TECHNOLOGYCHINESE ACADEMY OF SCIENCES 1 A Pose-Independent Method of Animating Scanned Human Bodies Yong Yu, Tianlu Mao, Shihong.

Semi-Supervised Hierarchical Models for 3D Human Pose Reconstruction Atul Kanaujia, CBIM, Rutgers Cristian Sminchisescu, TTI-C Dimitris Metaxas,CBIM, Rutgers.

Model base human pose tracking. Papers Real-Time Human Pose Tracking from Range Data Simultaneous Shape and Pose Adaption of Articulated Models using.

Modeling 3D Deformable and Articulated Shapes Yu Chen, Tae-Kyun Kim, Roberto Cipolla Department of Engineering University of Cambridge.

Computer Graphics Group Alexander Hornung Alexander Hornung and Leif Kobbelt RWTH Aachen Robust Reconstruction of Watertight 3D Models from Non-uniformly.

PARAMETRIC RESHAPING OF HUMAN BODIES IN IMAGES SIGGRAPH 2010 Shizhe Zhou Hongbo Fu Ligang Liu Daniel Cohen-Or Xiaoguang Han.

Reverse Engineering Niloy J. Mitra.

Computer Vision Group University of California Berkeley Shape Matching and Object Recognition using Shape Contexts Jitendra Malik U.C. Berkeley (joint.

One-Shot Multi-Set Non-rigid Feature-Spatial Matching

An Optimization Approach to Improving Collections of Shape Maps Andy Nguyen, Mirela Ben-Chen, Katarzyna Welnicka, Yinyu Ye, Leonidas Guibas Computer Science.

Spectral embedding Lecture 6 1 © Alexander & Michael Bronstein

A Study of Approaches for Object Recognition

1 Bronstein 2 and Kimmel Extrinsic and intrinsic similarity of nonrigid shapes Michael M. Bronstein Department of Computer Science Technion – Israel Institute.

Correspondence & Symmetry

Andrei Sharf Dan A. Alcantara Thomas Lewiner Chen Greif Alla Sheffer Nina Amenta Daniel Cohen-Or Space-time Surface Reconstruction using Incompressible.

1 Numerical geometry of non-rigid shapes Spectral Methods Tutorial. Spectral Methods Tutorial 6 © Maks Ovsjanikov tosca.cs.technion.ac.il/book Numerical.

Spectral Embedding Alexander Bronstein, Michael Bronstein

1 Bronstein, Bronstein, and Kimmel Joint extrinsic and intrinsic similarity of non-rigid shapes Rock, paper, and scissors Joint extrinsic and intrinsic.

Recovering Articulated Object Models from 3D Range Data Dragomir Anguelov Daphne Koller Hoi-Cheung Pang Praveen Srinivasan Sebastian Thrun Computer Science.

Face Recognition from Face Motion Manifolds using Robust Kernel RAD Ognjen Arandjelović Roberto Cipolla Funded by Toshiba Corp. and Trinity College, Cambridge.

1 Bronstein 2 & Kimmel An isometric model for facial animation and beyond AMDO, Puerto de Andratx, 2006 An isometric model for facial animation and beyond.

Lijuan Zhao Advisors: Prof. Fatima Merchant Prof. Shishir Shah.

Manifold learning: Locally Linear Embedding Jieping Ye Department of Computer Science and Engineering Arizona State University

Dual Evolution for Geometric Reconstruction Huaiping Yang (FSP Project S09202) Johannes Kepler University of Linz 1 st FSP-Meeting in Graz, Nov ,

Tracking Surfaces with Evolving Topology Morten Bojsen-Hansen IST Austria Hao Li Columbia University Chris Wojtan IST Austria.

Functional maps: A Flexible Representation of Maps Between Shapes SIGGRAPH 2012 Maks Ovsjanikov 1 Mirela Ben-Chen 2 Justin Solomon 2 Adrian Butscher 2.

Modal Shape Analysis beyond Laplacian (CAGP 2012) Klaus Hildebrandt, Christian Schulz, Christoph von Tycowicz, Konrad Polthier (brief) Presenter: ShiHao.Wu.

Shape Matching for Model Alignment 3D Scan Matching and Registration, Part I ICCV 2005 Short Course Michael Kazhdan Johns Hopkins University.

Xiaoguang Han Department of Computer Science Probation talk – D Human Reconstruction from Sparse Uncalibrated Views.

Coarse-to-Fine Combinatorial Matching for Dense Isometric Shape Correspondence Yusuf Sahillioğlu and Yücel Yemez Computer Eng. Dept., Koç University, Istanbul,

CSE554AlignmentSlide 1 CSE 554 Lecture 5: Alignment Fall 2011.

ALIGNMENT OF 3D ARTICULATE SHAPES. Articulated registration Input: Two or more 3d point clouds (possibly with connectivity information) of an articulated.

Expression-invariant Face Recognition using Geodesic Distance Isometries Kerry Widder A Review of ‘Robust expression-invariant face recognition from partially.

INFORMATIK Laplacian Surface Editing Olga Sorkine Daniel Cohen-Or Yaron Lipman Tel Aviv University Marc Alexa TU Darmstadt Christian Rössl Hans-Peter Seidel.

Computer Vision Lab. SNU Young Ki Baik Nonlinear Dimensionality Reduction Approach (ISOMAP, LLE)

Roee Litman, Alexander Bronstein, Michael Bronstein

ISOMAP TRACKING WITH PARTICLE FILTER Presented by Nikhil Rane.

Mesh Coarsening zhenyu shu Mesh Coarsening Large meshes are commonly used in numerous application area Modern range scanning devices are used.

Temporally Coherent Completion of Dynamic Shapes AUTHORS:HAO LI,LINJIE LUO,DANIEL VLASIC PIETER PEERS,JOVAN POPOVIC,MARK PAULY,SZYMON RUSINKIEWICZ Presenter:Zoomin(Zhuming)

Lijuan Zhao Advisors: Prof. Fatima Merchant Prof. Shishir Shah.

H. Lexie Yang1, Dr. Melba M. Crawford2

David Levin Tel-Aviv University Afrigraph 2009 Shape Preserving Deformation David Levin Tel-Aviv University Afrigraph 2009 Based on joint works with Yaron.

Skuller: A volumetric shape registration algorithm for modeling skull deformities Yusuf Sahillioğlu 1 and Ladislav Kavan 2 Medical Image Analysis 2015.

With Tamal Dey, Qichao Que, Issam Safa, Lei Wang, Yusu Wang Computer science and Engineering The Ohio State University Xiaoyin Ge.

Implicit Active Shape Models for 3D Segmentation in MR Imaging M. Rousson 1, N. Paragio s 2, R. Deriche 1 1 Odyssée Lab., INRIA Sophia Antipolis, France.

Affine Registration in R m 5. The matching function allows to define tentative correspondences and a RANSAC-like algorithm can be used to estimate the.

Mesh Segmentation via Spectral Embedding and Contour Analysis Speaker: Min Meng

Parametric Quadratic Optimization Oleksandr Romanko Joint work with Alireza Ghaffari Hadigheh and Tamás Terlaky McMaster University January 19, 2004.

Rongjie Lai University of Southern California Joint work with: Jian Liang, Alvin Wong, Hongkai Zhao 1 Geometric Understanding of Point Clouds using Laplace-Beltrami.

Qifeng Chen Stanford University Vladlen Koltun Intel Labs.

Structure Recovery by Part Assembly Chao-Hui Shen, Hongbo Fu, Kang Chen and Shi-Min Hu Tsinghua University City University of Hong Kong Presented by: Chenyang.

Deformation Modeling for Robust 3D Face Matching Xioguang Lu and Anil K. Jain Dept. of Computer Science & Engineering Michigan State University.

Prior Knowledge for Part Correspondence

Morphing and Shape Processing

Point-wise Map Recovery and Refinement from Functional Correspondence

Spectral Methods Tutorial 6 1 © Maks Ovsjanikov

ISOMAP TRACKING WITH PARTICLE FILTERING

CSE 554 Lecture 10: Extrinsic Deformations

Presentation transcript:

DEPARTMENT OF COMPUTER SCIENCE AND ENGINEERING Automatic Posing of a Meshed Human Model Using Point Clouds Lei Wang Joint work with Tamal K. Dey, Huamin Wang and Bo Fu

DEPARTMENT OF COMPUTER SCIENCE AND ENGINEERING Problem Statement Low-end scanning devices are becoming popular. But quality of their output… Reconstruct from problematic human scans by deforming a prior high quality template mesh

DEPARTMENT OF COMPUTER SCIENCE AND ENGINEERING Related Work Model-based Registration Parametric human body models Registration without a Model Manual intervention Non-rigid registration by nonlinear optimization Isometric deformations: keep geodesic distance unchanged

DEPARTMENT OF COMPUTER SCIENCE AND ENGINEERING Our Method: Outline computing correspondences posingoutput

DEPARTMENT OF COMPUTER SCIENCE AND ENGINEERING Computing Correspondences

DEPARTMENT OF COMPUTER SCIENCE AND ENGINEERING Computing Correspondences The Global Point Signature (GPS) framework by [Rustamov 2007]: Apply Gaussian-weighted Graph Laplacian on the adjacency graph of input point cloud Graph Laplacian GPS in dimension 1, 2 and 3

DEPARTMENT OF COMPUTER SCIENCE AND ENGINEERING Computing Correspondences GPS is invariant under isometric deformation We choose only the first three eigenfunctions

DEPARTMENT OF COMPUTER SCIENCE AND ENGINEERING Computing Correspondences Correspondences are expanded from 5 extremums of aligned GPS embeddings

DEPARTMENT OF COMPUTER SCIENCE AND ENGINEERING Posing Template Mesh Formulated as an energy minimization problem: is the internal energy of template mesh ○ measures difference between template and the point cloud Solved by Invertible FEM [Irving et al. 2004]

DEPARTMENT OF COMPUTER SCIENCE AND ENGINEERING It has two stages Point cloud alignment: deformed by input point cloud Posing Template Mesh Initial alignment: deformed by correspondence

DEPARTMENT OF COMPUTER SCIENCE AND ENGINEERING Posing Template Mesh For efficiency, posing is performed on a simplified template mesh, called control mesh Deformed template is recovered by Mean Value Coordinates [Ju et al. 2005], i.e., weighted sum of the control mesh

DEPARTMENT OF COMPUTER SCIENCE AND ENGINEERING Results

DEPARTMENT OF COMPUTER SCIENCE AND ENGINEERING Results

DEPARTMENT OF COMPUTER SCIENCE AND ENGINEERING Results

DEPARTMENT OF COMPUTER SCIENCE AND ENGINEERING Results (a) input scan (b) our method (c) SCAPE

DEPARTMENT OF COMPUTER SCIENCE AND ENGINEERING Results can be used to control the body size

DEPARTMENT OF COMPUTER SCIENCE AND ENGINEERING Supplementary Video

DEPARTMENT OF COMPUTER SCIENCE AND ENGINEERING Discussion An automatic approach to align a detailed template mesh with human point clouds in different poses Robust to noise and occlusions Sensitive to topological change Can not handle details like fingers Does not run in real-time

DEPARTMENT OF COMPUTER SCIENCE AND ENGINEERING Q & A Thank you!