Exploring the space of human body shapes: data-driven synthesis under anthropometric control Brett Allen Brian Curless Zoran Popović University of Washington.

Slides:



Advertisements
Similar presentations
3D Morphing using Multiplanar Representation
Advertisements

Layered Acting for Character Animation By Mira Dontcheva Gary Yngve Zoran Popović presented by Danny House SIGGRAPH 2003.
Temporally Coherent Completion of Dynamic Shapes Hao Li, Linjie Luo, Daniel Vlasic, Pieter Peers, Jovan Popović, Mark Pauly, Szymon Rusinkiewicz ACM Transactions.
Learning to estimate human pose with data driven belief propagation Gang Hua, Ming-Hsuan Yang, Ying Wu CVPR 05.
Learning a correlated model of identity and pose-dependent body shape variation for real-time synthesis Brett Allen 1,2, Brian Curless 1, Zoran Popović.
Modeling the Shape of People from 3D Range Scans
3D Shape Representation Tianqiang 04/01/2014. Image/video understanding Content creation Why do we need 3D shapes?
A Probabilistic Model for Component-Based Shape Synthesis Evangelos Kalogerakis, Siddhartha Chaudhuri, Daphne Koller, Vladlen Koltun Stanford University.
Modeling 3D Deformable and Articulated Shapes Yu Chen, Tae-Kyun Kim, Roberto Cipolla Department of Engineering University of Cambridge.
Zen and the Art of Facial Image Quality Terry P. Riopka.
Xianfeng Gu, Yaling Wang, Tony Chan, Paul Thompson, Shing-Tung Yau
PARAMETRIC RESHAPING OF HUMAN BODIES IN IMAGES SIGGRAPH 2010 Shizhe Zhou Hongbo Fu Ligang Liu Daniel Cohen-Or Xiaoguang Han.
Computing 3D Geometry Directly From Range Images Sarah F. Frisken and Ronald N. Perry Mitsubishi Electric Research Laboratories.
A 4-WEEK PROJECT IN Active Shape and Appearance Models
Reverse Engineering Niloy J. Mitra.
Sam Pfister, Stergios Roumeliotis, Joel Burdick
Physically Based Motion Transformation Zoran Popović Andrew Witkin SIGGRAPH ‘99.
Capturing Facial Details by Space- time Shape-from-shading Yung-Sheng Lo *, I-Chen Lin *, Wen-Xing Zhang *, Wen-Chih Tai †, Shian-Jun Chiou † CAIG Lab,
Introduction to Data-driven Animation Jinxiang Chai Computer Science and Engineering Texas A&M University.
Exchanging Faces in Images SIGGRAPH ’04 Blanz V., Scherbaum K., Vetter T., Seidel HP. Speaker: Alvin Date: 21 July 2004.
Example Based 3D Shape Completion Mark Pauly 1,2, Niloy J. Mitra 1, Joachim Giesen 2, Markus Gross 2, Leonidas J. Guibas 1 1 Stanford University 2 ETH,
Technion - Israel Institute of Technology 1 On Interpolation Methods using Statistical Models RONEN SHER Supervisor: MOSHE PORAT.
The space of human body shapes: reconstruction and parameterization from range scans Brett Allen Brian Curless Zoran Popović University of Washington.
Technion - Israel Institute of Technology 1 On Interpolation Methods using Statistical Models RONEN SHER Supervisor: MOSHE PORAT.
Real-time Combined 2D+3D Active Appearance Models Jing Xiao, Simon Baker,Iain Matthew, and Takeo Kanade CVPR 2004 Presented by Pat Chan 23/11/2004.
Multi-Scale Analysis for Network Traffic Prediction and Anomaly Detection Ling Huang Joint work with Anthony Joseph and Nina Taft January, 2005.
Curve Analogies Aaron Hertzmann Nuria Oliver Brain Curless Steven M. Seitz University of Washington Microsoft Research Thirteenth Eurographics.
Face Recognition Based on 3D Shape Estimation
Recovering Articulated Object Models from 3D Range Data Dragomir Anguelov Daphne Koller Hoi-Cheung Pang Praveen Srinivasan Sebastian Thrun Computer Science.
Surface Light Fields for 3D Photography Daniel N. Wood University of Washington SIGGRAPH 2001 Course.
Composition of complex optimal multi-character motions C. Karen Liu Aaron Hertzmann Zoran Popović.
The Planar-Reflective Symmetry Transform Princeton University.
Facial Type, Expression, and Viseme Generation Josh McCoy, James Skorupski, and Jerry Yee.
Accurate, Dense and Robust Multi-View Stereopsis Yasutaka Furukawa and Jean Ponce Presented by Rahul Garg and Ryan Kaminsky.
1 Extension of the Scope of Large 3D Anthropometric Data Pools for Product Development Athens, 19/03/2014.
A Practical System for Modelling Body Shapes from Single View Measurements Yu Chen 1, Duncan Robertson 2, Roberto Cipolla 1 Department of Engineering,
IE 594 : Research Methodology – Discrete Event Simulation David S. Kim Spring 2009.
Laplacian Surface Editing
Computer Graphics Group Tobias Weyand Mesh-Based Inverse Kinematics Sumner et al 2005 presented by Tobias Weyand.
Automatic Registration of Color Images to 3D Geometry Computer Graphics International 2009 Yunzhen Li and Kok-Lim Low School of Computing National University.
Use and Re-use of Facial Motion Capture M. Sanchez, J. Edge, S. King and S. Maddock.
1 ECE 738 Paper presentation Paper: Active Appearance Models Author: T.F.Cootes, G.J. Edwards and C.J.Taylor Student: Zhaozheng Yin Instructor: Dr. Yuhen.
Navigation, Visualization and Searching in Databases of Full Body 3D Scans Marc Rioux, Eric Paquet, and Zouhour Benazouz Visual Information Technology,
Automatic Locating of Anthropometric Landmarks on 3D Human Models
Temporally Coherent Completion of Dynamic Shapes AUTHORS:HAO LI,LINJIE LUO,DANIEL VLASIC PIETER PEERS,JOVAN POPOVIC,MARK PAULY,SZYMON RUSINKIEWICZ Presenter:Zoomin(Zhuming)
CPSC : Data-driven Computer Graphics Jinxiang Chai.
The Planar-Reflective Symmetry Transform Princeton University.
(c) 2000, 2001 SNU CSE Biointelligence Lab Finding Region Another method for processing image  to find “regions” Finding regions  Finding outlines.
Subject Name: Computer Graphics Subject Code: Textbook: “Computer Graphics”, C Version By Hearn and Baker Credits: 6 1.
Skuller: A volumetric shape registration algorithm for modeling skull deformities Yusuf Sahillioğlu 1 and Ladislav Kavan 2 Medical Image Analysis 2015.
Outline ● Introduction – What is the problem ● Generate stochastic textures ● Improve realism ● High level approach - Don't just jump into details – Why.
David Kennedy.  In the past MMC systems used passive models with video systems used for motion capture.  But with these systems automatic and accuracy.
1 Tom Edgar’s Contribution to Model Reduction as an introduction to Global Sensitivity Analysis Procedure Accounting for Effect of Available Experimental.
X3D: Real Time 3D Solution for the web Web3D Tech Talk – Aug 13, SIGGRAPH 2008 X3D: Real Time 3D Solution for the web Web3D Tech Talk – Aug 13, SIGGRAPH.
Outline ● Introduction – What is the problem ● Generate stochastic textures ● Improve realism ● High level approach - Don't just jump into details – Why.
Eigen Texture Method : Appearance compression based method Surface Light Fields for 3D photography Presented by Youngihn Kho.
1 Review and Summary We have covered a LOT of material, spending more time and more detail on 2D image segmentation and analysis, but hopefully giving.
Contrast optimization for structure-from-motion surveys James O’Connor 1 Mike Smith 1, Mike R. James
Accuracy of 3D Scanning Technologies in a Face Scanning Scenario Chris Boehnen and Patrick Flynn University of Notre Dame.
Shape2Pose: Human Centric Shape Analysis CMPT888 Vladimir G. Kim Siddhartha Chaudhuri Leonidas Guibas Thomas Funkhouser Stanford University Princeton University.
Danfoss Visual Inspection System
Fusion, Face, HD Face Matthew Simari | Program Manager, Kinect Team
Outline S. C. Zhu, X. Liu, and Y. Wu, “Exploring Texture Ensembles by Efficient Markov Chain Monte Carlo”, IEEE Transactions On Pattern Analysis And Machine.
Techniques for studying correlation and covariance structure
Scale-Space Representation for Matching of 3D Models
A Volumetric Method for Building Complex Models from Range Images
Scale-Space Representation for Matching of 3D Models
Wavelet-based Compression of 3D Mesh Sequences
Noise Robust Surface Reconstruction by Combining PU and Graph-cut
Statistical 3D Face Modeling
Presentation transcript:

Exploring the space of human body shapes: data-driven synthesis under anthropometric control Brett Allen Brian Curless Zoran Popović University of Washington

Motivation Traditional anthropometry has focused on sets of one-dimensional measurements.

Motivation Full body shape capture promises to advance the state of the art. ?

CAESAR Civilian American & European Surface Anthropometry Resource thousands of subjects in the U.S. and Europe traditional anthropometry demographic survey laser range scans We’ll use 250 of these scans (125 male, 125 female).

Scan detail ~250,000 triangles incomplete coverage surface color 74 markers

Overview 1. Introduction 2. Building a model 3. Synthesis & editing

Overview 1. Introduction 2. Building a model 3. Synthesis & editing

The Correspondence Problem

Matching algorithm scantemplate Find the shape that: 1. Matches the template markers to the scanned markers 2. Moves template vertices to scanned surface 3. Minimizes the deformation

Matching algorithm

Overview 1. Introduction 2. Building a model 3. Synthesis & editing

Statistical analysis x0x0 y0y0 z0z0 x1x1 y1y1 z1z1 x2x2 x0x0 y0y0 z0z0 x1x1 y1y1 z1z1 x2x2 x0x0 y0y0 z0z0 x1x1 y1y1 z1z1 x2x2 average male mean + PCA component #1

mean + PCA component #2 Statistical analysis x0x0 y0y0 z0z0 x1x1 y1y1 z1z1 x2x2 x0x0 y0y0 z0z0 x1x1 y1y1 z1z1 x2x2 x0x0 y0y0 z0z0 x1x1 y1y1 z1z1 x2x2 average male

Statistical analysis x0x0 y0y0 z0z0 x1x1 y1y1 z1z1 x2x2 x0x0 y0y0 z0z0 x1x1 y1y1 z1z1 x2x2 x0x0 y0y0 z0z0 x1x1 y1y1 z1z1 x2x2 average male mean + PCA component #3

PCA reconstruction

Fitting to attributes We can correlate the PCA reconstructions of our scanned people with known attributes:

Fitting to attributes

Fitting to points Using the distribution of the PCA weights as a prior, we can find the most likely person that fits a set of point constraints. PCA varianceuser constraint optimized reconstruction

Summary Contributions: - an algorithm for creating a consistent mesh representation from range scan data. - several ways to explore the variation in human body shape, and to synthesize and edit body models

Future work - analyze shape variation between poses

Future work - combine with anatomical models and physical simulation Aubel

Acknowledgments - Kathleen Robinette and the CAESAR project - Ethel Evans - Domi Pitturo - Daniel Wood - NSF - NSERC - Microsoft Research, Electronic Arts, Sony - University of Washington Animation Research Labs