"Free at Last" Living Geometry Dr Yann Savoye Innsbruck University POEMS 15: Polytopal Element Methods in Mathematics and Engineering October 30, 2015 www.animlife.com
Content 1. Introduction 2. Background and Related Work 3. Inversion 4. Reskinning 5. Registration 6. Stylization 7. Conclusions 1 October 30, 2015 Dr Yann Savoye #2
Bringing Life to Creatures Capturing Life-Like Dynamic Geometry Into Deformable Cages. A new Graphics-To-Vision Strategy built around the cage-based scheme. Several Technical Tools in Shape Modeling, Animation, 4D Vision. October 30, 2015 Dr Yann Savoye #3
Bringing Life to Creatures October 30, 2015 Dr Yann Savoye #4
Technical Pillars October 30, 2015 Dr Yann Savoye #5
Inspired from Traditional Animation October 30, 2015 Dr Yann Savoye #6
Content 1. Introduction 2. Background and Related Work 3. Inversion 4. Reskinning 5. Registration 6. Stylization 7. Conclusions 2 October 30, 2015 Dr Yann Savoye #7
Performance Capture. October 30, 2015 Dr Yann Savoye #8
Deformation Mean Value Coordinates Ju et al 05 Variational Harmonics Ben Chen et al 09 Harmonic Coordinates Joshi et al 07 Green Coordinates Lipman et al 08 Biharmonic Coordinates Jacobson et al 07 October 30, 2015 Dr Yann Savoye #9
Mean Value Coordinates Mean Value Coordinates for Closed Triangular Meshes Ju et al 05 October 30, 2015 Dr Yann Savoye #10
Green Coordinates Green Coordinates Lipman et al 08 October 30, 2015 Dr Yann Savoye #11
Harmonic Coordinates Harmonic Coordinates for Character Articulation Joshi et al 07 October 30, 2015 Dr Yann Savoye #12
Presentation Overview Modeling Reskinning Registration Stylization Interactive Modeling (User-Specified) Animation Reskinning (Temporally Data-Driven) Space-Time Capture (Video-based, Unsupervized) Surface Exaggeration ( Space-Time Filtering ) October 30, 2015 Dr Yann Savoye #13
Presentation Overview Modeling Reskinning Registration Stylization Graphics Vision October 30, 2015 Dr Yann Savoye #14
Presentation Overview Modeling Reskinning Registration Stylization Graphics-To-Vision Strategy: Relaxing the prior knowledge on the data October 30, 2015 Dr Yann Savoye #15
Content 1. Introduction 2. Background and Related Work 3. Inversion 4. Reskinning 5. Registration 6. Stylization 7. Conclusions 3 October 30, 2015 Dr Yann Savoye #16
Modeling Modeling Reskinning Registration Stylization Objective: Introduction of a core inverse cage-based technique. October 30, 2015 Dr Yann Savoye #17
Interactive Shape Modeling Laplacian Mesh Editing Sorkine et al 05 Volumetric Graph Laplacian Zhou et al 05 As Rigid As Possible Sorkine et al 07 Mesh IK Sumner et al 05 October 30, 2015 Dr Yann Savoye #18
Inverse Modeling Sparse Contraints Default Pose Resulting Deformation October 30, 2015 Dr Yann Savoye #19
Inverse Modeling Least-Square Cage (regularisation term) October 30, 2015 Dr Yann Savoye #20
Inverse Modeling Differential Cage Coordinates Laplacian Cage Operator October 30, 2015 Dr Yann Savoye #21
Inverse Modeling User-Specified Deforming Constraints October 30, 2015 Dr Yann Savoye #22
GPU Barycentric Map October 30, 2015 Dr Yann Savoye #23
Inverse Modeling Fitting October 30, 2015 Dr Yann Savoye #24
Inverse Modeling Sparse Linear Least-Square Fitting October 30, 2015 Dr Yann Savoye #25
Content 1. Introduction 2. Background and Related Work 3. Inversion 4. Reskinning 5. Registration 6. Stylization 7. Conclusions 4 October 30, 2015 Dr Yann Savoye #26
Reskinning Modeling Reskinning Registration Stylization Objective: Introduction of a core space-time cage fitting technique. October 30, 2015 Dr Yann Savoye #27
Surface Performance Capture Surface Capture Starck and Hilton 07 Performance Capture De Aguiar et al. 08 Skin Capture Park and Hodgins 06 October 30, 2015 Dr Yann Savoye #28
Highly Non-Rigid Surfaces October 30, 2015 Dr Yann Savoye #29
Generic and Shape-Aware Cages October 30, 2015 Dr Yann Savoye #30
Harmonic Rigging Cage-Model Setup Cage Voxelization Volumetric Heat diffusion Harmonic Coordinates October 30, 2015 Dr Yann Savoye #31
Performance Animation Space-Time Cage Optimization October 30, 2015 Dr Yann Savoye #32
Silhouette Consistency Evaluation: Silhouette Consistency October 30, 2015 Dr Yann Savoye #33
Content 1. Introduction 2. Background and Related Work 3. Inversion 4. Reskinning 5. Registration 6. Stylization 7. Conclusions 5 October 30, 2015 Dr Yann Savoye #34
Registration Modeling Reskinning Registration Stylization Objective: Extending the system toward unaligned geometric targets. October 30, 2015 Dr Yann Savoye #35
Geometric Reconstruction Polyhedral Visual Hull Matusik et al 01 Watertight Reconstruction Hornung et al 07 Multi-view Stereo Liu et al 10 October 30, 2015 Dr Yann Savoye #36
Geometric Registration Piecewise Rigid registration Pekelny et al 08 Non-Rigid Registration Li et al 08 Patch-based Registration Budd et al 10 October 30, 2015 Dr Yann Savoye #37
Target Geometry from Silhouettes Camera Projection Operator Silhouette-based Visual Cone Voxel-based Visual Hull October 30, 2015 Dr Yann Savoye #38
Volumetric Shape Carving October 30, 2015 Dr Yann Savoye #39
Watertight Surface Polygonization Temporally Inconsistent Surface Laplacian Surface Smoothing Oriented Target Point Clouds October 30, 2015 Dr Yann Savoye #40
Target Geometry from Silhouettes October 30, 2015 Dr Yann Savoye #41
Normal-Guided Correspondences Normal-Guided Pruning. Standard Shepard Interpolation for compatible candidates. Locally Weighted Correspondences. October 30, 2015 Dr Yann Savoye #42
Biharmonic Overlapping Fields Biharmonic Coordinates Per-Handle Biharmonic Field Flexible Local Rigidity Field October 30, 2015 Dr Yann Savoye #43
Elasto-Plastic Optimization Re-Weighted Iterative Subspace Solver October 30, 2015 Dr Yann Savoye #44
Template Registration October 30, 2015 Dr Yann Savoye #45
Space-Time Output Surface October 30, 2015 Dr Yann Savoye #46
Content 1. Introduction 2. Background and Related Works 3. Inversion 4. Reskinning 5. Registration 6. Stylization 7. Conclusions 6 October 30, 2015 Dr Yann Savoye #47
Stylization Modeling Reskinning Registration Stylization Objective: Exaggerating surface motion by cage-based filtering. October 30, 2015 Dr Yann Savoye #48
Shape Exaggeration Input Animation Mesh Sequence Conversion Temporal Cage Parameters Filtering October 30, 2015 Dr Yann Savoye #49
Shape Exaggeration October 30, 2015 Dr Yann Savoye #50
Content 1. Introduction 2. Background and Related Work 3. Inversion 4. Reskinning 5. Registration 6. Stylization 7. Conclusions 7 October 30, 2015 Dr Yann Savoye #51
Conclusions Capturing Life-Like Dynamic Geometry Into Cages. A new Graphics-To-Vision Strategy built around the cage-based scheme. Several Technical Tools in Shape Modeling, Animation, 4D Vision. Registration / Filtering / Reskinning. Fitting And Non-Rigid ICP Scheme. Unsupervized Correspondences and Watertight Point Cloud. Silhouette-Awareness and Shape-Awareness. Scalability / Interactivity / Linearity / Efficiency / Simplicity. October 30, 2015 Dr Yann Savoye #52
Caged or not caged? Even if shapes are enclosed inside cages, highly non-rigid deformation is allowed by a few degree of freedom shapes are free at last! October 30, 2015 Dr Yann Savoye #53
To add fuel to the fire Performance Capture Studies in Computational Intelligence vol 509 Springer Book October 30, 2015 Dr Yann Savoye #54