Anatomy and Geometry Constrained One-Stage Framework for 3D Human Pose Estimation

Xin Cao (Shanghai JiaoTong University), Xu Zhao (Shanghai Jiao Tong University)*

Keywords: 3D Computer Vision

Abstract: Although significant progress has been achieved in monocular3D human pose estimation, the correlation between body parts andcross-view geometry consistency have not been well studied. In this work,to fully explore the priors on body structure and view-relationship for3D human pose estimation, we propose an anatomy and geometry constrainedone-stage framework. First of all, we define a kinematic structuremodel in deep learning framework which represents the joint positionsin a tree-structure model. Then we propose bone-length and bone-symmetrylosses based on the anatomy prior, to encode the body structureinformation. To further explore the cross-view geometry information,we introduce a novel training mechanism for multi-view consistencyconstraints, which effectively reduces unnatural and implausible estimationresults. The proposed approach achieves state-of-the-art results onboth Human3.6M and MPI-INF-3DHP data sets.

SlidesLive

Similar Papers

Self-Supervised Multi-View Synchronization Learning for 3D Pose Estimation
Simon Jenni (Universität Bern)*, Paolo Favaro (University of Bern)
Speech2Video Synthesis with 3D Skeleton Regularization and Expressive Body Poses
Miao Liao (Baidu)*, Sibo Zhang (Baidu), Peng Wang (Baidu USA LLC.), Hao Zhu (Nanjing University), Xinxin Zuo (University of Kentucky), Ruigang Yang (University of Kentucky, USA)
End-to-end Model-based Gait Recognition
Xiang Li (Nanjing University of Science and Technology)*, Yasushi Makihara ("""Osaka University, Japan"""), Chi Xu (Nanjing University of Science and Technology), Yasushi Yagi (Osaka University), Shiqi Yu (Southern University of Science and Technology, China), Mingwu Ren (Nanjing University of Science and Technology)