3D human body shape and motion tracking by LBS and snake

A new framework combining Snake deformable model with LBS (Linear Blend Skinning) is proposed for both 3D human body shape and motion tracking. First, skinned mesh model of object is established. Then surface mesh with highly improved quality is obtained by using our new silhouette-based visual hull reconstruction method for each frame of multi-view videos. After that, articulated ICP registration method is used to capture the 3D human body shape and motion under Skeletal Subspace Deformation. Furthermore, the multi-view silhouettes are applied again for Snake external force computation, and then the vertices of surface mesh are moved to approach the target object under silhouette and internal forces. Synthetic data with ground-truth is used for quantitative comparison, and experimental results show that the tracking accuracy is improved since both 3D and 2D error constraints are used.