Rating is available when the video has been rented.
This feature is not available right now. Please try again later.
Published on Jun 29, 2011
Due to occlusions, the estimation of the full pose of a human hand interacting with an object is much more challenging than pose recovery of a hand observed in isolation. In this work we formulate an optimization problem whose solution is the 26-DOF hand pose together with the pose and model parameters of the manipulated object. Optimization seeks for the joint hand-object model that (a) best explains the incompleteness of observations resulting from occlusions due to hand-object interaction and (b) is physically plausible in the sense that the hand does not share the same physical space with the object. The proposed method is the first that solves efficiently the continuous, full-DOF, joint hand-object tracking problem based solely on camera input. Additionally, it is the first to demonstrate how hand-object interaction can be exploited as a context that facilitates hand pose estimation, instead of being considered as a complicating factor. Extensive quantitative and qualitative experiments with simulated and real world image sequences as well as a comparative evaluation with a state-of-the-art method for pose estimation of isolated hands, support the above findings.
Reference: I. Oikonomidis, N. Kyriazis and A.A. Argyros, "Full DOF tracking of a hand interacting with an object by modeling occlusions and physical constraints", to appear in Proceedings of the IEEE International Conference on Computer Vision, ICCV 2011, Barcelona, Spain, 6-13 Nov, 2011.