Real-time Joint Tracking of a Hand Manipulating an Object from RGB-D Input

Srinath Sridhar, Franziska Mueller, Michael Zollhöfer, Dan Casas, Antti Oulasvirta, Christian Theobalt

Tutkimustuotos: Artikkeli kirjassa/konferenssijulkaisussaConference contributionScientificvertaisarvioitu

61 Sitaatiot (Scopus)
194 Lataukset (Pure)

Abstrakti

Real-time simultaneous tracking of hands manipulating and interacting with external objects has many potential applications in augmented reality, tangible computing, and wearable computing. However, due to difficult occlusions, fast motions, and uniform hand appearance, jointly tracking hand and object pose is more challenging than tracking either of the two separately. Many previous approaches resort to complex multi-camera setups to remedy the occlusion problem and often employ expensive segmentation and optimization steps which makes real-time tracking impossible. In this paper, we propose a real-time solution that uses a single commodity RGB-D camera. The core of our approach is a 3D articulated Gaussian mixture alignment strategy tailored to hand-object tracking that allows fast pose optimization. The alignment energy uses novel regularizers to address occlusions and hand-object contacts. For added robustness, we guide the optimization with discriminative part classification of the hand and segmentation of the object. We conducted extensive experiments on several existing datasets and introduce a new annotated hand-object dataset. Quantitative and qualitative results show the key advantages of our method: speed, accuracy, and robustness.
AlkuperäiskieliEnglanti
OtsikkoComputer Vision - ECCV 2016
Alaotsikko14th European Conference, Amsterdam, The Netherlands, October 11-14, 2016 : proceedings, part 2
ToimittajatBastian Leibe, Jiri Matas, Nicu Sebe, Max Welling
Sivut294-310
Sivumäärä17
ISBN (elektroninen)978-3-319-46475-6
DOI - pysyväislinkit
TilaJulkaistu - 1 lokakuuta 2016
OKM-julkaisutyyppiA4 Artikkeli konferenssijulkaisuussa
TapahtumaEuropean Conference on Computer Vision - Amsterdam, Alankomaat
Kesto: 11 lokakuuta 201614 lokakuuta 2016
Konferenssinumero: 14

Julkaisusarja

NimiLECTURE NOTES IN COMPUTER SCIENCE
KustantajaSpringer
Numero9906
ISSN (painettu)0302-9743
ISSN (elektroninen)1611-3349

Conference

ConferenceEuropean Conference on Computer Vision
LyhennettäECCV
MaaAlankomaat
KaupunkiAmsterdam
Ajanjakso11/10/201614/10/2016

Sormenjälki Sukella tutkimusaiheisiin 'Real-time Joint Tracking of a Hand Manipulating an Object from RGB-D Input'. Ne muodostavat yhdessä ainutlaatuisen sormenjäljen.

Siteeraa tätä