Multi-FinGAN: Generative Coarse-To-Fine Sampling of Multi-Finger Grasps

Jens Lundell, Eric Corona, Tran Nguyen Le, Francesco Verdoja, Philippe Weinzaepfel, Grégory Rogez, Francesc Moreno-Noguer, Ville Kyrki

Tutkimustuotos: Artikkeli kirjassa/konferenssijulkaisussaConference contributionScientificvertaisarvioitu

1 Sitaatiot (Scopus)

Abstrakti

While there exists many methods for manipulating rigid objects with parallel-jaw grippers, grasping with multi-finger robotic hands remains a quite unexplored research topic. Reasoning and planning collision-free trajectories on the additional degrees of freedom of several fingers represents an important challenge that, so far, involves computationally costly and slow processes. In this work, we present Multi-FinGAN, a fast generative multi-finger grasp sampling method that synthesizes high quality grasps directly from RGB-D images in about a second. We achieve this by training in an end-to-end fashion a coarse-to-fine model composed of a classification network that distinguishes grasp types according to a specific taxonomy and a refinement network that produces refined grasp poses and joint angles. We experimentally validate and benchmark our method against a standard grasp-sampling method on 790 grasps in simulation and 20 grasps on a real Franka Emika Panda. All experimental results using our method show consistent improvements both in terms of grasp quality metrics and grasp success rate. Remarkably, our approach is up to 20-30 times faster than the baseline, a significant improvement that opens the door to feedback-based grasp re-planning and task informative grasping. Code is available at https://irobotics.aalto.fi/multi-fingan/.
AlkuperäiskieliEnglanti
OtsikkoProceedings of IEEE International Conference on Robotics and Automation, ICRA 2021
KustantajaIEEE
Sivut4495-4501
Sivumäärä7
ISBN (elektroninen)9781728190778
ISBN (painettu)9781728190785
DOI - pysyväislinkit
TilaJulkaistu - 18 lokak. 2021
OKM-julkaisutyyppiA4 Artikkeli konferenssijulkaisuussa
TapahtumaIEEE International Conference on Robotics and Automation - Xi'an, Kiina
Kesto: 30 toukok. 20215 kesäk. 2021

Conference

ConferenceIEEE International Conference on Robotics and Automation
LyhennettäICRA
Maa/AlueKiina
KaupunkiXi'an
Ajanjakso30/05/202105/06/2021

Sormenjälki

Sukella tutkimusaiheisiin 'Multi-FinGAN: Generative Coarse-To-Fine Sampling of Multi-Finger Grasps'. Ne muodostavat yhdessä ainutlaatuisen sormenjäljen.

Siteeraa tätä