InterHand2.6M: A Dataset and Baseline for 3D Interacting Hand Pose Estimation from a Single RGB Image

European Conference on Computer Vision (ECCV)


Analysis of hand-hand interactions is a crucial step towards better understanding human behavior. However, most researches in 3D hand pose estimation have focused on the isolated single hand case. Therefore, we firstly propose (1) a large-scale dataset, InterHand2.6M, and (2) a baseline network, InterNet, for 3D interacting hand pose estimation from a single RGB image. The proposed InterHand2.6M consists of 2.6M labeled single and interacting hand frames under various poses from multiple subjects. Our InterNet simultaneously performs 3D single and interacting hand pose estimation. In our experiments, we demonstrate big gains in 3D interacting hand pose estimation accuracy when leveraging the interacting hand data in InterHand2.6M. We also report the accuracy of InterNet on InterHand2.6M, which serves as a strong baseline for this new dataset. Finally, we show 3D interacting hand pose estimation results from general images. Our code and dataset are available.

Related Publications

All Publications

Compacted CPU/GPU Data Compression via Modified Virtual Address Translation

Larry Seiler, Daqi Lin, Cem Yuksel

High Performance Graphics - August 15, 2020

Neuro-Symbolic Generative Art: A Preliminary Study

Gunjan Aggarwal, Devi Parikh

ICCC - September 7, 2020

Numerical simulations of near-field head-related transfer functions: Magnitude verification and validation with laser spark sources

Sebastian T. Prepeliţă, Javier Gómez Bolaños, Ville Pulkki, Lauri Savioja, Ravish Mehra

Journal of the Acoustical Society of America - July 10, 2020

A Hybrid Active-Passive Actuation and Control Approach for Kinesthetic Handheld Haptics

Patrick Dills, Nick Colonnese, Priyanshu Agarwal, Michael Zinn

Haptics Symposium - May 12, 2020

To help personalize content, tailor and measure ads, and provide a safer experience, we use cookies. By clicking or navigating the site, you agree to allow our collection of information on and off Facebook through cookies. Learn more, including about available controls: Cookies Policy