The whole workshop video is here.
Hand-object interactions (HOI) feature regularly in our daily activities in which we use one hand or two to manipulate objects directly or to use various tools. Through HOI, humans excel in manipulation tasks, master new skills, and adapt to complex and continuously changing environments. Recently, there is a surge of interest in understanding and generating hand-object interaction, to support applications in robotics, augmented reality, and other important fields. Such applications usually require a detailed understanding of hands dynamically interacting with a wide range of objects in 4D (3D space + 1D time), and struggle to synthesize or execute dexterous manipulations in 4D at the same level of skill as humans.
The key goal of this workshop is to assemble experts in 4D vision, hand-object interaction, dexterous manipulation, and animation synthesis to synchronize and coordinate the efforts. First of all, the workshop would help researchers working on 4D HOI understanding to know about dexterous manipulation and tailor their research topics toward interaction-oriented 4D understanding. Secondly, embodied AI researchers could improve their understanding of the limitation of current 4D HOI perception and design their methods properly. Finally, in the workshop we will also host a competition designed for benchmarking the progress of 4D HOI geometric understanding, to invite more researchers to the field.
We have invited a few leading researchers with extensive related experience to make keynote presentations at our workshop. We will also organize a competition to benchmark the current progress of 4D HOI geometric understanding and to also encourage more researchers to join the field. We will organize a panel discussion at the conclusion of our full-day workshop. We envision that such discussions will inspire people and stimulate novel research for 4D hand-object interaction.
In this workshop, we will encourage participating researchers to focus on topics below:
We host an online leaderboard(https://hoi4d.top) through which participants could indicate the track they are working on and submit their results. We will evaluate the submissions on our server and update the leaderboard accordingly
| 01-20 | Announce HOI4D Challenge and call for participants |
| 02-01 | Challenge Begin |
| 06-05 | Challenge Deadline |
| 06-10 | Notification to Authors |
| 06-18 | Workshop |
| Start | End | Event | Speaker |
|---|---|---|---|
| 1:00pm | 1:10pm | Opening Remark | |
| 1:10pm | 1:20pm | HOI4D Challenge overview | |
| 1:20pm | 1:40pm | HOI4D Challenge winner talks | |
| 1:40pm | 2:10pm | Invited Talk | Jitendra Malik |
| 2:10pm | 2:40pm | Handling Complex Hand-Object Manipulations | Vincent Lepetit |
| 2:40pm | 3:10pm | Toward a 3D Understanding of Complex Hand Interactions | Zicong Fan |
| 3:10pm | 4:00pm | Student talk | |
| 4:00pm | 4:30pm | Understanding Hand-Object Interaction in Mixed-Reality | Marc Pollefeys |
| 4:30pm | 5:00pm | Three Lessons from Teaching Dexterity | Lerrel Pinto |
| 5:00pm | 5:30pm | 4D Reconstruction of Human Interaction Motion | Feng Xu |
