A Dynamical System Approach for Adaptive Grasping, Navigation and Co-Manipulation with Humanoid Robots
In this work , we present an integrated approach that provides compliant control of an iCub humanoid robot and adaptive reaching, grasping, navigating and co-manipulating. We use state-dependent dynamical systems (DS) to (i) coordinate and drive the robot's hands an object in position and orientation to grasp an object , and (ii) drive the robot's base while walking/navigating. The use of DS as motion generators allows us to adapt smoothly as the object moves and to re-plan on-line motion of arms and body to reach the object's new location. The desired trajectory generated by the DS are used in combination with a whole-body compliant control strategy that absorbs perturbations while walking  and offers compliant behaviors for grasping and manipulation tasks . The desired dynamics for arm and body can be learned from demonstrations . By integrating these components we achieve unprecedented adaptive behaviors for whole body manipulation. We showcase this in simulations and real-world experiments where iCub robots (i) walk-to-grasp objects, (ii) follow a human (or another iCub) through interaction and (iii) learn to navigate or co-manipulate an object from human guided demonstrations; whilst being robust to changing targets and perturbations.
In more detail, the novelty of this work lies in the integration and extension of three sets of
techniques developed previously by the coauthors, namely DS-based coordinated planning of reach to grasp motion
, whole-body balancing  and compliant walking . Finally, we use the adaptive walking approach to collect
trajectories and use them to learn desired complex navigation
tasks with a state-of-the-art DS-based learning scheme 
Video of Approach and Robot Experiments
Supplementary video for ICRA submission:
Complementary video for adaptive co-manipulation with master-slave strategy simulation:
Complementary video for co-manipulation with learned DS:
Following we list all of the code repositories made available for this project, including:
 Figueroa, N., Faraji, S., Koptev, M. and Billard, A. (2019) “A Dynamical System Approach for Adaptive Grasping, Navigation and Co-Manipulation with Humanoid Robots”. In proceedings of the IEEE International Conference on Robotics and Automation (ICRA-2020). Paris, France pdf-link
 S. Mirrazavi, N. Figueroa, and A. Billard, “A unified framework for coordinated multi-arm motion planning,” The International Journal of Robotics Research, vol. 37, no. 10, pp. 1205–1232, 2018.
 S. Faraji, P. Mullhaupt, and A. Ijspeert, “Imprecise dynamic walking with time-projection control,” arxiv, 2018.
 S. Faraji and A. J. Ijspeert, “Singularity-tolerant inverse kinematics for bipedal robots: An efficient use of computational power to reduce energy consumption,” IEEE Robotics and Automation Letters, vol. 2, no. 2, pp. 1132–1139, April 2017.
 N. Figueroa and A. Billard, “A physically-consistent bayesian non-parametric mixture model for dynamical system learning,” in Proceedings of The 2nd Conference on Robot Learning, ser. Proceedings of Machine Learning Research, vol. 87. PMLR, 29–31 Oct 2018, pp. 927–946 .