Machine Intelligence

One of our core research themes is the development of novel machine learning paradigms that enable complex dynamical systems with the ability to learn its self, how to interact with the world and to autonomously acquire and generalize knowledge. For this, the integration of nonlinear control theory and machine learning with intelligent data representations opens up entirely new perspectives and avenues in generating machine intelligence. Although this discipline is still in its early days there is a surprisingly high number of robotic problems that can be processed with existing results.

Contributions

Overall, our group develops machine learning for embodied systems approaches in a variety of areas. A central field has been learning tactile manipulation [160]. We introduced a skill formalism [161] that reduces the skill solution parameter space via a Parameter Space Partitioning (PSP) algorithm to a reasonable area that allows to express the solution with significantly less parameters [148]. This makes the learning of the reduced number of parameters more manageable via data-driven methods and allows to reliably learn and solve tasks such as peg-in-hole and key-in-lock with only a few trials. We have also exploited the capabilities of tactile robots to learn to detect and classify contacts [162, 163] via neural networks (NN) and other machine learning methods. The results demonstrated that NNs can be trained to detect collisions and discriminate between the collided materials, even with different human body parts [164]. Another of our research areas focuses grasp planning and learning where, in recent work [165], we introduced a segmented-mesh-based approach using objects and human knowledge as center pieces for grasping posture prediction. Our results generated feasible posture estimations in objects which are significantly different than the ones used as training samples. Furthermore, in the area of learning optimal controllers from optimal control [59] we developed supervised learning methods that use numerical solutions of optimal control problems to generate training data for learning a function approximate to an optimal controller. This Learning from Optimal Control (LfOC) approach has been successfully demonstrated for real-time quadrotor aggressive maneuvers[166] and throwing/reaching tasks for robotic manipulators [98].

Additionally, we work on the area of physics-informed machine learning, in particular we work on the translation of conventional system identification methods into a sequence of learning modules that enable robots to acquire their body model [21]. Our results have, for instance, enabled the online learning of physically feasible parameters for robot manipulators [169] or learning the entire morphology from proprioceptive sensing only [170]. Finally, we research on evolutionary robot synthesis involves the use of machine learning to enable the training of design models, which automatically generate robot parts and sub-systems to fulfill the requirements of new tasks and environmental conditions and execute a defined set of tasks time and cost efficient compared to traditional design adaptation approaches. We integrate model-based compliant control approaches with human neuromusculoskeletal models and learning algorithms [68]. Technology transfer is a core focus of our group; therefore, we work with industry and clinical partners to test our systems in the field as early as possible.

[21] Fernando Díaz Ledezma and Sami Haddadin. “FOP Networks for Learning Humanoid Body Schema and Dynamics”. In: 2018 IEEE-RAS 18th International Conference on Humanoid Robots (Humanoids). 2018, pp. 1–9. 

[59] Sami Haddadin, Roman Weitschat, Felix Huber, Can Mehmet Özparpucu, Nico Mansfeld, and Alin Albu-Schäffer. “Optimal Control for Viscoelastic Robots and its Generalization in RealTime”. In: International Symposium on Robotics Research (ISRR). 2013. 

[68] Kim K. Peper, Dinmukhamed Zardykhan, Marion Egger, Martina Steinböck, Friedemann Müller, Xavier Hildenbrand, Alexander Koenig, Elisabeth R. Jensen, and Sami Haddadin. “Testing RobotBased Assist-as-Needed Therapy for Improving Active Participation of a Patient during Early Neurorehabilitation: A Case Study”. In: 2022 International Conference on Rehabilitation Robotics (ICORR). Rotterdam, Netherlands: IEEE Press, 2022, pp. 1–6. 

[98] Sami Haddadin, Roman Weitschat, Felix Huber, Mehmet Can Özparpucu, Nico Mansfeld, and Alin Albu-Schäffer. “Optimal control for viscoelastic robots and its generalization in real-time”. In: Robotics Research. Springer, 2016, pp. 131–148.

[148] Florian Voigt, Lars Johannsmeier, and Sami Haddadin. “Multi-Level Structure vs. End-to-End Learning in High-Performance Tactile Robotic Manipulation.” In: CoRL. 2020, pp. 2306–2316. 

[160] Sami Haddadin and Lars Johannsmeier. “The Art of Manipulation: Learning to Manipulate Blindly”. In: 2018 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS). 2018, pp. 1–9. 

[161] Lars Johannsmeier, Malkin Gerchow, and Sami Haddadin. “A framework for robot manipulation: Skill formalism, meta learning and adaptive control”. In: 2019 International Conference on Robotics and Automation (ICRA). IEEE. 2019, pp. 5844–5850. 

[162] Carlos Magno CO Valle, Alexander Kurdas, Edmundo Pozo Fortunic, Saeed Abdolshah, and ´ Sami Haddadin. “Real-time IMU-Based Learning: a Classification of Contact Materials”. In: 2022 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS). IEEE. 2022, pp. 1965–1971. 

[163] Saskia Golz, Christian Osendorfer, and Sami Haddadin. “Using tactile sensation for learning contact knowledge: Discriminate collision from physical interaction”. In: Robotics and Automation (ICRA), 2015 IEEE International Conference on. May 2015, pp. 3788–3794. 

[164] Elie Aljalbout, Ji Chen, Konstantin Ritt, Maximilian Ulmer, and Sami Haddadin. “Learning Vision-based Reactive Policies for Obstacle Avoidance”. In: Conference on Robot Learning (CoRL). 2020.

[165] Diego Hidalgo-Carvajal, Carlos Magno CO Valle, Abdeldjallil Naceri, and Sami Haddadin. “ObjectCentric Grasping Transferability: Linking Meshes to Postures”. In: 2022 IEEE-RAS 21st International Conference on Humanoid Robots (Humanoids). IEEE. 2022, pp. 659–666. 

[166] Teodor Tomic, Moritz Maier, and Sami Haddadin. “Learning quadrotor maneuvers from optimal control and generalizing in real-time”. In: IEEE International Conference on Robotics and Automation (ICRA). 2014, pp. 1747–1754. 

[169] Fernando Dıaz Ledezma and Sami Haddadin. “RIL: Riemannian Incremental Learning of the Inertial Properties of the Robot Body Schema”. In: 2021 IEEE International Conference on Robotics and Automation (ICRA). IEEE. 2021, pp. 9354–9360. 

[170] Jonathan Vorndamme, Moritz Schappler, and Sami Haddadin. “Collision Handling for Humanoids using Proprioceptive Sensing”. In: IEEE International Conference on Robotics and Automation (ICRA), Workshop: The Robotic Sense of Touch: From Sensing to Understanding. Singapore, May 2017.