{"id":7806,"date":"2022-04-13T14:21:05","date_gmt":"2022-04-13T12:21:05","guid":{"rendered":"https:\/\/www.isir.upmc.fr\/?post_type=isir_news&#038;p=7806"},"modified":"2022-04-25T11:45:22","modified_gmt":"2022-04-25T09:45:22","slug":"elsa-project-giving-robots-the-ability-to-learn-social-affordances-to-improve-interaction-with-humans","status":"publish","type":"isir_news","link":"https:\/\/www.isir.upmc.fr\/news\/elsa-project-giving-robots-the-ability-to-learn-social-affordances-to-improve-interaction-with-humans\/?lang=en","title":{"rendered":"ELSA PROJECT: GIVING ROBOTS THE ABILITY TO LEARN SOCIAL AFFORDANCES TO IMPROVE INTERACTION WITH HUMANS"},"content":{"rendered":"\n<h4 class=\"has-text-align-center wp-block-heading\"><strong>Project ELSA <em>&#8211; Effective learning of social affordances for human-robot interaction<\/em><\/strong><\/h4>\n\n\n\n<p class=\"wp-block-paragraph\">The concept of affordances is the ability of an object or an environment to evoke its use or function. It is gradually attracting the attention of robotics and artificial intelligence (AI) researchers as a way to provide artificial agents with more autonomy, by allowing them to learn for themselves which commands sent to their motors produce effects on the environment.&nbsp;<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Nevertheless, social affordances remain largely unexplored in robotics and AI. While physical affordances represent a step towards autonomous agents that better understand their physical environment, social affordances are necessary to move towards more realistic multi-agent environments. Moreover, we know that humans accquire social affordances while learning how to interact with others. Enabling robots to do so could permit them to better interact with humans.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\"><strong>ELSA<\/strong> &#8211; <em>Effective Learning of Social Affordances for Human-Robot Interaction<\/em> &#8211; is a Franco-Austrian research project that aims at studying the learning of social affordances in robots. The project aims at providing robots with the ability to learn social affordances for natural and efficient interaction with humans. The project is funded for 4 years, starting in January 2022, by the ANR on the French side and by the FWF agency on the Austrian side.&nbsp;<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">The project consortium is composed of four research institutes, two in France and two in Austria. On the French side, <strong>ISIR<\/strong> is involved with Mehdi Khamassi, Research Director, who coordinates the project, and Beno\u00eet Girard, Research Director, leader of the second work package of the project (WP2). The <a href=\"https:\/\/www.laas.fr\/public\/\" data-type=\"URL\" data-id=\"https:\/\/www.laas.fr\/public\/\" target=\"_blank\" rel=\"noreferrer noopener\">LAAS-CNRS<\/a>, Laboratory of Analysis and Architecture of Systems, is also a French partner. On the Austrian side, t<a href=\"https:\/\/www.uibk.ac.at\/de\/\" data-type=\"URL\" data-id=\"https:\/\/www.uibk.ac.at\/de\/\" target=\"_blank\" rel=\"noreferrer noopener\">he University of Innsbruck<\/a> is a partner via the Department of Computer Science (IFI) and the Digital Science Center (DiSC).&nbsp;<\/p>\n\n\n\n<p class=\"wp-block-paragraph\"><em>Description of the ELSA project by Mehdi Khamassi, project coordinator.<\/em><\/p>\n\n\n\n<h4 class=\"wp-block-heading\"><strong><em><strong><em>What does the project involve?&nbsp;<\/em><\/strong><\/em><\/strong><\/h4>\n\n\n\n<p class=\"wp-block-paragraph\">It is about studying the learning of social affordances in robots. Affordances are opportunities for actions perceived by an agent when interacting with its environment. They are of interest to roboticists to describe the potential interactions of the robot with objects beyond simple physical properties.&nbsp;<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">In the <strong>ELSA<\/strong> project, we extend the notion to social affordances, which have so far barely been studied in robotics. Here, we make the following hypothesis:&nbsp;<\/p>\n\n\n\n<ul class=\"wp-block-list\"><li>that robots can learn social affordances in the same way as they learn affordances in non-social situations;<\/li><li>that robots, while learning to autonomously recognize social affordances offered by their human partners, will be able to respond more efficiently and appropriately to humans. This would facilitate coordination and cooperation between humans and robots.<\/li><\/ul>\n\n\n\n<h4 class=\"wp-block-heading\"><strong><em>What is the objective of the project?<\/em><\/strong><\/h4>\n\n\n\n<p class=\"wp-block-paragraph\">The central objective of the project is to study the conditions that allow a robot to efficiently learn social affordances, in order to facilitate communication and cooperation with humans. In particular, we will study problems related to social affordances in robotics, organized in 4 work packages:&nbsp;<\/p>\n\n\n\n<ul class=\"wp-block-list\"><li>Theory and practice of social affordances;<\/li><li>Social affordances in decision making;<\/li><li>Social affordances for action execution;<\/li><li>Architecture, scenario, integration.<\/li><\/ul>\n\n\n\n<p class=\"wp-block-paragraph\">The work package concerning \u00ab\u00a0social affordances in decision making\u00a0\u00bb, led by ISIR, aims at proposing algorithmic solutions to allow robots to learn different types of social affordances. The objective is to allow robots to learn an internal model of human agent skills, so that the robot can progressively distinguish between human-general and human-specific social affordances. For instance, nearly all humans would respond to a salutation with the hand by handwaving. However, some gestures induce different responses in different people.<\/p>\n\n\n\n<figure class=\"wp-block-gallery has-nested-images columns-default is-cropped wp-block-gallery-1 is-layout-flex wp-block-gallery-is-layout-flex\">\n<figure class=\"wp-block-image size-large\"><img loading=\"lazy\" decoding=\"async\" width=\"841\" height=\"430\" data-id=\"7805\" src=\"https:\/\/www.isir.upmc.fr\/wp-content\/uploads\/2022\/04\/pile-cube1v-Copyright-LAAS-CNRS-.jpg\" alt=\"\" class=\"wp-image-7805\" srcset=\"https:\/\/www.isir.upmc.fr\/wp-content\/uploads\/2022\/04\/pile-cube1v-Copyright-LAAS-CNRS-.jpg 841w, https:\/\/www.isir.upmc.fr\/wp-content\/uploads\/2022\/04\/pile-cube1v-Copyright-LAAS-CNRS--300x153.jpg 300w, https:\/\/www.isir.upmc.fr\/wp-content\/uploads\/2022\/04\/pile-cube1v-Copyright-LAAS-CNRS--768x393.jpg 768w\" sizes=\"auto, (max-width: 841px) 100vw, 841px\" \/><\/figure>\n<figcaption class=\"blocks-gallery-caption\">Caption: Tabletop scenario &#8211; human participants can cooperate with the robot to achieve a particular goal (e.g., build a tower with cubes). The robot must learn to dissociate human competence in specific tasks from the properties of specific objects (e.g., the human can&rsquo;t place a ball on top of the tower of cubes not because he is incompetent, but rather because balls fall from towers). Copyright: Aur\u00e9lie Clodic, LAAS-CNRS.<\/figcaption><\/figure>\n\n\n\n<h4 class=\"wp-block-heading\"><strong><em>What are the possible applications?&nbsp;<\/em><\/strong><\/h4>\n\n\n\n<p class=\"wp-block-paragraph\">The main application framework of this work is human-robot interaction, and more precisely human-robot cooperation. A better understanding of how robots can learn to recognize and express social affordances would help designing more cooperative robots with humans. This would then allow to assist humans in a variety of tasks, such as object manipulation or navigation. The project will also contribute to other spin-offs, notably in terms of fundamental knowledge on how humans learn, perceive and express social affordances. Developing algorithms that allow a robot to learn social affordances is a way to propose models of how humans do this learning.&nbsp;<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Overall, the project addresses a critical lack of basic knowledge about how social affordances are learned and used in the context of human-robot interaction. The major strength of the project is that it addresses a relatively unexplored subfield (social affordances in robotics) that builds on well-studied areas (non-social affordances in robotics but also in psychology). In the continuity of the previous works of the consortium, the project is highly interdisciplinary and involves complementary expertise. One of the work packages will set up new social affordance learning experiments in humans. Of the originalities is that these experiments have been designed from questions and hypotheses enriched with robotics discussions. We thus aim to shed a new light on these questions in order to also contribute to experimental psychology research.<\/p>\n\n\n\n<hr class=\"wp-block-separator has-text-color has-background has-white-background-color has-white-color\"\/>\n\n\n\n<p class=\"wp-block-paragraph\">This project relies on various scientific expertises of the <strong>ISIR<\/strong>. First, the expertise of the <strong>AMAC<\/strong> team on learning in robotics. Secondly, the expertise of several <strong>ISIR<\/strong> teams (including <strong>PIRoS<\/strong> and <strong>AMAC<\/strong>) on learning in social interaction situations, what Mohamed Chetouani, researcher at <strong>ISIR<\/strong> and Professor at <a href=\"https:\/\/www.sorbonne-universite.fr\/\" data-type=\"URL\" data-id=\"https:\/\/www.sorbonne-universite.fr\/\" target=\"_blank\" rel=\"noreferrer noopener\">Sorbonne University<\/a>, calls \u00ab\u00a0interactive learning\u00a0\u00bb. Finally, the project is rooted in the study of human cognition and in the design of experimental psychology protocols, to measure in a precise, rigorous and repeatable way human and robot behaviors.<\/p>\n\n\n\n<hr class=\"wp-block-separator has-text-color has-background has-black-background-color has-black-color\"\/>\n\n\n\n<p class=\"wp-block-paragraph\"><strong>Contact for the project<\/strong>: <a href=\"https:\/\/www.isir.upmc.fr\/personnel\/khamassi\/\" data-type=\"URL\" data-id=\"https:\/\/www.isir.upmc.fr\/personnel\/khamassi\/\" target=\"_blank\" rel=\"noreferrer noopener\">Mehdi Khamassi<\/a>, CNRS Research Director<\/p>\n","protected":false},"featured_media":7803,"template":"","isir_news_categories":[252],"class_list":["post-7806","isir_news","type-isir_news","status-publish","has-post-thumbnail","hentry","isir_news_categories-research"],"_links":{"self":[{"href":"https:\/\/www.isir.upmc.fr\/wp-json\/wp\/v2\/isir_news\/7806","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.isir.upmc.fr\/wp-json\/wp\/v2\/isir_news"}],"about":[{"href":"https:\/\/www.isir.upmc.fr\/wp-json\/wp\/v2\/types\/isir_news"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.isir.upmc.fr\/wp-json\/wp\/v2\/media\/7803"}],"wp:attachment":[{"href":"https:\/\/www.isir.upmc.fr\/wp-json\/wp\/v2\/media?parent=7806"}],"wp:term":[{"taxonomy":"isir_news_categories","embeddable":true,"href":"https:\/\/www.isir.upmc.fr\/wp-json\/wp\/v2\/isir_news_categories?post=7806"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}