{"id":7825,"date":"2022-04-19T16:26:23","date_gmt":"2022-04-19T14:26:23","guid":{"rendered":"https:\/\/www.isir.upmc.fr\/?post_type=isir_projects&#038;p=7825"},"modified":"2025-06-03T12:00:15","modified_gmt":"2025-06-03T10:00:15","slug":"elsa","status":"publish","type":"isir_projects","link":"https:\/\/www.isir.upmc.fr\/projects\/elsa\/?lang=en","title":{"rendered":"ELSA"},"content":{"rendered":"\n<h3 class=\"wp-block-heading\">Project ELSA&nbsp;\u2013 Effective learning of social affordances for human-robot interaction<\/h3>\n\n\n\n<p class=\"wp-block-paragraph\">It is about studying the learning of social affordances in robots. Affordances are opportunities for actions perceived by an agent when interacting with its environment. They are of interest to roboticists to describe the potential interactions of the robot with objects beyond simple physical properties.&nbsp;<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">In the&nbsp;<strong>ELSA<\/strong>&nbsp;project, we extend the notion to social affordances, which have so far barely been studied in robotics. Here, we make the following hypothesis:&nbsp;<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">&#8211; that robots can learn social affordances in the same way as they learn affordances in non-social situations;<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">&#8211; that robots, while learning to autonomously recognize social affordances offered by their human partners, will be able to respond more efficiently and appropriately to humans. This would facilitate coordination and cooperation between humans and robots.<\/p>\n\n\n\n<h3 class=\"wp-block-heading\">Context<\/h3>\n\n\n\n<p class=\"wp-block-paragraph\">The concept of affordances is the ability of an object or an environment to evoke its use or function. It is gradually attracting the attention of robotics and artificial intelligence (AI) researchers as a way to provide artificial agents with more autonomy, by allowing them to learn for themselves which commands sent to their motors produce effects on the environment.&nbsp;<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Nevertheless, social affordances remain largely unexplored in robotics and AI. While physical affordances represent a step towards autonomous agents that better understand their physical environment, social affordances are necessary to move towards more realistic multi-agent environments. Moreover, we know that humans accquire social affordances while learning how to interact with others. Enabling robots to do so could permit them to better interact with humans.<\/p>\n\n\n\n<h3 class=\"wp-block-heading\">Objectives<\/h3>\n\n\n\n<p class=\"wp-block-paragraph\">The central objective of the project is to study the conditions that allow a robot to efficiently learn social affordances, in order to facilitate communication and cooperation with humans. In particular, we will study problems related to social affordances in robotics, organized in 4 work packages:&nbsp;<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">&#8211; Theory and practice of social affordances;<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">&#8211; Social affordances in decision making (<em>directed by ISIR<\/em>);<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">&#8211; Social affordances for action execution;<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">&#8211; Architecture, scenario, integration.<\/p>\n\n\n\n<figure class=\"wp-block-gallery has-nested-images columns-default is-cropped wp-block-gallery-1 is-layout-flex wp-block-gallery-is-layout-flex\">\n<figure class=\"wp-block-image size-large\"><img loading=\"lazy\" decoding=\"async\" width=\"841\" height=\"430\" data-id=\"7805\" src=\"https:\/\/www.isir.upmc.fr\/wp-content\/uploads\/2022\/04\/pile-cube1v-Copyright-LAAS-CNRS-.jpg\" alt=\"\" class=\"wp-image-7805\" srcset=\"https:\/\/www.isir.upmc.fr\/wp-content\/uploads\/2022\/04\/pile-cube1v-Copyright-LAAS-CNRS-.jpg 841w, https:\/\/www.isir.upmc.fr\/wp-content\/uploads\/2022\/04\/pile-cube1v-Copyright-LAAS-CNRS--300x153.jpg 300w, https:\/\/www.isir.upmc.fr\/wp-content\/uploads\/2022\/04\/pile-cube1v-Copyright-LAAS-CNRS--768x393.jpg 768w\" sizes=\"auto, (max-width: 841px) 100vw, 841px\" \/><\/figure>\n<figcaption class=\"blocks-gallery-caption wp-element-caption\">Caption: Tabletop scenario \u2013 human participants can cooperate with the robot to achieve a particular goal (e.g., build a tower with cubes). The robot must learn to dissociate human competence in specific tasks from the properties of specific objects (e.g., the human can\u2019t place a ball on top of the tower of cubes not because he is incompetent, but rather because balls fall from towers). Copyright: Aur\u00e9lie Clodic, LAAS-CNRS.<br><\/figcaption><\/figure>\n\n\n\n<h3 class=\"wp-block-heading\">Results<\/h3>\n\n\n\n<p class=\"wp-block-paragraph\">The main application framework of this work is human-robot interaction, and more precisely human-robot cooperation. A better understanding of how robots can learn to recognize and express social affordances would help designing more cooperative robots with humans. This would then allow to assist humans in a variety of tasks, such as object manipulation or navigation. The project will also contribute to other spin-offs, notably in terms of fundamental knowledge on how humans learn, perceive and express social affordances. Developing algorithms that allow a robot to learn social affordances is a way to propose models of how humans do this learning.&nbsp;<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Overall, the project addresses a critical lack of basic knowledge about how social affordances are learned and used in the context of human-robot interaction. The major strength of the project is that it addresses a relatively unexplored subfield (social affordances in robotics) that builds on well-studied areas (non-social affordances in robotics but also in psychology).<\/p>\n\n\n\n<h3 class=\"wp-block-heading\">Partnerships and collaborations<\/h3>\n\n\n\n<p class=\"wp-block-paragraph\">The project is coordinated by Mehdi Khamassi, Research Director at <strong>ISIR<\/strong>. The consortium of the project is composed as follows:&nbsp;<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">&#8211; ISIR,\u00a0<a href=\"https:\/\/www.sorbonne-universite.fr\" target=\"_blank\" rel=\"noreferrer noopener\">Sorbonne University<\/a>\u00a0\u2013 France,\u00a0<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">&#8211; <a href=\"https:\/\/www.laas.fr\/public\/\" target=\"_blank\" rel=\"noreferrer noopener\">LAAS-CNRS<\/a>\u00a0\u2013 France,\u00a0<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">&#8211; Department of Computer Science (IFI),\u00a0<a href=\"https:\/\/www.uibk.ac.at\/de\/\" target=\"_blank\" rel=\"noreferrer noopener\">University of Innsbruck<\/a>\u00a0\u2013 Austria,\u00a0<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">&#8211; Digital Science Center (DiSC),\u00a0<a href=\"https:\/\/www.uibk.ac.at\/de\/\" target=\"_blank\" rel=\"noreferrer noopener\">University of Innsbruck<\/a>\u00a0\u2013 Austria.<\/p>\n","protected":false},"featured_media":7824,"template":"","isir_project_types":[237],"isir_teams":[265],"class_list":["post-7825","isir_projects","type-isir_projects","status-publish","has-post-thumbnail","hentry","isir_project_types-all-projects","isir_teams-acide"],"_links":{"self":[{"href":"https:\/\/www.isir.upmc.fr\/wp-json\/wp\/v2\/isir_projects\/7825","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.isir.upmc.fr\/wp-json\/wp\/v2\/isir_projects"}],"about":[{"href":"https:\/\/www.isir.upmc.fr\/wp-json\/wp\/v2\/types\/isir_projects"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.isir.upmc.fr\/wp-json\/wp\/v2\/media\/7824"}],"wp:attachment":[{"href":"https:\/\/www.isir.upmc.fr\/wp-json\/wp\/v2\/media?parent=7825"}],"wp:term":[{"taxonomy":"isir_project_types","embeddable":true,"href":"https:\/\/www.isir.upmc.fr\/wp-json\/wp\/v2\/isir_project_types?post=7825"},{"taxonomy":"isir_teams","embeddable":true,"href":"https:\/\/www.isir.upmc.fr\/wp-json\/wp\/v2\/isir_teams?post=7825"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}