Institut des Systèmes Intelligents
et de Robotique

Partenariats

UPMC

CNRS

INSERM

Tremplin CARNOT Interfaces

Labex SMART

Rechercher

Teaching

khamassi Mehdi
Title : Researcher
Address : 4 place Jussieu, CC 173, 75252 Paris cedex 05
Phone : +33 (0) 1 44 27 28 85
Email : khamassi(at)isir.upmc.fr
Group : AMAC (AMAC)

 

 

 

 

Teaching (current)

 

 

2015- Ecole Normale Supérieure Ulm, Paris, CogMaster
Course coordinators: Mehdi Khamassi and Benoît Girard
"Robotic modelling approaches to Cognitive Sciences" (click on the link to access to course material)
2015- Université d'Orsay - Paris 11, Master 2 Information, Learning, Cognition
Course coordinator: Michèle Sebag
"Reinforcement learning models and their applications to Robotics and Neuroscience"
2014- Université Pierre et Marie Curie, Paris 6, Licence (all disciplines)
Course coordinators: Frédéric Decremps and Mehdi Khamassi
http://www.isir.upmc.fr/?op=view_profil&lang=fr&id=82&pageid=1300
2014- Ecole Normale Supérieure Ulm / PSL Labex, Paris, Master 2 d'Cognitive Engineering
Course coordinators: Emmanuel Dupoux and Srdjan Ostojic
"Reinforcement learning models and their applications to Robotics and Neuroscience"
2013- Ecole Polytechnique, Palaiseau, Brain and Cognition Seminar Series
Course coordinators: Yves Frégnac and Cyril Monier
"Reinforcement learning models and their applications to Robotics and Neuroscience"
2013- Université Claude Bernard, Lyon 1, Licence (all disciplines)
Course coordinators: Denis Machon and Maïlys Faraut
"Education to images and critical thinking in front of advertising"
2012- Ecole Normale Supérieure Ulm, Paris, Master 1 of Neuroscience
Course Coordinators: Clément Léna and Daniela Popa
"Reinforcement learning: computational models and model-based analysis of electrophysiological data"
2012- Polytech Paris UPMC, 5th year of Engineering School
Course coordinator: Jean-Baptiste Mouret
"Reinforcement learning and neuro-inspired decision-making"
2011- Université Pierre et Marie Curie, Paris 6, International Master 2 of Mechatronics Systems for Rehabilitation (Robotics)
Course coordinator: Véronique Perdereau
"Bio-inspired action selection and learning"
2010- Université Claude Bernard, Lyon 1, Master 2 of Integrative Neuroscience
Course coordinators: Céline Amiez and Jean-Claude Dreher
"Decision-making and reinforcement learning: elements of computational modelling"
2008- Université Pierre et Marie Curie, Paris 6, Master 2 of Artificial Intelligence and Decision (Computer Science) then Master 2 ANDROIDE
Course coordinators: Stéphane Doncieux then Nicolas Bredèche
"Neuro-inspired reinforcement learning"

 

Teaching (past)

 

2013 Harvard Summer Class in Trento, Italy
Course coordinator: Giorgio Coricelli
"Reinforcement learning: computational models and model-based analysis of electrophysiological data"
2013 Univ. Pierre & Marie Curie – Paris 6, Master 2 Integrative Neuroscience
Course coordinator: Laure Rondi-Reig
"Computational models of parallel memory systems for navigation"
2012 Telluride Neuromorphic Engineering Summerschool, USA
Summerschool directors: Ralph Etienne-Cummings, Timothy Horiuchi and Tobi Delbruck
"Reinforcement learning models and their applications to Robotics and Neuroscience"

 

Downloadable material

University Pierre and Marie Curie 2015, Course on Reinforcement Learning models, their links with Neurobiology, and their applications to Autonomous Robotics:

  1. Model-free (MF) Reinforcement Learning (RL)
    1. Temporal-Difference Learning
    2. Links with Neurobiological and Psychological data
    3. Applications of RL to the Neuroscience of decision-making
    4. Continuous state-space Reinforcement Learning in Robotics
    5. Limitations of MF RL in Neuroscience and Robotics
  2. Model-based (MB) Reinforcement Learning (RL)
    1. Formalism (e.g. dyna-Q, dynamic programming)
    2. Off-line processing and the hippocampus
    3. Meta-Learning for the coordination of MF and MB RL
    4. Meta-Learning for the dynamic regulation of RL parameters
    5. Applications to Robotics and feedback to Neuroscience

Click here to download the pdf file of the course