Simulation is a powerful tool used to train Reinforcement Learning (RL) agents involved in robotic tasks. It allows to collect large amount of data in comparatively faster and safer way than on the real robot. However, a simulator is only an approximation of the physical system to be controlled. Due to modeling errors, a controller learned on the simulator dynamics may behave differently once applied to the real robot. In the worst case, the controller, although being successful when applied on the simulator, may fail when applied on the real platform. In this paper, we deal with the sim-to-real transfer of a RL controller for a Poppy Ergo-Jr robotic arm involved in a positioning task: i.e., moving the servo joints in order to reach a desired target position with the end-effector. In particular, we want to investigate the differences between the real robot and its simulator and how they affect the controller performance after its transfer from the simulator to the real platform.

Characterization of Modeling Errors Affecting Performances of a Robotics Deep Reinforcement Learning Controller in a Sim-to-Real Transfer

Erica Salvato
;
Gianfranco Fenu;Eric Medvet;Felice Andrea Pellegrino
2021-01-01

Abstract

Simulation is a powerful tool used to train Reinforcement Learning (RL) agents involved in robotic tasks. It allows to collect large amount of data in comparatively faster and safer way than on the real robot. However, a simulator is only an approximation of the physical system to be controlled. Due to modeling errors, a controller learned on the simulator dynamics may behave differently once applied to the real robot. In the worst case, the controller, although being successful when applied on the simulator, may fail when applied on the real platform. In this paper, we deal with the sim-to-real transfer of a RL controller for a Poppy Ergo-Jr robotic arm involved in a positioning task: i.e., moving the servo joints in order to reach a desired target position with the end-effector. In particular, we want to investigate the differences between the real robot and its simulator and how they affect the controller performance after its transfer from the simulator to the real platform.
https://ieeexplore.ieee.org/document/9596864
File in questo prodotto:
File Dimensione Formato  
Characterization_of_Modeling_Errors_Affecting_Performances_of_a_Robotics_Deep_Reinforcement_Learning_Controller_in_a_Sim-to-Real_Transfer.pdf

Accesso chiuso

Tipologia: Documento in Versione Editoriale
Licenza: Copyright Editore
Dimensione 661.85 kB
Formato Adobe PDF
661.85 kB Adobe PDF   Visualizza/Apri   Richiedi una copia

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/11368/2998879
Citazioni
  • ???jsp.display-item.citation.pmc??? ND
  • Scopus 1
  • ???jsp.display-item.citation.isi??? ND
social impact