Visual Rewards From Observation for Sequential Tasks: Autonomous Pile Loading

Nataliya Strokina*, Wenyan Yang, Joni Pajarinen, Nikolay Serbenyuk, Joni Kämäräinen, Reza Ghabcheloo

*Corresponding author for this work

Research output: Contribution to journalArticleScientificpeer-review

1 Downloads (Pure)


One of the key challenges in implementing reinforcement learning methods for real-world robotic applications is the design of a suitable reward function. In field robotics, the absence of abundant datasets, limited training time, and high variation of environmental conditions complicate the task further. In this paper, we review reward learning techniques together with visual representations commonly used in current state-of-the-art works in robotics. We investigate a practical approach proposed in prior work to associate the reward with the stage of the progress in task completion based on visual observation. This approach was demonstrated in controlled laboratory conditions. We study its potential for a real-scale field application, autonomous pile loading, tested outdoors in three seasons: summer, autumn, and winter. In our framework, the cumulative reward combines the predictions about the process stage and the task completion (terminal stage). We use supervised classification methods to train prediction models and investigate the most common state-of-the-art visual representations. We use task-specific contrastive features for terminal stage prediction.

Original languageEnglish
Article number838059
JournalFrontiers in Robotics and AI
Publication statusPublished - 31 May 2022
MoE publication typeA1 Journal article-refereed


  • earth moving
  • field robotics
  • learning from demonstration
  • reinforcement learning
  • visual representations
  • visual rewards


Dive into the research topics of 'Visual Rewards From Observation for Sequential Tasks: Autonomous Pile Loading'. Together they form a unique fingerprint.

Cite this