arxivst stuff from arxiv that you should probably bookmark

Investigating Recurrence and Eligibility Traces in Deep Q-Networks

Abstract · Apr 18, 2017 18:46 ·

sutton eligibility recurrent sec atari traces cs-ai cs-lg

Arxiv Abstract

  • Jean Harb
  • Doina Precup

Eligibility traces in reinforcement learning are used as a bias-variance trade-off and can often speed up training time by propagating knowledge back over time-steps in a single update. We investigate the use of eligibility traces in combination with recurrent networks in the Atari domain. We illustrate the benefits of both recurrent nets and eligibility traces in some Atari games, and highlight also the importance of the optimization used in the training.

Read the paper (pdf) »