arxivst stuff from arxiv that you should probably bookmark

Time Series Forecasting using RNNs: an Extended Attention Mechanism to Model Periods and Handle Missing Values

Abstract · Mar 29, 2017 15:11 ·

cs-lg cs-ne

Arxiv Abstract

  • Yagmur G. Cinar
  • Hamid Mirisaee
  • Parantapa Goswami
  • Eric Gaussier
  • Ali Ait-Bachir
  • Vadim Strijov

In this paper, we study the use of recurrent neural networks (RNNs) for modeling and forecasting time series. We first illustrate the fact that standard sequence-to-sequence RNNs neither capture well periods in time series nor handle well missing values, even though many real life times series are periodic and contain missing values. We then propose an extended attention mechanism that can be deployed on top of any RNN and that is designed to capture periods and make the RNN more robust to missing values. We show the effectiveness of this novel model through extensive experiments with multiple univariate and multivariate datasets.

Read the paper (pdf) »