arxivst stuff from arxiv that you should probably bookmark

Selective Encoding for Abstractive Sentence Summarization

Abstract · Apr 24, 2017 07:57 ·

summarization rnn sentence encoding encoder selective decoder gate summary abstractive cs-cl

Arxiv Abstract

  • Qingyu Zhou
  • Nan Yang
  • Furu Wei
  • Ming Zhou

We propose a selective encoding model to extend the sequence-to-sequence framework for abstractive sentence summarization. It consists of a sentence encoder, a selective gate network, and an attention equipped decoder. The sentence encoder and decoder are built with recurrent neural networks. The selective gate network constructs a second level sentence representation by controlling the information flow from encoder to decoder. The second level representation is tailored for sentence summarization task, which leads to better performance. We evaluate our model on the English Gigaword, DUC 2004 and MSR abstractive sentence summarization datasets. The experimental results show that the proposed selective encoding model outperforms the state-of-the-art baseline models.

Read the paper (pdf) »