arxivst stuff from arxiv that you should probably bookmark

Learning Joint Multilingual Sentence Representations with Neural Machine Translation

Abstract · Apr 13, 2017 14:40 ·

nmt tence sequence sentence languages facebook sentences cs-cl

Arxiv Abstract

  • Holger Schwenk
  • Ke Tran
  • Orhan Firat
  • Matthijs Douze

In this paper, we use the framework of neural machine translation to learn joint sentence representations across different languages. Our hope is that a representation which is independent of the language a sentence is written in, is likely to capture the underlying semantics. We search and compare more than 1.4M sentence representations in three different languages and study the characteristics of close sentences. We provide experimental evidence that sentences that are close in embedding space are indeed semantically highly related, but often have quite different structure and syntax. These relations also hold when comparing sentences in different languages.

Read the paper (pdf) »