arxivst stuff from arxiv that you should probably bookmark

Testing and Learning on Distributions with Symmetric Noise Invariance

Abstract · Mar 22, 2017 10:40 ·

stat-ml

Arxiv Abstract

  • Ho Chung Leon Law
  • Christopher Yau
  • Dino Sejdinovic

Kernel embeddings of distributions and the Maximum Mean Discrepancy (MMD), the resulting distance between distributions, are useful tools for fully nonparametric two-sample testing and learning on distributions. However, it is rarely that all possible differences between samples are of interest – discovered differences can be due to different types of measurement noise, data collection artefacts or other irrelevant sources of variability. We propose distances between distributions which encode invariance to additive symmetric noise, aimed at testing whether the assumed true underlying processes differ. Moreover, we construct invariant features of distributions, leading to learning algorithms robust to the impairment of the input distributions with symmetric additive noise. Such features lend themselves to a straightforward neural network implementation and can thus also be learned given a supervised signal.

Read the paper (pdf) »