arxivst stuff from arxiv that you should probably bookmark

Getting Around Feature Engineering in Image-Based Anomaly Detection with GANs

Post · Mar 20, 2017 19:25 ·

GAN images unsupervised

Capturing markers for disease progression can be hindered by a limited vocabulary of known markers, and explicitly discovering/identifying these markers is time consuming. Instead, the authors propose a GAN to learn a manifold and teach it to score anomalies!

Arxiv Abstract

  • Thomas Schlegl
  • Philipp Seeböck
  • Sebastian M. Waldstein
  • Ursula Schmidt-Erfurth
  • Georg Langs

Obtaining models that capture imaging markers relevant for disease progression and treatment monitoring is challenging. Models are typically based on large amounts of data with annotated examples of known markers aiming at automating detection. High annotation effort and the limitation to a vocabulary of known markers limit the power of such approaches. Here, we perform unsupervised learning to identify anomalies in imaging data as candidates for markers. We propose AnoGAN, a deep convolutional generative adversarial network to learn a manifold of normal anatomical variability, accompanying a novel anomaly scoring scheme based on the mapping from image space to a latent space. Applied to new data, the model labels anomalies, and scores image patches indicating their fit into the learned distribution. Results on optical coherence tomography images of the retina demonstrate that the approach correctly identifies anomalous images, such as images containing retinal fluid or hyperreflective foci.

Read the paper (pdf) »