Disentanglement with Hyperspherical Latent Spaces using Diffusion Variational Autoencoders

03/19/2020
by   Luis A. Pérez Rey, et al.
0

A disentangled representation of a data set should be capable of recovering the underlying factors that generated it. One question that arises is whether using Euclidean space for latent variable models can produce a disentangled representation when the underlying generating factors have a certain geometrical structure. Take for example the images of a car seen from different angles. The angle has a periodic structure but a 1-dimensional representation would fail to capture this topology. How can we address this problem? The submissions presented for the first stage of the NeurIPS2019 Disentanglement Challenge consist of a Diffusion Variational Autoencoder (ΔVAE) with a hyperspherical latent space which can, for example, recover periodic true factors. The training of the ΔVAE is enhanced by incorporating a modified version of the Evidence Lower Bound (ELBO) for tailoring the encoding capacity of the posterior approximate.

READ FULL TEXT

Please sign up or login with your details

Forgot password? Click here to reset