Linearizing Visual Processes with Convolutional Variational Autoencoders

03/20/2018
by   Alexander Sagel, et al.
0

This work studies the problem of modeling non-linear visual processes by learning linear generative models from observed sequences. We propose a joint learning framework, combining a Linear Dynamic System and a Variational Autoencoder with convolutional layers. After discussing several conditions for linearizing neural networks, we propose an architecture that allows Variational Autoencoders to simultaneously learn the non-linear observation as well as the linear state-transition from a sequence of observed frames. The proposed framework is demonstrated experimentally in three series of synthesis experiments.

READ FULL TEXT

Please sign up or login with your details

Forgot password? Click here to reset