Faster Learning and Better Image Quality with Evolving Generative Adversarial Networks

NeuroHive
NeuroHive
May 22, 2018 · 5 min read

Generative Adversarial Networks are one of the most promising recent developments in the area of Deep Learning. GANs are generative models that have recently become very popular among the machine learning community. In a sense, Generative Adversarial Networks are able to generate completely new data samples that keep the characteristics of some specific domain. Therefore, this kind of models have attracted a lot of interest and have numerous applications.

Realistic images of non-existing celebrities generated with an evolving GAN network.

Throughout time, GANs have proved that given enough modeling power they can model high-dimensional data distributions and provide a generative model. For example, they can model realistic images distributions and generate novel images that resemble the training set. This powerful family of models in deep learning has been brought by an innovative combination of deep neural networks and game theory (GANs, Ian Goodfellow, 2014). Generative Adversarial Networks consist of two networks: Generator (a network generating samples from a latent code) and Discriminator (a network who has to asses the generated sample). The ultimate goal is to be able to generate samples from a distribution almost indistinguishable from the training set distribution.

There are two key things to keep in mind when it comes to Generative Adversarial Networks: quality of the generated data sample (in terms of how realistic it is w.r.t. the training data) and variational capabilities. The goal of the generative process is to maximize both of them. Several problems have arisen in the way of achieving this goal and they have been addressed in different ways. However, the conventional wisdom is that there should always be the trade-off between the data quality and the variation. Intuitively, this can be explained in a way that: constraining the modeled distribution to preserve the quality squeezes the distribution in the space that results with the constrained variation of the generated data samples.

The difficulty of the task of generation grows with the dimensionality of the data distribution. Talking about images (where GANs are mostly used), generating high-resolution images with GAN network represents a difficult task. First because of the lack of ability to capture small details (which is easily noticeable in high-resolution images) and second, the long and unstable training process.

Novel Concept

The proposed new method of progressive growing of GANs. Simultaneous growing of both networks: the Generator and the Discriminator.

Evolving GANs Throughout Training

Normalization in Generator and Discriminator

To constrain the competition among the networks, the authors propose pixel-wise feature vector normalization which is, in fact, normalizing the feature vector in each pixel to the unit length. This is done as usual, after each convolutional layer in the generator network.

The proposed method and the improvements were assessed mainly using CELEBA dataset which contains 30 000 high-resolution images (1024x1024) of faces of celebrities. The details are important and easily noticeable, and that’s why this dataset is pretty well suited for evaluation of this new concept. The results show higher perceptual quality and vastly more variation than existing methods. Also, the stability and speed of the learning process were confirmed when training using high-resolution images like the ones from CELEBA. As an additional contribution, a higher-quality version of the CELEBA dataset called CELEBA-HQ was constructed and will be published by the authors.

Gradually improving results (MS-SSIM — Multi-Scale Structural Similarity score) with different improvements. Evaluation using CELEBA and LSUN Datasets.
Comparison of the quality of the generated images with existing methods on the LSUN bedroom dataset.

This new concept of progressive growth of generative model shows promising results, and we may expect to see many applications and improvements coming from it. Still, there is a long way to true photorealism and generation of high-quality images that are perceptually indistinguishable from real ones.

Dane Mitriev

Neurohive - CV papers

Machine Learning and Neural Networks

Welcome to a place where words matter. On Medium, smart voices and original ideas take center stage - with no ads in sight. Watch
Follow all the topics you care about, and we’ll deliver the best stories for you to your homepage and inbox. Explore
Get unlimited access to the best stories on Medium — and support writers while you’re at it. Just $5/month. Upgrade

Get the Medium app

A button that says 'Download on the App Store', and if clicked it will lead you to the iOS App store
A button that says 'Get it on, Google Play', and if clicked it will lead you to the Google Play store