Autoencoding Blade Runner

Reconstructing films with artificial neural networks

Image for post
Image for post
Reconstruction of Roy Batty’s eye looking over LA in the opening scene
Side by side trailer comparison of Blade Runner and the reconstruction from the artificial neural network

Technical Background

Image for post
Image for post
Fig.1 Images of bedrooms generated with DCGAN [Radford et al. 2015]
Image for post
Image for post
Fig.2 Comparison of VAE to VAE with learned similarity metric and GAN [Larsen et al. 2015]
Image for post
Image for post
Overview of the variational autoencoder model combined with a discriminator network.

Artistic Motivation

Image for post
Image for post
Reconstruction of the second Voight-Kampff test
Image for post
Image for post
Image for post
Image for post
Image for post
Image for post
Image for post
Image for post
Image for post
Image for post
Reconstructions from various scenes of Blade Runner

Blade Runner — Reconstructed

Side by side comparison of the opening scene reconstructed
Side by side comparisons of the ‘Tears in the Rain’ scene reconstructed
Image for post
Image for post
Image for post
Image for post
Image for post
Image for post
Reconstructions of scenes from Koyaanisqatsi using the network trained to model Blade Runner

Reconstructing Other Films

A sample from Koyaanisqatsi reconstructed with the network trained on Blade Runner
The 1984 Apple Macintosh advert reconstructed with the network trained on Blade Runner
John Whitney’s Matrix III reconstructed with the network trained on Blade Runner
Image for post
Image for post
Image for post
Image for post
Image for post
Image for post
Reconstructions of scenes from A Scanner Darkly

Autoencoding A Scanner Darkly

Side by side comparison of the trailer for A Scanner Darkly reconstructed
Blade Runner trailer reconstructed with the network trained on A Scanner Darkly
A sample from Koyaanisqatsi reconstructed with the network trained on A Scanner Darkly

Conclusion

Image for post
Image for post

Artist and researcher, Ph.D. student at Goldsmiths.

Get the Medium app

A button that says 'Download on the App Store', and if clicked it will lead you to the iOS App store
A button that says 'Get it on, Google Play', and if clicked it will lead you to the Google Play store