Introducing Mur.AI

Real-time neural style transfer for video

Jeffrey Rainy
Feb 12, 2018 · 8 min read

by Jeffrey Rainy and Archy de Berker

What is style transfer?

Image for post
Image for post
Here the source image is of two developers (Phil Mathieu and Jean Raby) and the style comes from Notre Dame de Grace by A’Shop, a mural in Montreal.

How does it work?

Image for post
Image for post

Classification Network

Image for post
Image for post
A typical schema for a convolutional neural network for classification.
Image for post
Image for post
Some examples of the kind of features that different layers in a CNN prefer (we move deeper in the network as we move left to right). From Olah, et al., “Feature Visualization”, Distill, 2017.

Stylization Network

Image for post
Image for post

Deploying our system

Image for post
Image for post
Our demo has been deployed on-screen around the world, and has even been projected onto buildings here in Montreal (as part of the Up375 project).
Image for post
Image for post
The finished system runs on a Zotac EN1070 minicomputer with an NVIDIA GeForce 1070 GPU, and is easily portable

Twitter integration

Styles used

Image for post
Image for post
Image for post
Image for post
Notre Dame de Grâce, by A’Shop. 6310 rue Sherbrooke Ouest. Spray paint on brick, 2011.
Image for post
Image for post
Image for post
Image for post
Sans titre, by Bicicleta Sem Freio. 3527 boulevard St-Laurent. Spray paint on brick, 2015
Image for post
Image for post
Image for post
Image for post
Sans titre, by El Curiot. 265 rue Sherbrooke Ouest. Acrylic on brick, 2015
Image for post
Image for post
Image for post
Image for post
Quai des Arts, by EN MASSE. 4890 boulevard St-Laurent. Spray paint on brick, 2011
Image for post
Image for post
Image for post
Image for post
Galaktic Giant, Chris Dyer. 3483 rue Coloniale. Spray paint on brick, 2013
Image for post
Image for post
Image for post
Image for post
Sans titre, by David ‘Meggs’ Hook. 3527 boulevard St-Laurent. 2016
Image for post
Image for post
Image for post
Image for post
Autumn Foliage Series #1 by Matt W. Moore. 4660 boulevard St-Laurent. 2014
Image for post
Image for post
Image for post
Image for post
Mémoire du coeur by Julian Palma. 4505 rue Notre-Dame Ouest. Spray paint on brick, 2016
Image for post
Image for post
Image for post
Image for post
Sans titre, by SBuONe. 4243 boulevard St-Laurent. 2016
Image for post
Image for post
Image for post
Image for post
Sans titre, by Zilon. 53 rue Marie-Anne. Spray paint on various medium

Acknowledgments

Element AI Lab

We’ve moved!

Thanks to Archy de Berker, Eric Robert, Simon Hudson, and Xavier Snelgrove

Jeffrey Rainy

Written by

C++ specialist, Machine Learning enthusiast, Go (game) amateur. Often skeptic, opinions are my own.

Element AI Lab

We’ve moved! See our latest content on www.elementai.com/news !

Jeffrey Rainy

Written by

C++ specialist, Machine Learning enthusiast, Go (game) amateur. Often skeptic, opinions are my own.

Element AI Lab

We’ve moved! See our latest content on www.elementai.com/news !

Welcome to a place where words matter. On Medium, smart voices and original ideas take center stage - with no ads in sight. Watch

Follow all the topics you care about, and we’ll deliver the best stories for you to your homepage and inbox. Explore

Get unlimited access to the best stories on Medium — and support writers while you’re at it. Just $5/month. Upgrade

Get the Medium app