Top 10 Deep Learning experiences run on your Browser

Originally published at www.dlology.com. For more practical deep learning experiences.

No coding tutorial today. Just sharing my top 10 deep learning experiences found recently that run on browsers.

Enjoy the ride, no coding experience needed.

Image related

1 Quick Draw

A game where you are challenged to draw a something, e.g. a donut, and let the neural net guess what you are drawing. My first attempt gets 4 out of 6 right. Let’s see how well you can draw.

How it works

Under the hood, the model takes sequences of strokes your draw on the canvas and feed into a combination of convolution layer and recurrent network. Finally, the class digits will be generated from the softmax output layer.

And here is the illustration of the structure of the model.

You may wonder where are those training data came from. You guessed it! It is a collection of 50 million drawings across 345 categories coming from people plays the game.

2 Teachable Machine

Another AI Experients from google build on the deeplearn.js library.

Teach machine to recognize your gesture and trigger events, whether it is a sound or gif. Be sure to train on enough samples and different angles, otherwise, the model will likely find it hard to generalize your gestures.

3 Rock Paper Scissors

This experience built on TensorFire runs neural networks in the browser using WebGL which means it is GPU-accelerated. It allows you to compete with a computer in real time through your webcam.

4 TensorFire Fast Style Transfer

Another demo from TensorFilre, GPU accelerated style transfer. It takes one of your photos and turns it into an astonishing piece of art.

If you are familiar with Keras library, you may already come across its demo for style transfer which computes two losses “content” and “style” when training the model. It takes really long to generate a decent image.

While this one running on your browser takes less than 10 seconds, make it even possible for videos.

5 Thing Translator

This demo based on Google Cloud Vision API which means the browser sends a request to Google’s server. Kindly like when you use Google Image search to search for similar images.

6 RNN based handwriting generation

This demo uses LSTM recurrent neural networks for handwriting synthesis. the source code is available.

7 Pix2Pix

You sketch a cat, the model will generate the photo for you, very likely a creepy cat.

How it works

The demo talks to the backend server running TensorFlow model, the backend server run by itself or forward to Cloud ML hosted TensorFlow service run by Google.

The cat model is trained on 2k cat photo and automatically generated edges from cat photos. So it is “edge” to “photo”. The model itself uses a conditional generative adversarial network (cGAN).

Check out the original paper if you are interested in implementation detail, it shows more example usages for cGAN like “map to aerial”, “day to night” etc.

Text Related

8 TensorFire Cyborg Writer

Another in-browser experience builds on the hardware accelerated TensorFire library let you auto-complete your sentences like Taylor Swift, Shakespeare and many more.

The original author’s goal is not to make the result “better”, but to make it “weirder”.

The model is built on rnn-writter, to learn more, you can read the author’s page.

Music Related

9 Performance RNN

Enjoy real-time piano performances created in the browser.

This model creates music in a language similar to MIDI itself, but with note-on and note-off events instead of explicit durations. So the model is capable of generating performances with more natural timing and dynamics.

Deep Learning Playground

10 TensorFlow Playground

Tinker with a neural network in your browser. Tweak the model by using different learning rate, activation function and more. Visualize the model as its training.

Let’s have a sneak peek into the brain of the neural network.

So that’s it. Do you have any cool deep learning experience you want to share? Please leave a comment and let’s continue the journey.

Ready for more experience?

I have one last secret experience at the bottom of my original post at www.dlology.com.

Originally published at www.dlology.com.