Multi-GPU training of Large, Sparse-Matrix on Wide #NeuralNetwork
Multi-GPU training of neural network on TensorFlow (v0.12 as of this blog) is a pain. It is a pain if you get off the beaten path that is. I found out a bit early that the SparseTensors in the contrib.learn package…