Francisco InghaminA paper a day avoids neuron decayDay 12: Generating Long Sequences with Sparse Transformers[Apr 23, 2018] Model very long sequences in a compute/memory efficient way9 min read·May 1, 2019--3--3
Francisco InghaminA paper a day avoids neuron decayDay 10: All You Need Is A Good Init[Nov 19, 2015] How to initialize your deep networks for any activation function5 min read·Apr 22, 2019----
Francisco InghaminVoice Tech PodcastDay 9: Transformer-XL: Attentive Language Models Beyond a Fixed-Length ContextHow to improve your Transformer’s performance through increased long-term coherence by using recurrence8 min read·Apr 5, 2019--1--1
Francisco InghaminA paper a day avoids neuron decayDay 9: Transformer-XL: Attentive Language Models Beyond a Fixed-Length Context[Jan 18, 2019] How to improve your Transformer’s performance through increased long-term coherence by using recurrence8 min read·Apr 3, 2019----
Francisco InghaminA paper a day avoids neuron decayDay 8: Delving Deep into Rectifiers: Surpassing Human-Level Performance on ImageNet Classification…[Feb 6, 2015] How to initialize your deep ReLU activated networks to avoid vanishing and exploding gradients8 min read·Mar 29, 2019----
Francisco InghaminA paper a day avoids neuron decayDay 7: Natural TTS Synthesis By Conditioning WaveNet On Mel Spectogram Predictions (Tacotron 2)[Dec 16, 2017] The key to generate human-like speech, without predefined features8 min read·Mar 27, 2019----
Francisco InghaminA paper a day avoids neuron decayDay 6: Deep Voice 3: Scaling Text to Speech with Convolutional Sequence Learning[Oct 20, 2017] Real-time, high quality, multi-speaker text-to-speech inference8 min read·Mar 19, 2019----
Francisco InghaminA paper a day avoids neuron decayDay 5: Conditional Image Generation with PixelCNN Decoders[Jun 16, 2016] Creating images from a vector5 min read·Mar 16, 2019--1--1
Francisco InghaminA paper a day avoids neuron decayDay 4: Pixel Recurrent Neural Networks[Jan 25, 2016] Generating images with RNN’s6 min read·Mar 15, 2019--1--1
Francisco InghaminA paper a day avoids neuron decayDay 3: WaveNet: A Generative Model for Raw Audio[Sep 12, 2016] The key to generating human-like speech6 min read·Mar 12, 2019----
