Published inA paper a day avoids neuron decayDay 12: Generating Long Sequences with Sparse Transformers[Apr 23, 2018] Model very long sequences in a compute/memory efficient wayMay 1, 20193May 1, 20193
Published inA paper a day avoids neuron decayDay 10: All You Need Is A Good Init[Nov 19, 2015] How to initialize your deep networks for any activation functionApr 22, 2019Apr 22, 2019
Published inVoice Tech PodcastDay 9: Transformer-XL: Attentive Language Models Beyond a Fixed-Length ContextHow to improve your Transformer’s performance through increased long-term coherence by using recurrenceApr 5, 20191Apr 5, 20191
Published inA paper a day avoids neuron decayDay 9: Transformer-XL: Attentive Language Models Beyond a Fixed-Length Context[Jan 18, 2019] How to improve your Transformer’s performance through increased long-term coherence by using recurrenceApr 3, 2019Apr 3, 2019
Published inA paper a day avoids neuron decayDay 8: Delving Deep into Rectifiers: Surpassing Human-Level Performance on ImageNet Classification…[Feb 6, 2015] How to initialize your deep ReLU activated networks to avoid vanishing and exploding gradientsMar 29, 2019Mar 29, 2019
Published inA paper a day avoids neuron decayDay 7: Natural TTS Synthesis By Conditioning WaveNet On Mel Spectogram Predictions (Tacotron 2)[Dec 16, 2017] The key to generate human-like speech, without predefined featuresMar 27, 2019Mar 27, 2019
Published inA paper a day avoids neuron decayDay 6: Deep Voice 3: Scaling Text to Speech with Convolutional Sequence Learning[Oct 20, 2017] Real-time, high quality, multi-speaker text-to-speech inferenceMar 19, 2019Mar 19, 2019
Published inA paper a day avoids neuron decayDay 5: Conditional Image Generation with PixelCNN Decoders[Jun 16, 2016] Creating images from a vectorMar 16, 20191Mar 16, 20191
Published inA paper a day avoids neuron decayDay 4: Pixel Recurrent Neural Networks[Jan 25, 2016] Generating images with RNN’sMar 15, 20191Mar 15, 20191
Published inA paper a day avoids neuron decayDay 3: WaveNet: A Generative Model for Raw Audio[Sep 12, 2016] The key to generating human-like speechMar 12, 2019Mar 12, 2019
