Homepage
Open in app
Sign in
Get started
Between Real and Ideal
About HPC and DNN research and my life
Follow
Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift 4/100
Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift 4/100
4th thesis is about Batch Normalization (a.k.a BN) which allows us to use high learning rates and be less careful about initialization…
Shun John Iwase
Apr 13, 2018
Extremely Large Minibatch SGD: Training ResNet-50 on ImageNet in 15 Minutes 3/100
Extremely Large Minibatch SGD: Training ResNet-50 on ImageNet in 15 Minutes 3/100
3rd thesis is about Rest-50 training with using extremely large minibatch SGD.
Shun John Iwase
Apr 10, 2018
Distributed Second-Order Optimization using Kronecker-Factored Approximations 2/100
Distributed Second-Order Optimization using Kronecker-Factored Approximations 2/100
2nd thesis is about speeding up training with using K-FAC method instead of SGD.
Shun John Iwase
Apr 10, 2018
Imagenet Training in Minutes 1/100
Imagenet Training in Minutes 1/100
Just I started challenge to read 100 theses until May 6th. It’s just note to myself. Feel free to quote and make a link to this article.
Shun John Iwase
Apr 9, 2018
About my dream
About my dream
From this April, I got in the master course of computer science and became a member of the Yokota Lab in Tokyo Institute of Technology…
Shun John Iwase
Apr 7, 2018
About Between Real and Ideal
Latest Stories
Archive
About Medium
Terms
Privacy
Teams