Shaurya GoelinThe StartupExpectation Maximisation(EM) explained part 1Let’s derive why EM algorithm is called EM and the two types of EM algorithm.May 28, 20201May 28, 20201
Shaurya GoelGELU (GAUSSIAN ERROR LINEAR UNIT)A new activation function called GELU which is inspired by the Gaussian distributionJul 21, 20191Jul 21, 20191
Shaurya GoelKaiming He initializationWe will derive Kaiming initialization in this post.Jul 14, 20192Jul 14, 20192
Shaurya GoelPReLU activationThis paper introduced both the PReLU activation and Kaiming initialization. We will discuss PReLU in this post and Kaiming initialization…Jul 10, 20193Jul 10, 20193