Pure as Snow by Mono

Gets to the peak of a…

Is ReLU after Sigmoid bad?

There was a recent blog post on mental models for deep learning drawing parallels from optics [link]. We all have intuitions for few models but it is hard to put it in words, I believe it is necessary to work collectively for this mental model.

I want to write blogs, cause I know I have been embarrassed to write a lot of things in this space or just too shy. But shouldn’t we try to have lesser friction between what we do and what we are. At the same time, this is too much to start with, so I would use some zen and start with a hand full of water than the whole blues.