…o the input data. Problem …o the input data. Problem with linear activation function is that it’s derivative is a constant and it’s gradient will be a constant too and the descent will be on a constant gradient.Secret Sauce behind the beauty of Deep Learning: Beginners guide to Activation Functions1.2K7Mate LabsAlex MurphyFollowAug 23, 2017 · 1 min readits