Feb 23, 2017 · 1 min read
Hi Saurav,
I think what you are asking is whether the gradient would flow backwards through both the normal and skip connection, and the answer is yes. This wouldn’t be updating twice, however. It will flow backwards through the same path that the activation flowed forward. Hope that clarifies.
