Arthur Juliani
Feb 23, 2017 · 1 min read

Hi Saurav,

I think what you are asking is whether the gradient would flow backwards through both the normal and skip connection, and the answer is yes. This wouldn’t be updating twice, however. It will flow backwards through the same path that the activation flowed forward. Hope that clarifies.

    Arthur Juliani

    Written by

    PhD Student in Cog Neuro

    Welcome to a place where words matter. On Medium, smart voices and original ideas take center stage - with no ads in sight.
    Follow all the topics you care about, and we’ll deliver the best stories for you to your homepage and inbox.
    Get unlimited access to the best stories on Medium — and support writers while you’re at it. Just $5/month.