From Gated Recurrent Units explained using Matrices: Part 1 by Sparkle Russell-Puleri

The answer is we use a process called “Broadcasting”. Broadcasting is used to make the shapes of the these two tensors compatible, such that we can perform our element-wise matrix operations. This means that Wz will get broadcasted to a non-matrix dimension, which in our case is our sequen…