Jingyi Xie
Jingyi Xie

Jingyi Xie

Medium member since October 2019
5 Following
1 Followers

Highlighted by Jingyi Xie

See more

From Understanding GRU Networks by Simeon Kostadinov

The update gate helps the model to determine how much of the past information (from previous time steps) needs to be passed along to the future. That is really powerful because the model can decide to copy all the information from the past and…

From Generating Training Datasets Using Energy Based Models that Actually Scale by Jesus Rodriguez

To mitigate the limitations of traditional EBMs related to the dependency on gradient-descent methods, OpenAI d…

From Generating Training Datasets Using Energy Based Models that Actually Scale by Jesus Rodriguez

To mitigate the limitations of traditional EBMs related to the dependency on gradient-descent methods, OpenAI decided to leverage a technique known as Langevin Dynamics as its main optimization method.…