Hwang DongseongActually GeLU is not scaled Swish. It's approximation.Actual GeLU = x CDF(x)Aug 24Aug 24
Hwang DongseonginI. M. H. O.Mankind The Story of All of Usfor who like very fast and realistic plot storyNov 30, 2013Nov 30, 2013