Sehyun ChoiThe Rise of RNN? Review of Retentive NetworkTLDR; RetNet meets all three criterias: O(1) inference, parallel training, and beats same-sized transformers.Jul 21, 20236Jul 21, 20236
Sehyun ChoiReview of the ACL2023 GZIP paper — “Low-Resource” Text Classification: A Parameter-Free…TLDR;Jul 14, 2023Jul 14, 2023