Antonio LopardoinDAIR.AIBART: Are all pretraining techniques created equal?A framework to compare different pre-training techniques5 min read·May 15, 2020----
Antonio LopardoinTowards Data ScienceWord2Vec to TransformersThe evolution of word embeddings, notes from CS224n.6 min read·Jan 7, 2020----
Antonio LopardoThe basics of Language ModelingNotes from CS224n lesson 6 and 7.4 min read·Dec 23, 2019----