constanza fierroAbout biases in the data and how that affects the factual knowledge language models learnIn this blogpost we’re going to talk about 3 papers presented at EMNLP 2021 [5,6,7] that touch on the subject of biases in the training…7 min read·Jan 31, 2022----
constanza fierroinDAIR.AIRecipes for building an open-domain chatbotRecipes for building an open-domain chatbot10 min read·Jun 5, 2020----
constanza fierroinDAIR.AIA Light Introduction to BERTPre-training of Deep Bidirectional Transformers for Language Understanding.6 min read·May 11, 2020----
constanza fierroinDAIR.AIAttention is all you need, the transformer architectureThis is the paper that first introduced the transformer architecture, which allowed language models to be way bigger and parallelizable.5 min read·Apr 25, 2020----