Dzmitry BahdanauThe FLOPs Calculus of Language Model TrainingExtremely large language models like the famous GPT-3 by OpenAI are all the rage. Many of us are now trying to get a sense of scale of the…Jan 9, 20223Jan 9, 20223