PinnedPedro MagalhãesRPC —A New Way to Build Language ModelsThis work explains how to build a very small language model (5M Params) using a new approach called Relevant Pecedence Compression.4d ago4d ago