Sampling in LLMs
There’s been a lot written about Large Language Models (LLMs) and ways to adjust them to your particular needs. Sampling is one of these ways that is fairly easy to use that allows the user to vary the output of an LLM such as Gemma. This post will describe some common techniques of sampling…