A complete guide to running local LLM models

Meta just released Llama 2 [1], a large language model (LLM) that allows free research and commercial use. It’s expected to spark another wave of local LLMs that are fine-tuned based on it.

The open-source community has been very active in trying to build open and locally accessible LLMs as alternatives to ChatGPT after the first version of Llama came out in late February.

I have been closely following this trend — I have run and tested dozens of local LLMs that can be run on commercial hardware because I truly look forward to…