LLaMA & Alpaca: “ChatGPT” On Your Local Computer 🤯 | Tutorial

Martin Thissen
5 min readMar 18, 2023

In this article I will show you how you can run state-of-the-art large language models on your local computer. Yes, you’ve heard right.

For this we will use the dalai library which allows us to run the foundational language model LLaMA as well as the instruction-following Alpaca model. While the LLaMA model is a foundational (or broad) language model that is able to predict the next token (word) based on a given input sequence (sentence), the Alpaca model is a fine-tuned version of the LLaMA model capable of following instructions (which you can think of as ChatGPT behaviour). What’s even more impressive, both these models achieve comparable results or even outperform their GPT counterparts while still being small enough to run on your local computer. In this video I will show you that it only takes a few steps (thanks to the dalai library) to run “ChatGPT” on your local computer.

If you like videos more, feel free to check out my YouTube video to this article:

LLaMA Model

--

--

Martin Thissen

Writing Articles on How to Use AI Models and How They Work