How to Run Your Own Local LLM: Updated for 2024 — Version 2
Originally Published on HackerNoon
This is the breakout year for Generative AI!
Yes, this article’s been written by a violinist and there’s new content! Spectacular new and awesome content!
Well; to say the very least, this year, I’ve been spoiled for choice as to how to run an LLM Model locally.
Let’s start!
1) HuggingFace Transformers
Magic of Bing Image Creator — Very imaginative.
Hugging Face Transformers is a state-of-the-art machine learning library that provides easy access to a wide range of pre-trained models for Natural Language Processing (NLP), Computer Vision, Audio tasks, and more. It’s an open-source library developed by Hugging Face, a company that has built a strong community around machine learning and NLP.