Llama 3 + Llama.cpp is the local AI Heaven

Build a fully local (nano) DiagramGPT using Llama 3 8B and learn about inline function calling

Vatsal Saglani
Towards AI
Published in
18 min readMay 12, 2024

--

Image by ChatGPT

The Quest for Local AI Innovation

This is the third time in three weeks that I’m writing about developing AI-powered or GenAI-powered applications that work with local LLMs. Since, the…

--

--