AnchenFine-tune Llama3 with function calling via MLX-LMWith the recent release of Llama 3, Meta has delivered a game-changing open-source model that combines impressive performance with a…3 min read·Apr 27, 2024--3--3
AnchenQlora Mixtral 8x7B via mlxMixture of Experts (MoE) models, the latest in cutting-edge LLM model, Their unique architecture and gating mechanism necessitate more…3 min read·Jan 25, 2024----
AnchenRunning LLM with apple’s MLX frameworkMLX is a new ML framework for machine learning on Apple Silicon that was recently released. Considering that Apple Silicon devices…2 min read·Dec 22, 2023----
AnchenReplace Grammarly with open source LLMI have been using the self-hosted llama 30B model for local grammar check and translation because most of the smaller llama models are not…3 min read·Oct 14, 2023--4--4
AnchenHost your own ChatGPT alternativeIn my previous posts, we fine-tuned some of the open-source LLM models and most of the time we just use text-generation UI or handcrafted…4 min read·Sep 14, 2023----
AnchenFine-Tuning CodeLlama 34B for ChatWhile Meta’s Llama2 captured significant attention in the AI landscape, however the 34b model was notably absent for quite a while. For…4 min read·Sep 6, 2023----
AnchenFine-tune Llama 2 with SFT and DPOIn my previous article, we discussed how to fine-tune the LLAMA model using Qlora script. However, with the latest release of the LLAMA 2…4 min read·Aug 13, 2023--1--1
AnchenBuild your own copliot using open source LLMI first became aware of LLM through the GitHub Copilot release. I was impressed by how it improves developer productivity and always…4 min read·Jun 19, 2023----
AnchenFine-tune the llama model for your application use caseWhen developing an LLM related application, often, you may find that the model output doesn’t strictly follow the instructions, especially…3 min read·Jun 10, 2023----
AnchenHow to fine-tune an open-source LLaMa using QLoRaAs a developer who often turns to ChatGPT as my trusty pair-programming companion, we end up engaging in many detailed discussions on…3 min read·Jun 1, 2023--1--1