AnchenFine-tune Llama3 with function calling via MLX-LMWith the recent release of Llama 3, Meta has delivered a game-changing open-source model that combines impressive performance with a…Apr 273Apr 273
AnchenQlora Mixtral 8x7B via mlxMixture of Experts (MoE) models, the latest in cutting-edge LLM model, Their unique architecture and gating mechanism necessitate more…Jan 25Jan 25
AnchenRunning LLM with apple’s MLX frameworkMLX is a new ML framework for machine learning on Apple Silicon that was recently released. Considering that Apple Silicon devices…Dec 22, 2023Dec 22, 2023
AnchenReplace Grammarly with open source LLMI have been using the self-hosted llama 30B model for local grammar check and translation because most of the smaller llama models are not…Oct 14, 20235Oct 14, 20235
AnchenHost your own ChatGPT alternativeIn my previous posts, we fine-tuned some of the open-source LLM models and most of the time we just use text-generation UI or handcrafted…Sep 14, 2023Sep 14, 2023
AnchenFine-Tuning CodeLlama 34B for ChatWhile Meta’s Llama2 captured significant attention in the AI landscape, however the 34b model was notably absent for quite a while. For…Sep 6, 2023Sep 6, 2023
AnchenFine-tune Llama 2 with SFT and DPOIn my previous article, we discussed how to fine-tune the LLAMA model using Qlora script. However, with the latest release of the LLAMA 2…Aug 13, 20231Aug 13, 20231
AnchenBuild your own copliot using open source LLMI first became aware of LLM through the GitHub Copilot release. I was impressed by how it improves developer productivity and always…Jun 19, 2023Jun 19, 2023
AnchenFine-tune the llama model for your application use caseWhen developing an LLM related application, often, you may find that the model output doesn’t strictly follow the instructions, especially…Jun 10, 2023Jun 10, 2023
AnchenHow to fine-tune an open-source LLaMa using QLoRaAs a developer who often turns to ChatGPT as my trusty pair-programming companion, we end up engaging in many detailed discussions on…Jun 1, 20231Jun 1, 20231