LLMs customization with Low-Rank Adaptation (LoRA)

Valentina Alto
Microsoft Azure

--

Large Language Models (LLMs) such as GPT-4, Llama-2 and Mistral are featured by a huge amount of parameters (measured in hundred of billions) and designed to be general purpose. If you want to adapt them to specific task, the most straightforward way would be that of “asking” them to do that specific task. For example, if you want your LLM to be your sentiment analyzer, you might instruct it with a…

--

--

Valentina Alto
Microsoft Azure

Data&AI Specialist at @Microsoft | MSc in Data Science | AI, Machine Learning and Running enthusiast