Dhanoop KarunakaranParameter Efficient Finetuning (PEFT) of LLMThis article explains the PEFT technique to finetune LLM and how can we implement it. To learn more about Transformer and its different…Oct 23, 2023Oct 23, 2023
Dhanoop KarunakaranFine-tuning Large Language Models series: Part1 — Internal mechanism of LLMsMy intention is to post multiple articles about the fine-tuning of LLMs. In this article, I discuss what are the underline technology…Jul 28, 2023Jul 28, 2023
Dhanoop KarunakaranIntroduction to TransformerThe transformer is a neural network that can learn the context in sequential data such as languages[1]. It performs many architectures…Oct 26, 20221Oct 26, 20221
Dhanoop KarunakaranGenerative Adversarial Nets(GAN) and Conditional Generative Adversarial Nets(CGAN)There are two types of methods to construct the predictive model in ML: Discriminative and Generative. The discriminative approach learns…Jan 20, 2021Jan 20, 2021
Dhanoop KarunakaranOff-policy policy gradient reinforcement learning algorithmsOn-policy algorithms are using target policy to sample the actions and the same policy is used to optimise for. REINFORCE and vanilla…Nov 5, 20201Nov 5, 20201
Dhanoop KarunakaranThe link between Maximum Likelihood Estimation(MLE)and Cross-EntropyMaximum Likelihood EstimationMay 29, 20201May 29, 20201
Dhanoop KarunakaranGradient descent algorithm explained with linear regression exampleGradient descent algorithm is an optimisation algorithm that uses to find the optimal value of parameters that minimises loss function…May 21, 2020May 21, 2020
Dhanoop KarunakaranOne shot learning explained using FaceNetOne shot learningSep 27, 20181Sep 27, 20181
Dhanoop KarunakaranInstall TensorFlow gpu on ubuntu18.04I wrote this post to simplify the installation process of gpu version of TensorFlow on Ubuntu 18.04. I have described installation steps…Aug 27, 20181Aug 27, 20181
Dhanoop KarunakaranTraffic sign detection - Udacity’s selfdriving car nanodegree— deep learning series 31. IntroductionJun 6, 20181Jun 6, 20181
