Lukas HauzenbergerIntroducing pytora — a minimal PyTorch implementation of LoRATLDR - here is the code: https://github.com/sirluk/pytoraMay 26May 26
Lukas HauzenbergerMultilabel Classification using Mistral-7B on a single GPU with quantization and LoRALLMs have impressed with there abilities to solve a wide variety of tasks, not only for natural language but also in a multimodal setting…Jan 1611Jan 1611
Lukas HauzenbergerWhat I learned doing Data Science Interviews in the 2020sFew disciplines have experienced hype periods comparable to that of Data Science (DS) and Machine Learning (ML) since approximately 2016…Dec 18, 2023Dec 18, 2023
Lukas HauzenbergerTraining and serving PyTorch models in the Google Cloud with Vertex AI pipelinesWith each new feature Vertex AI is making it easier to put Machine Learning (ML) prototypes into production. Nowadays you do not really…Apr 7, 20233Apr 7, 20233
Lukas HauzenbergerAdverserial TrainingLarge language models following the transformer architecture have been incredibly successful since their introduction by Vaswani et. al. in…Aug 22, 2022Aug 22, 2022
Lukas HauzenbergerAn practical introduction to Diff-Pruning for BERTIn this article I would like to give a short introduction for an elegant technique to make finetuning of large language models more storage…Feb 23, 20224Feb 23, 20224
