AmansinghalmlAudio Codecs (OPUS, Encodec)Why are audio codecs needed? Because we convert analog music data to digital data through sampling. And as per the Nyquist criteria the…Apr 21Apr 21
AmansinghalmlLLM.int8(): 8-bit Matrix Multiplication for Transformers at ScaleWhy is this paper relevant? The goal is to reduce memory footprint using quantization of model weights and activations. Previously…Apr 15Apr 15
AmansinghalmlMulti-armed banditsAre the number of possible arms in multi-armed bandit discrete or continuous? DiscreteMar 29Mar 29
AmansinghalmlDecoding strategies for MCQ questionsHow are they evaluating the models on MCQ questions? There are 3 ways to evaluate MCQ questions & answers (1) Generate option A (2) Compare…Mar 22Mar 22
AmansinghalmlUnderstanding DimensionsWhat does it mean that a vanilla neural network has 5 neurons?Oct 30, 2023Oct 30, 2023
AmansinghalmlDecoding Transformer Decodingso this is how encoder decoder architectures work, specifically the decoder work. During training it learns through teacher forcing…Oct 29, 2023Oct 29, 2023