Pragyan SubediPyTorch C++ Frontend — Build a MNIST DCGAN using C++Learn how to build a MNIST DCGAN implementation in C++ using PyTorch C++ API. This article references PyTorch’s original tutorial on the…May 26May 26
Pragyan SubediUncovering variants of GLU for improving TransformersThis article is a concise explanation of variations of Gated Linear Unit (GLU) based gating mechanism introduced in the Language Modeling…Feb 9Feb 9
Pragyan SubediGated Linear Unit — Enabling stacked convolutions to out-perform RNNsThis article is a concise explanation of the Gated Linear Unit activation function introduced in the Language Modeling with Gated…Feb 9Feb 9
Pragyan SubediinCoinmonksPython Configuration Management using Hydra by MetaThis article is a concise explanation of the Hydra open-source configuration management package by Meta/Facebook Research.Feb 5Feb 5
Pragyan SubediPosition-wise Feed Forward Network For Positional Embeddings In TransformersPosition-wise feed-forward network has the following benefits over the usual positional embeddings in transformers:Jun 23, 2023Jun 23, 2023
Pragyan SubediAdaptive Embedding for Transformer XLTransformer XL, an extension of the original Transformer model, introduced adaptive embeddings to address the limitation of fixed…Jun 23, 2023Jun 23, 2023
Pragyan SubediGenerating fixed positional embeddings for input sequences using sinusoidal embeddingsWhen implementing transformer based Machine Learning model architectures, fixed positional embeddings are usually required to capture the…Jun 23, 2023Jun 23, 2023
Pragyan SubediTransformer Models by Google Brain Explained With PyTorch ImplementationThis article is a concise explanation of the Transformer model by Google Brain with a side-by-side implementation in PyTorch.Apr 19, 20231Apr 19, 20231
Pragyan SubediCLIP by OpenAI ExplainedThis article is a concise explanation of the CLIP model by OpenAI.Apr 19, 2023Apr 19, 2023
Pragyan SubediThe 4 AM Morning After An ExitHappiness shouldn’t be tied to a financial milestone nor to the euphoria of achieving something — for the grandeur of such milestones will…Mar 27, 2022Mar 27, 2022
