In-depth Explanation and Visualizations — Introduction Nvidia has recently published a new vision transformer, titled the Global Context Vision Transformer (GC ViT) (Hatamizadeh et al., 2022). GC ViT introduced a novel architecture that leverages both global attention and local attention, allowing it to model both short-range and long-range spatial interactions. The clever techniques used by the…

In-depth Explanation and Animations — Introduction Swin Transformer (Liu et al., 2021) is a transformer-based deep learning model with state-of-the-art performance in vision tasks. Unlike the Vision Transformer (ViT) (Dosovitskiy et al., 2020) which precedes it, Swin Transformer is highly efficient and has greater accuracy. Due to these desirable properties, Swin Transformers are used as the…

Is this the beginning of the end for Batch Normalization? — Introduction DeepMind has recently released a new family of image classifiers that achieved a new state-of-the-art accuracy on the ImageNet dataset. This new family of image classifiers, named NFNets (short for Normalizer-Free Networks), achieves comparable accuracy to EfficientNet-B7, while having a whopping 8.7x faster train time.

GANs — Illustrated, explained and coded — Introduction In 2014, a then-unknown Ph.D. student named Ian Goodfellow introduced Generative Adversarial Networks (GANs) to the world. GANs were unlike anything the AI community had seen, and Yann LeCun described it as “the most interesting idea in the last 10 years in ML”. Since then, much research effort have poured…

A gentle introduction to modern movie recommenders — Traditionally, recommender systems are based on methods such as clustering, nearest neighbor and matrix factorization. However, in recent years, deep learning has yielded tremendous success across multiple domains, from image recognition to natural language processing. Recommender systems have also benefited from deep learning’s success. In fact, today’s state-of-the-art recommender systems…

A year ago, I posted my very first article on Medium titled ‘How to build your own Neural Network from scratch in Python’. How to build your own Neural Network from scratch in Python A beginner’s guide to understanding the inner workings of Deep Learningtowardsdatascience.com Inspired by the many articles I read here, I wanted to contribute to the community by writing a beginner’s guide to Neural Networks in Python. …