Self-supervised learning is all the rage these days for machine learning. Whether its models like GPT-3 for natural language processing or data augmentation for computer vision, everyone is trying to get something for free from their data without paying for expensive things like labels.

In this article, we’ll go over one area of computer vision research focused on the very same goal. This area has gone relatively unnoticed by the broader machine learning community. …