Good question! In a followup post I will be extending BYOL-Hindsight to work in a new partially observable 2D Minecraft environment. Therefore I will be using recurrent networks.