Arxiv Bytes

Summary: GameGAN

Ideas from this summary are taken from the GameGAN paper.

Summary: Conservative Policy Iteration

Conservative Policy Iteration has 3 goals: (1) an iterative procedure guaranteed to improve a performance metric, (2) terminate in a “small” number of steps, and (3) find an “approximate” optimal policy. These three goals are hit by relying on a few assumptions…

Summary: SimPLe

Ideas and figures from this summary are taken from Model-Based Reinforcement Learning for Atari(SimPLe).

Summary: PlaNet

Deep Planning Network (PlaNet), is a model-based agent that learns a latent state dynamics model from images and takes actions…

Summary: World Models

One of the core issues in Reinforcement Learning is sample complexity. Therefore it’s appealing to train RL agents in a…

Summary: Learning Plannable Representations with Causal InfoGAN

Summary: Value Prediction Networks(VPN)

VPN is a deep reinforcement learning architecture that mixes ideas from both model free and model based methods. Generally model based methods learn environment dynamics so as to predict real observations, however, VPN attempts to learn a dynamics model that…

Summary: Proximal Policy Optimization(PPO)

Ideas from this summary are taken from the Proximal Policy Optimization paper.

PPO offers two key improvements to policy gradient methods:

1. Surrogate objective include a simple first order trust region…

Summary: TreeQN

Ideas from this summary are taken from the TreeQN and ATreeC paper.