This post is a summary of Lecture 5 of Deep RL Bootcamp 2017 at UC Berkely. All of the figures, equations, and text are taken from the lecture slides and videos available here.