Excellent article.
Neil Slater

Hi Neil,

You bring up a good point, which I don’t mention in the article. You are right that there is definitely a memory aspect of the game which is not present when simple feed-forward networks are used as the policy. I would love to see more research in this direction as well.