Image for post
Image for post
The AlphaGo Zero Cheat Sheet (high-res link below)

AlphaGo Zero Explained In One Diagram

Download the AlphaGo Zero cheat sheet

David Foster
Oct 29, 2017 · 2 min read

Get the full cheat sheet here


Update! (2nd December 2019)

I’ve just released a series on MuZero — AlphaZero’s younger and cooler brother. Check it out 👇

How to Build Your Own MuZero Using Python (Part 1/3)

How to Build Your Own MuZero Using Python (Part 2/3)

How to Build Your Own MuZero Using Python (Part 3/3)


Update! (26th January 2018)

I’ve just released a post on how you can build AlphaZero using Python and Keras. Check it out 👇

How to build your own AlphaZero AI using Python and Keras


What’s AlphaZero?

Recently Google DeepMind announced AlphaGo Zero — an extraordinary achievement that has shown how it is possible to train an agent to a superhuman level in the highly complex and challenging domain of Go, ‘tabula rasa’ — that is, from a blank slate, with no human expert play used as training data.

It thrashed the previous reincarnation 100–0, using only 4TPUs instead of 48TPUs and a single neural network instead of two.

The paper that the cheat sheet is based on was published in Nature and is available here. I highly recommend you read it, as it explains in detail how deep learning and Monte Carlo Tree Search are combined to produce a powerful reinforcement learning algorithm.

Hopefully you find the AlphaGo Zero cheat sheet useful — let me know if you find any typos or have questions about anything in the document.


Image for post
Image for post

If you would like to learn more about how our company, Applied Data Science develops innovative data science solutions for businesses, feel free to get in touch through our website or directly through LinkedIn.

… and if you like this, feel free to leave a few hearty claps :)


Applied Data Science is a London based consultancy that implements end-to-end data science solutions for businesses, delivering measurable value. If you’re looking to do more with your data, let’s talk.

Applied Data Science

Cutting edge data science, machine learning and AI projects

Welcome to a place where words matter. On Medium, smart voices and original ideas take center stage - with no ads in sight. Watch
Follow all the topics you care about, and we’ll deliver the best stories for you to your homepage and inbox. Explore
Get unlimited access to the best stories on Medium — and support writers while you’re at it. Just $5/month. Upgrade

Get the Medium app

A button that says 'Download on the App Store', and if clicked it will lead you to the iOS App store
A button that says 'Get it on, Google Play', and if clicked it will lead you to the Google Play store