Running BERT on Google Cloud Platform With TPU

Use Google Cloud and TPU to Build a Deep Learning Environment

Jason Zhang
Nov 11, 2020 · 9 min read
Photo by Rajeshwar Bachu on Unsplash

By 2020, various deep learning models such as Transformer, BERT, and GPT-series make AI become smarter and smarter, using them can achieve many incredible tasks. On the hardware, Google launched Cloud TPU allows programmers to train these “Big” models at a reasonable cost.