Train Machine Learning models with Vertex AI Training
A simple and scalable approach with custom container
Published in
6 min readJun 9, 2022
I regularly guide customers on how they can scale their training on the Cloud. While every customer has unique requirements and expectations, the overall process is the same.
In this article, we train a transformer model (DistilBert) with Vertex AI. As a machine learning Framework, I use TensorFlow. It will also work for any other machine learning framework (PyTorch, XGBoost, scikit-learn, you name it) and any other ML use case. There are no limitations.
Don’t get overwhelmed by the lengthiness of the article. If you have it done once, you can do it next time in under 5 minutes.
Jump Directly to the Notebook
All the code for this article is ready to use in a Google Colab notebook. If you have questions, please reach out to me via LinkedIn or Twitter.
