Engineering Insights

Using Karpenter to manage GPU nodes with time-slicing

TarrantRo
Jina AI

--

Introduction

For machine learning, utilizing GPUs will power the computation workloads. However, nowadays, companies and users are keen to use the cloud instead of individual bare machines. With cloud computing, you only need to pay what you use and don’t need to buy expensive machines with graphic cards…

--

--

TarrantRo
Jina AI

IT guy who love movies, Japanese manga. Have some experiences in Linux system, container/k8s, devops, cloud, etc.