Jupyter Notebook Culling in Kubeflow

Benjamin Tan Wei Hao
DKatalis
Published in
4 min readDec 6, 2021

--

By default, when Jupyter Notebooks are launched, the notebook server hangs on forever even if there is no activity. Clearly, this is a waste of resources, and even more so when GPUs are provisioned for the notebook.

Thankfully, there is notebook culling logic built into the Kubeflow Jupyter Notebook controller. However, it is a) not documented and b) not enabled by default.

--

--

Benjamin Tan Wei Hao
DKatalis

Author of The Little Elixir & OTP Guidebook, Mastering Ruby Closures, Building an ML Pipeline in Kubeflow. | Currently: Product Owner at @dkatalis.