How to Train a Very Large and Deep Model on One GPU?
Problem: GPU memory limitation
I believe I don’t need to explain how powerful a GPU can be for training deep neural networks anymore. Using a commonly popular ML framework, it is much more convenient to assign the…