Yash OzaScaling Model Training Across Multiple GPUs: Efficient Strategies with PyTorch DDP and FSDPRecent years have witnessed exponential growth in the scale of distributed parallel training and the size of deep learning models. In…Jun 251Jun 251
Yash OzaGPU Architecture (CUDA)With th rapid growth of GPU computing use case, the demand for graphics processing units has surged . The demand for GPU’s has been so…May 71May 71
Yash OzaI-Introduction to CompilingThe principles and techniques of compiler writing are so pervasive that the ideas found will be used many times in the career of Computer…Apr 15Apr 15