ming gaoDistributed Model Training at Scale: Part One— Parallel-TrainingParallel-training strategies such as data parallelism, ZeRO data parallelism, tensor parallelism, and pipeline parallelism.1d ago
Lucas de Lima NogueirainTowards Data ScienceHow Bend Works: A Parallel Programming Language That “Feels Like Python but Scales Like CUDA”A brief introduction to Lambda Calculus, Interaction Combinators, and how they are used to parallelize operations on Bend / HVM.Jun 267
Daniel LasSpeed of Java streamIs Java Stream API nice but slow abstraction? Myths debunked.Mar 2312Mar 2312
Bill ChenUsing C++ Conditional Variables for Thread SynchronizationA synchronization primitive blocking multiple threads until a condition is met.14h ago14h ago
Super Fast PythonPython ProcessPoolExecutor: 7-Day Crash CourseThe Python ProcessPoolExecutor allows us to create and manage process pools in Python.Dec 10, 20231Dec 10, 20231
ming gaoDistributed Model Training at Scale: Part One— Parallel-TrainingParallel-training strategies such as data parallelism, ZeRO data parallelism, tensor parallelism, and pipeline parallelism.1d ago
Lucas de Lima NogueirainTowards Data ScienceHow Bend Works: A Parallel Programming Language That “Feels Like Python but Scales Like CUDA”A brief introduction to Lambda Calculus, Interaction Combinators, and how they are used to parallelize operations on Bend / HVM.Jun 267
Bill ChenUsing C++ Conditional Variables for Thread SynchronizationA synchronization primitive blocking multiple threads until a condition is met.14h ago
Super Fast PythonPython ProcessPoolExecutor: 7-Day Crash CourseThe Python ProcessPoolExecutor allows us to create and manage process pools in Python.Dec 10, 20231
Natdhanai PraneenatthaveeEffortless Parallel Custom Deep Learning Model with Ray: A Practical GuideI mainly focus on GPU parallelism.2d ago
Siladitya GhoshUnlocking the Power of CUDA in the Cloud: Accelerating Parallel ComputingIn the world of high-performance computing, CUDA (Compute Unified Device Architecture) has emerged as a game-changer, enabling developers…1d ago