Matthew GuntoninTowards Data ScienceLine-By-Line, Let’s Reproduce GPT-2: Section 2 — Hardware OptimizationThis blog post will go line-by-line through the hardware optimizations in Section 2 of Andrej Karpathy’s “Let’s reproduce GPT-2 (124M)”Jul 31
Igor OfitserovinNebiusNVIDIA H100 and other GPUs — which are relevant for your ML workload?My name is Igor, I’m the Technical Product Manager for IaaS at Nebius AI. Today, I’m going to break down the differences between NVIDIA’s…Nov 21, 2023
ExetonHow NVIDIA A100 GPUs Can Revolutionize Game DevelopmentGaming has evolved from a niche hobby to a booming multi-billion-dollar industry, with its market value expected to hit a whopping $625…Jun 4Jun 4
Nigel CanningsUnlocking Maximum Inference Capability: A Deep Dive into Llama2–70B on an 80GB A100 GPUSep 25, 2023Sep 25, 2023
ExetonNVIDIA H100 vs. A100: Which GPU Reigns Supreme?NVIDIA’s CEO, Jensen Huang, unveiled the NVIDIA H100 Tensor Core GPU at NVIDIA GTC 2022, marking a significant leap in GPU technology with…May 29May 29
Matthew GuntoninTowards Data ScienceLine-By-Line, Let’s Reproduce GPT-2: Section 2 — Hardware OptimizationThis blog post will go line-by-line through the hardware optimizations in Section 2 of Andrej Karpathy’s “Let’s reproduce GPT-2 (124M)”Jul 31
Igor OfitserovinNebiusNVIDIA H100 and other GPUs — which are relevant for your ML workload?My name is Igor, I’m the Technical Product Manager for IaaS at Nebius AI. Today, I’m going to break down the differences between NVIDIA’s…Nov 21, 2023
ExetonHow NVIDIA A100 GPUs Can Revolutionize Game DevelopmentGaming has evolved from a niche hobby to a booming multi-billion-dollar industry, with its market value expected to hit a whopping $625…Jun 4
Nigel CanningsUnlocking Maximum Inference Capability: A Deep Dive into Llama2–70B on an 80GB A100 GPUSep 25, 2023
ExetonNVIDIA H100 vs. A100: Which GPU Reigns Supreme?NVIDIA’s CEO, Jensen Huang, unveiled the NVIDIA H100 Tensor Core GPU at NVIDIA GTC 2022, marking a significant leap in GPU technology with…May 29
Sanjay Basu, PhDinmy_aimlOn Memory — the better half of LLM’s beloved Compute!!“640K ought to be enough for anybody.” — Remark attributed to Bill Gates in 1981. Gates denied in 1996 that he made this remark. The…Feb 9, 2023
GPUnetFace-off between AI Powerhouses — A100 vs. H100! A Complete AnalysisThe decade of AI, ruled by the chip making companies and compute accelerators. The decade which will be remembered for multiple decades…May 16
Aditya BibaveinSearceMonitor your Nvidia GPUs on Kubernetes using DatadogIn this blog, we are going to configure monitoring of Nvidia A100 GPU workloads on GKE using Datadog’s integration with DCGM exporter.Nov 25, 2022