Venkat's Blog – Medium

Venkat's Blog

Pinned

Venkat's Blog

Essential Math & Concepts for LLM Inference

Back of the envelope calculations to estimate model’s GPU memory requirements & insights into HW/SW optimizations

11 min readMay 31, 2024

--

Essential Math & Concepts for LLM Inference

--

Pinned

Venkat's Blog

The power of Mechanical Sympathy in Software Engineering

Exploring Locality of Reference, LMAX Disruptor & Flash Attention

21 min readApr 18, 2024

--

The power of Mechanical Sympathy in Software Engineering

--

Pinned

Venkat's Blog
in
GoPenAI

CPU & GPU — The Basics

A digestible high-level overview of what happens in The Die

15 min readApr 8, 2024

--

CPU & GPU — The Basics

--

Venkat's Blog

IMHO, this is not the correct benchmark.

"The mean processing time is 286ms for Rust versus 436ms for Java." --> On the contrary, it proves how fast LMAX Disruptor is.

1 min readMay 2, 2024

--

1

--

1

Venkat's Blog

How Understanding CPU Caches Can Supercharge Your Code: 461% Faster MatMul Case Study

The power of Mechanical Sympathy in Software Engineering — Part 1

6 min readApr 25, 2024

--

How Understanding CPU Caches Can Supercharge Your Code: 461% Faster MatMul Case Study

--

Venkat's Blog

OS Error: Too many open files. Understanding file and socket descriptors.

Debugging resource leakage and optimizing server configuration

7 min readMar 26, 2024

--

OS Error: Too many open files. Understanding file and socket descriptors.

--

Venkat's Blog

HTTP Load Balancer on Top of WSO2 Gateway — Part 1: Project Repository, Architecture and Features

It’s almost four months and it has been an amazing journey! At this point, I would like to thank my mentorsIsuru Ranawaka and Kasun…

11 min readNov 13, 2022

--

HTTP Load Balancer on Top of WSO2 Gateway — Part 1: Project Repository, Architecture and Features

--

Venkat's Blog

HTTP Load Balancer performance test

In myprevious post, I discussed Load Balancer Engine Architecture and its features. In this post, I’ll be discussing on performance…

3 min readNov 13, 2022

--

HTTP Load Balancer performance test

--

Venkat's Blog

GSoC — Community Bonding Period

This year, the community bonding period was from April 22nd — May 22nd.. Though I was communicating with my mentor and community members…

2 min readNov 13, 2022

--

--

Venkat's Blog

HTTP Load Balancer on Top of WSO2 Gateway — Part 1: Project Repository, Architecture and Features

It’s almost four months and it has been an amazing journey! At this point, I would like to thank my mentors Isuru Ranawaka and Kasun…

2 min readNov 13, 2022

--

HTTP Load Balancer on Top of WSO2 Gateway — Part 1: Project Repository, Architecture and Features

--

Venkat's Blog

Venkat's Blog

🧑‍💻 Staff Engineer – Distributed Systems, Machine Learning |📍Berlin 🇩🇪 | 📚 https://venkat.eu | 💬 https://twitter.com/Venkat2811

Following

Help
Status
About
Careers
Press
Blog
Privacy
Terms
Text to speech
Teams