Open in app
Sign inGet started
Introduction to UCX Network Programming

Introduction to UCX Network Programming

Network programming is always a hassle; on the bright side, as developers, we rarely get to write network programs ourselves. In most…
Go to the profile of Supun Kamburugamuve
Supun Kamburugamuve

High-Performance Network Fabrics and Libraries

Not long ago, high-performance network fabrics like InfiniBand, HPE Slingshot, or Intel Omni-Path (now CORNELIS) were primarily found in…
Go to the profile of Supun Kamburugamuve
Supun Kamburugamuve
Scalability of IO-Intensive Applications

Scalability of IO-Intensive Applications

Modern computing applications can be divided into broader categories: IO-intensive and Compute-Intensive. As the name suggests…
Go to the profile of Supun Kamburugamuve
Supun Kamburugamuve
Visual Guide to Distribution Patterns for Arrays in MPI, NCCL

Visual Guide to Distribution Patterns for Arrays in MPI, NCCL

When multiple processes are involved in a parallel computation, they must communicate periodically to synchronize the data. Many libraries…
Go to the profile of Supun Kamburugamuve
Supun Kamburugamuve
Parquet, Orc, Avro, CSV and JSON

Parquet, Orc, Avro, CSV and JSON

We encounter data in many different formats. Some common examples are CSV, JSON, XML, Text, and Binary types. Every such format has a…
Go to the profile of Supun Kamburugamuve
Supun Kamburugamuve

Table Abstractions for Data Processing

Table abstractions are a great way to represent heterogeneous and structured data in memory. In data analytics, a table is a structured…
Go to the profile of Supun Kamburugamuve
Supun Kamburugamuve
Arrays & Tensors for Data Processing

Arrays & Tensors for Data Processing

Vectors and matrices are two foundational structures in computations. A vector is an ordered collection of elements. A matrix is a…
Go to the profile of Supun Kamburugamuve
Supun Kamburugamuve

In-Memory Data Structures for Data Operations

Every program deals with data structures. Whether it is a distributed program running on thousands of computers or a serial program running…
Go to the profile of Supun Kamburugamuve
Supun Kamburugamuve
About Parallel & Distributed Computing For Data EnthusiastsLatest StoriesArchiveAbout MediumTermsPrivacyTeams