Tributary Data

Delta Lake is a powerful open-source storage layer that brings ACID transactions to Apache Spark and big data workloads. It provides…

Delta tables are a new type of table in Databricks that provide a powerful and efficient way to work with big data. They are optimized for…

In today’s data-driven landscape, businesses seek powerful solutions to harness the full potential of their data. This post aims to guide…

Partitioning is a fundamental concept in distributed data systems like Databricks, aimed at improving data organization and retrieval…

What are Webhooks, how do they work, and what challenges you face when implementing them

The data engineer will frequently work with many types of data to execute numerous operations utilizing a variety of scripting or coding…

This post in the series discusses the fundamental concepts and the architecture of event storage layer of an event streaming platform

How to apply the practices of Change Data Capture to reliably move data from operational databases to other systems for other purposes.

The Competing Consumers pattern enables multiple concurrent consumers to process messages received on the same messaging channel.

Amazon SQS sets a visibility timeout to prevent other consumers from processing the same message again. Article discusses how it works.

How does the Bring Your Own Cloud (BYOC) model achieve data privacy and sovereignty of self-hosting with the ease and scalability of fully…

A technology-agnostic explanation of stateless operators in stream processing.