DataPebbles

Exploring the World of Containers: Docker, Kubernetes and Beyond

Introduction

Avoid Unknown UNION Branch and send avro data using Kafka avro console producer

Leveraging the power of Vector databases (CrateDB) with OpenAI’s CLIP model

Vector databases have been around for some time but with the advent of GenAI they are gaining more prominence.

Let’s see why?

Stream and Batch, where these worlds meet? Lets figure this out

Automation using Azure Logic Apps

Introduction

This blog is written with the intention of showing the simplicity of Logic apps in Azure cloud.

“Azure Logic Apps is a cloud platform where you can create and run automated workflows with little to…

Kafka StateStore walkthrough

In this blog, we will discuss a brief introduction to state stores in Kafka streams.

Building a trading bot with Deep Reinforcement Learning(DRL)

Quantitative trading involves the use of computer…

Harnessing Azure YAML Pipelines: A Beacon of Compliance in Data Engineering

Working programmatically in Snowflake using Snowpark API