Open in app
Sign inGet started
Our experience shared as we learn it!
How Windward Leverages lakeFS For Resilient Data Ingestion

How Windward Leverages lakeFS For Resilient Data Ingestion

Implementing CI/CD-inspired workflows built atop lakeFS operations prevents inconsistent data and brings increased reliability to our…
Go to the profile of Lior Resisi
Lior Resisi
Creating a no-code AWS native OLTP to OLAP data pipeline — Part 2 (the nitty-gritty)

Creating a no-code AWS native OLTP to OLAP data pipeline — Part 2 (the nitty-gritty)

Leveraging Kafka Connect to Stream Data from MySQL RDS to S3 and make them available to Redshift without writing a line of code.
Go to the profile of Haris Michailidis
Haris Michailidis
Docker free Kafka integration tests

Docker free Kafka integration tests

schemaregistry-junit an in-memory Confluent SchemaRegistry for testing. Waiting for Docker containers will be a memory of the past.
Go to the profile of Francesco Nobilia
Francesco Nobilia
Creating a no-code AWS native OLTP to OLAP data pipeline — Part 1

Creating a no-code AWS native OLTP to OLAP data pipeline — Part 1

Leveraging Kafka Connect to Stream Data from MySQL RDS to S3 and make them available to Redshift without writing a line of code.
Go to the profile of Haris Michailidis
Haris Michailidis
Kafka record tracing

Kafka record tracing

A journey of discovery for a new engineer learning about Kafka
Go to the profile of Cosmin Mircea
Cosmin Mircea
Kubernetes, Strimzi, Amazon MSK and Kafka-Proxy: A recipe for automation

Kubernetes, Strimzi, Amazon MSK and Kafka-Proxy: A recipe for automation

Goals
Go to the profile of Nabil Andaloussi
Nabil Andaloussi
Managing Kafka Connectors at scale using Kafka Connect Manager(KCM)

Managing Kafka Connectors at scale using Kafka Connect Manager(KCM)

Find out how we automatically managed Kafka connectors at scale at Babylon Health
Go to the profile of Sandeep Mehta
Sandeep Mehta
Trending
Schema evolution is not that complex

Schema evolution is not that complex

When I first started working with Apache Kafka and the Confluent Schema Registry, I did not focus enough on how to structure the Apache…
Go to the profile of Francesco Nobilia
Francesco Nobilia
Share with us

Share with us

How to become a Data Rocker
Go to the profile of Francesco Nobilia
Francesco Nobilia
Protobuf as an encoding format for Apache Kafka

Protobuf as an encoding format for Apache Kafka

When talking about schema in the context of Apache Kafka, Apache Avro is the de facto standard. But what about Google Protobuf?
Go to the profile of Francesco Nobilia
Francesco Nobilia
About Data rocksLatest StoriesArchiveAbout MediumTermsPrivacyTeams