Conduktor v1.19 — Live Debug Kafka, Aiven & Confluent

Faster Kafka Data Exploration and Deeper Kafka provider integrations

Stéphane Derosiaux
Conduktor
4 min readNov 3, 2023

--

👉 Full changelog: https://www.conduktor.io/changelog/Console-1.19.0

Consume live messages

Unsure about what to look for but have a rough idea of when an event occurred? Using a live debug view can make it easier and faster to explore topic data to see real-time updates and analyze data within a specific timeframe.

You can now consume live messages from within the topic consume screen. Set the limit filter to None, and you’ll see new records flowing as they are produced. Streaming data is beautiful. 😉

✨ Full-size of the gif below: https://www.conduktor.io/images/changelog/platform/v19/live-consume.gif

Consume messages infinitely

We have finally said goodbye to the 5000 records limitation! If you wish to consume 100k records, 10M records, or even an entire topic, it’s now possible! Note that for performance reasons, your browser will only store the most recent 5000 records available for browsing or for use via the export feature.

Warning: we’re not responsible for the sudden spike in your billing for Bytes-Out. If this becomes a problem, we might even have something for you!

Consume between dates

If you want to know how many messages were produced between two moments, you now have a new limit option dedicated to this. Apply the following filters:

  • Show from: {datetime}
  • Limit: {datetime}

It works particularly well with filters, whereby you can now count how many messages matched your filters and how many total messages were produced between those dates.

In the example below, 190 records match the filter conditions out of 10,522 consumed.

Provider Integrations

Connect with your Kafka Provider to manage their benefits directly in a unified Kafka UI. With this first iteration, we bring features that are only available with the provider’s APIs.

Gateway Integration

You can now connect our other product artifact, Conduktor Gateway, to the Conduktor Console. This enables you to configure interceptors on Gateway virtual clusters through a dedicated set of pages accessible via the Gateway Interceptors tab.

You must be connected to a Gateway cluster to utilize this feature. You can explore interactive demos below:

Aiven Cloud

We now support the following resources from Aiven Cloud:

  • Manage Service Accounts
  • Manage ACLs

To manage Aiven resources, navigate to the Service Accounts screen when connected to an Aiven Kafka cluster.

Confluent Cloud

We now support the following resources from Confluent Cloud:

  • Manage Service Accounts & ACLs
  • Manage API Keys

To manage Confluent Cloud resources, navigate to the Service Accounts screen when connected to a Confluent Cloud Kafka cluster.

Next steps

Conduktor 1.20 is coming: faster, even more beautiful, and a huge gift to our incredible community. 😘

About Conduktor

Conduktor equips Developers, DevOps, and Architects to save time and avoid creating a Kafka and data mess by preventing it from happening in the first place.

Contact us to discuss your use cases. We are Kafka experts and want to build out-of-the-box and innovative solutions for enterprises using Apache Kafka, so we are very interested in your feedback.

--

--

Stéphane Derosiaux
Conduktor

Founder of conduktor.io. Kafka and data streaming all the way down. Living between London and NYC. ➡️ https://www.linkedin.com/in/stephane-derosiaux/