Testing Kafka Connectors is indeed a cumber-stone process.

As we’ve built 25+ Kafka Connectors at https://github.com/Landoop/stream-reactor

We ended up building coyote an open source tool — that allows us to docker compose fast-data-dev container with i.e. multiple versions of ElasticSearch, and test the integration of the connector with them

The results are published at http://coyote.landoop.com/connect/

So here’s another way to do integration tests for those into Kafka & Kafka Connect


    Written by

    Exploring distributed computations with Scalding, Akka, Scala, Spark and wondering about the future ...