CODEWITHSUNDEEP
dockerapache-kafka
lingxiao
lingxiao

Reputation: 1224

How to go from Apache Kafka to Confluent Platform?

I have a dockerized Apache Kafka cluster (each vm runs one docker container which in turn runs one instance of both kafka and zookeeper) set up and with topics and messages in it already. Using mostly logstash as producers, logstash and node-kafka as consumers. How do I convert the system to use the newly released Confluent Platform with no downtime?

The REST API would save me a lot of time but it seems to me that the REST API requires the Schema Registry to be running. First of all, how did I survive without a Schema Registry before and second, why do I need it now? What would happen to the data that's already in Apache Kafka?

Since everything has to be containerized, what are the recommendations? multiple Dockerfiles or one single Dockerfile for everything? Currently I have only one Dockerfile and use supervisord to start both kafka and zookeeper.

Upvotes: 4

Views: 1080

Answers (1)

Kyle Mathews
Kyle Mathews

Reputation: 3278

Confluent released (experimental) Docker images at https://github.com/confluentinc/docker-images

Upvotes: 2

Related Questions