CODEWITHSUNDEEP
apache-kafkarabbitmqapache-kafka-streams
Alexander Teut
Alexander Teut

Reputation: 343

Kafka Streams without Sink

I'm currently planning the architecture for an application that reads from a Kafka topic and after some conversion puts data to RabbitMq. I'm kind new for Kafka Streams and they look a good choice for my task. But the problem is that Kafka server is hosted at another vendor's place, so I can't even install Cafka Connector to RabbitMq Sink plugin.

Is it possible to write Kafka steam application that doesn't have any Sink points, but just processes input stream? I can just push to RabbitMQ in foreach operations, but I'm not sure will Stream even work without a sink point.

Upvotes: 1

Views: 442

Answers (1)

OneCricketeer
OneCricketeer

Reputation: 191728

foreach is a Sink action, so to answer your question directly, no.

However, Kafka Streams should be limited to only Kafka Communication.

Kafka Connect can be installed and ran anywhere, if that is what you wanted to use... You can also use other Apache tools like Camel, Spark, NiFi, Flink, etc to write to RabbitMQ after consuming from Kafka, or write any application in a language of your choice. For example, the Spring Integration or Cloud Streams frameworks allows a single contract between many communication channels

Upvotes: 3

Related Questions