CODEWITHSUNDEEP
apache-kafkaapache-flinkapache-kafka-streams
sclee1
sclee1

Reputation: 1281

KafkaStream Vs Flink

I have used the Flink for sending data from source to sink. My flink app consumes the data from Kafka and send to the destination. The destination is also kafka topic which has a different topic name. The Flink is only used for delivering purpose without having any business logic.

In this case, I think that changing the flink to Kafka Stream will increase the throughput. Because the flink has no contribution except for delivering data from source to sink. Also my source and sink uses the kafka so I think that kafka streams will be faster in case of the delivery data.

I would appreciate if you could give you any opinion for my question.

Thanks.

Upvotes: 0

Views: 202

Answers (1)

OneCricketeer
OneCricketeer

Reputation: 191681

There's no guarantee one will be faster than the other. You still need to do JVM and network tuning.

Either will work, but the limitation of Kafka Streams is that the data must remain in the same Kafka cluster. Flink has no such limitation.

Or you can simply use MirrorMaker for moving data between Kafka topics of different clusters.

Upvotes: 2

Related Questions