Nandish Kotadia
Nandish Kotadia

Reputation: 461

KStream-KStream Join vs KStream-KTable Join Performance

I have a Kafka Streams Application which takes data from few topics and joins the data and puts it in another topic.

Kafka Configuration:

5 kafka brokers
Kafka Topics - 15 partitions and 3 replication factor. 

Few millions of records are consumed/produced every hour.

I am making KStream-KStream join which creates 2 internal topics. While KStream-KTable join will create 1 internal topic + 1 table.

Which is better in terms of performance and other factors ?

Upvotes: 0

Views: 1363

Answers (1)

Matthias J. Sax
Matthias J. Sax

Reputation: 62350

The choice is not a question of performance, but a question of semantics: what should the join result be? Both joins, do compute quite different results so you should pick the semantics that meet your application needs.

The different semantics are documented in CP docs and AK wiki:

Upvotes: 1

Related Questions